2024-02-15T23:16:40.098 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-15T23:16:40.098 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725 --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725/orig.config.yaml 2024-02-15T23:16:40.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T23:16:40.227 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725 branch: wip-yuri2-testing-2024-02-15-0913-squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: yweinste@redhat.com first_in_suite: false job_id: '7561725' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri2-testing-2024-02-15-0913-squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2024-02-15-0913-squid sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9739 sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 sleep_before_teardown: 0 subset: 111/120000 suite: rgw suite_branch: wip-yuri2-testing-2024-02-15-0913-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 targets: smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0OS+JU08rJh+dWZW9jO+UeEZ3UuIuC7YzxMkgGN8sHlAUKbwDCvatR6Ngn/BRKfgmyTA5jyT8rsi89Cm9DdDs= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmIJEoP1VBMP1oBqsydMSpwbHi4m+lWuDRVyqDjzPv0NI1IuDmzKprt1Y/mp9q14V+8jwDY8ylCPUCVJFUxOmo= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_21:10:42 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-15T23:16:40.227 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa; will attempt to use it 2024-02-15T23:16:40.228 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks 2024-02-15T23:16:40.228 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-15T23:16:40.230 INFO:teuthology.task.internal:Checking packages... 2024-02-15T23:16:40.253 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'fddf34c14d11a944c077fae4b86a8722d85c0772' 2024-02-15T23:16:40.253 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T23:16:40.253 INFO:teuthology.packaging:ref: None 2024-02-15T23:16:40.254 INFO:teuthology.packaging:tag: None 2024-02-15T23:16:40.254 INFO:teuthology.packaging:branch: wip-yuri2-testing-2024-02-15-0913-squid 2024-02-15T23:16:40.254 INFO:teuthology.packaging:sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T23:16:40.254 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri2-testing-2024-02-15-0913-squid 2024-02-15T23:16:40.396 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:16:40.397 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-15T23:16:40.403 INFO:teuthology.task.internal:no buildpackages task found 2024-02-15T23:16:40.403 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-15T23:16:40.410 INFO:teuthology.task.internal:Saving configuration 2024-02-15T23:16:40.422 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-15T23:16:40.427 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T23:16:40.453 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 23:11:15.381552', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEfMyilP9wC68YkxgP4ivlTxBvGDcXrI27L6gq6OKVRN'} 2024-02-15T23:16:40.475 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 23:11:15.379485', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAj2HNnjSNLDSnMuXuopMBCG+tSFsgj0HDZXhlMnocXD'} 2024-02-15T23:16:40.475 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-15T23:16:40.481 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-02-15T23:16:40.481 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-15T23:16:40.481 INFO:teuthology.run_tasks:Running task console_log... 2024-02-15T23:16:40.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f143f9b83a0>, signals=[15]) 2024-02-15T23:16:40.550 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-15T23:16:40.557 INFO:teuthology.task.internal:Opening connections... 2024-02-15T23:16:40.557 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T23:16:40.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:16:40.636 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:16:40.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:16:40.714 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-15T23:16:40.721 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-02-15T23:16:40.726 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-02-15T23:16:40.727 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-02-15T23:16:40.780 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-15T23:16:40.780 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2024-02-15T23:16:40.780 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2024-02-15T23:16:40.780 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-15T23:16:40.780 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2024-02-15T23:16:40.780 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2024-02-15T23:16:40.780 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2024-02-15T23:16:40.781 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-15T23:16:40.781 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-15T23:16:40.781 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-15T23:16:40.781 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-15T23:16:40.781 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2024-02-15T23:16:40.781 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-02-15T23:16:40.809 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-02-15T23:16:40.814 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-02-15T23:16:40.814 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="22.04" 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=jammy 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-15T23:16:40.863 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-15T23:16:40.864 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=jammy 2024-02-15T23:16:40.864 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-02-15T23:16:40.883 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-15T23:16:40.891 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-15T23:16:40.913 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-15T23:16:40.913 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-02-15T23:16:40.916 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-02-15T23:16:40.920 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-15T23:16:40.927 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-15T23:16:40.928 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-02-15T23:16:40.964 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-02-15T23:16:40.985 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-15T23:16:41.035 INFO:teuthology.run_tasks:Running task kernel... 2024-02-15T23:16:41.048 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-15T23:16:41.048 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-15T23:16:41.049 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T23:16:41.049 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T23:16:41.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:16:41.054 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-02-15T23:16:41.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:16:41.055 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-02-15T23:16:41.099 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-56-generic 2024-02-15T23:16:41.099 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.15.0-56-generic 2024-02-15T23:16:41.099 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get clean 2024-02-15T23:16:41.104 INFO:teuthology.orchestra.run.smithi133.stdout:5.15.0-56-generic 2024-02-15T23:16:41.104 INFO:teuthology.task.kernel:Running kernel on smithi133: 5.15.0-56-generic 2024-02-15T23:16:41.104 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2024-02-15T23:16:41.235 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-02-15T23:16:41.248 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2024-02-15T23:16:41.428 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-15T23:16:41.475 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-15T23:16:41.482 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-15T23:16:41.542 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-15T23:16:41.542 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-15T23:16:41.577 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-15T23:16:41.650 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-15T23:16:41.742 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [569 kB] 2024-02-15T23:16:41.888 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,376 kB] 2024-02-15T23:16:41.928 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,161 kB] 2024-02-15T23:16:41.939 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,161 kB] 2024-02-15T23:16:41.941 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-15T23:16:41.946 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-15T23:16:41.953 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-15T23:16:41.954 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-15T23:16:41.956 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,431 kB] 2024-02-15T23:16:41.991 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [235 kB] 2024-02-15T23:16:41.995 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-15T23:16:41.995 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [689 kB] 2024-02-15T23:16:42.005 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,049 kB] 2024-02-15T23:16:42.024 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [237 kB] 2024-02-15T23:16:42.027 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-15T23:16:42.046 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,184 B] 2024-02-15T23:16:42.046 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-15T23:16:42.047 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-15T23:16:42.048 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-15T23:16:42.048 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-15T23:16:42.048 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-15T23:16:42.049 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-15T23:16:42.066 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-15T23:16:42.078 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [569 kB] 2024-02-15T23:16:42.089 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-15T23:16:42.090 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-15T23:16:42.090 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-15T23:16:42.091 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-15T23:16:42.270 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,376 kB] 2024-02-15T23:16:42.318 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [404 kB] 2024-02-15T23:16:42.338 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [213 kB] 2024-02-15T23:16:42.343 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [404 kB] 2024-02-15T23:16:42.348 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-15T23:16:42.348 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-15T23:16:42.350 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,401 kB] 2024-02-15T23:16:42.362 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [213 kB] 2024-02-15T23:16:42.372 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-15T23:16:42.373 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,401 kB] 2024-02-15T23:16:42.411 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-15T23:16:42.425 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-15T23:16:42.426 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-15T23:16:42.428 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,431 kB] 2024-02-15T23:16:42.440 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [231 kB] 2024-02-15T23:16:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-15T23:16:42.451 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [842 kB] 2024-02-15T23:16:42.463 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-15T23:16:42.481 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [231 kB] 2024-02-15T23:16:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [592 kB] 2024-02-15T23:16:42.486 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [235 kB] 2024-02-15T23:16:42.486 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-15T23:16:42.486 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [842 kB] 2024-02-15T23:16:42.491 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-15T23:16:42.535 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [592 kB] 2024-02-15T23:16:42.661 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [161 kB] 2024-02-15T23:16:42.698 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [689 kB] 2024-02-15T23:16:42.709 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [161 kB] 2024-02-15T23:16:43.056 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-15T23:16:43.062 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-15T23:16:43.063 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-15T23:16:43.077 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-15T23:16:43.080 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-15T23:16:43.113 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-15T23:16:43.119 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-15T23:16:43.134 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-15T23:16:43.134 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-15T23:16:43.137 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-15T23:16:43.282 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,049 kB] 2024-02-15T23:16:43.393 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [237 kB] 2024-02-15T23:16:43.412 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-15T23:16:43.414 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-15T23:16:43.417 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,184 B] 2024-02-15T23:16:43.417 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-15T23:16:43.418 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-15T23:16:43.419 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-15T23:16:43.420 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-15T23:16:43.424 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-15T23:16:43.588 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-15T23:16:43.670 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-15T23:16:43.751 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-15T23:16:43.800 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-15T23:16:43.858 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-15T23:16:47.458 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 11.6 MB in 2s (6,161 kB/s) 2024-02-15T23:16:48.167 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 11.6 MB in 3s (4,548 kB/s) 2024-02-15T23:16:48.700 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-02-15T23:16:48.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-15T23:16:48.768 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-02-15T23:16:48.938 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-02-15T23:16:48.939 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-02-15T23:16:49.085 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-02-15T23:16:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-15T23:16:49.085 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-15T23:16:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-15T23:16:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-15T23:16:49.086 INFO:teuthology.orchestra.run.smithi131.stdout: python2.7-minimal 2024-02-15T23:16:49.086 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-15T23:16:49.087 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-02-15T23:16:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-15T23:16:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-15T23:16:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-15T23:16:49.089 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-02-15T23:16:49.089 INFO:teuthology.orchestra.run.smithi131.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-15T23:16:49.089 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-02-15T23:16:49.089 INFO:teuthology.orchestra.run.smithi131.stdout: thermald 2024-02-15T23:16:49.139 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-02-15T23:16:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-15T23:16:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-15T23:16:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-15T23:16:49.140 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages will be upgraded: 2024-02-15T23:16:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-15T23:16:49.321 INFO:teuthology.orchestra.run.smithi131.stdout:3 upgraded, 5 newly installed, 0 to remove and 287 not upgraded. 2024-02-15T23:16:49.322 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 113 MB of archives. 2024-02-15T23:16:49.322 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-15T23:16:49.322 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-15T23:16:49.533 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-02-15T23:16:49.550 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-15T23:16:49.614 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-02-15T23:16:49.789 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2024-02-15T23:16:49.789 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2024-02-15T23:16:49.938 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2024-02-15T23:16:49.938 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-15T23:16:49.938 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-15T23:16:49.939 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-15T23:16:49.939 INFO:teuthology.orchestra.run.smithi133.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-15T23:16:49.939 INFO:teuthology.orchestra.run.smithi133.stdout: python2.7-minimal 2024-02-15T23:16:49.939 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-15T23:16:49.940 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2024-02-15T23:16:49.940 INFO:teuthology.orchestra.run.smithi133.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-15T23:16:49.940 INFO:teuthology.orchestra.run.smithi133.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-15T23:16:49.941 INFO:teuthology.orchestra.run.smithi133.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-15T23:16:49.941 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2024-02-15T23:16:49.942 INFO:teuthology.orchestra.run.smithi133.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-15T23:16:49.942 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2024-02-15T23:16:49.942 INFO:teuthology.orchestra.run.smithi133.stdout: thermald 2024-02-15T23:16:49.990 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2024-02-15T23:16:49.990 INFO:teuthology.orchestra.run.smithi133.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-15T23:16:49.990 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-15T23:16:49.991 INFO:teuthology.orchestra.run.smithi133.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-15T23:16:49.992 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2024-02-15T23:16:49.992 INFO:teuthology.orchestra.run.smithi133.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-15T23:16:50.053 INFO:teuthology.orchestra.run.smithi133.stdout:3 upgraded, 5 newly installed, 0 to remove and 287 not upgraded. 2024-02-15T23:16:50.053 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 113 MB of archives. 2024-02-15T23:16:50.053 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-15T23:16:50.053 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-15T23:16:50.673 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-15T23:16:50.729 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-15T23:16:50.866 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-15T23:16:51.075 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-15T23:16:52.009 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-15T23:16:52.010 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-15T23:16:52.010 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-15T23:16:52.418 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-15T23:16:52.856 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 113 MB in 2s (45.9 MB/s) 2024-02-15T23:16:53.037 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-15T23:16:53.343 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-15T23:16:53.352 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-15T23:16:53.354 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-15T23:16:54.385 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-15T23:16:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-15T23:16:54.937 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 113 MB in 5s (21.0 MB/s) 2024-02-15T23:16:55.011 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-15T23:16:55.015 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-15T23:16:55.098 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-15T23:16:55.142 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:16:57.040 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-15T23:16:57.044 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-15T23:16:57.113 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:16:57.259 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-15T23:16:57.280 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-15T23:16:57.368 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:16:58.312 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-15T23:16:58.332 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-15T23:16:58.370 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:16:59.298 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-15T23:16:59.319 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-15T23:16:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:16:59.843 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-15T23:16:59.863 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-15T23:16:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:04.895 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-15T23:17:05.020 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-15T23:17:05.369 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-15T23:17:05.473 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-15T23:17:05.793 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-15T23:17:05.815 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-15T23:17:05.884 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-15T23:17:06.753 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-15T23:17:06.880 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-15T23:17:07.264 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-15T23:17:07.392 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-15T23:17:07.695 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-15T23:17:07.717 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-15T23:17:07.762 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-15T23:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-15T23:17:11.976 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-15T23:17:12.005 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:13.272 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-15T23:17:13.308 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-15T23:17:13.346 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:14.703 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-15T23:17:14.833 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-15T23:17:15.216 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-15T23:17:15.337 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:15.489 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-15T23:17:15.616 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:15.925 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-15T23:17:16.050 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-15T23:17:16.393 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-15T23:17:16.522 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:16.665 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-15T23:17:16.792 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:17.545 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:18.229 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:18.908 INFO:teuthology.orchestra.run.smithi133.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-15T23:17:18.909 INFO:teuthology.orchestra.run.smithi133.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-15T23:17:18.909 INFO:teuthology.orchestra.run.smithi133.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-15T23:17:18.909 INFO:teuthology.orchestra.run.smithi133.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-15T23:17:19.071 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:19.601 INFO:teuthology.orchestra.run.smithi131.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-15T23:17:19.601 INFO:teuthology.orchestra.run.smithi131.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-15T23:17:19.601 INFO:teuthology.orchestra.run.smithi131.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-15T23:17:19.601 INFO:teuthology.orchestra.run.smithi131.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-15T23:17:19.731 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:20.489 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-15T23:17:20.615 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-15T23:17:20.766 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:20.832 INFO:teuthology.orchestra.run.smithi133.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-15T23:17:20.833 INFO:teuthology.orchestra.run.smithi133.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-15T23:17:21.791 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-15T23:17:21.917 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-15T23:17:21.982 INFO:teuthology.orchestra.run.smithi131.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-15T23:17:21.982 INFO:teuthology.orchestra.run.smithi131.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-15T23:17:34.698 INFO:teuthology.orchestra.run.smithi133.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-15T23:17:34.699 INFO:teuthology.orchestra.run.smithi133.stdout:Sourcing file `/etc/default/grub' 2024-02-15T23:17:34.710 INFO:teuthology.orchestra.run.smithi133.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-15T23:17:34.738 INFO:teuthology.orchestra.run.smithi133.stdout:Generating grub configuration file ... 2024-02-15T23:17:35.112 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-15T23:17:35.131 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-15T23:17:35.517 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-15T23:17:35.523 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-15T23:17:35.593 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-15T23:17:35.598 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-15T23:17:35.754 INFO:teuthology.orchestra.run.smithi133.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-15T23:17:35.754 INFO:teuthology.orchestra.run.smithi133.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-15T23:17:35.754 INFO:teuthology.orchestra.run.smithi133.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-15T23:17:35.795 INFO:teuthology.orchestra.run.smithi133.stdout:done 2024-02-15T23:17:35.966 INFO:teuthology.orchestra.run.smithi131.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-15T23:17:35.966 INFO:teuthology.orchestra.run.smithi131.stdout:Sourcing file `/etc/default/grub' 2024-02-15T23:17:35.988 INFO:teuthology.orchestra.run.smithi131.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-15T23:17:36.010 INFO:teuthology.orchestra.run.smithi131.stdout:Generating grub configuration file ... 2024-02-15T23:17:36.257 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-15T23:17:36.265 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2024-02-15T23:17:36.272 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 21 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 5.15.0.94.91 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2024-02-15T23:17:36.281 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2024-02-15T23:17:36.282 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2024-02-15T23:17:36.282 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-15T23:17:36.282 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T23:17:36.282 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T23:17:36.282 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-02-15T23:17:36.282 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T23:17:36.282 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2024-02-15T23:17:36.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2024-02-15T23:17:36.559 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-15T23:17:36.565 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-15T23:17:36.575 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-15T23:17:36.575 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-15T23:17:36.588 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-15T23:17:36.613 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-15T23:17:36.637 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-15T23:17:36.643 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-15T23:17:36.809 INFO:teuthology.orchestra.run.smithi131.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-15T23:17:36.809 INFO:teuthology.orchestra.run.smithi131.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-15T23:17:36.810 INFO:teuthology.orchestra.run.smithi131.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-15T23:17:36.855 INFO:teuthology.orchestra.run.smithi131.stdout:done 2024-02-15T23:17:37.297 DEBUG:teuthology.orchestra.run.smithi131:> dpkg -s linux-image-generic 2024-02-15T23:17:37.317 INFO:teuthology.orchestra.run.smithi131.stdout:Package: linux-image-generic 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Status: install ok installed 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Priority: optional 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Section: kernel 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Installed-Size: 21 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Maintainer: Ubuntu Kernel Team 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: amd64 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Source: linux-meta 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Version: 5.15.0.94.91 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Recommends: thermald 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout:Description: Generic Linux kernel image 2024-02-15T23:17:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: This package will always depend on the latest generic kernel image 2024-02-15T23:17:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: available. 2024-02-15T23:17:37.319 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-15T23:17:37.319 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T23:17:37.319 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T23:17:37.319 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-15T23:17:37.319 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T23:17:37.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get clean 2024-02-15T23:17:37.508 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-02-15T23:17:37.696 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-15T23:17:37.748 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-15T23:17:37.830 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-15T23:17:37.874 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-02-15T23:17:37.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-15T23:17:37.911 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-15T23:17:37.954 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-02-15T23:17:38.146 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2024-02-15T23:17:38.147 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2024-02-15T23:17:38.318 INFO:teuthology.orchestra.run.smithi133.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-15T23:17:38.318 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2024-02-15T23:17:38.318 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-15T23:17:38.318 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-15T23:17:38.318 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-15T23:17:38.319 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-15T23:17:38.319 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-15T23:17:38.319 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-15T23:17:38.360 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 0 newly installed, 0 to remove and 287 not upgraded. 2024-02-15T23:17:38.362 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2024-02-15T23:17:38.377 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2024-02-15T23:17:38.378 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2024-02-15T23:17:38.378 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2024-02-15T23:17:38.378 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2024-02-15T23:17:38.378 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 21 2024-02-15T23:17:38.378 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2024-02-15T23:17:38.378 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2024-02-15T23:17:38.379 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2024-02-15T23:17:38.379 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 5.15.0.94.91 2024-02-15T23:17:38.379 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-15T23:17:38.379 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-15T23:17:38.379 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2024-02-15T23:17:38.379 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2024-02-15T23:17:38.379 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2024-02-15T23:17:38.379 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2024-02-15T23:17:38.379 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-02-15T23:17:38.426 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.JpwBlFQ9rB 2024-02-15T23:17:38.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub/grub.cfg /tmp/tmp.JpwBlFQ9rB 2024-02-15T23:17:38.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.JpwBlFQ9rB 2024-02-15T23:17:38.615 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.JpwBlFQ9rB is 10KB 2024-02-15T23:17:38.628 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.JpwBlFQ9rB 2024-02-15T23:17:38.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-15T23:17:38.686 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:17:38.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-15T23:17:38.687 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-15T23:17:38.766 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-15T23:17:38.766 DEBUG:teuthology.orchestra.run.smithi133:> sudo update-grub 2024-02-15T23:17:39.055 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-02-15T23:17:39.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-15T23:17:39.132 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-02-15T23:17:39.325 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-02-15T23:17:39.325 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-02-15T23:17:39.495 INFO:teuthology.orchestra.run.smithi131.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-15T23:17:39.495 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-02-15T23:17:39.495 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-15T23:17:39.495 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-15T23:17:39.495 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-15T23:17:39.495 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-15T23:17:39.496 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-15T23:17:39.496 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-15T23:17:39.537 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 0 newly installed, 0 to remove and 287 not upgraded. 2024-02-15T23:17:39.539 DEBUG:teuthology.orchestra.run.smithi131:> dpkg -s linux-image-generic 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Package: linux-image-generic 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Status: install ok installed 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Priority: optional 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Section: kernel 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Installed-Size: 21 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Maintainer: Ubuntu Kernel Team 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: amd64 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Source: linux-meta 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Version: 5.15.0.94.91 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-15T23:17:39.555 INFO:teuthology.orchestra.run.smithi131.stdout:Recommends: thermald 2024-02-15T23:17:39.556 INFO:teuthology.orchestra.run.smithi131.stdout:Description: Generic Linux kernel image 2024-02-15T23:17:39.556 INFO:teuthology.orchestra.run.smithi131.stdout: This package will always depend on the latest generic kernel image 2024-02-15T23:17:39.556 INFO:teuthology.orchestra.run.smithi131.stdout: available. 2024-02-15T23:17:39.556 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-02-15T23:17:39.602 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.Yrd0one08h 2024-02-15T23:17:39.602 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Yrd0one08h 2024-02-15T23:17:39.658 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.Yrd0one08h 2024-02-15T23:17:39.788 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.Yrd0one08h is 10KB 2024-02-15T23:17:39.801 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.Yrd0one08h 2024-02-15T23:17:39.807 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-15T23:17:39.862 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:17:39.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-15T23:17:39.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-15T23:17:39.930 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-15T23:17:39.930 DEBUG:teuthology.orchestra.run.smithi131:> sudo update-grub 2024-02-15T23:17:40.092 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2024-02-15T23:17:40.093 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-15T23:17:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2024-02-15T23:17:40.373 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-15T23:17:40.381 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-15T23:17:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-15T23:17:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-15T23:17:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-15T23:17:40.722 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-15T23:17:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-15T23:17:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-15T23:17:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-15T23:17:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:done 2024-02-15T23:17:40.858 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2024-02-15T23:17:41.085 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub' 2024-02-15T23:17:41.087 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-15T23:17:41.088 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-02-15T23:17:41.266 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-15T23:17:41.271 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-15T23:17:41.498 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-15T23:17:41.503 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-15T23:17:41.545 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-15T23:17:41.551 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-15T23:17:41.673 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-15T23:17:41.673 INFO:teuthology.orchestra.run.smithi131.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-15T23:17:41.673 INFO:teuthology.orchestra.run.smithi131.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-15T23:17:41.688 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-02-15T23:17:41.705 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-02-15T23:18:10.928 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-02-15T23:18:10.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T23:18:10.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:18:11.708 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-15T23:18:11.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T23:18:11.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:18:29.436 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T23:18:30.204 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-02-15T23:18:38.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T23:18:38.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:18:39.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T23:18:39.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:18:41.500 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T23:18:53.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T23:18:53.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:19:11.932 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T23:19:26.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T23:19:26.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:19:27.301 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-02-15T23:19:28.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T23:19:28.076 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-94-generic"... 2024-02-15T23:19:28.076 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-02-15T23:19:28.124 INFO:teuthology.orchestra.run.smithi133.stdout:5.15.0-94-generic 2024-02-15T23:19:28.125 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-15T23:19:28.125 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T23:19:28.125 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-15T23:19:29.126 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-02-15T23:19:29.126 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T23:19:29.210 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2024-02-15T23:19:29.234 DEBUG:teuthology.parallel:result is None 2024-02-15T23:19:39.208 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T23:19:51.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T23:19:51.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:19:51.495 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-02-15T23:19:52.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T23:19:52.046 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-94-generic"... 2024-02-15T23:19:52.046 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-02-15T23:19:52.096 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-94-generic 2024-02-15T23:19:52.096 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-15T23:19:52.096 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T23:19:52.096 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-15T23:19:53.097 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-15T23:19:53.098 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T23:19:53.434 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-02-15T23:19:53.465 DEBUG:teuthology.parallel:result is None 2024-02-15T23:19:53.465 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-15T23:19:53.473 INFO:teuthology.task.internal:Creating test directory... 2024-02-15T23:19:53.473 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T23:19:53.476 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T23:19:53.482 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-15T23:19:53.489 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-15T23:19:53.496 INFO:teuthology.task.internal:Creating archive directory... 2024-02-15T23:19:53.496 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T23:19:53.524 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T23:19:53.610 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-15T23:19:53.617 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-15T23:19:53.617 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T23:19:53.620 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T23:19:53.640 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T23:19:53.643 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T23:19:53.649 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T23:19:53.651 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T23:19:53.653 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-15T23:19:53.661 INFO:teuthology.task.internal:Configuring sudo... 2024-02-15T23:19:53.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T23:19:53.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T23:19:53.709 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-15T23:19:53.718 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-15T23:19:53.718 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T23:19:53.752 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T23:19:53.757 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T23:19:53.803 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T23:19:53.851 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:19:53.851 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T23:19:53.924 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T23:19:53.930 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T23:19:53.977 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:19:53.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T23:19:54.047 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-02-15T23:19:54.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-02-15T23:19:54.134 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-15T23:19:54.141 INFO:teuthology.task.internal:Starting timer... 2024-02-15T23:19:54.142 INFO:teuthology.run_tasks:Running task pcp... 2024-02-15T23:19:54.154 INFO:teuthology.run_tasks:Running task selinux... 2024-02-15T23:19:54.165 DEBUG:teuthology.task.selinux:Excluding smithi131: OS 'ubuntu' does not support SELinux 2024-02-15T23:19:54.165 DEBUG:teuthology.task.selinux:Excluding smithi133: OS 'ubuntu' does not support SELinux 2024-02-15T23:19:54.165 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-15T23:19:54.165 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-15T23:19:54.166 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-15T23:19:54.166 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-15T23:19:54.175 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-15T23:19:54.194 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-15T23:19:54.196 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi131.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-15T23:26:46.416 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2024-02-15T23:26:46.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T23:26:46.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:26:46.500 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-02-15T23:26:46.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T23:26:46.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T23:26:46.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:26:46.652 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-02-15T23:26:46.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T23:26:46.732 INFO:teuthology.run_tasks:Running task clock... 2024-02-15T23:26:46.745 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-15T23:26:46.745 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T23:26:46.745 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T23:26:46.748 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T23:26:46.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Command line: ntpd -gq 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: ---------------------------------------------------- 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: ntp-4 is maintained by Network Time Foundation, 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: corporation. Support and training for ntp-4 are 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: available at https://www.nwtime.org/support 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: ---------------------------------------------------- 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: proto: precision = 0.043 usec (-24) 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: basedate set to 2022-02-04 2024-02-15T23:26:46.778 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: gps base set to 2022-02-06 (week 2196) 2024-02-15T23:26:46.779 INFO:teuthology.orchestra.run.smithi131.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-15T23:26:46.779 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-15T23:26:46.779 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: restrict ::: KOD does nothing without LIMITED. 2024-02-15T23:26:46.779 INFO:teuthology.orchestra.run.smithi131.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-15T23:26:46.780 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Listen and drop on 0 v6wildcard [::]:123 2024-02-15T23:26:46.780 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-15T23:26:46.780 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Listen normally on 2 lo 127.0.0.1:123 2024-02-15T23:26:46.781 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Listen normally on 3 enp3s0f1 172.21.15.131:123 2024-02-15T23:26:46.781 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Listen normally on 4 lo [::1]:123 2024-02-15T23:26:46.781 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:72f9%5]:123 2024-02-15T23:26:46.781 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:46 ntpd[17166]: Listening on routing socket on fd #22 for interface updates 2024-02-15T23:26:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-15T23:26:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Command line: ntpd -gq 2024-02-15T23:26:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: ---------------------------------------------------- 2024-02-15T23:26:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: ntp-4 is maintained by Network Time Foundation, 2024-02-15T23:26:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-15T23:26:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: corporation. Support and training for ntp-4 are 2024-02-15T23:26:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: available at https://www.nwtime.org/support 2024-02-15T23:26:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: ---------------------------------------------------- 2024-02-15T23:26:46.802 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: proto: precision = 0.045 usec (-24) 2024-02-15T23:26:46.802 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: basedate set to 2022-02-04 2024-02-15T23:26:46.802 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: gps base set to 2022-02-06 (week 2196) 2024-02-15T23:26:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-15T23:26:46.802 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-15T23:26:46.803 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: restrict ::: KOD does nothing without LIMITED. 2024-02-15T23:26:46.803 INFO:teuthology.orchestra.run.smithi133.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-15T23:26:46.804 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Listen and drop on 0 v6wildcard [::]:123 2024-02-15T23:26:46.804 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-15T23:26:46.804 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Listen normally on 2 lo 127.0.0.1:123 2024-02-15T23:26:46.804 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Listen normally on 3 enp3s0f1 172.21.15.133:123 2024-02-15T23:26:46.804 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Listen normally on 4 lo [::1]:123 2024-02-15T23:26:46.804 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8087%5]:123 2024-02-15T23:26:46.804 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:46 ntpd[17163]: Listening on routing socket on fd #22 for interface updates 2024-02-15T23:26:47.778 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:47 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:47.778 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:47 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:47.778 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:47 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:47.778 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:47 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:47.778 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:47 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:47.778 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:47 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:47 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:47 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:47 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:47.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:47 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:47.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:47 ntpd[17163]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:47.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:47 ntpd[17163]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:48.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:48 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:48.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:48 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:48.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:48 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:48.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:48 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:48.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:48 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:48.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:48 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:48.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:48 ntpd[17163]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:48.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:48 ntpd[17163]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:49.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:49.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:49.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:49.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:49.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:49.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:49.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:49.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:49.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:49.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:49.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:49.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:49.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:49.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:49 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:49.801 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:49 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:49.801 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:49 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:49.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:49 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:49.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:49 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:49.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:49 ntpd[17163]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:49.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:49 ntpd[17163]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:50.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:50 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:50.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:50 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:50.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:50 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:50.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:50 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:50.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:50 ntpd[17163]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:50.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:50 ntpd[17163]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:51.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:51.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:51 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:51.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:51 ntpd[17163]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:52 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:52 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:52 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:52 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:52 ntpd[17163]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:52 ntpd[17163]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:53.779 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:15 Feb 23:26:53 ntpd[17166]: ntpd: time slew -0.000566 s 2024-02-15T23:26:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:ntpd: time slew -0.000566s 2024-02-15T23:26:53.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-15T23:26:53.781 INFO:teuthology.orchestra.run.smithi131.stderr:15 Feb 23:26:53 ntpd[17166]: can't open /var/log/ntpstats/loopstats.20240215: Permission denied 2024-02-15T23:26:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-15T23:26:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: can't open /var/log/ntpstats/rawstats.20240215: Permission denied 2024-02-15T23:26:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-15T23:26:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: can't open /var/log/ntpstats/peerstats.20240215: Permission denied 2024-02-15T23:26:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:15 Feb 23:26:53 ntpd[17163]: ntpd: time slew -0.003524 s 2024-02-15T23:26:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time slew -0.003524s 2024-02-15T23:26:53.803 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-15T23:26:53.803 INFO:teuthology.orchestra.run.smithi133.stderr:15 Feb 23:26:53 ntpd[17163]: can't open /var/log/ntpstats/loopstats.20240215: Permission denied 2024-02-15T23:26:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-02-15T23:26:53.830 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-02-15T23:26:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:26:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:26:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:26:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:26:53.853 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2024-02-15T23:26:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2024-02-15T23:26:53.854 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:26:53.854 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:26:53.854 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:26:53.854 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:26:53.855 INFO:teuthology.run_tasks:Running task install... 2024-02-15T23:26:53.863 DEBUG:teuthology.task.install:project ceph 2024-02-15T23:26:53.863 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}} 2024-02-15T23:26:53.863 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'} 2024-02-15T23:26:53.864 INFO:teuthology.task.install:Using flavor: default 2024-02-15T23:26:53.869 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-15T23:26:53.869 INFO:teuthology.task.install:extra packages: [] 2024-02-15T23:26:53.870 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-key list | grep Ceph 2024-02-15T23:26:53.870 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-key list | grep Ceph 2024-02-15T23:26:53.929 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-15T23:26:53.948 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-15T23:26:53.954 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-15T23:26:53.954 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph.com (release key) 2024-02-15T23:26:53.955 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-15T23:26:53.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T23:26:53.974 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-15T23:26:53.974 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph.com (release key) 2024-02-15T23:26:53.975 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-15T23:26:53.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T23:26:54.178 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default/ 2024-02-15T23:26:54.178 INFO:teuthology.task.install.deb:Package version is 19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:26:54.188 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default/ 2024-02-15T23:26:54.188 INFO:teuthology.task.install.deb:Package version is 19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:26:54.520 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:26:54.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-15T23:26:54.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2024-02-15T23:26:54.571 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:26:54.571 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-15T23:26:54.585 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-02-15T23:26:54.703 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-15T23:26:54.703 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-15T23:26:54.717 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-15T23:26:54.746 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-15T23:26:54.765 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-15T23:26:54.870 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-15T23:26:54.951 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-15T23:26:54.975 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy InRelease 2024-02-15T23:26:55.032 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-15T23:26:55.053 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-15T23:26:55.097 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy InRelease 2024-02-15T23:26:55.135 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-15T23:26:55.189 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-15T23:26:55.214 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-02-15T23:26:55.275 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-15T23:26:55.290 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-15T23:26:55.354 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-15T23:26:55.380 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 28.9 kB in 1s (44.0 kB/s) 2024-02-15T23:26:55.445 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-02-15T23:26:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 28.9 kB in 1s (38.3 kB/s) 2024-02-15T23:26:56.318 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-02-15T23:26:56.333 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1468-gfddf34c1-1jammy cephadm=19.0.0-1468-gfddf34c1-1jammy ceph-mds=19.0.0-1468-gfddf34c1-1jammy ceph-mgr=19.0.0-1468-gfddf34c1-1jammy ceph-common=19.0.0-1468-gfddf34c1-1jammy ceph-fuse=19.0.0-1468-gfddf34c1-1jammy ceph-test=19.0.0-1468-gfddf34c1-1jammy ceph-volume=19.0.0-1468-gfddf34c1-1jammy radosgw=19.0.0-1468-gfddf34c1-1jammy python3-rados=19.0.0-1468-gfddf34c1-1jammy python3-rgw=19.0.0-1468-gfddf34c1-1jammy python3-cephfs=19.0.0-1468-gfddf34c1-1jammy python3-rbd=19.0.0-1468-gfddf34c1-1jammy libcephfs2=19.0.0-1468-gfddf34c1-1jammy libcephfs-dev=19.0.0-1468-gfddf34c1-1jammy librados2=19.0.0-1468-gfddf34c1-1jammy librbd1=19.0.0-1468-gfddf34c1-1jammy rbd-fuse=19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:26:56.396 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-02-15T23:26:56.497 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-02-15T23:26:56.512 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1468-gfddf34c1-1jammy cephadm=19.0.0-1468-gfddf34c1-1jammy ceph-mds=19.0.0-1468-gfddf34c1-1jammy ceph-mgr=19.0.0-1468-gfddf34c1-1jammy ceph-common=19.0.0-1468-gfddf34c1-1jammy ceph-fuse=19.0.0-1468-gfddf34c1-1jammy ceph-test=19.0.0-1468-gfddf34c1-1jammy ceph-volume=19.0.0-1468-gfddf34c1-1jammy radosgw=19.0.0-1468-gfddf34c1-1jammy python3-rados=19.0.0-1468-gfddf34c1-1jammy python3-rgw=19.0.0-1468-gfddf34c1-1jammy python3-cephfs=19.0.0-1468-gfddf34c1-1jammy python3-rbd=19.0.0-1468-gfddf34c1-1jammy libcephfs2=19.0.0-1468-gfddf34c1-1jammy libcephfs-dev=19.0.0-1468-gfddf34c1-1jammy librados2=19.0.0-1468-gfddf34c1-1jammy librbd1=19.0.0-1468-gfddf34c1-1jammy rbd-fuse=19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:26:56.565 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-02-15T23:26:56.587 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2024-02-15T23:26:56.588 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2024-02-15T23:26:56.735 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-02-15T23:26:56.735 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-02-15T23:26:56.762 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2024-02-15T23:26:56.762 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-15T23:26:56.762 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-15T23:26:56.762 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-15T23:26:56.762 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-15T23:26:56.763 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-15T23:26:56.763 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-15T23:26:56.763 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2024-02-15T23:26:56.763 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-15T23:26:56.763 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-15T23:26:56.764 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-15T23:26:56.764 INFO:teuthology.orchestra.run.smithi133.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-15T23:26:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet zip 2024-02-15T23:26:56.766 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2024-02-15T23:26:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: btrfs-tools 2024-02-15T23:26:56.868 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2024-02-15T23:26:56.868 INFO:teuthology.orchestra.run.smithi133.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-15T23:26:56.868 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-15T23:26:56.868 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-15T23:26:56.868 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-15T23:26:56.868 INFO:teuthology.orchestra.run.smithi133.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-15T23:26:56.869 INFO:teuthology.orchestra.run.smithi133.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-15T23:26:56.870 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-15T23:26:56.871 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-15T23:26:56.871 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-15T23:26:56.871 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-15T23:26:56.871 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-15T23:26:56.871 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-15T23:26:56.871 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-15T23:26:56.871 INFO:teuthology.orchestra.run.smithi133.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-15T23:26:56.890 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-02-15T23:26:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-15T23:26:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-15T23:26:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-15T23:26:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-15T23:26:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-15T23:26:56.891 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-15T23:26:56.893 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-02-15T23:26:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-15T23:26:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-15T23:26:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-15T23:26:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-15T23:26:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-15T23:26:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-15T23:26:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-15T23:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-15T23:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-15T23:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-15T23:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet zip 2024-02-15T23:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-02-15T23:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-15T23:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-15T23:26:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-15T23:26:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-15T23:26:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-15T23:26:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-15T23:26:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-15T23:26:56.896 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-02-15T23:26:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: btrfs-tools 2024-02-15T23:26:56.994 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-02-15T23:26:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-15T23:26:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-15T23:26:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-15T23:26:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-15T23:26:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-15T23:26:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-15T23:26:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-15T23:26:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-15T23:26:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-15T23:26:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-15T23:26:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-15T23:26:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-15T23:26:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-15T23:26:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-15T23:26:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-15T23:26:57.056 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 118 newly installed, 0 to remove and 274 not upgraded. 2024-02-15T23:26:57.056 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 176 MB of archives. 2024-02-15T23:26:57.056 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 730 MB of additional disk space will be used. 2024-02-15T23:26:57.056 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-15T23:26:57.184 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 118 newly installed, 0 to remove and 274 not upgraded. 2024-02-15T23:26:57.184 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 176 MB of archives. 2024-02-15T23:26:57.184 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 730 MB of additional disk space will be used. 2024-02-15T23:26:57.184 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-15T23:26:57.239 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1468-gfddf34c1-1jammy [3,535 kB] 2024-02-15T23:26:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1468-gfddf34c1-1jammy [3,535 kB] 2024-02-15T23:26:57.484 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-15T23:26:57.496 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-15T23:26:57.579 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-15T23:26:57.613 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-15T23:26:57.625 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-15T23:26:57.707 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-15T23:26:57.809 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-15T23:26:57.821 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-15T23:26:57.823 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1468-gfddf34c1-1jammy [3,212 kB] 2024-02-15T23:26:57.851 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-15T23:26:57.860 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-15T23:26:57.861 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-15T23:26:57.862 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-15T23:26:57.881 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-15T23:26:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-15T23:26:57.949 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1468-gfddf34c1-1jammy [710 kB] 2024-02-15T23:26:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-15T23:26:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-15T23:26:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-15T23:26:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-15T23:26:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-15T23:26:58.009 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-15T23:26:58.049 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-15T23:26:58.054 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1468-gfddf34c1-1jammy [356 kB] 2024-02-15T23:26:58.062 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1468-gfddf34c1-1jammy [32.8 kB] 2024-02-15T23:26:58.063 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1468-gfddf34c1-1jammy [180 kB] 2024-02-15T23:26:58.074 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1468-gfddf34c1-1jammy [64.8 kB] 2024-02-15T23:26:58.076 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1468-gfddf34c1-1jammy [330 kB] 2024-02-15T23:26:58.101 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1468-gfddf34c1-1jammy [6,565 kB] 2024-02-15T23:26:58.177 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-15T23:26:58.206 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1468-gfddf34c1-1jammy [3,212 kB] 2024-02-15T23:26:58.387 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1468-gfddf34c1-1jammy [710 kB] 2024-02-15T23:26:58.446 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1468-gfddf34c1-1jammy [356 kB] 2024-02-15T23:26:58.451 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-15T23:26:58.473 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1468-gfddf34c1-1jammy [32.8 kB] 2024-02-15T23:26:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1468-gfddf34c1-1jammy [180 kB] 2024-02-15T23:26:58.481 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1468-gfddf34c1-1jammy [64.8 kB] 2024-02-15T23:26:58.486 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-15T23:26:58.486 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1468-gfddf34c1-1jammy [330 kB] 2024-02-15T23:26:58.488 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-15T23:26:58.534 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1468-gfddf34c1-1jammy [6,565 kB] 2024-02-15T23:26:58.568 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-15T23:26:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-15T23:26:58.616 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1468-gfddf34c1-1jammy [112 kB] 2024-02-15T23:26:58.619 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-15T23:26:58.619 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1468-gfddf34c1-1jammy [465 kB] 2024-02-15T23:26:58.620 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-15T23:26:58.621 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-15T23:26:58.641 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-15T23:26:58.641 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1468-gfddf34c1-1jammy [24.1 MB] 2024-02-15T23:26:58.647 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-15T23:26:58.648 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-15T23:26:58.660 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-15T23:26:58.660 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-15T23:26:58.702 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-15T23:26:58.753 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-15T23:26:58.775 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-15T23:26:58.781 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-15T23:26:58.783 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-15T23:26:58.794 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-15T23:26:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-15T23:26:58.825 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-15T23:26:58.908 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-15T23:26:58.937 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-15T23:26:58.954 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-15T23:26:58.961 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-15T23:26:58.991 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1468-gfddf34c1-1jammy [112 kB] 2024-02-15T23:26:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1468-gfddf34c1-1jammy [465 kB] 2024-02-15T23:26:58.998 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-15T23:26:59.012 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1468-gfddf34c1-1jammy [24.1 MB] 2024-02-15T23:26:59.044 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-15T23:26:59.073 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-15T23:26:59.090 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-15T23:26:59.135 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-15T23:26:59.208 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-15T23:26:59.223 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-15T23:26:59.230 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-15T23:26:59.235 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-15T23:26:59.256 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-15T23:26:59.260 INFO:teuthology.orchestra.run.smithi133.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-15T23:26:59.350 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-15T23:26:59.365 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-15T23:26:59.372 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-15T23:26:59.377 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-15T23:26:59.399 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-15T23:26:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-15T23:26:59.427 INFO:teuthology.orchestra.run.smithi133.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-15T23:26:59.568 INFO:teuthology.orchestra.run.smithi131.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-15T23:26:59.744 INFO:teuthology.orchestra.run.smithi133.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-15T23:26:59.782 INFO:teuthology.orchestra.run.smithi133.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-15T23:26:59.793 INFO:teuthology.orchestra.run.smithi133.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-15T23:26:59.936 INFO:teuthology.orchestra.run.smithi131.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-15T23:26:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-15T23:26:59.978 INFO:teuthology.orchestra.run.smithi131.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-15T23:26:59.998 INFO:teuthology.orchestra.run.smithi133.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-15T23:26:59.999 INFO:teuthology.orchestra.run.smithi133.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-15T23:27:00.005 INFO:teuthology.orchestra.run.smithi133.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-15T23:27:00.011 INFO:teuthology.orchestra.run.smithi133.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-15T23:27:00.026 INFO:teuthology.orchestra.run.smithi133.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-15T23:27:00.047 INFO:teuthology.orchestra.run.smithi133.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-15T23:27:00.053 INFO:teuthology.orchestra.run.smithi133.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-15T23:27:00.179 INFO:teuthology.orchestra.run.smithi131.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-15T23:27:00.180 INFO:teuthology.orchestra.run.smithi131.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-15T23:27:00.187 INFO:teuthology.orchestra.run.smithi131.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-15T23:27:00.192 INFO:teuthology.orchestra.run.smithi131.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-15T23:27:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-15T23:27:00.228 INFO:teuthology.orchestra.run.smithi133.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-15T23:27:00.229 INFO:teuthology.orchestra.run.smithi131.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-15T23:27:00.235 INFO:teuthology.orchestra.run.smithi131.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-15T23:27:00.319 INFO:teuthology.orchestra.run.smithi133.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1468-gfddf34c1-1jammy [5,073 kB] 2024-02-15T23:27:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-15T23:27:00.492 INFO:teuthology.orchestra.run.smithi133.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-15T23:27:00.640 INFO:teuthology.orchestra.run.smithi133.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1468-gfddf34c1-1jammy [243 kB] 2024-02-15T23:27:00.657 INFO:teuthology.orchestra.run.smithi133.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1468-gfddf34c1-1jammy [124 kB] 2024-02-15T23:27:00.660 INFO:teuthology.orchestra.run.smithi133.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1468-gfddf34c1-1jammy [1,517 kB] 2024-02-15T23:27:00.668 INFO:teuthology.orchestra.run.smithi133.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-15T23:27:00.673 INFO:teuthology.orchestra.run.smithi131.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-15T23:27:00.682 INFO:teuthology.orchestra.run.smithi133.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-15T23:27:00.702 INFO:teuthology.orchestra.run.smithi133.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-15T23:27:00.766 INFO:teuthology.orchestra.run.smithi133.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1468-gfddf34c1-1jammy [6,240 kB] 2024-02-15T23:27:00.766 INFO:teuthology.orchestra.run.smithi133.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-15T23:27:00.851 INFO:teuthology.orchestra.run.smithi131.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-15T23:27:00.866 INFO:teuthology.orchestra.run.smithi131.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-15T23:27:00.885 INFO:teuthology.orchestra.run.smithi131.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-15T23:27:00.958 INFO:teuthology.orchestra.run.smithi131.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-15T23:27:00.960 INFO:teuthology.orchestra.run.smithi131.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1468-gfddf34c1-1jammy [5,073 kB] 2024-02-15T23:27:01.055 INFO:teuthology.orchestra.run.smithi133.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-15T23:27:01.058 INFO:teuthology.orchestra.run.smithi133.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-15T23:27:01.061 INFO:teuthology.orchestra.run.smithi133.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-15T23:27:01.061 INFO:teuthology.orchestra.run.smithi133.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-15T23:27:01.064 INFO:teuthology.orchestra.run.smithi133.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-15T23:27:01.237 INFO:teuthology.orchestra.run.smithi131.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-15T23:27:01.240 INFO:teuthology.orchestra.run.smithi131.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-15T23:27:01.242 INFO:teuthology.orchestra.run.smithi131.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-15T23:27:01.243 INFO:teuthology.orchestra.run.smithi131.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-15T23:27:01.245 INFO:teuthology.orchestra.run.smithi131.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-15T23:27:01.251 INFO:teuthology.orchestra.run.smithi133.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1468-gfddf34c1-1jammy [22.7 MB] 2024-02-15T23:27:01.284 INFO:teuthology.orchestra.run.smithi133.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-15T23:27:01.327 INFO:teuthology.orchestra.run.smithi131.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1468-gfddf34c1-1jammy [243 kB] 2024-02-15T23:27:01.363 INFO:teuthology.orchestra.run.smithi131.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1468-gfddf34c1-1jammy [124 kB] 2024-02-15T23:27:01.366 INFO:teuthology.orchestra.run.smithi131.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1468-gfddf34c1-1jammy [1,517 kB] 2024-02-15T23:27:01.465 INFO:teuthology.orchestra.run.smithi131.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-15T23:27:01.481 INFO:teuthology.orchestra.run.smithi131.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1468-gfddf34c1-1jammy [6,240 kB] 2024-02-15T23:27:01.715 INFO:teuthology.orchestra.run.smithi133.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-15T23:27:01.720 INFO:teuthology.orchestra.run.smithi133.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-15T23:27:01.904 INFO:teuthology.orchestra.run.smithi131.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-15T23:27:01.910 INFO:teuthology.orchestra.run.smithi131.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-15T23:27:01.985 INFO:teuthology.orchestra.run.smithi131.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1468-gfddf34c1-1jammy [22.7 MB] 2024-02-15T23:27:02.010 INFO:teuthology.orchestra.run.smithi133.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-15T23:27:02.010 INFO:teuthology.orchestra.run.smithi133.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-15T23:27:02.013 INFO:teuthology.orchestra.run.smithi133.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-15T23:27:02.014 INFO:teuthology.orchestra.run.smithi133.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-15T23:27:02.016 INFO:teuthology.orchestra.run.smithi133.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-15T23:27:02.018 INFO:teuthology.orchestra.run.smithi133.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-15T23:27:02.019 INFO:teuthology.orchestra.run.smithi133.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-15T23:27:02.020 INFO:teuthology.orchestra.run.smithi133.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-15T23:27:02.201 INFO:teuthology.orchestra.run.smithi131.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-15T23:27:02.201 INFO:teuthology.orchestra.run.smithi131.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-15T23:27:02.202 INFO:teuthology.orchestra.run.smithi133.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-15T23:27:02.204 INFO:teuthology.orchestra.run.smithi131.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-15T23:27:02.205 INFO:teuthology.orchestra.run.smithi131.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-15T23:27:02.207 INFO:teuthology.orchestra.run.smithi131.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-15T23:27:02.209 INFO:teuthology.orchestra.run.smithi131.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-15T23:27:02.210 INFO:teuthology.orchestra.run.smithi131.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-15T23:27:02.211 INFO:teuthology.orchestra.run.smithi131.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-15T23:27:02.393 INFO:teuthology.orchestra.run.smithi131.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-15T23:27:02.608 INFO:teuthology.orchestra.run.smithi133.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-15T23:27:02.655 INFO:teuthology.orchestra.run.smithi133.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-15T23:27:02.674 INFO:teuthology.orchestra.run.smithi133.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-15T23:27:02.787 INFO:teuthology.orchestra.run.smithi133.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-15T23:27:02.800 INFO:teuthology.orchestra.run.smithi131.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-15T23:27:02.828 INFO:teuthology.orchestra.run.smithi133.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-15T23:27:02.846 INFO:teuthology.orchestra.run.smithi131.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-15T23:27:02.881 INFO:teuthology.orchestra.run.smithi131.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-15T23:27:02.925 INFO:teuthology.orchestra.run.smithi133.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-15T23:27:02.926 INFO:teuthology.orchestra.run.smithi133.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-15T23:27:02.927 INFO:teuthology.orchestra.run.smithi133.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1468-gfddf34c1-1jammy [14.0 kB] 2024-02-15T23:27:02.928 INFO:teuthology.orchestra.run.smithi133.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1468-gfddf34c1-1jammy [864 kB] 2024-02-15T23:27:02.937 INFO:teuthology.orchestra.run.smithi133.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-15T23:27:02.939 INFO:teuthology.orchestra.run.smithi133.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-15T23:27:02.945 INFO:teuthology.orchestra.run.smithi133.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1468-gfddf34c1-1jammy [2,185 kB] 2024-02-15T23:27:02.946 INFO:teuthology.orchestra.run.smithi133.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-15T23:27:02.978 INFO:teuthology.orchestra.run.smithi131.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-15T23:27:03.018 INFO:teuthology.orchestra.run.smithi131.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-15T23:27:03.030 INFO:teuthology.orchestra.run.smithi131.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-15T23:27:03.035 INFO:teuthology.orchestra.run.smithi131.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-15T23:27:03.039 INFO:teuthology.orchestra.run.smithi133.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1468-gfddf34c1-1jammy [776 kB] 2024-02-15T23:27:03.082 INFO:teuthology.orchestra.run.smithi131.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-15T23:27:03.084 INFO:teuthology.orchestra.run.smithi133.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1468-gfddf34c1-1jammy [144 kB] 2024-02-15T23:27:03.086 INFO:teuthology.orchestra.run.smithi131.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-15T23:27:03.096 INFO:teuthology.orchestra.run.smithi133.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1468-gfddf34c1-1jammy [1,921 kB] 2024-02-15T23:27:03.106 INFO:teuthology.orchestra.run.smithi131.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-15T23:27:03.111 INFO:teuthology.orchestra.run.smithi133.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-15T23:27:03.218 INFO:teuthology.orchestra.run.smithi133.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1468-gfddf34c1-1jammy [8,625 kB] 2024-02-15T23:27:03.271 INFO:teuthology.orchestra.run.smithi131.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-15T23:27:03.376 INFO:teuthology.orchestra.run.smithi133.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-15T23:27:03.395 INFO:teuthology.orchestra.run.smithi133.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-15T23:27:03.537 INFO:teuthology.orchestra.run.smithi131.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-15T23:27:03.547 INFO:teuthology.orchestra.run.smithi133.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-15T23:27:03.556 INFO:teuthology.orchestra.run.smithi131.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-15T23:27:03.576 INFO:teuthology.orchestra.run.smithi133.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-15T23:27:03.636 INFO:teuthology.orchestra.run.smithi131.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1468-gfddf34c1-1jammy [14.0 kB] 2024-02-15T23:27:03.636 INFO:teuthology.orchestra.run.smithi131.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1468-gfddf34c1-1jammy [864 kB] 2024-02-15T23:27:03.653 INFO:teuthology.orchestra.run.smithi131.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1468-gfddf34c1-1jammy [2,185 kB] 2024-02-15T23:27:03.709 INFO:teuthology.orchestra.run.smithi131.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-15T23:27:03.733 INFO:teuthology.orchestra.run.smithi133.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-15T23:27:03.735 INFO:teuthology.orchestra.run.smithi133.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-15T23:27:03.737 INFO:teuthology.orchestra.run.smithi133.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-15T23:27:03.737 INFO:teuthology.orchestra.run.smithi131.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-15T23:27:03.759 INFO:teuthology.orchestra.run.smithi133.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-15T23:27:03.765 INFO:teuthology.orchestra.run.smithi133.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-15T23:27:03.766 INFO:teuthology.orchestra.run.smithi133.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1468-gfddf34c1-1jammy [14.2 kB] 2024-02-15T23:27:03.766 INFO:teuthology.orchestra.run.smithi133.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1468-gfddf34c1-1jammy [49.9 MB] 2024-02-15T23:27:03.779 INFO:teuthology.orchestra.run.smithi131.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1468-gfddf34c1-1jammy [776 kB] 2024-02-15T23:27:03.835 INFO:teuthology.orchestra.run.smithi131.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1468-gfddf34c1-1jammy [144 kB] 2024-02-15T23:27:03.848 INFO:teuthology.orchestra.run.smithi131.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1468-gfddf34c1-1jammy [1,921 kB] 2024-02-15T23:27:03.896 INFO:teuthology.orchestra.run.smithi131.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-15T23:27:03.898 INFO:teuthology.orchestra.run.smithi131.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-15T23:27:03.901 INFO:teuthology.orchestra.run.smithi131.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-15T23:27:03.923 INFO:teuthology.orchestra.run.smithi131.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-15T23:27:03.928 INFO:teuthology.orchestra.run.smithi131.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-15T23:27:03.987 INFO:teuthology.orchestra.run.smithi131.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1468-gfddf34c1-1jammy [8,625 kB] 2024-02-15T23:27:04.599 INFO:teuthology.orchestra.run.smithi131.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1468-gfddf34c1-1jammy [14.2 kB] 2024-02-15T23:27:04.600 INFO:teuthology.orchestra.run.smithi131.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1468-gfddf34c1-1jammy [49.9 MB] 2024-02-15T23:27:07.405 INFO:teuthology.orchestra.run.smithi133.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1468-gfddf34c1-1jammy [121 kB] 2024-02-15T23:27:07.408 INFO:teuthology.orchestra.run.smithi133.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1468-gfddf34c1-1jammy [38.4 kB] 2024-02-15T23:27:07.409 INFO:teuthology.orchestra.run.smithi133.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1468-gfddf34c1-1jammy [13.0 MB] 2024-02-15T23:27:08.131 INFO:teuthology.orchestra.run.smithi133.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1468-gfddf34c1-1jammy [91.5 kB] 2024-02-15T23:27:08.268 INFO:teuthology.orchestra.run.smithi131.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1468-gfddf34c1-1jammy [121 kB] 2024-02-15T23:27:08.270 INFO:teuthology.orchestra.run.smithi131.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1468-gfddf34c1-1jammy [38.4 kB] 2024-02-15T23:27:08.271 INFO:teuthology.orchestra.run.smithi131.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1468-gfddf34c1-1jammy [13.0 MB] 2024-02-15T23:27:08.681 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 176 MB in 11s (15.6 MB/s) 2024-02-15T23:27:08.847 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-15T23:27:08.948 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-15T23:27:08.953 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-15T23:27:09.036 INFO:teuthology.orchestra.run.smithi131.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1468-gfddf34c1-1jammy [91.5 kB] 2024-02-15T23:27:09.046 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-15T23:27:09.382 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-15T23:27:09.409 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-15T23:27:09.449 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-15T23:27:09.590 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 176 MB in 12s (14.6 MB/s) 2024-02-15T23:27:09.724 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-15T23:27:09.822 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-15T23:27:09.827 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-15T23:27:09.906 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-15T23:27:10.035 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-15T23:27:10.063 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-15T23:27:10.102 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-15T23:27:10.327 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-15T23:27:10.353 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-15T23:27:10.401 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-15T23:27:10.555 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-15T23:27:10.582 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-15T23:27:10.630 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:27:10.755 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-15T23:27:10.781 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-15T23:27:10.821 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-15T23:27:11.041 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-15T23:27:11.068 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-15T23:27:11.108 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:27:11.375 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-15T23:27:11.402 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-15T23:27:11.411 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-15T23:27:11.438 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-15T23:27:11.458 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:27:11.486 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:27:11.854 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-15T23:27:11.864 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-15T23:27:11.880 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-15T23:27:11.890 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-15T23:27:11.920 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:27:11.930 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-15T23:27:12.232 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-15T23:27:12.258 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librados2. 2024-02-15T23:27:12.259 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-15T23:27:12.285 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../007-librados2_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:12.290 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:27:12.325 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:12.644 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-15T23:27:12.669 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-15T23:27:12.710 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-15T23:27:12.786 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librbd1. 2024-02-15T23:27:12.813 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../008-librbd1_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:12.844 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:13.039 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librados2. 2024-02-15T23:27:13.064 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../007-librados2_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:13.105 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librados2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:13.255 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2. 2024-02-15T23:27:13.282 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:13.322 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:13.533 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librbd1. 2024-02-15T23:27:13.548 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../008-librbd1_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:13.583 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librbd1 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:13.599 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rados. 2024-02-15T23:27:13.626 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:13.665 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rados (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:13.977 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-15T23:27:13.977 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs2. 2024-02-15T23:27:14.003 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:14.004 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:14.044 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:14.052 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-argparse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:14.279 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cephfs. 2024-02-15T23:27:14.294 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:14.322 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rados. 2024-02-15T23:27:14.329 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cephfs (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:14.337 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:14.380 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rados (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:14.615 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-15T23:27:14.642 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:14.682 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-common (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:14.683 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-15T23:27:14.709 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:14.750 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-argparse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:14.985 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cephfs. 2024-02-15T23:27:15.001 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:15.044 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cephfs (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:15.177 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-15T23:27:15.203 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-15T23:27:15.252 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-15T23:27:15.614 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-15T23:27:15.621 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-prettytable. 2024-02-15T23:27:15.640 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:15.647 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-15T23:27:15.681 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-common (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:15.687 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-15T23:27:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rbd. 2024-02-15T23:27:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rbd (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:16.009 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-15T23:27:16.035 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-15T23:27:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-15T23:27:16.293 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-15T23:27:16.319 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-15T23:27:16.359 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-15T23:27:16.395 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-prettytable. 2024-02-15T23:27:16.421 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-15T23:27:16.454 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-15T23:27:16.629 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-15T23:27:16.655 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-15T23:27:16.689 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rbd. 2024-02-15T23:27:16.695 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-15T23:27:16.705 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:16.748 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rbd (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:16.981 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-15T23:27:16.996 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-15T23:27:17.039 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-15T23:27:17.101 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-15T23:27:17.127 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-15T23:27:17.167 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-15T23:27:17.326 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua5.1. 2024-02-15T23:27:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-15T23:27:17.375 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-15T23:27:17.454 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-15T23:27:17.479 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-15T23:27:17.529 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-15T23:27:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-any. 2024-02-15T23:27:17.722 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-15T23:27:17.762 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-15T23:27:17.807 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-15T23:27:17.822 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-15T23:27:17.865 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-15T23:27:17.989 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package zip. 2024-02-15T23:27:18.015 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-15T23:27:18.056 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking zip (3.0-12build2) ... 2024-02-15T23:27:18.202 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua5.1. 2024-02-15T23:27:18.228 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-15T23:27:18.268 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-15T23:27:18.359 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package unzip. 2024-02-15T23:27:18.386 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-15T23:27:18.425 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-15T23:27:18.614 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-any. 2024-02-15T23:27:18.629 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-15T23:27:18.663 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-15T23:27:18.771 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package luarocks. 2024-02-15T23:27:18.798 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-15T23:27:18.829 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-15T23:27:18.868 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package zip. 2024-02-15T23:27:18.892 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-15T23:27:18.933 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking zip (3.0-12build2) ... 2024-02-15T23:27:19.245 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2. 2024-02-15T23:27:19.261 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package unzip. 2024-02-15T23:27:19.271 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../025-librgw2_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:19.288 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-15T23:27:19.311 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:19.328 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-15T23:27:19.732 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package luarocks. 2024-02-15T23:27:19.758 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-15T23:27:19.799 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-15T23:27:19.855 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rgw. 2024-02-15T23:27:19.882 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:19.922 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rgw (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:20.157 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librgw2. 2024-02-15T23:27:20.183 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../025-librgw2_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:20.223 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librgw2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:20.241 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-15T23:27:20.268 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-15T23:27:20.308 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-15T23:27:20.745 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1. 2024-02-15T23:27:20.771 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:20.811 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:20.918 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rgw. 2024-02-15T23:27:20.933 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:20.976 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rgw (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:21.239 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common. 2024-02-15T23:27:21.267 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:21.314 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:21.321 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-15T23:27:21.347 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-15T23:27:21.388 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-15T23:27:21.658 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libradosstriper1. 2024-02-15T23:27:21.684 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:21.724 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libradosstriper1 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:22.178 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-common. 2024-02-15T23:27:22.204 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:22.244 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-common (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:22.653 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-base. 2024-02-15T23:27:22.679 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:22.728 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-base (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:23.273 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-15T23:27:23.299 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-15T23:27:23.331 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-15T23:27:23.525 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-base. 2024-02-15T23:27:23.552 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:23.601 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-base (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:23.609 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cheroot. 2024-02-15T23:27:23.635 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-15T23:27:23.675 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-15T23:27:24.004 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-15T23:27:24.030 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-15T23:27:24.070 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-15T23:27:24.196 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-15T23:27:24.222 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-15T23:27:24.263 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-15T23:27:24.373 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-15T23:27:24.399 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-15T23:27:24.439 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-15T23:27:24.632 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cheroot. 2024-02-15T23:27:24.659 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-15T23:27:24.716 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-15T23:27:24.717 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-15T23:27:24.732 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-15T23:27:24.767 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-15T23:27:25.053 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempora. 2024-02-15T23:27:25.080 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-15T23:27:25.094 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-15T23:27:25.120 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-15T23:27:25.120 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-15T23:27:25.169 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-15T23:27:25.406 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-portend. 2024-02-15T23:27:25.432 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-15T23:27:25.472 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-15T23:27:25.514 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-15T23:27:25.540 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-15T23:27:25.580 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-15T23:27:25.775 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-15T23:27:25.801 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-15T23:27:25.842 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-15T23:27:25.908 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-15T23:27:25.937 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-15T23:27:26.117 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-15T23:27:26.128 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-15T23:27:26.154 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-15T23:27:26.186 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-15T23:27:26.486 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempora. 2024-02-15T23:27:26.512 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-15T23:27:26.523 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-natsort. 2024-02-15T23:27:26.538 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-15T23:27:26.561 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-15T23:27:26.581 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-15T23:27:26.893 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-logutils. 2024-02-15T23:27:26.898 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-portend. 2024-02-15T23:27:26.919 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-15T23:27:26.924 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-15T23:27:26.959 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-15T23:27:26.964 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-15T23:27:27.220 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-15T23:27:27.247 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-15T23:27:27.267 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-15T23:27:27.278 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-15T23:27:27.293 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-15T23:27:27.334 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-15T23:27:27.581 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-mako. 2024-02-15T23:27:27.608 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-15T23:27:27.647 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-15T23:27:27.687 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-15T23:27:27.713 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-15T23:27:27.753 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-15T23:27:27.976 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-15T23:27:28.002 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-15T23:27:28.042 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-15T23:27:28.091 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-natsort. 2024-02-15T23:27:28.117 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-15T23:27:28.158 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-15T23:27:28.345 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-15T23:27:28.372 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-15T23:27:28.411 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-15T23:27:28.453 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-logutils. 2024-02-15T23:27:28.479 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-15T23:27:28.519 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-15T23:27:28.664 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webob. 2024-02-15T23:27:28.691 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-15T23:27:28.722 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-15T23:27:28.797 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-15T23:27:28.824 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-15T23:27:28.864 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-15T23:27:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-waitress. 2024-02-15T23:27:29.052 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-15T23:27:29.095 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-15T23:27:29.167 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-mako. 2024-02-15T23:27:29.194 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-15T23:27:29.233 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-15T23:27:29.403 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempita. 2024-02-15T23:27:29.430 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-15T23:27:29.470 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-15T23:27:29.562 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-15T23:27:29.589 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-15T23:27:29.628 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-15T23:27:30.515 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-paste. 2024-02-15T23:27:30.541 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-15T23:27:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-15T23:27:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-15T23:27:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-15T23:27:30.674 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-15T23:27:30.952 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webob. 2024-02-15T23:27:30.978 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-15T23:27:31.018 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-15T23:27:31.126 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-15T23:27:31.141 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-15T23:27:31.184 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-15T23:27:31.495 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-15T23:27:31.497 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-waitress. 2024-02-15T23:27:31.522 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-15T23:27:31.523 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-15T23:27:31.562 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-15T23:27:31.566 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-15T23:27:31.840 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webtest. 2024-02-15T23:27:31.850 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempita. 2024-02-15T23:27:31.867 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-15T23:27:31.876 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-15T23:27:31.898 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-15T23:27:31.908 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-15T23:27:32.169 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-paste. 2024-02-15T23:27:32.176 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pecan. 2024-02-15T23:27:32.196 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-15T23:27:32.202 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-15T23:27:32.235 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-15T23:27:32.242 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-15T23:27:32.547 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-15T23:27:32.563 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-15T23:27:32.597 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-certifi. 2024-02-15T23:27:32.606 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-15T23:27:32.624 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-15T23:27:32.663 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-15T23:27:32.934 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-15T23:27:32.960 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-15T23:27:32.974 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-idna. 2024-02-15T23:27:33.000 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-15T23:27:33.001 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-15T23:27:33.032 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-15T23:27:33.278 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webtest. 2024-02-15T23:27:33.305 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-15T23:27:33.337 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-15T23:27:33.377 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-urllib3. 2024-02-15T23:27:33.403 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-15T23:27:33.443 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-15T23:27:33.632 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pecan. 2024-02-15T23:27:33.658 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-15T23:27:33.698 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-15T23:27:33.764 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests. 2024-02-15T23:27:33.790 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-15T23:27:33.830 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-15T23:27:34.053 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-certifi. 2024-02-15T23:27:34.080 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-15T23:27:34.120 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-15T23:27:34.141 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-15T23:27:34.168 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-15T23:27:34.207 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-15T23:27:34.450 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-idna. 2024-02-15T23:27:34.468 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-15T23:27:34.476 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-15T23:27:34.484 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:34.516 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-15T23:27:34.527 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:34.811 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-urllib3. 2024-02-15T23:27:34.838 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-15T23:27:34.878 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-15T23:27:34.882 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-15T23:27:34.897 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:34.931 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:35.181 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests. 2024-02-15T23:27:35.208 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-15T23:27:35.226 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-15T23:27:35.239 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-15T23:27:35.253 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-15T23:27:35.292 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-15T23:27:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-15T23:27:35.511 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-15T23:27:35.551 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-15T23:27:35.562 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-openssl. 2024-02-15T23:27:35.589 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-15T23:27:35.620 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-15T23:27:35.837 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-15T23:27:35.864 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:35.904 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:35.948 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr. 2024-02-15T23:27:35.975 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:36.025 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:36.243 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-15T23:27:36.258 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:36.301 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:36.426 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon. 2024-02-15T23:27:36.453 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:36.492 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:36.646 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-15T23:27:36.672 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-15T23:27:36.712 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-15T23:27:37.015 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-openssl. 2024-02-15T23:27:37.042 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-15T23:27:37.081 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-15T23:27:37.087 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd. 2024-02-15T23:27:37.103 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:37.137 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:37.377 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr. 2024-02-15T23:27:37.403 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:37.435 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:37.830 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mon. 2024-02-15T23:27:37.856 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:37.896 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mon (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:38.199 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph. 2024-02-15T23:27:38.214 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../066-ceph_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:38.257 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:38.492 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-osd. 2024-02-15T23:27:38.519 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:38.558 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-osd (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:38.576 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse. 2024-02-15T23:27:38.603 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:38.643 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:39.030 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds. 2024-02-15T23:27:39.057 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:39.096 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:39.424 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephadm. 2024-02-15T23:27:39.451 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../069-cephadm_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:39.481 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephadm (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:39.637 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph. 2024-02-15T23:27:39.664 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../066-ceph_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:39.703 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:39.801 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-15T23:27:39.828 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-15T23:27:39.867 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-15T23:27:40.048 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-fuse. 2024-02-15T23:27:40.075 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:40.114 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-fuse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:40.179 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-15T23:27:40.194 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-15T23:27:40.228 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-15T23:27:40.485 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mds. 2024-02-15T23:27:40.511 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:40.551 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mds (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:40.938 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephadm. 2024-02-15T23:27:40.953 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../069-cephadm_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:40.987 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephadm (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:41.299 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-15T23:27:41.325 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-15T23:27:41.365 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-15T23:27:41.483 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-babel. 2024-02-15T23:27:41.511 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-15T23:27:41.549 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-15T23:27:41.810 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-15T23:27:41.825 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-15T23:27:41.868 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-15T23:27:41.877 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jinja2. 2024-02-15T23:27:41.904 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-15T23:27:41.944 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-15T23:27:42.305 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-15T23:27:42.332 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:42.372 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:42.708 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-15T23:27:42.735 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-15T23:27:42.774 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-15T23:27:42.874 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-babel. 2024-02-15T23:27:42.901 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-15T23:27:42.940 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-15T23:27:43.077 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-routes. 2024-02-15T23:27:43.104 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-15T23:27:43.143 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-15T23:27:43.260 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jinja2. 2024-02-15T23:27:43.287 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-15T23:27:43.326 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-15T23:27:43.489 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-15T23:27:43.516 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:43.555 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:43.680 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-15T23:27:43.707 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:43.746 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:44.017 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-15T23:27:44.044 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-15T23:27:44.075 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-15T23:27:44.083 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-15T23:27:44.102 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-15T23:27:44.141 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-15T23:27:44.428 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-routes. 2024-02-15T23:27:44.455 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-15T23:27:44.494 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-15T23:27:44.595 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-joblib. 2024-02-15T23:27:44.623 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-15T23:27:44.661 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-15T23:27:44.840 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-15T23:27:44.867 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:44.906 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:44.990 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-15T23:27:45.017 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-15T23:27:45.048 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-15T23:27:45.342 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn. 2024-02-15T23:27:45.343 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-15T23:27:45.359 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-15T23:27:45.370 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-15T23:27:45.401 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-15T23:27:45.408 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-15T23:27:45.905 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-joblib. 2024-02-15T23:27:45.932 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-15T23:27:45.971 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-15T23:27:46.134 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-15T23:27:46.150 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:46.342 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-15T23:27:46.370 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-15T23:27:46.390 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:46.409 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-15T23:27:46.670 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn. 2024-02-15T23:27:46.685 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-15T23:27:46.728 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-15T23:27:47.358 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cachetools. 2024-02-15T23:27:47.385 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-15T23:27:47.421 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-15T23:27:47.424 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-15T23:27:47.448 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:47.564 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:47.685 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-15T23:27:47.713 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-15T23:27:47.752 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-15T23:27:48.081 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-15T23:27:48.108 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-15T23:27:48.147 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-15T23:27:48.458 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rsa. 2024-02-15T23:27:48.486 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-15T23:27:48.493 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cachetools. 2024-02-15T23:27:48.520 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-15T23:27:48.524 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-15T23:27:48.560 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-15T23:27:48.821 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-15T23:27:48.834 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-15T23:27:48.845 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-google-auth. 2024-02-15T23:27:48.862 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-15T23:27:48.872 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-15T23:27:48.911 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-15T23:27:49.175 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-15T23:27:49.202 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-15T23:27:49.206 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-15T23:27:49.222 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-15T23:27:49.241 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-15T23:27:49.256 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-15T23:27:49.526 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-websocket. 2024-02-15T23:27:49.536 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rsa. 2024-02-15T23:27:49.541 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-15T23:27:49.563 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-15T23:27:49.575 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-15T23:27:49.603 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-15T23:27:49.879 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-15T23:27:49.906 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-15T23:27:49.924 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-google-auth. 2024-02-15T23:27:49.945 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-15T23:27:49.950 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-15T23:27:49.990 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-15T23:27:50.311 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-15T23:27:50.337 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-15T23:27:50.376 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-15T23:27:50.626 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-15T23:27:50.646 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-websocket. 2024-02-15T23:27:50.654 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:50.662 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-15T23:27:50.692 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:50.696 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-15T23:27:50.962 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-15T23:27:50.990 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-15T23:27:51.020 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-15T23:27:51.050 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-15T23:27:51.077 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-15T23:27:51.116 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-15T23:27:51.408 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-15T23:27:51.435 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-15T23:27:51.523 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-15T23:27:51.792 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package jq. 2024-02-15T23:27:51.808 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-15T23:27:51.850 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-15T23:27:51.939 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-15T23:27:51.967 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:52.005 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:52.103 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package socat. 2024-02-15T23:27:52.119 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-15T23:27:52.153 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-15T23:27:52.439 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package xmlstarlet. 2024-02-15T23:27:52.455 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-15T23:27:52.489 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-15T23:27:52.509 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-15T23:27:52.536 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-15T23:27:52.576 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-15T23:27:52.827 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test. 2024-02-15T23:27:52.843 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:52.885 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:52.895 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-15T23:27:52.922 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-15T23:27:52.961 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-15T23:27:53.223 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package jq. 2024-02-15T23:27:53.249 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-15T23:27:53.289 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-15T23:27:53.584 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package socat. 2024-02-15T23:27:53.611 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-15T23:27:53.650 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-15T23:27:53.971 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package xmlstarlet. 2024-02-15T23:27:53.998 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-15T23:27:54.037 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-15T23:27:54.433 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-test. 2024-02-15T23:27:54.447 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:54.500 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-test (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:55.173 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-volume. 2024-02-15T23:27:55.200 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:55.239 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-volume (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:55.518 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-15T23:27:55.545 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:55.584 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs-dev (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:55.904 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-15T23:27:55.931 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-15T23:27:55.970 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-15T23:27:56.300 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-15T23:27:56.327 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-15T23:27:56.366 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-15T23:27:56.662 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package nvme-cli. 2024-02-15T23:27:56.690 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-15T23:27:56.728 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-15T23:27:56.805 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-volume. 2024-02-15T23:27:56.832 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1468-gfddf34c1-1jammy_all.deb ... 2024-02-15T23:27:56.879 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-volume (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:57.209 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-15T23:27:57.236 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:27:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs-dev (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:27:57.342 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package pkg-config. 2024-02-15T23:27:57.369 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-15T23:27:57.408 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-15T23:27:57.587 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-15T23:27:57.614 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-15T23:27:57.644 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-15T23:27:57.653 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-15T23:27:57.672 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-15T23:27:57.711 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-15T23:27:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-15T23:27:58.019 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-15T23:27:58.058 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-15T23:27:58.123 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-15T23:27:58.151 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-15T23:27:58.189 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-15T23:27:58.446 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package nvme-cli. 2024-02-15T23:27:58.473 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-15T23:27:58.492 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastescript. 2024-02-15T23:27:58.512 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-15T23:27:58.520 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-15T23:27:58.575 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-15T23:27:58.878 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pluggy. 2024-02-15T23:27:58.906 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-15T23:27:58.934 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pkg-config. 2024-02-15T23:27:58.945 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-15T23:27:58.962 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-15T23:27:59.001 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-15T23:27:59.206 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-psutil. 2024-02-15T23:27:59.222 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-15T23:27:59.262 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-15T23:27:59.264 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-15T23:27:59.289 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-15T23:27:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-15T23:27:59.592 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-py. 2024-02-15T23:27:59.605 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-15T23:27:59.642 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-15T23:27:59.757 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-15T23:27:59.784 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-15T23:27:59.823 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-15T23:27:59.912 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pygments. 2024-02-15T23:27:59.940 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-15T23:27:59.970 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-15T23:28:00.119 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastescript. 2024-02-15T23:28:00.146 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-15T23:28:00.193 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-15T23:28:00.441 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-15T23:28:00.469 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-15T23:28:00.507 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-15T23:28:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pluggy. 2024-02-15T23:28:00.566 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-15T23:28:00.605 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-15T23:28:00.827 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-toml. 2024-02-15T23:28:00.855 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-15T23:28:00.883 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-psutil. 2024-02-15T23:28:00.893 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-15T23:28:00.910 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-15T23:28:00.941 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-15T23:28:01.154 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pytest. 2024-02-15T23:28:01.167 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-15T23:28:01.195 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-15T23:28:01.295 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-py. 2024-02-15T23:28:01.322 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-15T23:28:01.369 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-15T23:28:01.524 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplejson. 2024-02-15T23:28:01.552 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-15T23:28:01.591 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-15T23:28:01.690 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pygments. 2024-02-15T23:28:01.717 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-15T23:28:01.756 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-15T23:28:01.868 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-15T23:28:01.884 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-15T23:28:01.926 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-15T23:28:02.236 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-15T23:28:02.263 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-15T23:28:02.494 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-15T23:28:02.705 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw. 2024-02-15T23:28:02.734 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../116-radosgw_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:28:02.755 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-toml. 2024-02-15T23:28:02.780 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:02.782 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-15T23:28:02.821 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-15T23:28:03.108 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pytest. 2024-02-15T23:28:03.135 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-15T23:28:03.174 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-15T23:28:03.492 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse. 2024-02-15T23:28:03.508 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:28:03.545 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplejson. 2024-02-15T23:28:03.549 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:03.572 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-15T23:28:03.611 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-15T23:28:03.836 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-15T23:28:03.889 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-15T23:28:03.917 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-15T23:28:03.955 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-15T23:28:04.113 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-15T23:28:04.256 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-15T23:28:04.487 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-15T23:28:04.710 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package radosgw. 2024-02-15T23:28:04.738 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../116-radosgw_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:28:04.776 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking radosgw (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:04.805 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-15T23:28:05.232 INFO:teuthology.orchestra.run.smithi133.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-15T23:28:05.290 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephadm (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:05.613 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package rbd-fuse. 2024-02-15T23:28:05.629 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1468-gfddf34c1-1jammy_amd64.deb ... 2024-02-15T23:28:05.679 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking rbd-fuse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:05.816 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user cephadm....done 2024-02-15T23:28:05.996 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-15T23:28:06.009 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-15T23:28:06.273 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-15T23:28:06.276 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-15T23:28:06.403 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-15T23:28:06.507 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-15T23:28:06.608 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-15T23:28:06.662 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-15T23:28:06.859 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-15T23:28:06.992 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-15T23:28:07.119 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-15T23:28:07.245 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-15T23:28:07.428 INFO:teuthology.orchestra.run.smithi131.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-15T23:28:07.504 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephadm (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:07.546 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-15T23:28:07.915 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-15T23:28:08.040 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user cephadm....done 2024-02-15T23:28:08.166 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-15T23:28:08.195 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-15T23:28:08.459 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-15T23:28:08.479 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-15T23:28:08.719 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-15T23:28:08.739 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-15T23:28:08.865 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-15T23:28:08.978 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-15T23:28:09.124 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-15T23:28:09.237 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-15T23:28:09.401 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-15T23:28:09.505 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-argparse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:09.527 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-15T23:28:09.829 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-15T23:28:09.948 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-15T23:28:10.099 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-15T23:28:10.197 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-15T23:28:10.250 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-15T23:28:10.376 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-15T23:28:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-15T23:28:10.627 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-15T23:28:10.775 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-15T23:28:10.977 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-15T23:28:11.011 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-15T23:28:11.041 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-15T23:28:11.114 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-15T23:28:11.221 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-15T23:28:11.265 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-15T23:28:11.479 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-15T23:28:11.641 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-15T23:28:11.730 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-argparse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:11.792 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-15T23:28:12.051 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-15T23:28:12.098 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-15T23:28:12.224 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-15T23:28:12.311 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-15T23:28:12.375 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-15T23:28:12.493 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-15T23:28:12.727 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-15T23:28:12.812 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up zip (3.0-12build2) ... 2024-02-15T23:28:12.947 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-15T23:28:13.102 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-15T23:28:13.142 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-15T23:28:13.206 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-15T23:28:13.332 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-15T23:28:13.599 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-15T23:28:13.683 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-15T23:28:13.810 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-15T23:28:13.874 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-15T23:28:14.017 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-15T23:28:14.077 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-15T23:28:14.143 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-15T23:28:14.329 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-15T23:28:14.436 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-15T23:28:14.671 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up zip (3.0-12build2) ... 2024-02-15T23:28:14.798 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-15T23:28:14.812 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-15T23:28:15.064 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-15T23:28:15.415 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-15T23:28:15.450 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-15T23:28:15.703 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-15T23:28:15.716 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-15T23:28:15.829 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-15T23:28:15.980 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-15T23:28:16.051 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-15T23:28:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-15T23:28:16.302 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-15T23:28:16.428 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-common (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:16.657 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-15T23:28:16.746 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-idna (3.3-1) ... 2024-02-15T23:28:16.925 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-15T23:28:17.064 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-15T23:28:17.301 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-15T23:28:17.611 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-15T23:28:18.221 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-15T23:28:18.311 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-15T23:28:18.480 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-15T23:28:18.554 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:28:18.606 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-common (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:18.714 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-15T23:28:18.899 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-idna (3.3-1) ... 2024-02-15T23:28:18.998 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-15T23:28:19.141 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-15T23:28:19.217 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-15T23:28:19.267 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-15T23:28:19.560 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-15T23:28:19.819 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-15T23:28:20.070 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:28:20.213 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-15T23:28:20.431 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-15T23:28:20.548 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-15T23:28:20.690 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:28:20.816 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-15T23:28:20.824 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-15T23:28:21.084 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-15T23:28:21.092 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-15T23:28:21.218 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-15T23:28:21.343 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-15T23:28:21.344 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-15T23:28:21.602 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-15T23:28:21.638 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-15T23:28:21.878 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-15T23:28:21.897 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-15T23:28:22.004 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-15T23:28:22.148 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:28:22.274 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-15T23:28:22.331 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-15T23:28:22.440 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-15T23:28:22.567 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-15T23:28:22.733 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-15T23:28:22.826 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-15T23:28:23.042 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-15T23:28:23.078 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-15T23:28:23.302 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-15T23:28:23.329 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-15T23:28:23.444 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-15T23:28:23.570 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-15T23:28:23.580 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-15T23:28:23.660 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-15T23:28:23.856 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-15T23:28:23.922 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-15T23:28:23.973 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-15T23:28:24.023 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-15T23:28:24.241 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-15T23:28:24.367 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-15T23:28:24.425 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-15T23:28:24.643 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-15T23:28:24.701 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-15T23:28:24.827 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-15T23:28:24.978 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-15T23:28:25.086 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:28:25.212 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-15T23:28:25.237 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-15T23:28:25.363 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-15T23:28:25.489 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-15T23:28:25.538 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-15T23:28:25.578 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-15T23:28:25.833 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-15T23:28:25.848 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-15T23:28:25.958 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-15T23:28:26.124 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-15T23:28:26.283 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-15T23:28:26.385 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-15T23:28:26.559 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-15T23:28:26.628 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-15T23:28:26.745 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-15T23:28:26.835 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-15T23:28:27.013 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-15T23:28:27.139 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-15T23:28:27.197 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-15T23:28:27.457 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-15T23:28:27.566 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-15T23:28:27.741 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-15T23:28:27.875 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-15T23:28:28.017 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-15T23:28:28.143 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-15T23:28:28.228 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-15T23:28:28.354 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:28.411 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-15T23:28:28.463 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:28.589 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-15T23:28:28.670 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-15T23:28:28.951 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:29.015 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-15T23:28:29.077 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:29.203 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-15T23:28:29.409 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-15T23:28:29.487 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:29.655 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-modules-core (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:29.684 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-15T23:28:29.806 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:30.012 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-15T23:28:30.032 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-15T23:28:30.033 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-15T23:28:30.138 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librados2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:30.281 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-15T23:28:30.549 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs-dev (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:30.684 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rados (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:30.709 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:30.810 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libradosstriper1 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:30.936 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-15T23:28:30.970 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-15T23:28:31.255 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librbd1 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:31.380 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-modules-core (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:31.506 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-fuse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:31.717 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-15T23:28:31.717 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-15T23:28:32.098 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rbd (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:32.199 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs-dev (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:32.249 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:32.325 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rados (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:32.391 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rgw (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:32.434 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librgw2 (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:32.517 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cephfs (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:32.544 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-15T23:28:32.643 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:33.214 INFO:teuthology.orchestra.run.smithi133.stdout:Adding group ceph....done 2024-02-15T23:28:33.630 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user ceph....done 2024-02-15T23:28:33.731 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rbd (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:33.749 INFO:teuthology.orchestra.run.smithi133.stdout:Setting system user ceph properties....done 2024-02-15T23:28:33.764 INFO:teuthology.orchestra.run.smithi133.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-15T23:28:33.873 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up rbd-fuse (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:33.899 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-15T23:28:33.999 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rgw (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:34.125 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cephfs (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:34.234 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-common (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:34.240 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-15T23:28:34.722 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:34.761 INFO:teuthology.orchestra.run.smithi131.stdout:Adding group ceph....done 2024-02-15T23:28:34.872 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:35.154 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user ceph....done 2024-02-15T23:28:35.339 INFO:teuthology.orchestra.run.smithi131.stdout:Setting system user ceph properties....done 2024-02-15T23:28:35.354 INFO:teuthology.orchestra.run.smithi131.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-15T23:28:35.390 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-15T23:28:35.390 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-15T23:28:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-15T23:28:35.841 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-15T23:28:36.067 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-base (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:36.421 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-15T23:28:36.595 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-test (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:36.721 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up radosgw (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:36.885 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:37.093 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-15T23:28:37.093 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-15T23:28:37.275 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-15T23:28:37.276 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-15T23:28:37.545 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:37.740 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-base (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:37.750 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-15T23:28:37.750 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-15T23:28:38.068 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-15T23:28:38.382 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:38.641 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-15T23:28:38.642 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-15T23:28:38.743 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mds (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:38.957 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-15T23:28:38.957 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-15T23:28:39.126 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:39.252 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:39.403 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:39.420 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:39.616 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-15T23:28:39.616 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-15T23:28:39.639 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-15T23:28:39.639 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-15T23:28:40.112 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-cephadm (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:40.138 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-osd (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:40.264 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:40.411 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-15T23:28:40.411 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-15T23:28:40.415 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dashboard (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:40.557 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-volume (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:40.897 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:40.923 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-15T23:28:41.024 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:41.088 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-15T23:28:41.166 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mon (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:41.359 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-15T23:28:41.391 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-15T23:28:41.391 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-15T23:28:41.851 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-cephadm (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:41.994 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:42.119 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-dashboard (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:42.320 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-volume (19.0.0-1468-gfddf34c1-1jammy) ... 2024-02-15T23:28:42.547 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-15T23:28:42.664 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-15T23:28:42.766 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-15T23:28:42.918 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-15T23:28:43.178 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-15T23:28:43.183 DEBUG:teuthology.parallel:result is None 2024-02-15T23:28:44.330 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-15T23:28:44.980 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-15T23:28:44.985 DEBUG:teuthology.parallel:result is None 2024-02-15T23:28:44.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T23:28:45.228 DEBUG:teuthology.orchestra.run.smithi131:> dpkg-query -W -f '${Version}' ceph 2024-02-15T23:28:45.247 INFO:teuthology.orchestra.run.smithi131.stdout:19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:28:45.248 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:28:45.248 INFO:teuthology.task.install:The correct ceph version 19.0.0-1468-gfddf34c1-1jammy is installed. 2024-02-15T23:28:45.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T23:28:45.386 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-query -W -f '${Version}' ceph 2024-02-15T23:28:45.406 INFO:teuthology.orchestra.run.smithi133.stdout:19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:28:45.406 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1468-gfddf34c1-1jammy 2024-02-15T23:28:45.406 INFO:teuthology.task.install:The correct ceph version 19.0.0-1468-gfddf34c1-1jammy is installed. 2024-02-15T23:28:45.408 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-15T23:28:45.409 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:45.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T23:28:45.423 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:28:45.423 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T23:28:45.463 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-15T23:28:45.463 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:45.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T23:28:45.476 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T23:28:45.528 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:28:45.528 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T23:28:45.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T23:28:45.597 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-15T23:28:45.598 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:45.598 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T23:28:45.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T23:28:45.665 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:28:45.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T23:28:45.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T23:28:45.734 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-15T23:28:45.734 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:45.734 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T23:28:45.747 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T23:28:45.800 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:28:45.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T23:28:45.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T23:28:45.866 INFO:teuthology.run_tasks:Running task ceph... 2024-02-15T23:28:45.949 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-15T23:28:45.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-02-15T23:28:45.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2024-02-15T23:28:45.964 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-15T23:28:45.964 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-15T23:28:46.006 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-15T23:28:46.019 INFO:tasks.ceph:Creating extra log directories... 2024-02-15T23:28:46.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-15T23:28:46.058 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-15T23:28:46.082 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-15T23:28:46.082 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-15T23:28:46.082 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725', 'branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7561725', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2024-02-15-0913-squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 51, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9739, 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rgw', 'suite_branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'targets': {'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0OS+JU08rJh+dWZW9jO+UeEZ3UuIuC7YzxMkgGN8sHlAUKbwDCvatR6Ngn/BRKfgmyTA5jyT8rsi89Cm9DdDs=', 'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmIJEoP1VBMP1oBqsydMSpwbHi4m+lWuDRVyqDjzPv0NI1IuDmzKprt1Y/mp9q14V+8jwDY8ylCPUCVJFUxOmo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-15_21:10:42', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-15T23:28:46.083 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-15T23:28:46.110 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-15T23:28:46.123 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-02-15T23:28:46.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2024-02-15T23:28:46.179 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:46.179 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T23:28:46.217 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T23:28:46.217 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-02-15T23:28:46.265 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T23:28:46.265 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T23:28:46.265 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-02-15T23:28:46.265 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T23:28:46.266 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-02-15 23:23:34.691591914 +0000 2024-02-15T23:28:46.266 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 23:23:34.435594199 +0000 2024-02-15T23:28:46.266 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 23:23:34.435594199 +0000 2024-02-15T23:28:46.266 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T23:28:46.266 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T23:28:46.319 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-02-15T23:28:46.319 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-02-15T23:28:46.319 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000450139 s, 1.1 MB/s 2024-02-15T23:28:46.321 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T23:28:46.371 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-02-15T23:28:46.421 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T23:28:46.421 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T23:28:46.421 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-02-15T23:28:46.421 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T23:28:46.421 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-02-15 23:23:35.167587668 +0000 2024-02-15T23:28:46.421 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 23:23:34.915589917 +0000 2024-02-15T23:28:46.421 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 23:23:34.915589917 +0000 2024-02-15T23:28:46.421 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T23:28:46.422 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T23:28:46.475 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-02-15T23:28:46.475 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-02-15T23:28:46.475 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000361483 s, 1.4 MB/s 2024-02-15T23:28:46.476 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T23:28:46.526 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-02-15T23:28:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T23:28:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T23:28:46.578 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-02-15T23:28:46.578 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T23:28:46.578 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-02-15 23:23:35.427585349 +0000 2024-02-15T23:28:46.578 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 23:23:35.423585384 +0000 2024-02-15T23:28:46.578 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 23:23:35.423585384 +0000 2024-02-15T23:28:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T23:28:46.578 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T23:28:46.632 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-02-15T23:28:46.632 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-02-15T23:28:46.632 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000407198 s, 1.3 MB/s 2024-02-15T23:28:46.633 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T23:28:46.682 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-02-15T23:28:46.729 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T23:28:46.729 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T23:28:46.730 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-02-15T23:28:46.730 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T23:28:46.730 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-02-15 23:23:36.163578783 +0000 2024-02-15T23:28:46.730 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 23:23:35.891581209 +0000 2024-02-15T23:28:46.730 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 23:23:35.891581209 +0000 2024-02-15T23:28:46.730 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T23:28:46.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T23:28:46.784 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-02-15T23:28:46.784 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-02-15T23:28:46.784 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.00031786 s, 1.6 MB/s 2024-02-15T23:28:46.785 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T23:28:46.835 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-15T23:28:46.835 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:28:46.835 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T23:28:46.841 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T23:28:46.841 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-02-15T23:28:46.887 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T23:28:46.887 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T23:28:46.887 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-02-15T23:28:46.887 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T23:28:46.888 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 23:23:33.677181657 +0000 2024-02-15T23:28:46.888 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 23:23:33.421183942 +0000 2024-02-15T23:28:46.888 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 23:23:33.421183942 +0000 2024-02-15T23:28:46.888 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T23:28:46.888 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T23:28:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T23:28:46.942 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T23:28:46.942 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000436885 s, 1.2 MB/s 2024-02-15T23:28:46.943 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T23:28:46.992 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-02-15T23:28:47.040 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T23:28:47.040 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T23:28:47.040 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-02-15T23:28:47.040 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T23:28:47.040 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 23:23:34.189177089 +0000 2024-02-15T23:28:47.040 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 23:23:33.937179339 +0000 2024-02-15T23:28:47.041 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 23:23:33.937179339 +0000 2024-02-15T23:28:47.041 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T23:28:47.041 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T23:28:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T23:28:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T23:28:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000361206 s, 1.4 MB/s 2024-02-15T23:28:47.096 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T23:28:47.144 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-02-15T23:28:47.190 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T23:28:47.191 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T23:28:47.191 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-02-15T23:28:47.191 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T23:28:47.191 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 23:23:34.709172452 +0000 2024-02-15T23:28:47.191 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 23:23:34.433174914 +0000 2024-02-15T23:28:47.191 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 23:23:34.433174914 +0000 2024-02-15T23:28:47.191 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T23:28:47.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T23:28:47.249 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T23:28:47.249 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T23:28:47.249 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.00043938 s, 1.2 MB/s 2024-02-15T23:28:47.250 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T23:28:47.300 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-02-15T23:28:47.346 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T23:28:47.346 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T23:28:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-02-15T23:28:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T23:28:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 23:23:35.241167706 +0000 2024-02-15T23:28:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 23:23:34.945170345 +0000 2024-02-15T23:28:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 23:23:34.945170345 +0000 2024-02-15T23:28:47.347 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T23:28:47.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T23:28:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T23:28:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T23:28:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000360994 s, 1.4 MB/s 2024-02-15T23:28:47.402 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T23:28:47.452 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-15T23:28:47.452 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-15T23:28:47.452 INFO:tasks.ceph:Generating config... 2024-02-15T23:28:47.453 INFO:tasks.ceph:[client] debug ms = 1 2024-02-15T23:28:47.453 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-02-15T23:28:47.453 INFO:tasks.ceph:[client] debug rgw = 20 2024-02-15T23:28:47.453 INFO:tasks.ceph:[client] setgroup = ceph 2024-02-15T23:28:47.454 INFO:tasks.ceph:[client] setuser = ceph 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] debug objclass = 20 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-15T23:28:47.454 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-15T23:28:47.455 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-15T23:28:47.455 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-15T23:28:47.455 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-15T23:28:47.455 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-15T23:28:47.455 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-15T23:28:47.455 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-15T23:28:47.455 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-15T23:28:47.455 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-15T23:28:47.455 INFO:tasks.ceph:Setting up mon.a... 2024-02-15T23:28:47.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-15T23:28:47.490 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.keyring 2024-02-15T23:28:47.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-15T23:28:47.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-15T23:28:47.636 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.131')] 2024-02-15T23:28:47.637 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.131'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-02-15T23:28:47.637 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:47.638 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-15T23:28:47.685 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.131 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:28:47.763 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:28:47.764 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:28:47.764 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:28:47.764 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: generated fsid 633d2778-ce48-4cf9-a862-869ac6a165af 2024-02-15T23:28:47.764 INFO:teuthology.orchestra.run.smithi131.stdout:setting min_mon_release = quincy 2024-02-15T23:28:47.764 INFO:teuthology.orchestra.run.smithi131.stdout:epoch 0 2024-02-15T23:28:47.765 INFO:teuthology.orchestra.run.smithi131.stdout:fsid 633d2778-ce48-4cf9-a862-869ac6a165af 2024-02-15T23:28:47.765 INFO:teuthology.orchestra.run.smithi131.stdout:last_changed 2024-02-15T23:28:47.762311+0000 2024-02-15T23:28:47.765 INFO:teuthology.orchestra.run.smithi131.stdout:created 2024-02-15T23:28:47.762311+0000 2024-02-15T23:28:47.765 INFO:teuthology.orchestra.run.smithi131.stdout:min_mon_release 17 (quincy) 2024-02-15T23:28:47.765 INFO:teuthology.orchestra.run.smithi131.stdout:election_strategy: 1 2024-02-15T23:28:47.765 INFO:teuthology.orchestra.run.smithi131.stdout:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2024-02-15T23:28:47.765 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-02-15T23:28:47.766 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-15T23:28:47.814 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 633d2778-ce48-4cf9-a862-869ac6a165af... 2024-02-15T23:28:47.815 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-15T23:28:47.858 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-15T23:28:47.884 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-02-15T23:28:47.884 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-02-15T23:28:47.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-02-15T23:28:47.886 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-02-15T23:28:47.887 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = 172.21.15.131 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 633d2778-ce48-4cf9-a862-869ac6a165af 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-02-15T23:28:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: debug objclass = 20 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-02-15T23:28:47.890 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-02-15T23:28:47.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-02-15T23:28:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-02-15T23:28:47.893 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-02-15T23:28:47.894 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-15T23:28:47.894 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-15T23:28:47.894 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-02-15T23:28:47.894 INFO:teuthology.orchestra.run.smithi131.stdout: rgw gc obj min wait = 15 2024-02-15T23:28:47.894 INFO:teuthology.orchestra.run.smithi131.stdout: debug rgw = 20 2024-02-15T23:28:47.894 INFO:teuthology.orchestra.run.smithi131.stdout: setgroup = ceph 2024-02-15T23:28:47.894 INFO:teuthology.orchestra.run.smithi131.stdout: setuser = ceph 2024-02-15T23:28:47.894 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2024-02-15T23:28:47.895 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2024-02-15T23:28:47.896 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.897 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = 172.21.15.131 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 633d2778-ce48-4cf9-a862-869ac6a165af 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2024-02-15T23:28:47.898 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug trim objects = true 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2024-02-15T23:28:47.899 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: debug objclass = 20 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2024-02-15T23:28:47.900 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.901 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2024-02-15T23:28:47.902 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-15T23:28:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-15T23:28:47.904 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-02-15T23:28:47.904 INFO:teuthology.orchestra.run.smithi133.stdout: rgw gc obj min wait = 15 2024-02-15T23:28:47.904 INFO:teuthology.orchestra.run.smithi133.stdout: debug rgw = 20 2024-02-15T23:28:47.904 INFO:teuthology.orchestra.run.smithi133.stdout: setgroup = ceph 2024-02-15T23:28:47.904 INFO:teuthology.orchestra.run.smithi133.stdout: setuser = ceph 2024-02-15T23:28:47.904 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2024-02-15T23:28:47.905 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-15T23:28:47.906 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-15T23:28:47.997 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-15T23:28:47.997 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:47.997 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-15T23:28:48.003 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:48.003 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-15T23:28:48.049 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T23:28:48.050 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:48.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-15T23:28:48.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-15T23:28:48.114 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:28:48.114 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:28:48.165 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:28:48.165 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-15T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-15T23:28:48.191 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:28:48.191 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:28:48.239 INFO:tasks.ceph:Setting up mon nodes... 2024-02-15T23:28:48.239 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-15T23:28:48.239 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-15T23:28:48.323 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-15T23:28:48.336 INFO:tasks.ceph:Setting up mds nodes... 2024-02-15T23:28:48.336 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-15T23:28:48.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-15T23:28:48.411 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-15T23:28:48.423 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-15T23:28:48.423 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-15T23:28:48.423 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-15T23:28:48.437 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-15T23:28:48.437 INFO:tasks.ceph:role: osd.0 2024-02-15T23:28:48.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T23:28:48.437 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-15T23:28:48.500 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-15T23:28:48.501 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-15T23:28:48.960 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-02-15T23:28:48.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-02-15T23:28:48.962 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-15T23:28:49.049 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-15T23:28:49.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:28:49.059 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-02-15T23:28:49.060 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:28:49.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:28:49.176+0000 7fa76f2177c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-15T23:28:49.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:28:49.176+0000 7fa76f2177c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-15T23:28:49.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:28:49.176+0000 7fa76f2177c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-15T23:28:49.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:28:49.176+0000 7fa76f2177c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-15T23:28:49.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:28:49.176+0000 7fa76f2177c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-15T23:28:49.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:28:49.180+0000 7fa76f2177c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-15T23:28:52.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T23:28:52.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-15T23:28:52.198 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-15T23:28:52.198 INFO:tasks.ceph:role: osd.1 2024-02-15T23:28:52.198 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:28:52.198 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-15T23:28:52.263 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-15T23:28:52.263 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-15T23:28:52.263 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-15T23:28:52.263 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-15T23:28:52.263 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-15T23:28:52.263 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-02-15T23:28:52.263 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-15T23:28:52.264 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-15T23:28:52.264 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-15T23:28:52.264 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-15T23:28:52.722 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-02-15T23:28:52.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-02-15T23:28:52.724 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-15T23:28:52.833 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-15T23:28:52.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:28:52.843 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2024-02-15T23:28:52.843 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-15T23:28:52.900 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-15T23:28:52.900 INFO:tasks.ceph:role: osd.2 2024-02-15T23:28:52.900 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:28:52.900 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-15T23:28:52.961 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-15T23:28:52.962 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-15T23:28:53.430 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-02-15T23:28:53.432 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-02-15T23:28:53.432 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-02-15T23:28:53.546 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-15T23:28:53.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:28:53.558 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2024-02-15T23:28:53.558 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-15T23:28:53.614 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-15T23:28:53.614 INFO:tasks.ceph:role: osd.3 2024-02-15T23:28:53.614 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:28:53.614 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-15T23:28:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-15T23:28:53.678 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-15T23:28:53.678 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-15T23:28:53.678 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-15T23:28:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-15T23:28:53.678 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-02-15T23:28:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-15T23:28:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-15T23:28:53.679 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-15T23:28:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-15T23:28:54.166 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-02-15T23:28:54.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-02-15T23:28:54.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-02-15T23:28:54.308 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-15T23:28:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2024-02-15T23:28:54.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:28:54.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:28:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:54.423+0000 7fa2bbc197c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-15T23:28:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:54.423+0000 7fa2bbc197c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-15T23:28:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:54.423+0000 7fa2bbc197c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-15T23:28:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:54.423+0000 7fa2bbc197c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-15T23:28:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:54.423+0000 7fa2bbc197c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-15T23:28:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:54.423+0000 7fa2bbc197c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-15T23:28:57.403 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T23:28:57.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:28:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:57.491+0000 7f7ec2aa77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-15T23:28:57.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:57.491+0000 7f7ec2aa77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-15T23:28:57.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:57.491+0000 7f7ec2aa77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-15T23:28:57.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:57.491+0000 7f7ec2aa77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-15T23:28:57.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:57.491+0000 7f7ec2aa77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-15T23:28:57.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:28:57.491+0000 7f7ec2aa77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-15T23:29:00.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T23:29:00.539 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:29:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:00.611+0000 7f8d893c87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-15T23:29:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:00.611+0000 7f8d893c87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-15T23:29:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:00.611+0000 7f8d893c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-15T23:29:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:00.611+0000 7f8d893c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-15T23:29:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:00.611+0000 7f8d893c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-15T23:29:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:00.611+0000 7f8d893c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-15T23:29:03.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T23:29:03.664 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-15T23:29:03.664 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:29:03.664 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-15T23:29:03.678 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:29:03.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-15T23:29:03.721 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:29:03.721 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-15T23:29:03.775 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:29:03.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-15T23:29:03.830 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:29:03.830 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-15T23:29:03.886 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:29:03.886 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-15T23:29:03.935 INFO:tasks.ceph:Adding keys to all mons... 2024-02-15T23:29:03.935 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAxns5lR9O8ChAAbXL3FzudjgKcgdMQHwwCLA== 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAwns5ljQD2EhAAPPzFWjPBuJzc4ILMFSwimg== 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA2ns5lIIhjGRAAjrJPMkfXcOdOiwKmyym1Nw== 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA5ns5lP+WDHRAA0rpPGi5M2DpVD2v4bjrGmg== 2024-02-15T23:29:03.947 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-02-15T23:29:03.948 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8ns5l4KqsJBAA6TJFiYUeT94IQkAzXFHcTA== 2024-02-15T23:29:03.948 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-02-15T23:29:03.948 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAwns5lumIzGBAAq+o96BarYeRH9JLpanltZA== 2024-02-15T23:29:03.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-15T23:29:04.037 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-15T23:29:04.077 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-15T23:29:04.164 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-15T23:29:04.249 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-15T23:29:04.336 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-15T23:29:04.428 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-15T23:29:04.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-15T23:29:04.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-15T23:29:04.530 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-15T23:29:04.541 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-15T23:29:04.588 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-15T23:29:04.589 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-15T23:29:04.589 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-15T23:29:04.634 INFO:tasks.ceph.mon.a:Started 2024-02-15T23:29:04.634 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-15T23:29:04.634 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-15T23:29:04.634 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-15T23:29:04.637 INFO:tasks.ceph.mgr.x:Started 2024-02-15T23:29:04.637 INFO:tasks.ceph:Setting crush tunables to default 2024-02-15T23:29:04.637 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd crush tunables default 2024-02-15T23:29:04.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.752+0000 7f3cbcc6b640 1 Processor -- start 2024-02-15T23:29:04.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.752+0000 7f3cbcc6b640 1 -- start start 2024-02-15T23:29:04.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.752+0000 7f3cbcc6b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3cb8099770 0x7f3cb8098a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:04.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.752+0000 7f3cbcc6b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb8098fa0 con 0x7f3cb8097f70 2024-02-15T23:29:04.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.752+0000 7f3cbcc6b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb8099130 con 0x7f3cb8099770 2024-02-15T23:29:04.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.760+0000 7f3cb5d9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3cb8099770 0x7f3cb8098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:04.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.760+0000 7f3cb5d9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3cb8099770 0x7f3cb8098a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49366/0 (socket says 172.21.15.131:49366) 2024-02-15T23:29:04.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.760+0000 7f3cb5d9b640 1 -- 172.21.15.131:0/3610001985 learned_addr learned my addr 172.21.15.131:0/3610001985 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:04.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.760+0000 7f3cb5d9b640 1 -- 172.21.15.131:0/3610001985 >> v1:172.21.15.131:6789/0 conn(0x7f3cb8097f70 legacy=0x7f3cb8098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:04.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.760+0000 7f3cb559a640 1 -- 172.21.15.131:0/3610001985 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276565418 0 0) 0x7f3cb8098fa0 con 0x7f3cb8097f70 2024-02-15T23:29:04.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.760+0000 7f3cb5d9b640 1 -- 172.21.15.131:0/3610001985 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8134520 con 0x7f3cb8099770 2024-02-15T23:29:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.760+0000 7f3cb5d9b640 1 --2- 172.21.15.131:0/3610001985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8099770 0x7f3cb8098a60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80097f0 tx=0x7f3ca801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7f952ab0394110 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cb559a640 1 -- 172.21.15.131:0/3610001985 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ca80ab530 con 0x7f3cb8099770 2024-02-15T23:29:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cb559a640 1 -- 172.21.15.131:0/3610001985 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca80a7050 con 0x7f3cb8099770 2024-02-15T23:29:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cb559a640 1 -- 172.21.15.131:0/3610001985 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ca80ab7e0 con 0x7f3cb8099770 2024-02-15T23:29:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/3610001985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8099770 msgr2=0x7f3cb8098a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 --2- 172.21.15.131:0/3610001985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8099770 0x7f3cb8098a60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80097f0 tx=0x7f3ca801c430 comp rx=0 tx=0).stop 2024-02-15T23:29:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/3610001985 shutdown_connections 2024-02-15T23:29:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 --2- 172.21.15.131:0/3610001985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8099770 0x7f3cb8098a60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/3610001985 >> 172.21.15.131:0/3610001985 conn(0x7f3cb809e690 msgr2=0x7f3cb809eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/3610001985 shutdown_connections 2024-02-15T23:29:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/3610001985 wait complete. 2024-02-15T23:29:04.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 Processor -- start 2024-02-15T23:29:04.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- start start 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8097f70 0x7f3cb808fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80963c0 con 0x7f3cb8097f70 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cb659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8097f70 0x7f3cb808fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cb659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8097f70 0x7f3cb808fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49370/0 (socket says 172.21.15.131:49370) 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cb659c640 1 -- 172.21.15.131:0/2100696901 learned_addr learned my addr 172.21.15.131:0/2100696901 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cb659c640 1 -- 172.21.15.131:0/2100696901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80094d0 con 0x7f3cb8097f70 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cb659c640 1 --2- 172.21.15.131:0/2100696901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8097f70 0x7f3cb808fca0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00c400 tx=0x7f3cac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3ca6ffd640 1 -- 172.21.15.131:0/2100696901 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cac0054d0 con 0x7f3cb8097f70 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3ca6ffd640 1 -- 172.21.15.131:0/2100696901 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac003600 con 0x7f3cb8097f70 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb8091ad0 con 0x7f3cb8097f70 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3ca6ffd640 1 -- 172.21.15.131:0/2100696901 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cac003960 con 0x7f3cb8097f70 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb8091ea0 con 0x7f3cb8097f70 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3ca6ffd640 1 -- 172.21.15.131:0/2100696901 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3cac003ac0 con 0x7f3cb8097f70 2024-02-15T23:29:04.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3ca6ffd640 1 -- 172.21.15.131:0/2100696901 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3cac012740 con 0x7f3cb8097f70 2024-02-15T23:29:04.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.764+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb80915c0 con 0x7f3cb8097f70 2024-02-15T23:29:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.780+0000 7f3ca6ffd640 1 -- 172.21.15.131:0/2100696901 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3cac017070 con 0x7f3cb8097f70 2024-02-15T23:29:04.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.840+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3cb8062860 con 0x7f3cb8097f70 2024-02-15T23:29:04.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.844+0000 7f3ca6ffd640 1 -- 172.21.15.131:0/2100696901 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3cac012a30 con 0x7f3cb8097f70 2024-02-15T23:29:04.850 INFO:teuthology.orchestra.run.smithi131.stderr:adjusted tunables profile to default 2024-02-15T23:29:04.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.844+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8097f70 msgr2=0x7f3cb808fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:04.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.844+0000 7f3cbcc6b640 1 --2- 172.21.15.131:0/2100696901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8097f70 0x7f3cb808fca0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00c400 tx=0x7f3cac00c8c0 comp rx=0 tx=0).stop 2024-02-15T23:29:04.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.844+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 shutdown_connections 2024-02-15T23:29:04.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.844+0000 7f3cbcc6b640 1 --2- 172.21.15.131:0/2100696901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb8097f70 0x7f3cb808fca0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:04.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.844+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 >> 172.21.15.131:0/2100696901 conn(0x7f3cb809e690 msgr2=0x7f3cb8132a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:04.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.844+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 shutdown_connections 2024-02-15T23:29:04.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:04.844+0000 7f3cbcc6b640 1 -- 172.21.15.131:0/2100696901 wait complete. 2024-02-15T23:29:04.868 INFO:tasks.ceph:check_enable_crimson: False 2024-02-15T23:29:04.868 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-15T23:29:04.868 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T23:29:04.868 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-15T23:29:04.878 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:29:04.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-15T23:29:04.892 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:29:04.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-15T23:29:04.947 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T23:29:04.947 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-15T23:29:05.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new a808640e-6008-4ec4-b6e0-4ae1c480ac33 0 2024-02-15T23:29:05.029 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:05.019+0000 7f49b2f08180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-15T23:29:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf3fd8640 1 Processor -- start 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf3fd8640 1 -- start start 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf3fd8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcbec118160 0x7fcbec11a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf3fd8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec11ab20 con 0x7fcbec1153c0 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf3fd8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec11bcc0 con 0x7fcbec118160 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf1573640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcbec118160 0x7fcbec11a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf1d74640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fcbec1153c0 0x7fcbec1157a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:56788/0 (socket says 172.21.15.133:56788) 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf1d74640 1 -- 172.21.15.133:0/1651319645 learned_addr learned my addr 172.21.15.133:0/1651319645 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf1573640 1 -- 172.21.15.133:0/1651319645 >> v1:172.21.15.131:6789/0 conn(0x7fcbec1153c0 legacy=0x7fcbec1157a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.143+0000 7fcbf1573640 1 -- 172.21.15.133:0/1651319645 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec11be00 con 0x7fcbec118160 2024-02-15T23:29:05.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf1573640 1 --2- 172.21.15.133:0/1651319645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec118160 0x7fcbec11a550 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009740 tx=0x7fcbdc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5d6a71b47a92c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:05.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf0d72640 1 -- 172.21.15.133:0/1651319645 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc0a8050 con 0x7fcbec118160 2024-02-15T23:29:05.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf0d72640 1 -- 172.21.15.133:0/1651319645 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0ac520 con 0x7fcbec118160 2024-02-15T23:29:05.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf0d72640 1 -- 172.21.15.133:0/1651319645 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc0ac7e0 con 0x7fcbec118160 2024-02-15T23:29:05.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/1651319645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec118160 msgr2=0x7fcbec11a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 --2- 172.21.15.133:0/1651319645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec118160 0x7fcbec11a550 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009740 tx=0x7fcbdc01c370 comp rx=0 tx=0).stop 2024-02-15T23:29:05.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/1651319645 shutdown_connections 2024-02-15T23:29:05.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 --2- 172.21.15.133:0/1651319645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec118160 0x7fcbec11a550 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/1651319645 >> 172.21.15.133:0/1651319645 conn(0x7fcbec0702e0 msgr2=0x7fcbec072700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:05.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/1651319645 shutdown_connections 2024-02-15T23:29:05.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/1651319645 wait complete. 2024-02-15T23:29:05.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 Processor -- start 2024-02-15T23:29:05.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 -- start start 2024-02-15T23:29:05.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec1153c0 0x7fcbec1a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:05.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.147+0000 7fcbf3fd8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec1a8d20 con 0x7fcbec1153c0 2024-02-15T23:29:05.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbf1d74640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec1153c0 0x7fcbec1a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbf1d74640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec1153c0 0x7fcbec1a87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:54690/0 (socket says 172.21.15.133:54690) 2024-02-15T23:29:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbf1d74640 1 -- 172.21.15.133:0/4071633823 learned_addr learned my addr 172.21.15.133:0/4071633823 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbf1d74640 1 -- 172.21.15.133:0/4071633823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009420 con 0x7fcbec1153c0 2024-02-15T23:29:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbf1d74640 1 --2- 172.21.15.133:0/4071633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec1153c0 0x7fcbec1a87e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c480 tx=0x7fcbe400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:05.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbe27fc640 1 -- 172.21.15.133:0/4071633823 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbe4005c20 con 0x7fcbec1153c0 2024-02-15T23:29:05.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec11bb30 con 0x7fcbec1153c0 2024-02-15T23:29:05.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbe27fc640 1 -- 172.21.15.133:0/4071633823 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4005d80 con 0x7fcbec1153c0 2024-02-15T23:29:05.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbe27fc640 1 -- 172.21.15.133:0/4071633823 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbe40071a0 con 0x7fcbec1153c0 2024-02-15T23:29:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec1a92f0 con 0x7fcbec1153c0 2024-02-15T23:29:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbe27fc640 1 -- 172.21.15.133:0/4071633823 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcbe4007300 con 0x7fcbec1153c0 2024-02-15T23:29:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbe27fc640 1 -- 172.21.15.133:0/4071633823 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcbe401b3f0 con 0x7fcbec1153c0 2024-02-15T23:29:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.151+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec062860 con 0x7fcbec1153c0 2024-02-15T23:29:05.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.159+0000 7fcbe27fc640 1 -- 172.21.15.133:0/4071633823 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcbec1a92f0 con 0x7fcbec1153c0 2024-02-15T23:29:05.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.227+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a808640e-6008-4ec4-b6e0-4ae1c480ac33", "id": 0} v 0) v1 -- 0x7fcbec067620 con 0x7fcbec1153c0 2024-02-15T23:29:05.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.231+0000 7fcbe27fc640 1 -- 172.21.15.133:0/4071633823 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a808640e-6008-4ec4-b6e0-4ae1c480ac33", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcbe4020060 con 0x7fcbec1153c0 2024-02-15T23:29:05.238 INFO:teuthology.orchestra.run.smithi133.stdout:0 2024-02-15T23:29:05.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.231+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec1153c0 msgr2=0x7fcbec1a87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.231+0000 7fcbf3fd8640 1 --2- 172.21.15.133:0/4071633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec1153c0 0x7fcbec1a87e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c480 tx=0x7fcbe400c940 comp rx=0 tx=0).stop 2024-02-15T23:29:05.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.231+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 shutdown_connections 2024-02-15T23:29:05.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.231+0000 7fcbf3fd8640 1 --2- 172.21.15.133:0/4071633823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbec1153c0 0x7fcbec1a87e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.231+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 >> 172.21.15.133:0/4071633823 conn(0x7fcbec0702e0 msgr2=0x7fcbec06db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:05.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.231+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 shutdown_connections 2024-02-15T23:29:05.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.231+0000 7fcbf3fd8640 1 -- 172.21.15.133:0/4071633823 wait complete. 2024-02-15T23:29:05.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 1965c486-d2df-4b7e-bca1-3827989223e8 1 2024-02-15T23:29:05.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.351+0000 7fae16f3d640 1 Processor -- start 2024-02-15T23:29:05.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.351+0000 7fae16f3d640 1 -- start start 2024-02-15T23:29:05.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.351+0000 7fae16f3d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fae101139e0 0x7fae10113de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:05.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae16f3d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae10114470 con 0x7fae1010ddc0 2024-02-15T23:29:05.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae16f3d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1010e980 con 0x7fae101139e0 2024-02-15T23:29:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae14cd9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fae101139e0 0x7fae10113de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae0ffff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fae1010ddc0 0x7fae1010e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:56802/0 (socket says 172.21.15.133:56802) 2024-02-15T23:29:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae14cd9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fae101139e0 0x7fae10113de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:54692/0 (socket says 172.21.15.133:54692) 2024-02-15T23:29:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae0ffff640 1 -- 172.21.15.133:0/3745363406 learned_addr learned my addr 172.21.15.133:0/3745363406 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae14cd9640 1 -- 172.21.15.133:0/3745363406 >> v1:172.21.15.131:6789/0 conn(0x7fae1010ddc0 legacy=0x7fae1010e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae14cd9640 1 -- 172.21.15.133:0/3745363406 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1010eaf0 con 0x7fae101139e0 2024-02-15T23:29:05.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae14cd9640 1 --2- 172.21.15.133:0/3745363406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae101139e0 0x7fae10113de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00a8e0 tx=0x7fadfc01d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f3cff603e5bdda server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:05.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae0f7fe640 1 -- 172.21.15.133:0/3745363406 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadfc0a66e0 con 0x7fae101139e0 2024-02-15T23:29:05.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae0f7fe640 1 -- 172.21.15.133:0/3745363406 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc0a6840 con 0x7fae101139e0 2024-02-15T23:29:05.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.355+0000 7fae0f7fe640 1 -- 172.21.15.133:0/3745363406 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadfc0a6b00 con 0x7fae101139e0 2024-02-15T23:29:05.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- 172.21.15.133:0/3745363406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae101139e0 msgr2=0x7fae10113de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 --2- 172.21.15.133:0/3745363406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae101139e0 0x7fae10113de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00a8e0 tx=0x7fadfc01d740 comp rx=0 tx=0).stop 2024-02-15T23:29:05.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- 172.21.15.133:0/3745363406 shutdown_connections 2024-02-15T23:29:05.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 --2- 172.21.15.133:0/3745363406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae101139e0 0x7fae10113de0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- 172.21.15.133:0/3745363406 >> 172.21.15.133:0/3745363406 conn(0x7fae1006eec0 msgr2=0x7fae100712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:05.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- 172.21.15.133:0/3745363406 shutdown_connections 2024-02-15T23:29:05.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- 172.21.15.133:0/3745363406 wait complete. 2024-02-15T23:29:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 Processor -- start 2024-02-15T23:29:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- start start 2024-02-15T23:29:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae1010ddc0 0x7fae1010f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1010ff00 con 0x7fae1010ddc0 2024-02-15T23:29:05.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae14cd9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae1010ddc0 0x7fae1010f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:05.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae14cd9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae1010ddc0 0x7fae1010f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:54700/0 (socket says 172.21.15.133:54700) 2024-02-15T23:29:05.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae14cd9640 1 -- 172.21.15.133:0/3472280064 learned_addr learned my addr 172.21.15.133:0/3472280064 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae14cd9640 1 -- 172.21.15.133:0/3472280064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc00a5c0 con 0x7fae1010ddc0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae14cd9640 1 --2- 172.21.15.133:0/3472280064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae1010ddc0 0x7fae1010f930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fadfc01b370 tx=0x7fadfc01a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae0d7fa640 1 -- 172.21.15.133:0/3472280064 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadfc0aeb70 con 0x7fae1010ddc0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae101100a0 con 0x7fae1010ddc0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae10110540 con 0x7fae1010ddc0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae0d7fa640 1 -- 172.21.15.133:0/3472280064 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc0aecd0 con 0x7fae1010ddc0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae0d7fa640 1 -- 172.21.15.133:0/3472280064 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadfc0b9440 con 0x7fae1010ddc0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae0d7fa640 1 -- 172.21.15.133:0/3472280064 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fadfc0b5040 con 0x7fae1010ddc0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae0d7fa640 1 -- 172.21.15.133:0/3472280064 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fadfc0b73f0 con 0x7fae1010ddc0 2024-02-15T23:29:05.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.359+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae10062860 con 0x7fae1010ddc0 2024-02-15T23:29:05.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.367+0000 7fae0d7fa640 1 -- 172.21.15.133:0/3472280064 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fadfc0bd020 con 0x7fae1010ddc0 2024-02-15T23:29:05.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.435+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1965c486-d2df-4b7e-bca1-3827989223e8", "id": 1} v 0) v1 -- 0x7fae10067620 con 0x7fae1010ddc0 2024-02-15T23:29:05.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.439+0000 7fae0d7fa640 1 -- 172.21.15.133:0/3472280064 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1965c486-d2df-4b7e-bca1-3827989223e8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fadfc0b3070 con 0x7fae1010ddc0 2024-02-15T23:29:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-02-15T23:29:05.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.439+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae1010ddc0 msgr2=0x7fae1010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.439+0000 7fae16f3d640 1 --2- 172.21.15.133:0/3472280064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae1010ddc0 0x7fae1010f930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fadfc01b370 tx=0x7fadfc01a4e0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.439+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 shutdown_connections 2024-02-15T23:29:05.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.439+0000 7fae16f3d640 1 --2- 172.21.15.133:0/3472280064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae1010ddc0 0x7fae1010f930 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.439+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 >> 172.21.15.133:0/3472280064 conn(0x7fae1006eec0 msgr2=0x7fae10111aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:05.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.439+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 shutdown_connections 2024-02-15T23:29:05.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.439+0000 7fae16f3d640 1 -- 172.21.15.133:0/3472280064 wait complete. 2024-02-15T23:29:05.465 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new bd677a5e-b48a-43c0-9fe4-701bb31f3331 2 2024-02-15T23:29:05.517 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:05.507+0000 7f49b2f08180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-15T23:29:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7b052a9640 1 Processor -- start 2024-02-15T23:29:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7b052a9640 1 -- start start 2024-02-15T23:29:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7b052a9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7b001142d0 0x7f7b001146b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7b052a9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b00114d40 con 0x7f7b0010e030 2024-02-15T23:29:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7b052a9640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0010ebf0 con 0x7f7b001142d0 2024-02-15T23:29:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7afeffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7b001142d0 0x7f7b001146b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7afeffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7b001142d0 0x7f7b001146b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:54708/0 (socket says 172.21.15.133:54708) 2024-02-15T23:29:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7afeffd640 1 -- 172.21.15.133:0/2099550510 learned_addr learned my addr 172.21.15.133:0/2099550510 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7afe7fc640 1 --1- 172.21.15.133:0/2099550510 >> v1:172.21.15.131:6789/0 conn(0x7f7b0010e030 0x7f7b0010e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:56816/0 (socket says 172.21.15.133:56816) 2024-02-15T23:29:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7afeffd640 1 -- 172.21.15.133:0/2099550510 >> v1:172.21.15.131:6789/0 conn(0x7f7b0010e030 legacy=0x7f7b0010e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.571+0000 7f7afeffd640 1 -- 172.21.15.133:0/2099550510 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0010ed60 con 0x7f7b001142d0 2024-02-15T23:29:05.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7afeffd640 1 --2- 172.21.15.133:0/2099550510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b001142d0 0x7f7b001146b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009e50 tx=0x7f7af801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05578c41583e64f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:05.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7afdffb640 1 -- 172.21.15.133:0/2099550510 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7af8009200 con 0x7f7b001142d0 2024-02-15T23:29:05.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7afdffb640 1 -- 172.21.15.133:0/2099550510 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af80a57e0 con 0x7f7b001142d0 2024-02-15T23:29:05.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7afdffb640 1 -- 172.21.15.133:0/2099550510 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7af80a5aa0 con 0x7f7b001142d0 2024-02-15T23:29:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 -- 172.21.15.133:0/2099550510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b001142d0 msgr2=0x7f7b001146b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 --2- 172.21.15.133:0/2099550510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b001142d0 0x7f7b001146b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009e50 tx=0x7f7af801c980 comp rx=0 tx=0).stop 2024-02-15T23:29:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 -- 172.21.15.133:0/2099550510 shutdown_connections 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 --2- 172.21.15.133:0/2099550510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b001142d0 0x7f7b001146b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 -- 172.21.15.133:0/2099550510 >> 172.21.15.133:0/2099550510 conn(0x7f7b0006f540 msgr2=0x7f7b00071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 -- 172.21.15.133:0/2099550510 shutdown_connections 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 -- 172.21.15.133:0/2099550510 wait complete. 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 Processor -- start 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.575+0000 7f7b052a9640 1 -- start start 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7b052a9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b0010e030 0x7f7b001a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7b052a9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b001a78f0 con 0x7f7b0010e030 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7afeffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b0010e030 0x7f7b001a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7afeffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b0010e030 0x7f7b001a73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:54710/0 (socket says 172.21.15.133:54710) 2024-02-15T23:29:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7afeffd640 1 -- 172.21.15.133:0/2184512954 learned_addr learned my addr 172.21.15.133:0/2184512954 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7afeffd640 1 -- 172.21.15.133:0/2184512954 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8009b30 con 0x7f7b0010e030 2024-02-15T23:29:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7afeffd640 1 --2- 172.21.15.133:0/2184512954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b0010e030 0x7f7b001a73b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7af801a5b0 tx=0x7f7af8019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7ae77fe640 1 -- 172.21.15.133:0/2184512954 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7af8007980 con 0x7f7b0010e030 2024-02-15T23:29:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b001a7a90 con 0x7f7b0010e030 2024-02-15T23:29:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7ae77fe640 1 -- 172.21.15.133:0/2184512954 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af8007ae0 con 0x7f7b0010e030 2024-02-15T23:29:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b001a7f90 con 0x7f7b0010e030 2024-02-15T23:29:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7ae77fe640 1 -- 172.21.15.133:0/2184512954 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7af8007d80 con 0x7f7b0010e030 2024-02-15T23:29:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7ae77fe640 1 -- 172.21.15.133:0/2184512954 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7af80b8800 con 0x7f7b0010e030 2024-02-15T23:29:05.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7ae77fe640 1 -- 172.21.15.133:0/2184512954 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7af80b6440 con 0x7f7b0010e030 2024-02-15T23:29:05.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.579+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b00062860 con 0x7f7b0010e030 2024-02-15T23:29:05.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.587+0000 7f7ae77fe640 1 -- 172.21.15.133:0/2184512954 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7af80bc020 con 0x7f7b0010e030 2024-02-15T23:29:05.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.651+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bd677a5e-b48a-43c0-9fe4-701bb31f3331", "id": 2} v 0) v1 -- 0x7f7b001142d0 con 0x7f7b0010e030 2024-02-15T23:29:05.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.655+0000 7f7ae77fe640 1 -- 172.21.15.133:0/2184512954 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd677a5e-b48a-43c0-9fe4-701bb31f3331", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7af80b66e0 con 0x7f7b0010e030 2024-02-15T23:29:05.665 INFO:teuthology.orchestra.run.smithi133.stdout:2 2024-02-15T23:29:05.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.655+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b0010e030 msgr2=0x7f7b001a73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.655+0000 7f7b052a9640 1 --2- 172.21.15.133:0/2184512954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b0010e030 0x7f7b001a73b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7af801a5b0 tx=0x7f7af8019720 comp rx=0 tx=0).stop 2024-02-15T23:29:05.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.655+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 shutdown_connections 2024-02-15T23:29:05.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.655+0000 7f7b052a9640 1 --2- 172.21.15.133:0/2184512954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b0010e030 0x7f7b001a73b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.655+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 >> 172.21.15.133:0/2184512954 conn(0x7f7b0006f540 msgr2=0x7f7b0010fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:05.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.655+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 shutdown_connections 2024-02-15T23:29:05.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.655+0000 7f7b052a9640 1 -- 172.21.15.133:0/2184512954 wait complete. 2024-02-15T23:29:05.681 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new e3b81b09-0178-420a-8d91-228e6ebabed6 3 2024-02-15T23:29:05.726 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:05.715+0000 7f49b2f08180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-15T23:29:05.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46fbd69640 1 Processor -- start 2024-02-15T23:29:05.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46fbd69640 1 -- start start 2024-02-15T23:29:05.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46fbd69640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46f4116f60 0x7f46f4119350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:05.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46fbd69640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f4119980 con 0x7f46f4114310 2024-02-15T23:29:05.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46fbd69640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f411ab40 con 0x7f46f4116f60 2024-02-15T23:29:05.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46f9304640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46f4116f60 0x7f46f4119350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:05.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46f9b05640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f46f4114310 0x7f46f4114710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:56832/0 (socket says 172.21.15.133:56832) 2024-02-15T23:29:05.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46f9304640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46f4116f60 0x7f46f4119350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:54722/0 (socket says 172.21.15.133:54722) 2024-02-15T23:29:05.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46f9b05640 1 -- 172.21.15.133:0/1213527355 learned_addr learned my addr 172.21.15.133:0/1213527355 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:05.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46f9304640 1 -- 172.21.15.133:0/1213527355 >> v1:172.21.15.131:6789/0 conn(0x7f46f4114310 legacy=0x7f46f4114710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.783+0000 7f46f9304640 1 -- 172.21.15.133:0/1213527355 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f411acb0 con 0x7f46f4116f60 2024-02-15T23:29:05.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46f9304640 1 --2- 172.21.15.133:0/1213527355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4116f60 0x7f46f4119350 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009740 tx=0x7f46e401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3be7e110fd408d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:05.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46f8b03640 1 -- 172.21.15.133:0/1213527355 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46e40a8050 con 0x7f46f4116f60 2024-02-15T23:29:05.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46f8b03640 1 -- 172.21.15.133:0/1213527355 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40ac520 con 0x7f46f4116f60 2024-02-15T23:29:05.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46f8b03640 1 -- 172.21.15.133:0/1213527355 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46e40ac7e0 con 0x7f46f4116f60 2024-02-15T23:29:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46fbd69640 1 -- 172.21.15.133:0/1213527355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4116f60 msgr2=0x7f46f4119350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46fbd69640 1 --2- 172.21.15.133:0/1213527355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4116f60 0x7f46f4119350 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009740 tx=0x7f46e401c370 comp rx=0 tx=0).stop 2024-02-15T23:29:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46fbd69640 1 -- 172.21.15.133:0/1213527355 shutdown_connections 2024-02-15T23:29:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46fbd69640 1 --2- 172.21.15.133:0/1213527355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4116f60 0x7f46f4119350 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46fbd69640 1 -- 172.21.15.133:0/1213527355 >> 172.21.15.133:0/1213527355 conn(0x7f46f406ee90 msgr2=0x7f46f40712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46fbd69640 1 -- 172.21.15.133:0/1213527355 shutdown_connections 2024-02-15T23:29:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.787+0000 7f46fbd69640 1 -- 172.21.15.133:0/1213527355 wait complete. 2024-02-15T23:29:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46fbd69640 1 Processor -- start 2024-02-15T23:29:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46fbd69640 1 -- start start 2024-02-15T23:29:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46fbd69640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4114310 0x7f46f41ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46fbd69640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f41ab900 con 0x7f46f4114310 2024-02-15T23:29:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46f9b05640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4114310 0x7f46f41ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46f9b05640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4114310 0x7f46f41ab330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:54730/0 (socket says 172.21.15.133:54730) 2024-02-15T23:29:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46f9b05640 1 -- 172.21.15.133:0/1145960698 learned_addr learned my addr 172.21.15.133:0/1145960698 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46f9b05640 1 -- 172.21.15.133:0/1145960698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4009420 con 0x7f46f4114310 2024-02-15T23:29:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46f9b05640 1 --2- 172.21.15.133:0/1145960698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4114310 0x7f46f41ab330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f46f000c3b0 tx=0x7f46f000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46ea7fc640 1 -- 172.21.15.133:0/1145960698 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46f0005c20 con 0x7f46f4114310 2024-02-15T23:29:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f41abaa0 con 0x7f46f4114310 2024-02-15T23:29:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46ea7fc640 1 -- 172.21.15.133:0/1145960698 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f0005d80 con 0x7f46f4114310 2024-02-15T23:29:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f41a5210 con 0x7f46f4114310 2024-02-15T23:29:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46ea7fc640 1 -- 172.21.15.133:0/1145960698 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46f0004920 con 0x7f46f4114310 2024-02-15T23:29:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46ea7fc640 1 -- 172.21.15.133:0/1145960698 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f46f00070d0 con 0x7f46f4114310 2024-02-15T23:29:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46ea7fc640 1 -- 172.21.15.133:0/1145960698 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f46f0007380 con 0x7f46f4114310 2024-02-15T23:29:05.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.791+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f4062860 con 0x7f46f4114310 2024-02-15T23:29:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.799+0000 7f46ea7fc640 1 -- 172.21.15.133:0/1145960698 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f46f0007610 con 0x7f46f4114310 2024-02-15T23:29:05.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.867+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e3b81b09-0178-420a-8d91-228e6ebabed6", "id": 3} v 0) v1 -- 0x7f46f4067620 con 0x7f46f4114310 2024-02-15T23:29:05.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.867+0000 7f46ea7fc640 1 -- 172.21.15.133:0/1145960698 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3b81b09-0178-420a-8d91-228e6ebabed6", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46f0005030 con 0x7f46f4114310 2024-02-15T23:29:05.877 INFO:teuthology.orchestra.run.smithi133.stdout:3 2024-02-15T23:29:05.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.867+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4114310 msgr2=0x7f46f41ab330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:05.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.867+0000 7f46fbd69640 1 --2- 172.21.15.133:0/1145960698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4114310 0x7f46f41ab330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f46f000c3b0 tx=0x7f46f000c870 comp rx=0 tx=0).stop 2024-02-15T23:29:05.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.867+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 shutdown_connections 2024-02-15T23:29:05.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.867+0000 7f46fbd69640 1 --2- 172.21.15.133:0/1145960698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f4114310 0x7f46f41ab330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:05.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.867+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 >> 172.21.15.133:0/1145960698 conn(0x7f46f406ee90 msgr2=0x7f46f41175f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:05.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.871+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 shutdown_connections 2024-02-15T23:29:05.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:05.871+0000 7f46fbd69640 1 -- 172.21.15.133:0/1145960698 wait complete. 2024-02-15T23:29:05.893 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-15T23:29:05.893 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-15T23:29:05.896 INFO:tasks.ceph.osd.0:Started 2024-02-15T23:29:05.896 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-15T23:29:05.896 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-15T23:29:05.939 INFO:tasks.ceph.osd.1:Started 2024-02-15T23:29:05.940 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-15T23:29:05.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-15T23:29:05.942 INFO:tasks.ceph.osd.2:Started 2024-02-15T23:29:05.942 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-15T23:29:05.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-15T23:29:05.944 INFO:tasks.ceph.osd.3:Started 2024-02-15T23:29:05.945 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T23:29:06.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 Processor -- start 2024-02-15T23:29:06.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 -- start start 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6481290f0 0x7fd64812c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd648095ee0 con 0x7fd648128d10 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd648096320 con 0x7fd6481290f0 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64dad1640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd648128d10 0x7fd64812bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:52428/0 (socket says 172.21.15.131:52428) 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64dad1640 1 -- 172.21.15.131:0/3177129055 learned_addr learned my addr 172.21.15.131:0/3177129055 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64d2d0640 1 --2- 172.21.15.131:0/3177129055 >> v2:172.21.15.131:3300/0 conn(0x7fd6481290f0 0x7fd64812c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64cacf640 1 -- 172.21.15.131:0/3177129055 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903385841 0 0) 0x7fd648095ee0 con 0x7fd648128d10 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64cacf640 1 -- 172.21.15.131:0/3177129055 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd634003530 con 0x7fd648128d10 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64d2d0640 1 -- 172.21.15.131:0/3177129055 >> v1:172.21.15.131:6789/0 conn(0x7fd648128d10 legacy=0x7fd64812bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64d2d0640 1 -- 172.21.15.131:0/3177129055 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd648128620 con 0x7fd6481290f0 2024-02-15T23:29:06.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64d2d0640 1 --2- 172.21.15.131:0/3177129055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6481290f0 0x7fd64812c230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd638009740 tx=0x7fd63801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b1fa516c8d7dcc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:06.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64cacf640 1 -- 172.21.15.131:0/3177129055 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6380ac530 con 0x7fd6481290f0 2024-02-15T23:29:06.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64cacf640 1 -- 172.21.15.131:0/3177129055 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6380a8050 con 0x7fd6481290f0 2024-02-15T23:29:06.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64cacf640 1 -- 172.21.15.131:0/3177129055 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6380ac7e0 con 0x7fd6481290f0 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 -- 172.21.15.131:0/3177129055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6481290f0 msgr2=0x7fd64812c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 --2- 172.21.15.131:0/3177129055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6481290f0 0x7fd64812c230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd638009740 tx=0x7fd63801c490 comp rx=0 tx=0).stop 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 -- 172.21.15.131:0/3177129055 shutdown_connections 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 --2- 172.21.15.131:0/3177129055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6481290f0 0x7fd64812c230 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.068+0000 7fd64fd35640 1 -- 172.21.15.131:0/3177129055 >> 172.21.15.131:0/3177129055 conn(0x7fd64809a2f0 msgr2=0x7fd64809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 -- 172.21.15.131:0/3177129055 shutdown_connections 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 -- 172.21.15.131:0/3177129055 wait complete. 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 Processor -- start 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 -- start start 2024-02-15T23:29:06.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd648128d10 0x7fd6481c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:06.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481281f0 con 0x7fd648128d10 2024-02-15T23:29:06.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64dad1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd648128d10 0x7fd6481c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:06.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64dad1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd648128d10 0x7fd6481c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49396/0 (socket says 172.21.15.131:49396) 2024-02-15T23:29:06.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64dad1640 1 -- 172.21.15.131:0/4277058311 learned_addr learned my addr 172.21.15.131:0/4277058311 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:06.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64dad1640 1 -- 172.21.15.131:0/4277058311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638009420 con 0x7fd648128d10 2024-02-15T23:29:06.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64dad1640 1 --2- 172.21.15.131:0/4277058311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd648128d10 0x7fd6481c4dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd64400c450 tx=0x7fd64400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd63e7fc640 1 -- 172.21.15.131:0/4277058311 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd644005c20 con 0x7fd648128d10 2024-02-15T23:29:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd63e7fc640 1 -- 172.21.15.131:0/4277058311 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd644005d80 con 0x7fd648128d10 2024-02-15T23:29:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd63e7fc640 1 -- 172.21.15.131:0/4277058311 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6440071a0 con 0x7fd648128d10 2024-02-15T23:29:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64806d9c0 con 0x7fd648128d10 2024-02-15T23:29:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd648127970 con 0x7fd648128d10 2024-02-15T23:29:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd63e7fc640 1 -- 172.21.15.131:0/4277058311 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd644007300 con 0x7fd648128d10 2024-02-15T23:29:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd63e7fc640 1 -- 172.21.15.131:0/4277058311 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd644012910 con 0x7fd648128d10 2024-02-15T23:29:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.072+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64806de50 con 0x7fd648128d10 2024-02-15T23:29:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.076+0000 7fd63e7fc640 1 -- 172.21.15.131:0/4277058311 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd644021060 con 0x7fd648128d10 2024-02-15T23:29:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.132+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd64806e100 con 0x7fd648128d10 2024-02-15T23:29:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.132+0000 7fd63e7fc640 1 -- 172.21.15.131:0/4277058311 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7fd644017070 con 0x7fd648128d10 2024-02-15T23:29:06.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:29:06.139 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":6,"fsid":"633d2778-ce48-4cf9-a862-869ac6a165af","created":"2024-02-15T23:29:04.739458+0000","modified":"2024-02-15T23:29:05.873641+0000","last_up_change":"0.000000","last_in_change":"2024-02-15T23:29:05.873641+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a808640e-6008-4ec4-b6e0-4ae1c480ac33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1965c486-d2df-4b7e-bca1-3827989223e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bd677a5e-b48a-43c0-9fe4-701bb31f3331","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e3b81b09-0178-420a-8d91-228e6ebabed6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:29:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.132+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd648128d10 msgr2=0x7fd6481c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:06.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.132+0000 7fd64fd35640 1 --2- 172.21.15.131:0/4277058311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd648128d10 0x7fd6481c4dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd64400c450 tx=0x7fd64400c910 comp rx=0 tx=0).stop 2024-02-15T23:29:06.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.132+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 shutdown_connections 2024-02-15T23:29:06.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.132+0000 7fd64fd35640 1 --2- 172.21.15.131:0/4277058311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd648128d10 0x7fd6481c4dd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:06.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.132+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 >> 172.21.15.131:0/4277058311 conn(0x7fd64809a2f0 msgr2=0x7fd648121940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:06.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.136+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 shutdown_connections 2024-02-15T23:29:06.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:06.136+0000 7fd64fd35640 1 -- 172.21.15.131:0/4277058311 wait complete. 2024-02-15T23:29:06.157 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-15T23:29:06.157 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-15T23:29:06.282 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.275+0000 7f49b2f08180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-15T23:29:06.335 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.327+0000 7f49b2f08180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-15T23:29:06.388 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.379+0000 7f49b2f08180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-15T23:29:06.463 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.455+0000 7f49b2f08180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-15T23:29:06.506 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-02-15T23:29:06.500+0000 7f3ed72f87c0 -1 Falling back to public interface 2024-02-15T23:29:06.515 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.507+0000 7f49b2f08180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-15T23:29:06.544 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-02-15T23:29:06.535+0000 7f9fd50cb7c0 -1 Falling back to public interface 2024-02-15T23:29:06.555 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-02-15T23:29:06.547+0000 7f7e909447c0 -1 Falling back to public interface 2024-02-15T23:29:06.559 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-02-15T23:29:06.551+0000 7f6d4e4407c0 -1 Falling back to public interface 2024-02-15T23:29:06.560 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-15T23:29:06.593 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.583+0000 7f49b2f08180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-15T23:29:06.645 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.635+0000 7f49b2f08180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-15T23:29:06.681 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d99c59640 1 Processor -- start 2024-02-15T23:29:06.681 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d99c59640 1 -- start start 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d99c59640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d94127700 0x7f9d94127ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d99c59640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d94127500 con 0x7f9d94128020 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d99c59640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d940938c0 con 0x7f9d94127700 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d937fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d94127700 0x7f9d94127ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d937fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d94127700 0x7f9d94127ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49412/0 (socket says 172.21.15.131:49412) 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d937fe640 1 -- 172.21.15.131:0/918290941 learned_addr learned my addr 172.21.15.131:0/918290941 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d92ffd640 1 -- 172.21.15.131:0/918290941 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247549306 0 0) 0x7f9d94127500 con 0x7f9d94128020 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d937fe640 1 -- 172.21.15.131:0/918290941 >> v1:172.21.15.131:6789/0 conn(0x7f9d94128020 legacy=0x7f9d9412a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:06.682 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.676+0000 7f9d937fe640 1 -- 172.21.15.131:0/918290941 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9406c8b0 con 0x7f9d94127700 2024-02-15T23:29:06.686 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d937fe640 1 --2- 172.21.15.131:0/918290941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d94127ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9d840097f0 tx=0x7f9d8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebddf58ec2d6b80 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d92ffd640 1 -- 172.21.15.131:0/918290941 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d840ab580 con 0x7f9d94127700 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d92ffd640 1 -- 172.21.15.131:0/918290941 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d840ab6e0 con 0x7f9d94127700 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d92ffd640 1 -- 172.21.15.131:0/918290941 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d840ab9a0 con 0x7f9d94127700 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 -- 172.21.15.131:0/918290941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 msgr2=0x7f9d94127ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 --2- 172.21.15.131:0/918290941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d94127ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9d840097f0 tx=0x7f9d8401c430 comp rx=0 tx=0).stop 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 -- 172.21.15.131:0/918290941 shutdown_connections 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 --2- 172.21.15.131:0/918290941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d94127ae0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 -- 172.21.15.131:0/918290941 >> 172.21.15.131:0/918290941 conn(0x7f9d9409a000 msgr2=0x7f9d9409a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 -- 172.21.15.131:0/918290941 shutdown_connections 2024-02-15T23:29:06.687 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 -- 172.21.15.131:0/918290941 wait complete. 2024-02-15T23:29:06.688 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 Processor -- start 2024-02-15T23:29:06.688 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 -- start start 2024-02-15T23:29:06.689 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d941c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:06.689 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.680+0000 7f9d99c59640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9412e630 con 0x7f9d94127700 2024-02-15T23:29:06.689 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d937fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d941c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:06.689 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d937fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d941c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49420/0 (socket says 172.21.15.131:49420) 2024-02-15T23:29:06.689 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d937fe640 1 -- 172.21.15.131:0/1827975007 learned_addr learned my addr 172.21.15.131:0/1827975007 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d937fe640 1 -- 172.21.15.131:0/1827975007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840094d0 con 0x7f9d94127700 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d937fe640 1 --2- 172.21.15.131:0/1827975007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d941c2fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d84019040 tx=0x7f9d8401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d90ff9640 1 -- 172.21.15.131:0/1827975007 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d840abe30 con 0x7f9d94127700 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d90ff9640 1 -- 172.21.15.131:0/1827975007 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d840aab40 con 0x7f9d94127700 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d90ff9640 1 -- 172.21.15.131:0/1827975007 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d840aade0 con 0x7f9d94127700 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9412e910 con 0x7f9d94127700 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9412eda0 con 0x7f9d94127700 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d90ff9640 1 -- 172.21.15.131:0/1827975007 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9d840043b0 con 0x7f9d94127700 2024-02-15T23:29:06.690 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d90ff9640 1 -- 172.21.15.131:0/1827975007 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f9d840beb70 con 0x7f9d94127700 2024-02-15T23:29:06.691 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d94062860 con 0x7f9d94127700 2024-02-15T23:29:06.692 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.684+0000 7f9d90ff9640 1 -- 172.21.15.131:0/1827975007 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9d840dddd0 con 0x7f9d94127700 2024-02-15T23:29:06.751 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.744+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d940683c0 con 0x7f9d94127700 2024-02-15T23:29:06.753 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.748+0000 7f9d90ff9640 1 -- 172.21.15.131:0/1827975007 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f9d840cc030 con 0x7f9d94127700 2024-02-15T23:29:06.753 INFO:teuthology.misc.health.smithi131.stdout: 2024-02-15T23:29:06.753 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":6,"fsid":"633d2778-ce48-4cf9-a862-869ac6a165af","created":"2024-02-15T23:29:04.739458+0000","modified":"2024-02-15T23:29:05.873641+0000","last_up_change":"0.000000","last_in_change":"2024-02-15T23:29:05.873641+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a808640e-6008-4ec4-b6e0-4ae1c480ac33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1965c486-d2df-4b7e-bca1-3827989223e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bd677a5e-b48a-43c0-9fe4-701bb31f3331","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e3b81b09-0178-420a-8d91-228e6ebabed6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:29:06.754 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.748+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 msgr2=0x7f9d941c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:06.754 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.748+0000 7f9d99c59640 1 --2- 172.21.15.131:0/1827975007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d941c2fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d84019040 tx=0x7f9d8401ac70 comp rx=0 tx=0).stop 2024-02-15T23:29:06.754 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.748+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 shutdown_connections 2024-02-15T23:29:06.754 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.748+0000 7f9d99c59640 1 --2- 172.21.15.131:0/1827975007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94127700 0x7f9d941c2fb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:06.754 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.748+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 >> 172.21.15.131:0/1827975007 conn(0x7f9d9409a000 msgr2=0x7f9d94096930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:06.754 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.748+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 shutdown_connections 2024-02-15T23:29:06.754 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:06.748+0000 7f9d99c59640 1 -- 172.21.15.131:0/1827975007 wait complete. 2024-02-15T23:29:06.769 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-15T23:29:06.791 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.783+0000 7f49b2f08180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-15T23:29:06.853 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:06.843+0000 7f49b2f08180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-15T23:29:07.531 INFO:tasks.ceph.mgr.x.smithi133.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-02-15T23:29:07.532 INFO:tasks.ceph.mgr.x.smithi133.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-02-15T23:29:07.532 INFO:tasks.ceph.mgr.x.smithi133.stderr: from numpy import show_config as show_numpy_config 2024-02-15T23:29:07.592 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:07.583+0000 7f49b2f08180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-15T23:29:07.766 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:07.755+0000 7f49b2f08180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-15T23:29:07.938 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:07.931+0000 7f49b2f08180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-15T23:29:08.008 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:07.999+0000 7f49b2f08180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-15T23:29:08.155 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:08.147+0000 7f49b2f08180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-15T23:29:08.776 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:08.767+0000 7f49b2f08180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-15T23:29:08.852 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:08.843+0000 7f49b2f08180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-15T23:29:09.031 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:09.023+0000 7f49b2f08180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-15T23:29:09.107 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:09.099+0000 7f49b2f08180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-15T23:29:09.407 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:09.399+0000 7f49b2f08180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-15T23:29:09.468 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:09.459+0000 7f49b2f08180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-15T23:29:09.890 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-02-15T23:29:09.883+0000 7f6d4e4407c0 -1 osd.3 0 log_to_monitors true 2024-02-15T23:29:10.196 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-02-15T23:29:10.188+0000 7f3ed72f87c0 -1 osd.0 0 log_to_monitors true 2024-02-15T23:29:10.393 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-02-15T23:29:10.383+0000 7f9fd50cb7c0 -1 osd.1 0 log_to_monitors true 2024-02-15T23:29:10.435 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-02-15T23:29:10.427+0000 7f7e909447c0 -1 osd.2 0 log_to_monitors true 2024-02-15T23:29:10.502 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T23:29:10.495+0000 7f495a359640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-15T23:29:12.511 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-02-15T23:29:12.504+0000 7f3ed42b4640 -1 osd.0 0 waiting for initial osdmap 2024-02-15T23:29:12.541 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-02-15T23:29:12.536+0000 7f3ecb0c5640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T23:29:13.173 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-15T23:29:13.293 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe12a032640 1 Processor -- start 2024-02-15T23:29:13.293 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe12a032640 1 -- start start 2024-02-15T23:29:13.294 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe12a032640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe124129060 0x7fe124130c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:13.294 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe12a032640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1240961b0 con 0x7fe124128430 2024-02-15T23:29:13.294 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe12a032640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe124094b00 con 0x7fe124129060 2024-02-15T23:29:13.294 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe1237fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe124128430 0x7fe124128950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53460/0 (socket says 172.21.15.131:53460) 2024-02-15T23:29:13.294 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe1237fe640 1 -- 172.21.15.131:0/2222702954 learned_addr learned my addr 172.21.15.131:0/2222702954 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:13.294 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe122ffd640 1 --2- 172.21.15.131:0/2222702954 >> v2:172.21.15.131:3300/0 conn(0x7fe124129060 0x7fe124130c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:13.294 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe1227fc640 1 -- 172.21.15.131:0/2222702954 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725212519 0 0) 0x7fe1240961b0 con 0x7fe124128430 2024-02-15T23:29:13.295 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe1227fc640 1 -- 172.21.15.131:0/2222702954 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10c003530 con 0x7fe124128430 2024-02-15T23:29:13.295 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe122ffd640 1 -- 172.21.15.131:0/2222702954 >> v1:172.21.15.131:6789/0 conn(0x7fe124128430 legacy=0x7fe124128950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:13.295 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.288+0000 7fe122ffd640 1 -- 172.21.15.131:0/2222702954 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240724c0 con 0x7fe124129060 2024-02-15T23:29:13.297 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe122ffd640 1 --2- 172.21.15.131:0/2222702954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124129060 0x7fe124130c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe118009740 tx=0x7fe11801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aba76ac64a152e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:13.298 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe1227fc640 1 -- 172.21.15.131:0/2222702954 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1180ab530 con 0x7fe124129060 2024-02-15T23:29:13.298 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe1227fc640 1 -- 172.21.15.131:0/2222702954 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1180a7050 con 0x7fe124129060 2024-02-15T23:29:13.298 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe1227fc640 1 -- 172.21.15.131:0/2222702954 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1180ab7e0 con 0x7fe124129060 2024-02-15T23:29:13.298 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 -- 172.21.15.131:0/2222702954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124129060 msgr2=0x7fe124130c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:13.298 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 --2- 172.21.15.131:0/2222702954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124129060 0x7fe124130c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe118009740 tx=0x7fe11801c400 comp rx=0 tx=0).stop 2024-02-15T23:29:13.299 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 -- 172.21.15.131:0/2222702954 shutdown_connections 2024-02-15T23:29:13.299 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 --2- 172.21.15.131:0/2222702954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124129060 0x7fe124130c90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:13.299 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 -- 172.21.15.131:0/2222702954 >> 172.21.15.131:0/2222702954 conn(0x7fe12409a000 msgr2=0x7fe12409a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:13.299 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 -- 172.21.15.131:0/2222702954 shutdown_connections 2024-02-15T23:29:13.299 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 -- 172.21.15.131:0/2222702954 wait complete. 2024-02-15T23:29:13.300 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 Processor -- start 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 -- start start 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124128430 0x7fe124124bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe12a032640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1241308e0 con 0x7fe124128430 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe1237fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124128430 0x7fe124124bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe1237fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124128430 0x7fe124124bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40234/0 (socket says 172.21.15.131:40234) 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe1237fe640 1 -- 172.21.15.131:0/407617042 learned_addr learned my addr 172.21.15.131:0/407617042 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.292+0000 7fe1237fe640 1 -- 172.21.15.131:0/407617042 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe118009420 con 0x7fe124128430 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe1237fe640 1 --2- 172.21.15.131:0/407617042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124128430 0x7fe124124bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c3d0 tx=0x7fe11400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe10bfff640 1 -- 172.21.15.131:0/407617042 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe114005ce0 con 0x7fe124128430 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe10bfff640 1 -- 172.21.15.131:0/407617042 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114005e40 con 0x7fe124128430 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe124095550 con 0x7fe124128430 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe10bfff640 1 -- 172.21.15.131:0/407617042 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe114007220 con 0x7fe124128430 2024-02-15T23:29:13.301 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12406d280 con 0x7fe124128430 2024-02-15T23:29:13.302 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe124067fa0 con 0x7fe124128430 2024-02-15T23:29:13.302 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe10bfff640 1 -- 172.21.15.131:0/407617042 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) v1 ==== 43479+0+0 (secure 0 0 0) 0x7fe114007440 con 0x7fe124128430 2024-02-15T23:29:13.302 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe10bfff640 1 --2- 172.21.15.131:0/407617042 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe110035930 0x7fe110037df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:13.302 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe10bfff640 1 -- 172.21.15.131:0/407617042 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7fe114046b90 con 0x7fe124128430 2024-02-15T23:29:13.302 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe122ffd640 1 --2- 172.21.15.131:0/407617042 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe110035930 0x7fe110037df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:13.303 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.296+0000 7fe122ffd640 1 --2- 172.21.15.131:0/407617042 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe110035930 0x7fe110037df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe118009740 tx=0x7fe1180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:13.306 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.300+0000 7fe10bfff640 1 -- 172.21.15.131:0/407617042 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe114019be0 con 0x7fe124128430 2024-02-15T23:29:13.337 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-02-15T23:29:13.327+0000 7f6d49bc6640 -1 osd.3 0 waiting for initial osdmap 2024-02-15T23:29:13.350 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-02-15T23:29:13.343+0000 7f7e8c0ca640 -1 osd.2 0 waiting for initial osdmap 2024-02-15T23:29:13.359 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-02-15T23:29:13.351+0000 7f6d4220d640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T23:29:13.375 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-02-15T23:29:13.367+0000 7f7e84711640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T23:29:13.403 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-02-15T23:29:13.395+0000 7f9fd2087640 -1 osd.1 0 waiting for initial osdmap 2024-02-15T23:29:13.435 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-02-15T23:29:13.427+0000 7f9fc8e98640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T23:29:13.467 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.460+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe124062860 con 0x7fe124128430 2024-02-15T23:29:13.468 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.460+0000 7fe10bfff640 1 -- 172.21.15.131:0/407617042 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4153 (secure 0 0 0) 0x7fe114017030 con 0x7fe124128430 2024-02-15T23:29:13.468 INFO:teuthology.misc.health.smithi131.stdout: 2024-02-15T23:29:13.468 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":8,"fsid":"633d2778-ce48-4cf9-a862-869ac6a165af","created":"2024-02-15T23:29:04.739458+0000","modified":"2024-02-15T23:29:11.550293+0000","last_up_change":"0.000000","last_in_change":"2024-02-15T23:29:05.873641+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a808640e-6008-4ec4-b6e0-4ae1c480ac33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1965c486-d2df-4b7e-bca1-3827989223e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bd677a5e-b48a-43c0-9fe4-701bb31f3331","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e3b81b09-0178-420a-8d91-228e6ebabed6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:29:13.470 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe110035930 msgr2=0x7fe110037df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 --2- 172.21.15.131:0/407617042 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe110035930 0x7fe110037df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe118009740 tx=0x7fe1180a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124128430 msgr2=0x7fe124124bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 --2- 172.21.15.131:0/407617042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124128430 0x7fe124124bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c3d0 tx=0x7fe11400c890 comp rx=0 tx=0).stop 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 shutdown_connections 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 --2- 172.21.15.131:0/407617042 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe110035930 0x7fe110037df0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 --2- 172.21.15.131:0/407617042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe124128430 0x7fe124124bf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 >> 172.21.15.131:0/407617042 conn(0x7fe12409a000 msgr2=0x7fe124096930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 shutdown_connections 2024-02-15T23:29:13.471 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:13.464+0000 7fe12a032640 1 -- 172.21.15.131:0/407617042 wait complete. 2024-02-15T23:29:13.488 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-15T23:29:19.891 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-15T23:29:20.012 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bfcb8640 1 Processor -- start 2024-02-15T23:29:20.013 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bfcb8640 1 -- start start 2024-02-15T23:29:20.014 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bfcb8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f33b8128430 0x7f33b8128950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.014 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bfcb8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b80961b0 con 0x7f33b8128e90 2024-02-15T23:29:20.014 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bfcb8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b8094b00 con 0x7f33b8128430 2024-02-15T23:29:20.014 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bda54640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f33b8128430 0x7f33b8128950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.014 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bda54640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f33b8128430 0x7f33b8128950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55752/0 (socket says 172.21.15.131:55752) 2024-02-15T23:29:20.014 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bda54640 1 -- 172.21.15.131:0/2258189178 learned_addr learned my addr 172.21.15.131:0/2258189178 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:20.014 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bda54640 1 -- 172.21.15.131:0/2258189178 >> v1:172.21.15.131:6789/0 conn(0x7f33b8128e90 legacy=0x7f33b812b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.014 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bda54640 1 -- 172.21.15.131:0/2258189178 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80724c0 con 0x7f33b8128430 2024-02-15T23:29:20.016 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bda54640 1 --2- 172.21.15.131:0/2258189178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b8128950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009820 tx=0x7f33b401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd83bf6a330caa77 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.016 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bca52640 1 -- 172.21.15.131:0/2258189178 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40ab530 con 0x7f33b8128430 2024-02-15T23:29:20.016 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bca52640 1 -- 172.21.15.131:0/2258189178 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40a7050 con 0x7f33b8128430 2024-02-15T23:29:20.016 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.008+0000 7f33bca52640 1 -- 172.21.15.131:0/2258189178 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40ab7e0 con 0x7f33b8128430 2024-02-15T23:29:20.017 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- 172.21.15.131:0/2258189178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 msgr2=0x7f33b8128950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.017 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 --2- 172.21.15.131:0/2258189178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b8128950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009820 tx=0x7f33b401c4a0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.017 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- 172.21.15.131:0/2258189178 shutdown_connections 2024-02-15T23:29:20.017 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 --2- 172.21.15.131:0/2258189178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b8128950 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.017 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- 172.21.15.131:0/2258189178 >> 172.21.15.131:0/2258189178 conn(0x7f33b809a000 msgr2=0x7f33b809a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:20.017 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- 172.21.15.131:0/2258189178 shutdown_connections 2024-02-15T23:29:20.017 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- 172.21.15.131:0/2258189178 wait complete. 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 Processor -- start 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- start start 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b81c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81259e0 con 0x7f33b8128430 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bda54640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b81c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bda54640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b81c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55766/0 (socket says 172.21.15.131:55766) 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bda54640 1 -- 172.21.15.131:0/1951668785 learned_addr learned my addr 172.21.15.131:0/1951668785 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bda54640 1 -- 172.21.15.131:0/1951668785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b40094d0 con 0x7f33b8128430 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bda54640 1 --2- 172.21.15.131:0/1951668785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b81c3600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f33b40ae040 tx=0x7f33b4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33ae7fc640 1 -- 172.21.15.131:0/1951668785 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40b4750 con 0x7f33b8128430 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33ae7fc640 1 -- 172.21.15.131:0/1951668785 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40b48b0 con 0x7f33b8128430 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33ae7fc640 1 -- 172.21.15.131:0/1951668785 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40b4b50 con 0x7f33b8128430 2024-02-15T23:29:20.019 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b8095ea0 con 0x7f33b8128430 2024-02-15T23:29:20.020 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b81248b0 con 0x7f33b8128430 2024-02-15T23:29:20.020 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b8067fa0 con 0x7f33b8128430 2024-02-15T23:29:20.020 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33ae7fc640 1 -- 172.21.15.131:0/1951668785 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f33b40b2040 con 0x7f33b8128430 2024-02-15T23:29:20.021 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33ae7fc640 1 --2- 172.21.15.131:0/1951668785 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f339c035a10 0x7f339c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.021 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33ae7fc640 1 -- 172.21.15.131:0/1951668785 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f33b40e2050 con 0x7f33b8128430 2024-02-15T23:29:20.021 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.012+0000 7f33bd253640 1 --2- 172.21.15.131:0/1951668785 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f339c035a10 0x7f339c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.021 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.016+0000 7f33bd253640 1 --2- 172.21.15.131:0/1951668785 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f339c035a10 0x7f339c037ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f33a8001590 tx=0x7f33a8007a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.024 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.020+0000 7f33ae7fc640 1 -- 172.21.15.131:0/1951668785 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f33b40bc9a0 con 0x7f33b8128430 2024-02-15T23:29:20.178 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.172+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33b8062860 con 0x7f33b8128430 2024-02-15T23:29:20.180 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.172+0000 7f33ae7fc640 1 -- 172.21.15.131:0/1951668785 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7975 (secure 0 0 0) 0x7f33b40b0030 con 0x7f33b8128430 2024-02-15T23:29:20.180 INFO:teuthology.misc.health.smithi131.stdout: 2024-02-15T23:29:20.180 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":13,"fsid":"633d2778-ce48-4cf9-a862-869ac6a165af","created":"2024-02-15T23:29:04.739458+0000","modified":"2024-02-15T23:29:17.594413+0000","last_up_change":"2024-02-15T23:29:13.557417+0000","last_in_change":"2024-02-15T23:29:05.873641+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T23:29:15.569040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a808640e-6008-4ec4-b6e0-4ae1c480ac33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6801","nonce":31994139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6803","nonce":31994139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6807","nonce":31994139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6805","nonce":31994139}]},"public_addr":"172.21.15.131:6801/31994139","cluster_addr":"172.21.15.131:6803/31994139","heartbeat_back_addr":"172.21.15.131:6807/31994139","heartbeat_front_addr":"172.21.15.131:6805/31994139","state":["exists","up"]},{"osd":1,"uuid":"1965c486-d2df-4b7e-bca1-3827989223e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6801","nonce":2918336019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6803","nonce":2918336019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6807","nonce":2918336019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6805","nonce":2918336019}]},"public_addr":"172.21.15.133:6801/2918336019","cluster_addr":"172.21.15.133:6803/2918336019","heartbeat_back_addr":"172.21.15.133:6807/2918336019","heartbeat_front_addr":"172.21.15.133:6805/2918336019","state":["exists","up"]},{"osd":2,"uuid":"bd677a5e-b48a-43c0-9fe4-701bb31f3331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6809","nonce":3615800201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6811","nonce":3615800201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6815","nonce":3615800201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6813","nonce":3615800201}]},"public_addr":"172.21.15.133:6809/3615800201","cluster_addr":"172.21.15.133:6811/3615800201","heartbeat_back_addr":"172.21.15.133:6815/3615800201","heartbeat_front_addr":"172.21.15.133:6813/3615800201","state":["exists","up"]},{"osd":3,"uuid":"e3b81b09-0178-420a-8d91-228e6ebabed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6817","nonce":1056376173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6819","nonce":1056376173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6823","nonce":1056376173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6821","nonce":1056376173}]},"public_addr":"172.21.15.133:6817/1056376173","cluster_addr":"172.21.15.133:6819/1056376173","heartbeat_back_addr":"172.21.15.133:6823/1056376173","heartbeat_front_addr":"172.21.15.133:6821/1056376173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.171302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.401420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.392376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:10.859549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:29:20.182 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f339c035a10 msgr2=0x7f339c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.182 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 --2- 172.21.15.131:0/1951668785 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f339c035a10 0x7f339c037ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f33a8001590 tx=0x7f33a8007a60 comp rx=0 tx=0).stop 2024-02-15T23:29:20.182 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 msgr2=0x7f33b81c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.182 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 --2- 172.21.15.131:0/1951668785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b81c3600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f33b40ae040 tx=0x7f33b4019240 comp rx=0 tx=0).stop 2024-02-15T23:29:20.182 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 shutdown_connections 2024-02-15T23:29:20.182 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 --2- 172.21.15.131:0/1951668785 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f339c035a10 0x7f339c037ed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.182 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 --2- 172.21.15.131:0/1951668785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33b8128430 0x7f33b81c3600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.182 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 >> 172.21.15.131:0/1951668785 conn(0x7f33b809a000 msgr2=0x7f33b8096930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:20.183 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 shutdown_connections 2024-02-15T23:29:20.183 INFO:teuthology.misc.health.smithi131.stderr:2024-02-15T23:29:20.176+0000 7f33bfcb8640 1 -- 172.21.15.131:0/1951668785 wait complete. 2024-02-15T23:29:20.196 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-02-15T23:29:20.196 INFO:tasks.ceph:Creating RBD pool 2024-02-15T23:29:20.196 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-15T23:29:20.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e97b3640 1 Processor -- start 2024-02-15T23:29:20.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e97b3640 1 -- start start 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e97b3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f75e412c080 0x7f75e412c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e97b3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e4094fb0 con 0x7f75e4095620 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e97b3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e40949e0 con 0x7f75e412c080 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e2ffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f75e412c080 0x7f75e412c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75dbfff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f75e4095620 0x7f75e4128620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53698/0 (socket says 172.21.15.131:53698) 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75dbfff640 1 -- 172.21.15.131:0/1798401195 learned_addr learned my addr 172.21.15.131:0/1798401195 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e2ffd640 1 -- 172.21.15.131:0/1798401195 >> v1:172.21.15.131:6789/0 conn(0x7f75e4095620 legacy=0x7f75e4128620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e2ffd640 1 -- 172.21.15.131:0/1798401195 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40951e0 con 0x7f75e412c080 2024-02-15T23:29:20.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e27fc640 1 -- 172.21.15.131:0/1798401195 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965473249 0 0) 0x7f75e4094fb0 con 0x7f75e4095620 2024-02-15T23:29:20.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e2ffd640 1 --2- 172.21.15.131:0/1798401195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e412c080 0x7f75e412c460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009740 tx=0x7f75d401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ba95a8f68569e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e27fc640 1 -- 172.21.15.131:0/1798401195 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75d40ab530 con 0x7f75e412c080 2024-02-15T23:29:20.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e27fc640 1 -- 172.21.15.131:0/1798401195 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d40a7050 con 0x7f75e412c080 2024-02-15T23:29:20.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.312+0000 7f75e27fc640 1 -- 172.21.15.131:0/1798401195 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75d40ab7e0 con 0x7f75e412c080 2024-02-15T23:29:20.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- 172.21.15.131:0/1798401195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e412c080 msgr2=0x7f75e412c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 --2- 172.21.15.131:0/1798401195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e412c080 0x7f75e412c460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009740 tx=0x7f75d401c310 comp rx=0 tx=0).stop 2024-02-15T23:29:20.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- 172.21.15.131:0/1798401195 shutdown_connections 2024-02-15T23:29:20.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 --2- 172.21.15.131:0/1798401195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e412c080 0x7f75e412c460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- 172.21.15.131:0/1798401195 >> 172.21.15.131:0/1798401195 conn(0x7f75e409a050 msgr2=0x7f75e409a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:20.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- 172.21.15.131:0/1798401195 shutdown_connections 2024-02-15T23:29:20.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- 172.21.15.131:0/1798401195 wait complete. 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 Processor -- start 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- start start 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e4095620 0x7f75e41c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e412f2a0 con 0x7f75e4095620 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e2ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e4095620 0x7f75e41c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e2ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e4095620 0x7f75e41c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55788/0 (socket says 172.21.15.131:55788) 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e2ffd640 1 -- 172.21.15.131:0/203303403 learned_addr learned my addr 172.21.15.131:0/203303403 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e2ffd640 1 -- 172.21.15.131:0/203303403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009420 con 0x7f75e4095620 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e2ffd640 1 --2- 172.21.15.131:0/203303403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e4095620 0x7f75e41c5440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75d4019fa0 tx=0x7f75d401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75db7fe640 1 -- 172.21.15.131:0/203303403 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75d40abcd0 con 0x7f75e4095620 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75db7fe640 1 -- 172.21.15.131:0/203303403 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d40abe30 con 0x7f75e4095620 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e412ef50 con 0x7f75e4095620 2024-02-15T23:29:20.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75db7fe640 1 -- 172.21.15.131:0/203303403 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75d40b7580 con 0x7f75e4095620 2024-02-15T23:29:20.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e406dc70 con 0x7f75e4095620 2024-02-15T23:29:20.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e4062860 con 0x7f75e4095620 2024-02-15T23:29:20.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75db7fe640 1 -- 172.21.15.131:0/203303403 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75d40b76e0 con 0x7f75e4095620 2024-02-15T23:29:20.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75db7fe640 1 --2- 172.21.15.131:0/203303403 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f75c40359c0 0x7f75c4037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75db7fe640 1 -- 172.21.15.131:0/203303403 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f75d40e2720 con 0x7f75e4095620 2024-02-15T23:29:20.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.316+0000 7f75dbfff640 1 --2- 172.21.15.131:0/203303403 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f75c40359c0 0x7f75c4037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.320+0000 7f75dbfff640 1 --2- 172.21.15.131:0/203303403 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f75c40359c0 0x7f75c4037e80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f75cc007fd0 tx=0x7f75cc007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.320+0000 7f75db7fe640 1 -- 172.21.15.131:0/203303403 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f75d40c76c0 con 0x7f75e4095620 2024-02-15T23:29:20.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.472+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f75e4072bb0 con 0x7f75e4095620 2024-02-15T23:29:20.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.604+0000 7f75db7fe640 1 -- 172.21.15.131:0/203303403 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f75d40b0070 con 0x7f75e4095620 2024-02-15T23:29:20.612 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'rbd' created 2024-02-15T23:29:20.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f75c40359c0 msgr2=0x7f75c4037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 --2- 172.21.15.131:0/203303403 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f75c40359c0 0x7f75c4037e80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f75cc007fd0 tx=0x7f75cc007940 comp rx=0 tx=0).stop 2024-02-15T23:29:20.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e4095620 msgr2=0x7f75e41c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 --2- 172.21.15.131:0/203303403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e4095620 0x7f75e41c5440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75d4019fa0 tx=0x7f75d401abb0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 shutdown_connections 2024-02-15T23:29:20.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 --2- 172.21.15.131:0/203303403 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f75c40359c0 0x7f75c4037e80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 --2- 172.21.15.131:0/203303403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e4095620 0x7f75e41c5440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 >> 172.21.15.131:0/203303403 conn(0x7f75e409a050 msgr2=0x7f75e4096980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:20.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 shutdown_connections 2024-02-15T23:29:20.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.608+0000 7f75e97b3640 1 -- 172.21.15.131:0/203303403 wait complete. 2024-02-15T23:29:20.632 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-15T23:29:20.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb91b3f640 1 Processor -- start 2024-02-15T23:29:20.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb91b3f640 1 -- start start 2024-02-15T23:29:20.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb91b3f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feb8c12bc20 0x7feb8c12c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb91b3f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c071920 con 0x7feb8c12c540 2024-02-15T23:29:20.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb91b3f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c09c870 con 0x7feb8c12bc20 2024-02-15T23:29:20.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb8b7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feb8c12bc20 0x7feb8c12c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb82ffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7feb8c12c540 0x7feb8c0960c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53704/0 (socket says 172.21.15.131:53704) 2024-02-15T23:29:20.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb82ffd640 1 -- 172.21.15.131:0/3711142426 learned_addr learned my addr 172.21.15.131:0/3711142426 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:20.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb8b7fe640 1 -- 172.21.15.131:0/3711142426 >> v1:172.21.15.131:6789/0 conn(0x7feb8c12c540 legacy=0x7feb8c0960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.740+0000 7feb8b7fe640 1 -- 172.21.15.131:0/3711142426 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c070cc0 con 0x7feb8c12bc20 2024-02-15T23:29:20.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb8b7fe640 1 --2- 172.21.15.131:0/3711142426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c12c000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009740 tx=0x7feb7c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3b46f7c875d883 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb8affd640 1 -- 172.21.15.131:0/3711142426 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb7c0ab530 con 0x7feb8c12bc20 2024-02-15T23:29:20.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb8affd640 1 -- 172.21.15.131:0/3711142426 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0a7050 con 0x7feb8c12bc20 2024-02-15T23:29:20.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb8affd640 1 -- 172.21.15.131:0/3711142426 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb7c0ab7e0 con 0x7feb8c12bc20 2024-02-15T23:29:20.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 -- 172.21.15.131:0/3711142426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 msgr2=0x7feb8c12c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:20.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 --2- 172.21.15.131:0/3711142426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c12c000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009740 tx=0x7feb7c01c370 comp rx=0 tx=0).stop 2024-02-15T23:29:20.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 -- 172.21.15.131:0/3711142426 shutdown_connections 2024-02-15T23:29:20.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 --2- 172.21.15.131:0/3711142426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c12c000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:20.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 -- 172.21.15.131:0/3711142426 >> 172.21.15.131:0/3711142426 conn(0x7feb8c09cbb0 msgr2=0x7feb8c09cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:20.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 -- 172.21.15.131:0/3711142426 shutdown_connections 2024-02-15T23:29:20.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 -- 172.21.15.131:0/3711142426 wait complete. 2024-02-15T23:29:20.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 Processor -- start 2024-02-15T23:29:20.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.744+0000 7feb91b3f640 1 -- start start 2024-02-15T23:29:20.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb91b3f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c1c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb91b3f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c127a60 con 0x7feb8c12bc20 2024-02-15T23:29:20.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb8b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c1c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb8b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c1c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55792/0 (socket says 172.21.15.131:55792) 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb8b7fe640 1 -- 172.21.15.131:0/472768532 learned_addr learned my addr 172.21.15.131:0/472768532 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb8b7fe640 1 -- 172.21.15.131:0/472768532 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c009420 con 0x7feb8c12bc20 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb8b7fe640 1 --2- 172.21.15.131:0/472768532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c1c3420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0ae040 tx=0x7feb7c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb88ff9640 1 -- 172.21.15.131:0/472768532 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb7c0b7660 con 0x7feb8c12bc20 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb88ff9640 1 -- 172.21.15.131:0/472768532 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0b77c0 con 0x7feb8c12bc20 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c1266d0 con 0x7feb8c12bc20 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb88ff9640 1 -- 172.21.15.131:0/472768532 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb7c0b7a60 con 0x7feb8c12bc20 2024-02-15T23:29:20.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c1c3960 con 0x7feb8c12bc20 2024-02-15T23:29:20.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c1268c0 con 0x7feb8c12bc20 2024-02-15T23:29:20.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb88ff9640 1 -- 172.21.15.131:0/472768532 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7feb7c0b7bc0 con 0x7feb8c12bc20 2024-02-15T23:29:20.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb88ff9640 1 --2- 172.21.15.131:0/472768532 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb6c0359c0 0x7feb6c037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:20.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb88ff9640 1 -- 172.21.15.131:0/472768532 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3471+0+0 (secure 0 0 0) 0x7feb7c0e2ad0 con 0x7feb8c12bc20 2024-02-15T23:29:20.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb82ffd640 1 --2- 172.21.15.131:0/472768532 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb6c0359c0 0x7feb6c037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:20.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.748+0000 7feb82ffd640 1 --2- 172.21.15.131:0/472768532 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb6c0359c0 0x7feb6c037e80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feb74001630 tx=0x7feb74007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:20.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.756+0000 7feb88ff9640 1 -- 172.21.15.131:0/472768532 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feb7c0c7d70 con 0x7feb8c12bc20 2024-02-15T23:29:20.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:20.904+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feb8c062860 con 0x7feb8c12bc20 2024-02-15T23:29:21.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.612+0000 7feb88ff9640 1 -- 172.21.15.131:0/472768532 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7feb7c0b0030 con 0x7feb8c12bc20 2024-02-15T23:29:21.618 INFO:teuthology.orchestra.run.smithi131.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-15T23:29:21.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb6c0359c0 msgr2=0x7feb6c037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 --2- 172.21.15.131:0/472768532 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb6c0359c0 0x7feb6c037e80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feb74001630 tx=0x7feb74007a90 comp rx=0 tx=0).stop 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 msgr2=0x7feb8c1c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 --2- 172.21.15.131:0/472768532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c1c3420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0ae040 tx=0x7feb7c01abb0 comp rx=0 tx=0).stop 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 shutdown_connections 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 --2- 172.21.15.131:0/472768532 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb6c0359c0 0x7feb6c037e80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 --2- 172.21.15.131:0/472768532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb8c12bc20 0x7feb8c1c3420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 >> 172.21.15.131:0/472768532 conn(0x7feb8c09cbb0 msgr2=0x7feb8c12daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 shutdown_connections 2024-02-15T23:29:21.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.616+0000 7feb91b3f640 1 -- 172.21.15.131:0/472768532 wait complete. 2024-02-15T23:29:21.645 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-15T23:29:21.645 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-15T23:29:21.645 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-15T23:29:21.646 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-15T23:29:21.646 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-15T23:29:21.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.756+0000 7f9c37e83640 1 Processor -- start 2024-02-15T23:29:21.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.756+0000 7f9c37e83640 1 -- start start 2024-02-15T23:29:21.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c37e83640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9c30099320 0x7f9c30133210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:21.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c37e83640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3009a490 con 0x7f9c30098830 2024-02-15T23:29:21.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c37e83640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c30072800 con 0x7f9c30099320 2024-02-15T23:29:21.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c3541e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9c30099320 0x7f9c30133210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:21.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c35c1f640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9c30098830 0x7f9c30098c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53706/0 (socket says 172.21.15.131:53706) 2024-02-15T23:29:21.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c35c1f640 1 -- 172.21.15.131:0/952469441 learned_addr learned my addr 172.21.15.131:0/952469441 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:21.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c3541e640 1 -- 172.21.15.131:0/952469441 >> v1:172.21.15.131:6789/0 conn(0x7f9c30098830 legacy=0x7f9c30098c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:21.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c3541e640 1 -- 172.21.15.131:0/952469441 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3009d790 con 0x7f9c30099320 2024-02-15T23:29:21.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c3541e640 1 --2- 172.21.15.131:0/952469441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30099320 0x7f9c30133210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009740 tx=0x7f9c2001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e861082b1107 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:21.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c34c1d640 1 -- 172.21.15.131:0/952469441 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c200ab530 con 0x7f9c30099320 2024-02-15T23:29:21.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c34c1d640 1 -- 172.21.15.131:0/952469441 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c200a7050 con 0x7f9c30099320 2024-02-15T23:29:21.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c34c1d640 1 -- 172.21.15.131:0/952469441 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c200ab7e0 con 0x7f9c30099320 2024-02-15T23:29:21.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c37e83640 1 -- 172.21.15.131:0/952469441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30099320 msgr2=0x7f9c30133210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:21.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.760+0000 7f9c37e83640 1 --2- 172.21.15.131:0/952469441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30099320 0x7f9c30133210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009740 tx=0x7f9c2001c370 comp rx=0 tx=0).stop 2024-02-15T23:29:21.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- 172.21.15.131:0/952469441 shutdown_connections 2024-02-15T23:29:21.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 --2- 172.21.15.131:0/952469441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30099320 0x7f9c30133210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:21.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- 172.21.15.131:0/952469441 >> 172.21.15.131:0/952469441 conn(0x7f9c300a0920 msgr2=0x7f9c3009ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:21.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- 172.21.15.131:0/952469441 shutdown_connections 2024-02-15T23:29:21.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- 172.21.15.131:0/952469441 wait complete. 2024-02-15T23:29:21.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 Processor -- start 2024-02-15T23:29:21.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- start start 2024-02-15T23:29:21.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30098830 0x7f9c301c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:21.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3012da70 con 0x7f9c30098830 2024-02-15T23:29:21.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c35c1f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30098830 0x7f9c301c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:21.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c35c1f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30098830 0x7f9c301c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55810/0 (socket says 172.21.15.131:55810) 2024-02-15T23:29:21.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c35c1f640 1 -- 172.21.15.131:0/53384311 learned_addr learned my addr 172.21.15.131:0/53384311 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:21.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c35c1f640 1 -- 172.21.15.131:0/53384311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20009420 con 0x7f9c30098830 2024-02-15T23:29:21.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c35c1f640 1 --2- 172.21.15.131:0/53384311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30098830 0x7f9c301c5440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c3a0 tx=0x7f9c2c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:21.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c267fc640 1 -- 172.21.15.131:0/53384311 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c005c20 con 0x7f9c30098830 2024-02-15T23:29:21.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c267fc640 1 -- 172.21.15.131:0/53384311 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c005d80 con 0x7f9c30098830 2024-02-15T23:29:21.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c267fc640 1 -- 172.21.15.131:0/53384311 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c007200 con 0x7f9c30098830 2024-02-15T23:29:21.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c30072140 con 0x7f9c30098830 2024-02-15T23:29:21.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c30071270 con 0x7f9c30098830 2024-02-15T23:29:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c30071a70 con 0x7f9c30098830 2024-02-15T23:29:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c267fc640 1 -- 172.21.15.131:0/53384311 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9c2c007360 con 0x7f9c30098830 2024-02-15T23:29:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c267fc640 1 --2- 172.21.15.131:0/53384311 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9c14035a10 0x7f9c14037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.764+0000 7f9c267fc640 1 -- 172.21.15.131:0/53384311 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f9c2c047230 con 0x7f9c30098830 2024-02-15T23:29:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.768+0000 7f9c3541e640 1 --2- 172.21.15.131:0/53384311 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9c14035a10 0x7f9c14037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:21.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.768+0000 7f9c3541e640 1 --2- 172.21.15.131:0/53384311 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9c14035a10 0x7f9c14037ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c200ad000 tx=0x7f9c200a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:21.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.772+0000 7f9c267fc640 1 -- 172.21.15.131:0/53384311 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9c2c01b3b0 con 0x7f9c30098830 2024-02-15T23:29:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.964+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9c30062860 con 0x7f9c30098830 2024-02-15T23:29:21.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.968+0000 7f9c267fc640 1 -- 172.21.15.131:0/53384311 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+83334 (secure 0 0 0) 0x7f9c2c017070 con 0x7f9c30098830 2024-02-15T23:29:21.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9c14035a10 msgr2=0x7f9c14037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 --2- 172.21.15.131:0/53384311 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9c14035a10 0x7f9c14037ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c200ad000 tx=0x7f9c200a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30098830 msgr2=0x7f9c301c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 --2- 172.21.15.131:0/53384311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30098830 0x7f9c301c5440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c3a0 tx=0x7f9c2c00c860 comp rx=0 tx=0).stop 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 shutdown_connections 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 --2- 172.21.15.131:0/53384311 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9c14035a10 0x7f9c14037ed0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 --2- 172.21.15.131:0/53384311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c30098830 0x7f9c301c5440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 >> 172.21.15.131:0/53384311 conn(0x7f9c300a0920 msgr2=0x7f9c3009b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 shutdown_connections 2024-02-15T23:29:21.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:21.972+0000 7f9c37e83640 1 -- 172.21.15.131:0/53384311 wait complete. 2024-02-15T23:29:21.993 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":3499050160},{"type":"v1","addr":"172.21.15.133:6825","nonce":3499050160}]},"active_addr":"172.21.15.133:6825/3499050160","active_change":"2024-02-15T23:29:09.486388+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2318961418}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":969432889}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":3178993053}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":1225470657}]}]} 2024-02-15T23:29:21.995 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-15T23:29:21.995 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-15T23:29:21.995 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T23:29:22.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee83c0b640 1 Processor -- start 2024-02-15T23:29:22.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee83c0b640 1 -- start start 2024-02-15T23:29:22.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee83c0b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fee7c12b000 0x7fee7c12b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee83c0b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c072390 con 0x7fee7c06c3f0 2024-02-15T23:29:22.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee83c0b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c09c1e0 con 0x7fee7c12b000 2024-02-15T23:29:22.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee811a6640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fee7c06c3f0 0x7fee7c1210b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53710/0 (socket says 172.21.15.131:53710) 2024-02-15T23:29:22.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee811a6640 1 -- 172.21.15.131:0/419943916 learned_addr learned my addr 172.21.15.131:0/419943916 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:22.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee819a7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fee7c12b000 0x7fee7c12b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee809a5640 1 -- 172.21.15.131:0/419943916 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572551507 0 0) 0x7fee7c072390 con 0x7fee7c06c3f0 2024-02-15T23:29:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee809a5640 1 -- 172.21.15.131:0/419943916 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee68003530 con 0x7fee7c06c3f0 2024-02-15T23:29:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee819a7640 1 -- 172.21.15.131:0/419943916 >> v1:172.21.15.131:6789/0 conn(0x7fee7c06c3f0 legacy=0x7fee7c1210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee819a7640 1 -- 172.21.15.131:0/419943916 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c06d030 con 0x7fee7c12b000 2024-02-15T23:29:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee819a7640 1 --2- 172.21.15.131:0/419943916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c12b000 0x7fee7c12b3e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee78009740 tx=0x7fee7801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c0892459d9214b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee809a5640 1 -- 172.21.15.131:0/419943916 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee780ab530 con 0x7fee7c12b000 2024-02-15T23:29:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee809a5640 1 -- 172.21.15.131:0/419943916 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee780a7050 con 0x7fee7c12b000 2024-02-15T23:29:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.108+0000 7fee809a5640 1 -- 172.21.15.131:0/419943916 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee780ab7e0 con 0x7fee7c12b000 2024-02-15T23:29:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- 172.21.15.131:0/419943916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c12b000 msgr2=0x7fee7c12b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 --2- 172.21.15.131:0/419943916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c12b000 0x7fee7c12b3e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee78009740 tx=0x7fee7801c370 comp rx=0 tx=0).stop 2024-02-15T23:29:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- 172.21.15.131:0/419943916 shutdown_connections 2024-02-15T23:29:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 --2- 172.21.15.131:0/419943916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c12b000 0x7fee7c12b3e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- 172.21.15.131:0/419943916 >> 172.21.15.131:0/419943916 conn(0x7fee7c09a2f0 msgr2=0x7fee7c09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- 172.21.15.131:0/419943916 shutdown_connections 2024-02-15T23:29:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- 172.21.15.131:0/419943916 wait complete. 2024-02-15T23:29:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 Processor -- start 2024-02-15T23:29:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- start start 2024-02-15T23:29:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c06c3f0 0x7fee7c1c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c125bf0 con 0x7fee7c06c3f0 2024-02-15T23:29:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee819a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c06c3f0 0x7fee7c1c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee819a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c06c3f0 0x7fee7c1c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55826/0 (socket says 172.21.15.131:55826) 2024-02-15T23:29:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee819a7640 1 -- 172.21.15.131:0/2999971839 learned_addr learned my addr 172.21.15.131:0/2999971839 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee819a7640 1 -- 172.21.15.131:0/2999971839 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78009420 con 0x7fee7c06c3f0 2024-02-15T23:29:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee819a7640 1 --2- 172.21.15.131:0/2999971839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c06c3f0 0x7fee7c1c5540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fee78019fa0 tx=0x7fee7801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee727fc640 1 -- 172.21.15.131:0/2999971839 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee780b7580 con 0x7fee7c06c3f0 2024-02-15T23:29:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee727fc640 1 -- 172.21.15.131:0/2999971839 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee780b76e0 con 0x7fee7c06c3f0 2024-02-15T23:29:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee727fc640 1 -- 172.21.15.131:0/2999971839 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee780b7980 con 0x7fee7c06c3f0 2024-02-15T23:29:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c124ff0 con 0x7fee7c06c3f0 2024-02-15T23:29:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c126cd0 con 0x7fee7c06c3f0 2024-02-15T23:29:22.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c067e00 con 0x7fee7c06c3f0 2024-02-15T23:29:22.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee727fc640 1 -- 172.21.15.131:0/2999971839 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fee780b7ae0 con 0x7fee7c06c3f0 2024-02-15T23:29:22.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee727fc640 1 --2- 172.21.15.131:0/2999971839 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fee60035a10 0x7fee60037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.112+0000 7fee727fc640 1 -- 172.21.15.131:0/2999971839 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fee780e28e0 con 0x7fee7c06c3f0 2024-02-15T23:29:22.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.116+0000 7fee811a6640 1 --2- 172.21.15.131:0/2999971839 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fee60035a10 0x7fee60037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.116+0000 7fee811a6640 1 --2- 172.21.15.131:0/2999971839 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fee60035a10 0x7fee60037ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee6c007fd0 tx=0x7fee6c007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.120+0000 7fee727fc640 1 -- 172.21.15.131:0/2999971839 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fee780c78f0 con 0x7fee7c06c3f0 2024-02-15T23:29:22.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.280+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee7c062860 con 0x7fee7c06c3f0 2024-02-15T23:29:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.280+0000 7fee727fc640 1 -- 172.21.15.131:0/2999971839 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9756 (secure 0 0 0) 0x7fee780b0030 con 0x7fee7c06c3f0 2024-02-15T23:29:22.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:29:22.286 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":15,"fsid":"633d2778-ce48-4cf9-a862-869ac6a165af","created":"2024-02-15T23:29:04.739458+0000","modified":"2024-02-15T23:29:21.610906+0000","last_up_change":"2024-02-15T23:29:13.557417+0000","last_in_change":"2024-02-15T23:29:05.873641+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T23:29:15.569040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-15T23:29:20.515339+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a808640e-6008-4ec4-b6e0-4ae1c480ac33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6801","nonce":31994139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6803","nonce":31994139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6807","nonce":31994139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6805","nonce":31994139}]},"public_addr":"172.21.15.131:6801/31994139","cluster_addr":"172.21.15.131:6803/31994139","heartbeat_back_addr":"172.21.15.131:6807/31994139","heartbeat_front_addr":"172.21.15.131:6805/31994139","state":["exists","up"]},{"osd":1,"uuid":"1965c486-d2df-4b7e-bca1-3827989223e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6801","nonce":2918336019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6803","nonce":2918336019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6807","nonce":2918336019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6805","nonce":2918336019}]},"public_addr":"172.21.15.133:6801/2918336019","cluster_addr":"172.21.15.133:6803/2918336019","heartbeat_back_addr":"172.21.15.133:6807/2918336019","heartbeat_front_addr":"172.21.15.133:6805/2918336019","state":["exists","up"]},{"osd":2,"uuid":"bd677a5e-b48a-43c0-9fe4-701bb31f3331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6809","nonce":3615800201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6811","nonce":3615800201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6815","nonce":3615800201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6813","nonce":3615800201}]},"public_addr":"172.21.15.133:6809/3615800201","cluster_addr":"172.21.15.133:6811/3615800201","heartbeat_back_addr":"172.21.15.133:6815/3615800201","heartbeat_front_addr":"172.21.15.133:6813/3615800201","state":["exists","up"]},{"osd":3,"uuid":"e3b81b09-0178-420a-8d91-228e6ebabed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6817","nonce":1056376173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6819","nonce":1056376173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6823","nonce":1056376173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6821","nonce":1056376173}]},"public_addr":"172.21.15.133:6817/1056376173","cluster_addr":"172.21.15.133:6819/1056376173","heartbeat_back_addr":"172.21.15.133:6823/1056376173","heartbeat_front_addr":"172.21.15.133:6821/1056376173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.171302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.401420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.392376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:10.859549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fee60035a10 msgr2=0x7fee60037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 --2- 172.21.15.131:0/2999971839 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fee60035a10 0x7fee60037ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee6c007fd0 tx=0x7fee6c007980 comp rx=0 tx=0).stop 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c06c3f0 msgr2=0x7fee7c1c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 --2- 172.21.15.131:0/2999971839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c06c3f0 0x7fee7c1c5540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fee78019fa0 tx=0x7fee7801abb0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 shutdown_connections 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 --2- 172.21.15.131:0/2999971839 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fee60035a10 0x7fee60037ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 --2- 172.21.15.131:0/2999971839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee7c06c3f0 0x7fee7c1c5540 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 >> 172.21.15.131:0/2999971839 conn(0x7fee7c09a2f0 msgr2=0x7fee7c094180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 shutdown_connections 2024-02-15T23:29:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.284+0000 7fee83c0b640 1 -- 172.21.15.131:0/2999971839 wait complete. 2024-02-15T23:29:22.306 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-15T23:29:22.306 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T23:29:22.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.416+0000 7f6e51344640 1 Processor -- start 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.416+0000 7f6e51344640 1 -- start start 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.416+0000 7f6e51344640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e4c098910 0x7f6e4c098cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.416+0000 7f6e51344640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c099d80 con 0x7f6e4c09d7e0 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.416+0000 7f6e51344640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c09a340 con 0x7f6e4c098910 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e4affd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e4c098910 0x7f6e4c098cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e4a7fc640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6e4c09d7e0 0x7f6e4c096590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53714/0 (socket says 172.21.15.131:53714) 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e4a7fc640 1 -- 172.21.15.131:0/3353595874 learned_addr learned my addr 172.21.15.131:0/3353595874 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e4affd640 1 -- 172.21.15.131:0/3353595874 >> v1:172.21.15.131:6789/0 conn(0x7f6e4c09d7e0 legacy=0x7f6e4c096590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e4affd640 1 -- 172.21.15.131:0/3353595874 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c09a5e0 con 0x7f6e4c098910 2024-02-15T23:29:22.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e4affd640 1 --2- 172.21.15.131:0/3353595874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c098cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009740 tx=0x7f6e4401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93eed900fc18a093 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e49ffb640 1 -- 172.21.15.131:0/3353595874 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e440ac570 con 0x7f6e4c098910 2024-02-15T23:29:22.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e49ffb640 1 -- 172.21.15.131:0/3353595874 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e440ac6d0 con 0x7f6e4c098910 2024-02-15T23:29:22.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e49ffb640 1 -- 172.21.15.131:0/3353595874 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e440ac990 con 0x7f6e4c098910 2024-02-15T23:29:22.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e51344640 1 -- 172.21.15.131:0/3353595874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 msgr2=0x7f6e4c098cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e51344640 1 --2- 172.21.15.131:0/3353595874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c098cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009740 tx=0x7f6e4401c3c0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e51344640 1 -- 172.21.15.131:0/3353595874 shutdown_connections 2024-02-15T23:29:22.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e51344640 1 --2- 172.21.15.131:0/3353595874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c098cf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e51344640 1 -- 172.21.15.131:0/3353595874 >> 172.21.15.131:0/3353595874 conn(0x7f6e4c0a0a00 msgr2=0x7f6e4c09cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e51344640 1 -- 172.21.15.131:0/3353595874 shutdown_connections 2024-02-15T23:29:22.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.420+0000 7f6e51344640 1 -- 172.21.15.131:0/3353595874 wait complete. 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e51344640 1 Processor -- start 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e51344640 1 -- start start 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e51344640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c1c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e51344640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c132680 con 0x7f6e4c098910 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e4affd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c1c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e4affd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c1c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55836/0 (socket says 172.21.15.131:55836) 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e4affd640 1 -- 172.21.15.131:0/3332087652 learned_addr learned my addr 172.21.15.131:0/3332087652 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e4affd640 1 -- 172.21.15.131:0/3332087652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44009420 con 0x7f6e4c098910 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e4affd640 1 --2- 172.21.15.131:0/3332087652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c1c5ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e44019ff0 tx=0x7f6e4401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e437fe640 1 -- 172.21.15.131:0/3332087652 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e440b8580 con 0x7f6e4c098910 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e437fe640 1 -- 172.21.15.131:0/3332087652 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e440b86e0 con 0x7f6e4c098910 2024-02-15T23:29:22.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c133a00 con 0x7f6e4c098910 2024-02-15T23:29:22.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e437fe640 1 -- 172.21.15.131:0/3332087652 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e440b89a0 con 0x7f6e4c098910 2024-02-15T23:29:22.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c133780 con 0x7f6e4c098910 2024-02-15T23:29:22.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c1332b0 con 0x7f6e4c098910 2024-02-15T23:29:22.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e437fe640 1 -- 172.21.15.131:0/3332087652 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6e440b8b00 con 0x7f6e4c098910 2024-02-15T23:29:22.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e437fe640 1 --2- 172.21.15.131:0/3332087652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e2c035a60 0x7f6e2c037f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e437fe640 1 -- 172.21.15.131:0/3332087652 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6e440e2db0 con 0x7f6e4c098910 2024-02-15T23:29:22.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.424+0000 7f6e4a7fc640 1 --2- 172.21.15.131:0/3332087652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e2c035a60 0x7f6e2c037f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.428+0000 7f6e4a7fc640 1 --2- 172.21.15.131:0/3332087652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e2c035a60 0x7f6e2c037f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6e34005c10 tx=0x7f6e340016a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.428+0000 7f6e437fe640 1 -- 172.21.15.131:0/3332087652 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6e440aa980 con 0x7f6e4c098910 2024-02-15T23:29:22.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.576+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e4c06c700 con 0x7f6e4c098910 2024-02-15T23:29:22.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.576+0000 7f6e437fe640 1 -- 172.21.15.131:0/3332087652 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9756 (secure 0 0 0) 0x7f6e440bc020 con 0x7f6e4c098910 2024-02-15T23:29:22.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:29:22.585 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":15,"fsid":"633d2778-ce48-4cf9-a862-869ac6a165af","created":"2024-02-15T23:29:04.739458+0000","modified":"2024-02-15T23:29:21.610906+0000","last_up_change":"2024-02-15T23:29:13.557417+0000","last_in_change":"2024-02-15T23:29:05.873641+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T23:29:15.569040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-15T23:29:20.515339+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a808640e-6008-4ec4-b6e0-4ae1c480ac33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6801","nonce":31994139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6803","nonce":31994139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6807","nonce":31994139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6805","nonce":31994139}]},"public_addr":"172.21.15.131:6801/31994139","cluster_addr":"172.21.15.131:6803/31994139","heartbeat_back_addr":"172.21.15.131:6807/31994139","heartbeat_front_addr":"172.21.15.131:6805/31994139","state":["exists","up"]},{"osd":1,"uuid":"1965c486-d2df-4b7e-bca1-3827989223e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6801","nonce":2918336019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6803","nonce":2918336019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6807","nonce":2918336019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6805","nonce":2918336019}]},"public_addr":"172.21.15.133:6801/2918336019","cluster_addr":"172.21.15.133:6803/2918336019","heartbeat_back_addr":"172.21.15.133:6807/2918336019","heartbeat_front_addr":"172.21.15.133:6805/2918336019","state":["exists","up"]},{"osd":2,"uuid":"bd677a5e-b48a-43c0-9fe4-701bb31f3331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6809","nonce":3615800201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6811","nonce":3615800201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6815","nonce":3615800201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6813","nonce":3615800201}]},"public_addr":"172.21.15.133:6809/3615800201","cluster_addr":"172.21.15.133:6811/3615800201","heartbeat_back_addr":"172.21.15.133:6815/3615800201","heartbeat_front_addr":"172.21.15.133:6813/3615800201","state":["exists","up"]},{"osd":3,"uuid":"e3b81b09-0178-420a-8d91-228e6ebabed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6817","nonce":1056376173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6819","nonce":1056376173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6823","nonce":1056376173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6821","nonce":1056376173}]},"public_addr":"172.21.15.133:6817/1056376173","cluster_addr":"172.21.15.133:6819/1056376173","heartbeat_back_addr":"172.21.15.133:6823/1056376173","heartbeat_front_addr":"172.21.15.133:6821/1056376173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.171302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.401420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.392376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:10.859549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:29:22.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e2c035a60 msgr2=0x7f6e2c037f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 --2- 172.21.15.131:0/3332087652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e2c035a60 0x7f6e2c037f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6e34005c10 tx=0x7f6e340016a0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 msgr2=0x7f6e4c1c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 --2- 172.21.15.131:0/3332087652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c1c5ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e44019ff0 tx=0x7f6e4401ac00 comp rx=0 tx=0).stop 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 shutdown_connections 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 --2- 172.21.15.131:0/3332087652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e2c035a60 0x7f6e2c037f20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 --2- 172.21.15.131:0/3332087652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e4c098910 0x7f6e4c1c5ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 >> 172.21.15.131:0/3332087652 conn(0x7f6e4c0a0a00 msgr2=0x7f6e4c127f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 shutdown_connections 2024-02-15T23:29:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.580+0000 7f6e51344640 1 -- 172.21.15.131:0/3332087652 wait complete. 2024-02-15T23:29:22.602 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-15T23:29:22.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-15T23:29:22.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-15T23:29:22.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-15T23:29:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a7940640 1 Processor -- start 2024-02-15T23:29:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a7940640 1 -- start start 2024-02-15T23:29:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a7940640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f05a0130f90 0x7f05a0133380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a7940640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a012dc20 con 0x7f05a012e0e0 2024-02-15T23:29:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a7940640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a0098b80 con 0x7f05a0130f90 2024-02-15T23:29:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f14a5bc9640 1 Processor -- start 2024-02-15T23:29:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f14a5bc9640 1 -- start start 2024-02-15T23:29:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a4edb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f05a0130f90 0x7f05a0133380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a56dc640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f05a012e0e0 0x7f05a012e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53720/0 (socket says 172.21.15.131:53720) 2024-02-15T23:29:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a4edb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f05a0130f90 0x7f05a0133380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55848/0 (socket says 172.21.15.131:55848) 2024-02-15T23:29:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a56dc640 1 -- 172.21.15.131:0/3964579281 learned_addr learned my addr 172.21.15.131:0/3964579281 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7fed6267e640 1 Processor -- start 2024-02-15T23:29:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7fed6267e640 1 -- start start 2024-02-15T23:29:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7fcccdaab640 1 Processor -- start 2024-02-15T23:29:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7fcccdaab640 1 -- start start 2024-02-15T23:29:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a4edb640 1 -- 172.21.15.131:0/3964579281 >> v1:172.21.15.131:6789/0 conn(0x7f05a012e0e0 legacy=0x7f05a012e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f0597fff640 1 -- 172.21.15.131:0/3964579281 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860147629 0 0) 0x7f05a012dc20 con 0x7f05a012e0e0 2024-02-15T23:29:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.704+0000 7f05a4edb640 1 -- 172.21.15.131:0/3964579281 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a00720c0 con 0x7f05a0130f90 2024-02-15T23:29:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f14a5bc9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f14a0130f90 0x7f14a0133380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f14a5bc9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a012dc20 con 0x7f14a012e0e0 2024-02-15T23:29:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f14a5bc9640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a0098b80 con 0x7f14a0130f90 2024-02-15T23:29:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed6267e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed5c09a210 0x7fed5c06c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed6267e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c06c3e0 con 0x7fed5c1220c0 2024-02-15T23:29:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed6267e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c095890 con 0x7fed5c09a210 2024-02-15T23:29:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149f7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f14a012e0e0 0x7f14a012e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53732/0 (socket says 172.21.15.131:53732) 2024-02-15T23:29:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149f7fe640 1 -- 172.21.15.131:0/248709077 learned_addr learned my addr 172.21.15.131:0/248709077 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149effd640 1 --2- 172.21.15.131:0/248709077 >> v2:172.21.15.131:3300/0 conn(0x7f14a0130f90 0x7f14a0133380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fcccdaab640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fccc812db20 0x7fccc812ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fcccdaab640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc8072990 con 0x7fccc812acc0 2024-02-15T23:29:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fcccdaab640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc812b7b0 con 0x7fccc812db20 2024-02-15T23:29:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149e7fc640 1 -- 172.21.15.131:0/248709077 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660107617 0 0) 0x7f14a012dc20 con 0x7f14a012e0e0 2024-02-15T23:29:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149e7fc640 1 -- 172.21.15.131:0/248709077 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1488003530 con 0x7f14a012e0e0 2024-02-15T23:29:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed5c09a210 0x7fed5c06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149effd640 1 -- 172.21.15.131:0/248709077 >> v1:172.21.15.131:6789/0 conn(0x7f14a012e0e0 legacy=0x7f14a012e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149effd640 1 -- 172.21.15.131:0/248709077 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00720c0 con 0x7f14a0130f90 2024-02-15T23:29:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc6ffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fccc812db20 0x7fccc812ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc77fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fccc812acc0 0x7fccc812b0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53754/0 (socket says 172.21.15.131:53754) 2024-02-15T23:29:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc77fe640 1 -- 172.21.15.131:0/3128168252 learned_addr learned my addr 172.21.15.131:0/3128168252 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed5c09a210 0x7fed5c06c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55868/0 (socket says 172.21.15.131:55868) 2024-02-15T23:29:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5bfff640 1 -- 172.21.15.131:0/3014043580 learned_addr learned my addr 172.21.15.131:0/3014043580 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5bfff640 1 -- 172.21.15.131:0/3014043580 >> v1:172.21.15.131:6789/0 conn(0x7fed5c1220c0 legacy=0x7fed5c122520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5bfff640 1 -- 172.21.15.131:0/3014043580 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c06c0d0 con 0x7fed5c09a210 2024-02-15T23:29:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc6ffd640 1 -- 172.21.15.131:0/3128168252 >> v1:172.21.15.131:6789/0 conn(0x7fccc812acc0 legacy=0x7fccc812b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc6ffd640 1 -- 172.21.15.131:0/3128168252 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc812a7b0 con 0x7fccc812db20 2024-02-15T23:29:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f05a4edb640 1 --2- 172.21.15.131:0/3964579281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a0130f90 0x7f05a0133380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0590009740 tx=0x7f059001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52613d849297f0e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f0597fff640 1 -- 172.21.15.131:0/3964579281 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05900a8050 con 0x7f05a0130f90 2024-02-15T23:29:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f0597fff640 1 -- 172.21.15.131:0/3964579281 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05900ac520 con 0x7f05a0130f90 2024-02-15T23:29:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f0597fff640 1 -- 172.21.15.131:0/3964579281 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05900ac7e0 con 0x7f05a0130f90 2024-02-15T23:29:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149effd640 1 --2- 172.21.15.131:0/248709077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a0130f90 0x7f14a0133380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1494009740 tx=0x7f149401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4722332d10142192 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5bfff640 1 --2- 172.21.15.131:0/3014043580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c06c830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0097f0 tx=0x7fed4c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dca5f4d8b4691e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc6ffd640 1 --2- 172.21.15.131:0/3128168252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812db20 0x7fccc812ff10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009d90 tx=0x7fccb401eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136c013c61daa690 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149e7fc640 1 -- 172.21.15.131:0/248709077 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1494004160 con 0x7f14a0130f90 2024-02-15T23:29:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f05a7940640 1 -- 172.21.15.131:0/3964579281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a0130f90 msgr2=0x7f05a0133380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f05a7940640 1 --2- 172.21.15.131:0/3964579281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a0130f90 0x7f05a0133380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0590009740 tx=0x7f059001c370 comp rx=0 tx=0).stop 2024-02-15T23:29:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5affd640 1 -- 172.21.15.131:0/3014043580 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4c0ab580 con 0x7fed5c09a210 2024-02-15T23:29:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5affd640 1 -- 172.21.15.131:0/3014043580 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c0ab6e0 con 0x7fed5c09a210 2024-02-15T23:29:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fed5affd640 1 -- 172.21.15.131:0/3014043580 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4c0ab9a0 con 0x7fed5c09a210 2024-02-15T23:29:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149e7fc640 1 -- 172.21.15.131:0/248709077 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14940a7050 con 0x7f14a0130f90 2024-02-15T23:29:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f149e7fc640 1 -- 172.21.15.131:0/248709077 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1494004450 con 0x7f14a0130f90 2024-02-15T23:29:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc67fc640 1 -- 172.21.15.131:0/3128168252 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccb40a7900 con 0x7fccc812db20 2024-02-15T23:29:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc67fc640 1 -- 172.21.15.131:0/3128168252 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb40a7a60 con 0x7fccc812db20 2024-02-15T23:29:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7fccc67fc640 1 -- 172.21.15.131:0/3128168252 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccb40a7d20 con 0x7fccc812db20 2024-02-15T23:29:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f05a7940640 1 -- 172.21.15.131:0/3964579281 shutdown_connections 2024-02-15T23:29:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f05a7940640 1 --2- 172.21.15.131:0/3964579281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a0130f90 0x7f05a0133380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f05a7940640 1 -- 172.21.15.131:0/3964579281 >> 172.21.15.131:0/3964579281 conn(0x7f05a009c330 msgr2=0x7f05a0071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f05a7940640 1 -- 172.21.15.131:0/3964579281 shutdown_connections 2024-02-15T23:29:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.708+0000 7f05a7940640 1 -- 172.21.15.131:0/3964579281 wait complete. 2024-02-15T23:29:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- 172.21.15.131:0/248709077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a0130f90 msgr2=0x7f14a0133380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 --2- 172.21.15.131:0/248709077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a0130f90 0x7f14a0133380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1494009740 tx=0x7f149401c330 comp rx=0 tx=0).stop 2024-02-15T23:29:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 -- 172.21.15.131:0/3014043580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 msgr2=0x7fed5c06c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- 172.21.15.131:0/248709077 shutdown_connections 2024-02-15T23:29:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 --2- 172.21.15.131:0/248709077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a0130f90 0x7f14a0133380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 --2- 172.21.15.131:0/3014043580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c06c830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0097f0 tx=0x7fed4c01c430 comp rx=0 tx=0).stop 2024-02-15T23:29:22.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- 172.21.15.131:0/248709077 >> 172.21.15.131:0/248709077 conn(0x7f14a009c330 msgr2=0x7f14a0071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 -- 172.21.15.131:0/3014043580 shutdown_connections 2024-02-15T23:29:22.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 --2- 172.21.15.131:0/3014043580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c06c830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 -- 172.21.15.131:0/3014043580 >> 172.21.15.131:0/3014043580 conn(0x7fed5c09d600 msgr2=0x7fed5c099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 -- 172.21.15.131:0/3014043580 shutdown_connections 2024-02-15T23:29:22.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 -- 172.21.15.131:0/3014043580 wait complete. 2024-02-15T23:29:22.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- 172.21.15.131:0/248709077 shutdown_connections 2024-02-15T23:29:22.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a7940640 1 Processor -- start 2024-02-15T23:29:22.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 -- 172.21.15.131:0/3128168252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812db20 msgr2=0x7fccc812ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 --2- 172.21.15.131:0/3128168252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812db20 0x7fccc812ff10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009d90 tx=0x7fccb401eaf0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a7940640 1 -- start start 2024-02-15T23:29:22.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 -- 172.21.15.131:0/3128168252 shutdown_connections 2024-02-15T23:29:22.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 --2- 172.21.15.131:0/3128168252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812db20 0x7fccc812ff10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 -- 172.21.15.131:0/3128168252 >> 172.21.15.131:0/3128168252 conn(0x7fccc809d600 msgr2=0x7fccc8099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a7940640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a012e0e0 0x7f05a01278a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a7940640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0114da0 con 0x7f05a012e0e0 2024-02-15T23:29:22.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 -- 172.21.15.131:0/3128168252 shutdown_connections 2024-02-15T23:29:22.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- 172.21.15.131:0/248709077 wait complete. 2024-02-15T23:29:22.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 Processor -- start 2024-02-15T23:29:22.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a56dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a012e0e0 0x7f05a01278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a56dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a012e0e0 0x7f05a01278a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55874/0 (socket says 172.21.15.131:55874) 2024-02-15T23:29:22.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a56dc640 1 -- 172.21.15.131:0/4220528829 learned_addr learned my addr 172.21.15.131:0/4220528829 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 Processor -- start 2024-02-15T23:29:22.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a56dc640 1 -- 172.21.15.131:0/4220528829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009420 con 0x7f05a012e0e0 2024-02-15T23:29:22.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a56dc640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a012e0e0 0x7f05a01278a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f059c00c420 tx=0x7f059c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- start start 2024-02-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a012e0e0 0x7f14a01278a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0114da0 con 0x7f14a012e0e0 2024-02-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 -- 172.21.15.131:0/3128168252 wait complete. 2024-02-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 Processor -- start 2024-02-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 -- start start 2024-02-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f0595ffb640 1 -- 172.21.15.131:0/4220528829 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059c0074d0 con 0x7f05a012e0e0 2024-02-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f0595ffb640 1 -- 172.21.15.131:0/4220528829 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c007630 con 0x7f05a012e0e0 2024-02-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f0595ffb640 1 -- 172.21.15.131:0/4220528829 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059c004960 con 0x7f05a012e0e0 2024-02-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a009bc30 con 0x7f05a012e0e0 2024-02-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f149f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a012e0e0 0x7f14a01278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f149f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a012e0e0 0x7f14a01278a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55888/0 (socket says 172.21.15.131:55888) 2024-02-15T23:29:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f149f7fe640 1 -- 172.21.15.131:0/1510456486 learned_addr learned my addr 172.21.15.131:0/1510456486 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a0127de0 con 0x7f05a012e0e0 2024-02-15T23:29:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f149f7fe640 1 -- 172.21.15.131:0/1510456486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494009420 con 0x7f14a012e0e0 2024-02-15T23:29:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 -- start start 2024-02-15T23:29:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812acc0 0x7fccc8092810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fcccdaab640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8099230 con 0x7fccc812acc0 2024-02-15T23:29:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f149f7fe640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a012e0e0 0x7f14a01278a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f149000c4d0 tx=0x7f149000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fccc77fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812acc0 0x7fccc8092810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fccc77fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812acc0 0x7fccc8092810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55906/0 (socket says 172.21.15.131:55906) 2024-02-15T23:29:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fccc77fe640 1 -- 172.21.15.131:0/3004548582 learned_addr learned my addr 172.21.15.131:0/3004548582 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14900074d0 con 0x7f14a012e0e0 2024-02-15T23:29:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490007650 con 0x7f14a012e0e0 2024-02-15T23:29:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1490004960 con 0x7f14a012e0e0 2024-02-15T23:29:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a009bc30 con 0x7f14a012e0e0 2024-02-15T23:29:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a0127de0 con 0x7f14a012e0e0 2024-02-15T23:29:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c1c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed6267e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c12c5e0 con 0x7fed5c09a210 2024-02-15T23:29:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed5bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c1c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed5bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c1c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55904/0 (socket says 172.21.15.131:55904) 2024-02-15T23:29:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed5bfff640 1 -- 172.21.15.131:0/1856630104 learned_addr learned my addr 172.21.15.131:0/1856630104 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7fed5bfff640 1 -- 172.21.15.131:0/1856630104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0094d0 con 0x7fed5c09a210 2024-02-15T23:29:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f0595ffb640 1 -- 172.21.15.131:0/4220528829 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f059c004ac0 con 0x7f05a012e0e0 2024-02-15T23:29:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f0595ffb640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0584035a10 0x7f0584037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f0595ffb640 1 -- 172.21.15.131:0/4220528829 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f059c047310 con 0x7f05a012e0e0 2024-02-15T23:29:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a7940640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7f05a0130f90 0x7f05a01302e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.712+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05a0115c10 con 0x7f05a0130f90 2024-02-15T23:29:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14a0115ea0 con 0x7f14a012e0e0 2024-02-15T23:29:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccc77fe640 1 -- 172.21.15.131:0/3004548582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4009a70 con 0x7fccc812acc0 2024-02-15T23:29:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed5bfff640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c1c3d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed4c019040 tx=0x7fed4c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccc77fe640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812acc0 0x7fccc8092810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c480 tx=0x7fccb800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f05a5edd640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7f05a0130f90 0x7f05a01302e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f05a4edb640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0584035a10 0x7f0584037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1490004ac0 con 0x7f14a012e0e0 2024-02-15T23:29:22.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f1487fff640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f148c035a10 0x7f148c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f05a5edd640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7f05a0130f90 0x7f05a01302e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f14900474d0 con 0x7f14a012e0e0 2024-02-15T23:29:22.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f1487fff640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f148c03b190 0x7f148c03d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f148c03dca0 con 0x7f148c03b190 2024-02-15T23:29:22.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f149001ad70 con 0x7f14a012e0e0 2024-02-15T23:29:22.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4c0b4600 con 0x7fed5c09a210 2024-02-15T23:29:22.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c0b4780 con 0x7fed5c09a210 2024-02-15T23:29:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4c0b4a60 con 0x7fed5c09a210 2024-02-15T23:29:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c12cf00 con 0x7fed5c09a210 2024-02-15T23:29:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c12df40 con 0x7fed5c09a210 2024-02-15T23:29:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccb8005c20 con 0x7fccc812acc0 2024-02-15T23:29:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb8005d80 con 0x7fccc812acc0 2024-02-15T23:29:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f05a4edb640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0584035a10 0x7f0584037ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f05900ae000 tx=0x7f05900a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f149effd640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f148c035a10 0x7f148c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f149ffff640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f148c03b190 0x7f148c03d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed5c12ddb0 con 0x7fed5c09a210 2024-02-15T23:29:22.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fed4c0b4bc0 con 0x7fed5c09a210 2024-02-15T23:29:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f149ffff640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f148c03b190 0x7f148c03d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7f149effd640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f148c035a10 0x7f148c037ed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14940ad000 tx=0x7f14940a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fed48035a10 0x7fed48037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc8097560 con 0x7fccc812acc0 2024-02-15T23:29:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccb80071a0 con 0x7fccc812acc0 2024-02-15T23:29:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc8122b30 con 0x7fccc812acc0 2024-02-15T23:29:22.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fed4c0e2990 con 0x7fed5c09a210 2024-02-15T23:29:22.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fed4803b190 0x7fed4803d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed4803dca0 con 0x7fed4803b190 2024-02-15T23:29:22.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed4c0bc700 con 0x7fed5c09a210 2024-02-15T23:29:22.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed5b7fe640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fed48035a10 0x7fed48037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed60c1b640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fed4803b190 0x7fed4803d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed60c1b640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fed4803b190 0x7fed4803d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccc8062860 con 0x7fccc812acc0 2024-02-15T23:29:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fccb8007300 con 0x7fccc812acc0 2024-02-15T23:29:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccbffff640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fccb0035a40 0x7fccb0037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fccb8047280 con 0x7fccc812acc0 2024-02-15T23:29:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccbffff640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7fccb003b050 0x7fccb003d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccb003db60 con 0x7fccb003b050 2024-02-15T23:29:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.716+0000 7fed5b7fe640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fed48035a10 0x7fed48037ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed50000f70 tx=0x7fed50007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.720+0000 7fccc6ffd640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fccb0035a40 0x7fccb0037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.720+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb80075b0 con 0x7fccc812acc0 2024-02-15T23:29:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.720+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fed4803dca0 con 0x7fed4803b190 2024-02-15T23:29:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.720+0000 7f0595ffb640 1 -- 172.21.15.131:0/4220528829 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f05a0115c10 con 0x7f05a0130f90 2024-02-15T23:29:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.720+0000 7fccc7fff640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7fccb003b050 0x7fccb003d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.720+0000 7fccc6ffd640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fccb0035a40 0x7fccb0037f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009d90 tx=0x7fccb40a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.720+0000 7fccc7fff640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7fccb003b050 0x7fccb003d490 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.720+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f148c03dca0 con 0x7f148c03b190 2024-02-15T23:29:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.724+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fccb003db60 con 0x7fccb003b050 2024-02-15T23:29:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05a012d740 con 0x7f05a0130f90 2024-02-15T23:29:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fed5c12c090 con 0x7fed4803b190 2024-02-15T23:29:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed58ff9640 1 -- 172.21.15.131:0/1856630104 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fed5c12c090 con 0x7fed4803b190 2024-02-15T23:29:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f0595ffb640 1 -- 172.21.15.131:0/4220528829 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05a012d740 con 0x7f05a0130f90 2024-02-15T23:29:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fed4803b190 msgr2=0x7fed4803d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fed4803b190 0x7fed4803d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fed48035a10 msgr2=0x7fed48037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fed48035a10 0x7fed48037ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed50000f70 tx=0x7fed50007a40 comp rx=0 tx=0).stop 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 msgr2=0x7fed5c1c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c1c3d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed4c019040 tx=0x7fed4c0191d0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 shutdown_connections 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fed4803b190 0x7fed4803d5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fed48035a10 0x7fed48037ed0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 --2- 172.21.15.131:0/1856630104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed5c09a210 0x7fed5c1c3d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 >> 172.21.15.131:0/1856630104 conn(0x7fed5c09d600 msgr2=0x7fed5c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7f05a0130f90 msgr2=0x7f05a01302e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7f05a0130f90 0x7f05a01302e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 shutdown_connections 2024-02-15T23:29:22.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7fed6267e640 1 -- 172.21.15.131:0/1856630104 wait complete. 2024-02-15T23:29:22.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0584035a10 msgr2=0x7f0584037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0584035a10 0x7f0584037ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f05900ae000 tx=0x7f05900a7000 comp rx=0 tx=0).stop 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a012e0e0 msgr2=0x7f05a01278a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a012e0e0 0x7f05a01278a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f059c00c420 tx=0x7f059c00c8e0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 shutdown_connections 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7f05a0130f90 0x7f05a01302e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0584035a10 0x7f0584037ed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 --2- 172.21.15.131:0/4220528829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a012e0e0 0x7f05a01278a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 >> 172.21.15.131:0/4220528829 conn(0x7f05a009c330 msgr2=0x7f05a012fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14a0115c10 con 0x7f148c03b190 2024-02-15T23:29:22.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 shutdown_connections 2024-02-15T23:29:22.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.732+0000 7f05a7940640 1 -- 172.21.15.131:0/4220528829 wait complete. 2024-02-15T23:29:22.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f1487fff640 1 -- 172.21.15.131:0/1510456486 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14a0115c10 con 0x7f148c03b190 2024-02-15T23:29:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f148c03b190 msgr2=0x7f148c03d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f148c03b190 0x7f148c03d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f148c035a10 msgr2=0x7f148c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f148c035a10 0x7f148c037ed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14940ad000 tx=0x7f14940a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a012e0e0 msgr2=0x7f14a01278a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a012e0e0 0x7f14a01278a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f149000c4d0 tx=0x7f149000c990 comp rx=0 tx=0).stop 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 shutdown_connections 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f148c03b190 0x7f148c03d5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f148c035a10 0x7f148c037ed0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 --2- 172.21.15.131:0/1510456486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14a012e0e0 0x7f14a01278a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 >> 172.21.15.131:0/1510456486 conn(0x7f14a009c330 msgr2=0x7f14a012fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 shutdown_connections 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7f14a5bc9640 1 -- 172.21.15.131:0/1510456486 wait complete. 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fccc8072110 con 0x7fccb003b050 2024-02-15T23:29:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7fccbffff640 1 -- 172.21.15.131:0/3004548582 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fccc8072110 con 0x7fccb003b050 2024-02-15T23:29:22.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7fccb003b050 msgr2=0x7fccb003d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7fcccdaab640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7fccb003b050 0x7fccb003d490 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fccb0035a40 msgr2=0x7fccb0037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.736+0000 7fcccdaab640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fccb0035a40 0x7fccb0037f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009d90 tx=0x7fccb40a9070 comp rx=0 tx=0).stop 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812acc0 msgr2=0x7fccc8092810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812acc0 0x7fccc8092810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c480 tx=0x7fccb800c940 comp rx=0 tx=0).stop 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 shutdown_connections 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7fccb003b050 0x7fccb003d490 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fccb0035a40 0x7fccb0037f00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 --2- 172.21.15.131:0/3004548582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc812acc0 0x7fccc8092810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 >> 172.21.15.131:0/3004548582 conn(0x7fccc809d600 msgr2=0x7fccc8098750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 shutdown_connections 2024-02-15T23:29:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.740+0000 7fcccdaab640 1 -- 172.21.15.131:0/3004548582 wait complete. 2024-02-15T23:29:22.761 INFO:teuthology.orchestra.run.smithi131.stdout:38654705670 2024-02-15T23:29:22.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-15T23:29:22.765 INFO:teuthology.orchestra.run.smithi131.stdout:38654705669 2024-02-15T23:29:22.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-15T23:29:22.770 INFO:teuthology.orchestra.run.smithi131.stdout:38654705670 2024-02-15T23:29:22.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-15T23:29:22.771 INFO:teuthology.orchestra.run.smithi131.stdout:38654705668 2024-02-15T23:29:22.771 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-15T23:29:22.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb5e09a640 1 Processor -- start 2024-02-15T23:29:22.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb5e09a640 1 -- start start 2024-02-15T23:29:22.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb5e09a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffb5812ee50 0x7ffb58131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb5e09a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5806c0d0 con 0x7ffb5806c490 2024-02-15T23:29:22.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb5e09a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb58093fb0 con 0x7ffb5812ee50 2024-02-15T23:29:22.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb56ffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffb5812ee50 0x7ffb58131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb577fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ffb5806c490 0x7ffb5806c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53768/0 (socket says 172.21.15.131:53768) 2024-02-15T23:29:22.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb577fe640 1 -- 172.21.15.131:0/974935068 learned_addr learned my addr 172.21.15.131:0/974935068 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:22.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb56ffd640 1 -- 172.21.15.131:0/974935068 >> v1:172.21.15.131:6789/0 conn(0x7ffb5806c490 legacy=0x7ffb5806c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.860+0000 7ffb56ffd640 1 -- 172.21.15.131:0/974935068 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5806cf80 con 0x7ffb5812ee50 2024-02-15T23:29:22.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb56ffd640 1 --2- 172.21.15.131:0/974935068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5812ee50 0x7ffb58131240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009740 tx=0x7ffb4c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fbb89a9e3dc9c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb567fc640 1 -- 172.21.15.131:0/974935068 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c0ac570 con 0x7ffb5812ee50 2024-02-15T23:29:22.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb567fc640 1 -- 172.21.15.131:0/974935068 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c0ac6d0 con 0x7ffb5812ee50 2024-02-15T23:29:22.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb567fc640 1 -- 172.21.15.131:0/974935068 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c0ac990 con 0x7ffb5812ee50 2024-02-15T23:29:22.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- 172.21.15.131:0/974935068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5812ee50 msgr2=0x7ffb58131240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 --2- 172.21.15.131:0/974935068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5812ee50 0x7ffb58131240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009740 tx=0x7ffb4c01c350 comp rx=0 tx=0).stop 2024-02-15T23:29:22.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- 172.21.15.131:0/974935068 shutdown_connections 2024-02-15T23:29:22.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 --2- 172.21.15.131:0/974935068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5812ee50 0x7ffb58131240 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- 172.21.15.131:0/974935068 >> 172.21.15.131:0/974935068 conn(0x7ffb5809b1d0 msgr2=0x7ffb5809b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- 172.21.15.131:0/974935068 shutdown_connections 2024-02-15T23:29:22.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- 172.21.15.131:0/974935068 wait complete. 2024-02-15T23:29:22.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 Processor -- start 2024-02-15T23:29:22.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- start start 2024-02-15T23:29:22.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5806c490 0x7ffb5812a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb581235e0 con 0x7ffb5806c490 2024-02-15T23:29:22.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb577fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5806c490 0x7ffb5812a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb577fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5806c490 0x7ffb5812a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55934/0 (socket says 172.21.15.131:55934) 2024-02-15T23:29:22.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb577fe640 1 -- 172.21.15.131:0/3954154774 learned_addr learned my addr 172.21.15.131:0/3954154774 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb577fe640 1 -- 172.21.15.131:0/3954154774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c009420 con 0x7ffb5806c490 2024-02-15T23:29:22.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb577fe640 1 --2- 172.21.15.131:0/3954154774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5806c490 0x7ffb5812a730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c480 tx=0x7ffb4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb3ffff640 1 -- 172.21.15.131:0/3954154774 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb48005c20 con 0x7ffb5806c490 2024-02-15T23:29:22.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb3ffff640 1 -- 172.21.15.131:0/3954154774 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48005d80 con 0x7ffb5806c490 2024-02-15T23:29:22.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb3ffff640 1 -- 172.21.15.131:0/3954154774 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb480071a0 con 0x7ffb5806c490 2024-02-15T23:29:22.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb58072660 con 0x7ffb5806c490 2024-02-15T23:29:22.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.864+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb58123990 con 0x7ffb5806c490 2024-02-15T23:29:22.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.868+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb58062860 con 0x7ffb5806c490 2024-02-15T23:29:22.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.868+0000 7ffb3ffff640 1 -- 172.21.15.131:0/3954154774 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffb48007300 con 0x7ffb5806c490 2024-02-15T23:29:22.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.868+0000 7ffb3ffff640 1 --2- 172.21.15.131:0/3954154774 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ffb44035a10 0x7ffb44037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.868+0000 7ffb3ffff640 1 -- 172.21.15.131:0/3954154774 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ffb480471b0 con 0x7ffb5806c490 2024-02-15T23:29:22.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.868+0000 7ffb56ffd640 1 --2- 172.21.15.131:0/3954154774 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ffb44035a10 0x7ffb44037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.868+0000 7ffb56ffd640 1 --2- 172.21.15.131:0/3954154774 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ffb44035a10 0x7ffb44037ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0ae000 tx=0x7ffb4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.876+0000 7ffb3ffff640 1 -- 172.21.15.131:0/3954154774 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffb480075b0 con 0x7ffb5806c490 2024-02-15T23:29:22.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37c092b640 1 Processor -- start 2024-02-15T23:29:22.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37c092b640 1 -- start start 2024-02-15T23:29:22.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37c092b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37bc098b30 0x7f37bc1336f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37c092b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc09a6d0 con 0x7f37bc098040 2024-02-15T23:29:22.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37b9d9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37bc098b30 0x7f37bc1336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37ba59c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f37bc098040 0x7f37bc098420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53784/0 (socket says 172.21.15.131:53784) 2024-02-15T23:29:22.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37ba59c640 1 -- 172.21.15.131:0/760633861 learned_addr learned my addr 172.21.15.131:0/760633861 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:22.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37c092b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc09a3c0 con 0x7f37bc098b30 2024-02-15T23:29:22.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37b9d9b640 1 -- 172.21.15.131:0/760633861 >> v1:172.21.15.131:6789/0 conn(0x7f37bc098040 legacy=0x7f37bc098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37b959a640 1 -- 172.21.15.131:0/760633861 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555751309 0 0) 0x7f37bc09a6d0 con 0x7f37bc098040 2024-02-15T23:29:22.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7f37b9d9b640 1 -- 172.21.15.131:0/760633861 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc099810 con 0x7f37bc098b30 2024-02-15T23:29:22.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf981e640 1 Processor -- start 2024-02-15T23:29:22.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf981e640 1 -- start start 2024-02-15T23:29:22.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf981e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efcf4071870 0x7efcf406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf981e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf409d7f0 con 0x7efcf406d050 2024-02-15T23:29:22.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf981e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf406e0d0 con 0x7efcf4071870 2024-02-15T23:29:22.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf2ffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efcf4071870 0x7efcf406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf27fc640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efcf406d050 0x7efcf406d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53788/0 (socket says 172.21.15.131:53788) 2024-02-15T23:29:22.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf2ffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efcf4071870 0x7efcf406cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55962/0 (socket says 172.21.15.131:55962) 2024-02-15T23:29:22.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf27fc640 1 -- 172.21.15.131:0/1737927529 learned_addr learned my addr 172.21.15.131:0/1737927529 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:22.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf2ffd640 1 -- 172.21.15.131:0/1737927529 >> v1:172.21.15.131:6789/0 conn(0x7efcf406d050 legacy=0x7efcf406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.912+0000 7efcf2ffd640 1 -- 172.21.15.131:0/1737927529 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4066bf0 con 0x7efcf4071870 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37b9d9b640 1 --2- 172.21.15.131:0/760633861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098b30 0x7f37bc1336f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009740 tx=0x7f37b001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777b9d14cb1ee9e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37b959a640 1 -- 172.21.15.131:0/760633861 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37b00ab530 con 0x7f37bc098b30 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37b959a640 1 -- 172.21.15.131:0/760633861 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b00a7050 con 0x7f37bc098b30 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37b959a640 1 -- 172.21.15.131:0/760633861 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37b00ab7e0 con 0x7f37bc098b30 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 -- 172.21.15.131:0/760633861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098b30 msgr2=0x7f37bc1336f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 --2- 172.21.15.131:0/760633861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098b30 0x7f37bc1336f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009740 tx=0x7f37b001c370 comp rx=0 tx=0).stop 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 -- 172.21.15.131:0/760633861 shutdown_connections 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 --2- 172.21.15.131:0/760633861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098b30 0x7f37bc1336f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 -- 172.21.15.131:0/760633861 >> 172.21.15.131:0/760633861 conn(0x7f37bc09e870 msgr2=0x7f37bc09ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 -- 172.21.15.131:0/760633861 shutdown_connections 2024-02-15T23:29:22.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 -- 172.21.15.131:0/760633861 wait complete. 2024-02-15T23:29:22.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf2ffd640 1 --2- 172.21.15.131:0/1737927529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf4071870 0x7efcf406cb10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efce4009740 tx=0x7efce401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211194690e074692 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf1ffb640 1 -- 172.21.15.131:0/1737927529 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efce40ab530 con 0x7efcf4071870 2024-02-15T23:29:22.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf1ffb640 1 -- 172.21.15.131:0/1737927529 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce40a7050 con 0x7efcf4071870 2024-02-15T23:29:22.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf1ffb640 1 -- 172.21.15.131:0/1737927529 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efce40ab7e0 con 0x7efcf4071870 2024-02-15T23:29:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 Processor -- start 2024-02-15T23:29:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 -- start start 2024-02-15T23:29:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098040 0x7f37bc091260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37c092b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc093870 con 0x7f37bc098040 2024-02-15T23:29:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37ba59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098040 0x7f37bc091260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf981e640 1 -- 172.21.15.131:0/1737927529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf4071870 msgr2=0x7efcf406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf981e640 1 --2- 172.21.15.131:0/1737927529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf4071870 0x7efcf406cb10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efce4009740 tx=0x7efce401c370 comp rx=0 tx=0).stop 2024-02-15T23:29:22.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37ba59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098040 0x7f37bc091260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55970/0 (socket says 172.21.15.131:55970) 2024-02-15T23:29:22.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37ba59c640 1 -- 172.21.15.131:0/2270542838 learned_addr learned my addr 172.21.15.131:0/2270542838 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf981e640 1 -- 172.21.15.131:0/1737927529 shutdown_connections 2024-02-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf981e640 1 --2- 172.21.15.131:0/1737927529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf4071870 0x7efcf406cb10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf981e640 1 -- 172.21.15.131:0/1737927529 >> 172.21.15.131:0/1737927529 conn(0x7efcf409c8e0 msgr2=0x7efcf409ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf981e640 1 -- 172.21.15.131:0/1737927529 shutdown_connections 2024-02-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf981e640 1 -- 172.21.15.131:0/1737927529 wait complete. 2024-02-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37ba59c640 1 -- 172.21.15.131:0/2270542838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0009420 con 0x7f37bc098040 2024-02-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37ba59c640 1 --2- 172.21.15.131:0/2270542838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098040 0x7f37bc091260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c400 tx=0x7f37ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37aaffd640 1 -- 172.21.15.131:0/2270542838 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37ac007410 con 0x7f37bc098040 2024-02-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37aaffd640 1 -- 172.21.15.131:0/2270542838 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac007570 con 0x7f37bc098040 2024-02-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7f37aaffd640 1 -- 172.21.15.131:0/2270542838 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37ac0047f0 con 0x7f37bc098040 2024-02-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.916+0000 7efcf981e640 1 Processor -- start 2024-02-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf981e640 1 -- start start 2024-02-15T23:29:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc092dd0 con 0x7f37bc098040 2024-02-15T23:29:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc092b00 con 0x7f37bc098040 2024-02-15T23:29:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf981e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf406d050 0x7efcf41226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf981e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4125d30 con 0x7efcf406d050 2024-02-15T23:29:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf2ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf406d050 0x7efcf41226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf2ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf406d050 0x7efcf41226a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55978/0 (socket says 172.21.15.131:55978) 2024-02-15T23:29:22.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf2ffd640 1 -- 172.21.15.131:0/4090367867 learned_addr learned my addr 172.21.15.131:0/4090367867 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf2ffd640 1 -- 172.21.15.131:0/4090367867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009420 con 0x7efcf406d050 2024-02-15T23:29:22.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7f37aaffd640 1 -- 172.21.15.131:0/2270542838 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f37ac004950 con 0x7f37bc098040 2024-02-15T23:29:22.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7f37aaffd640 1 --2- 172.21.15.131:0/2270542838 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f379c035a10 0x7f379c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7f37aaffd640 1 -- 172.21.15.131:0/2270542838 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f37ac047b60 con 0x7f37bc098040 2024-02-15T23:29:22.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf2ffd640 1 --2- 172.21.15.131:0/4090367867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf406d050 0x7efcf41226a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efce4019fa0 tx=0x7efce401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcdbfff640 1 -- 172.21.15.131:0/4090367867 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efce40b7580 con 0x7efcf406d050 2024-02-15T23:29:22.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcdbfff640 1 -- 172.21.15.131:0/4090367867 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce40b76e0 con 0x7efcf406d050 2024-02-15T23:29:22.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcdbfff640 1 -- 172.21.15.131:0/4090367867 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efce40b7980 con 0x7efcf406d050 2024-02-15T23:29:22.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf4070920 con 0x7efcf406d050 2024-02-15T23:29:22.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc062860 con 0x7f37bc098040 2024-02-15T23:29:22.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf41258f0 con 0x7efcf406d050 2024-02-15T23:29:22.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7f37b9d9b640 1 --2- 172.21.15.131:0/2270542838 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f379c035a10 0x7f379c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7122b8640 1 Processor -- start 2024-02-15T23:29:22.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7122b8640 1 -- start start 2024-02-15T23:29:22.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7f37b9d9b640 1 --2- 172.21.15.131:0/2270542838 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f379c035a10 0x7f379c037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37b00ad000 tx=0x7f37b00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7122b8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff704019a60 0x7ff704019e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7122b8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70401bc70 con 0x7ff7040b8900 2024-02-15T23:29:22.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7122b8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70401ba50 con 0x7ff704019a60 2024-02-15T23:29:22.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7112b6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff704019a60 0x7ff704019e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7112b6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff704019a60 0x7ff704019e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55982/0 (socket says 172.21.15.131:55982) 2024-02-15T23:29:22.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7112b6640 1 -- 172.21.15.131:0/1626756947 learned_addr learned my addr 172.21.15.131:0/1626756947 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf4125e70 con 0x7efcf406d050 2024-02-15T23:29:22.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7112b6640 1 -- 172.21.15.131:0/1626756947 >> v1:172.21.15.131:6789/0 conn(0x7ff7040b8900 legacy=0x7ff7040b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-15T23:29:22.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.920+0000 7ff7112b6640 1 -- 172.21.15.131:0/1626756947 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff704006b40 con 0x7ff704019a60 2024-02-15T23:29:22.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.924+0000 7ff7112b6640 1 --2- 172.21.15.131:0/1626756947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704019e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7080097f0 tx=0x7ff70801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf57eb854d1c869 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.924+0000 7f37aaffd640 1 -- 172.21.15.131:0/2270542838 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f37ac004e30 con 0x7f37bc098040 2024-02-15T23:29:22.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff703fff640 1 -- 172.21.15.131:0/1626756947 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7080ab410 con 0x7ff704019a60 2024-02-15T23:29:22.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff703fff640 1 -- 172.21.15.131:0/1626756947 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7080ab570 con 0x7ff704019a60 2024-02-15T23:29:22.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff703fff640 1 -- 172.21.15.131:0/1626756947 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7080ab830 con 0x7ff704019a60 2024-02-15T23:29:22.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7efcdbfff640 1 -- 172.21.15.131:0/4090367867 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efce40b7ae0 con 0x7efcf406d050 2024-02-15T23:29:22.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7efcdbfff640 1 --2- 172.21.15.131:0/4090367867 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efce0035a10 0x7efce0037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7efcdbfff640 1 -- 172.21.15.131:0/4090367867 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7efce40e2a70 con 0x7efcf406d050 2024-02-15T23:29:22.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 -- 172.21.15.131:0/1626756947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 msgr2=0x7ff704019e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:22.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 --2- 172.21.15.131:0/1626756947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704019e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7080097f0 tx=0x7ff70801c3f0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7efcf27fc640 1 --2- 172.21.15.131:0/4090367867 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efce0035a10 0x7efce0037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 -- 172.21.15.131:0/1626756947 shutdown_connections 2024-02-15T23:29:22.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 --2- 172.21.15.131:0/1626756947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704019e40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:22.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 -- 172.21.15.131:0/1626756947 >> 172.21.15.131:0/1626756947 conn(0x7ff7040059f0 msgr2=0x7ff704005dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:22.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 -- 172.21.15.131:0/1626756947 shutdown_connections 2024-02-15T23:29:22.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 -- 172.21.15.131:0/1626756947 wait complete. 2024-02-15T23:29:22.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7efcf27fc640 1 --2- 172.21.15.131:0/4090367867 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efce0035a10 0x7efce0037ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efce8001610 tx=0x7efce8007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 Processor -- start 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.928+0000 7ff7122b8640 1 -- start start 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7122b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704014300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7122b8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040b1980 con 0x7ff704019a60 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7112b6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704014300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7112b6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704014300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55986/0 (socket says 172.21.15.131:55986) 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7112b6640 1 -- 172.21.15.131:0/1057569300 learned_addr learned my addr 172.21.15.131:0/1057569300 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7112b6640 1 -- 172.21.15.131:0/1057569300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7080094d0 con 0x7ff704019a60 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7112b6640 1 --2- 172.21.15.131:0/1057569300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704014300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7080ad040 tx=0x7ff70801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff701ffb640 1 -- 172.21.15.131:0/1057569300 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7080b4600 con 0x7ff704019a60 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7122b8640 1 -- 172.21.15.131:0/1057569300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff704018b00 con 0x7ff704019a60 2024-02-15T23:29:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff701ffb640 1 -- 172.21.15.131:0/1057569300 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7080b4760 con 0x7ff704019a60 2024-02-15T23:29:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7efcdbfff640 1 -- 172.21.15.131:0/4090367867 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efce40bf9a0 con 0x7efcf406d050 2024-02-15T23:29:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff701ffb640 1 -- 172.21.15.131:0/1057569300 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7080b4a00 con 0x7ff704019a60 2024-02-15T23:29:22.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff701ffb640 1 -- 172.21.15.131:0/1057569300 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff7080b4b60 con 0x7ff704019a60 2024-02-15T23:29:22.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff701ffb640 1 --2- 172.21.15.131:0/1057569300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff6f00359c0 0x7ff6f0037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:22.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff7122b8640 1 -- 172.21.15.131:0/1057569300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7040b2220 con 0x7ff704019a60 2024-02-15T23:29:22.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff710ab5640 1 --2- 172.21.15.131:0/1057569300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff6f00359c0 0x7ff6f0037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:22.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff710ab5640 1 --2- 172.21.15.131:0/1057569300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff6f00359c0 0x7ff6f0037e80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0015a0 tx=0x7ff6fc007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:22.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff701ffb640 1 -- 172.21.15.131:0/1057569300 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff7080b3dc0 con 0x7ff704019a60 2024-02-15T23:29:22.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.932+0000 7ff6ef7fe640 1 -- 172.21.15.131:0/1057569300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e8005090 con 0x7ff704019a60 2024-02-15T23:29:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:22.940+0000 7ff701ffb640 1 -- 172.21.15.131:0/1057569300 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7080bd390 con 0x7ff704019a60 2024-02-15T23:29:23.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb58073100 con 0x7ffb5806c490 2024-02-15T23:29:23.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb3ffff640 1 -- 172.21.15.131:0/3954154774 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb48017030 con 0x7ffb5806c490 2024-02-15T23:29:23.062 INFO:teuthology.orchestra.run.smithi131.stdout:38654705669 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ffb44035a10 msgr2=0x7ffb44037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 --2- 172.21.15.131:0/3954154774 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ffb44035a10 0x7ffb44037ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0ae000 tx=0x7ffb4c008040 comp rx=0 tx=0).stop 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5806c490 msgr2=0x7ffb5812a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 --2- 172.21.15.131:0/3954154774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5806c490 0x7ffb5812a730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c480 tx=0x7ffb4800c940 comp rx=0 tx=0).stop 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 shutdown_connections 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 --2- 172.21.15.131:0/3954154774 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ffb44035a10 0x7ffb44037ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 --2- 172.21.15.131:0/3954154774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5806c490 0x7ffb5812a730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 >> 172.21.15.131:0/3954154774 conn(0x7ffb5809b1d0 msgr2=0x7ffb5812cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 shutdown_connections 2024-02-15T23:29:23.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.056+0000 7ffb5e09a640 1 -- 172.21.15.131:0/3954154774 wait complete. 2024-02-15T23:29:23.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.3 2024-02-15T23:29:23.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37bc073100 con 0x7f37bc098040 2024-02-15T23:29:23.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37aaffd640 1 -- 172.21.15.131:0/2270542838 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37ac011e80 con 0x7f37bc098040 2024-02-15T23:29:23.093 INFO:teuthology.orchestra.run.smithi131.stdout:38654705668 2024-02-15T23:29:23.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f379c035a10 msgr2=0x7f379c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:23.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 --2- 172.21.15.131:0/2270542838 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f379c035a10 0x7f379c037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37b00ad000 tx=0x7f37b00a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:23.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098040 msgr2=0x7f37bc091260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:23.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 --2- 172.21.15.131:0/2270542838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098040 0x7f37bc091260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c400 tx=0x7f37ac00c8c0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 shutdown_connections 2024-02-15T23:29:23.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 --2- 172.21.15.131:0/2270542838 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f379c035a10 0x7f379c037ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 --2- 172.21.15.131:0/2270542838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37bc098040 0x7f37bc091260 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 >> 172.21.15.131:0/2270542838 conn(0x7f37bc09e870 msgr2=0x7f37bc09af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:23.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 shutdown_connections 2024-02-15T23:29:23.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.088+0000 7f37c092b640 1 -- 172.21.15.131:0/2270542838 wait complete. 2024-02-15T23:29:23.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efcf4070920 con 0x7efcf406d050 2024-02-15T23:29:23.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcdbfff640 1 -- 172.21.15.131:0/4090367867 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efcf4070920 con 0x7efcf406d050 2024-02-15T23:29:23.097 INFO:teuthology.orchestra.run.smithi131.stdout:38654705667 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efce0035a10 msgr2=0x7efce0037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 --2- 172.21.15.131:0/4090367867 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efce0035a10 0x7efce0037ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efce8001610 tx=0x7efce8007ad0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf406d050 msgr2=0x7efcf41226a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 --2- 172.21.15.131:0/4090367867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf406d050 0x7efcf41226a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efce4019fa0 tx=0x7efce401abb0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 shutdown_connections 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 --2- 172.21.15.131:0/4090367867 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efce0035a10 0x7efce0037ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 --2- 172.21.15.131:0/4090367867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcf406d050 0x7efcf41226a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 >> 172.21.15.131:0/4090367867 conn(0x7efcf409c8e0 msgr2=0x7efcf4090420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 shutdown_connections 2024-02-15T23:29:23.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.092+0000 7efcf981e640 1 -- 172.21.15.131:0/4090367867 wait complete. 2024-02-15T23:29:23.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-02-15T23:29:23.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.108+0000 7ff6ef7fe640 1 -- 172.21.15.131:0/1057569300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff6e8005610 con 0x7ff704019a60 2024-02-15T23:29:23.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.108+0000 7ff701ffb640 1 -- 172.21.15.131:0/1057569300 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7080aa370 con 0x7ff704019a60 2024-02-15T23:29:23.114 INFO:teuthology.orchestra.run.smithi131.stdout:38654705669 2024-02-15T23:29:23.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2024-02-15T23:29:23.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 -- 172.21.15.131:0/1057569300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff6f00359c0 msgr2=0x7ff6f0037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:23.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 --2- 172.21.15.131:0/1057569300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff6f00359c0 0x7ff6f0037e80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0015a0 tx=0x7ff6fc007a20 comp rx=0 tx=0).stop 2024-02-15T23:29:23.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 -- 172.21.15.131:0/1057569300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 msgr2=0x7ff704014300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:23.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 --2- 172.21.15.131:0/1057569300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704014300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7080ad040 tx=0x7ff70801ac30 comp rx=0 tx=0).stop 2024-02-15T23:29:23.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 -- 172.21.15.131:0/1057569300 shutdown_connections 2024-02-15T23:29:23.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 --2- 172.21.15.131:0/1057569300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff6f00359c0 0x7ff6f0037e80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 --2- 172.21.15.131:0/1057569300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff704019a60 0x7ff704014300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:23.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 -- 172.21.15.131:0/1057569300 >> 172.21.15.131:0/1057569300 conn(0x7ff7040059f0 msgr2=0x7ff70401df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:23.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 -- 172.21.15.131:0/1057569300 shutdown_connections 2024-02-15T23:29:23.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:23.112+0000 7ff6ef7fe640 1 -- 172.21.15.131:0/1057569300 wait complete. 2024-02-15T23:29:23.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-02-15T23:29:24.079 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-15T23:29:24.115 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-15T23:29:24.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-15T23:29:24.132 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-15T23:29:24.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaac835640 1 Processor -- start 2024-02-15T23:29:24.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaac835640 1 -- start start 2024-02-15T23:29:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaac835640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdaa81220c0 0x7fdaa81224a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaac835640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa8096240 con 0x7fdaa81229e0 2024-02-15T23:29:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaac835640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa8095900 con 0x7fdaa81220c0 2024-02-15T23:29:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaa5d9b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fdaa81229e0 0x7fdaa8093090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53804/0 (socket says 172.21.15.131:53804) 2024-02-15T23:29:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaa5d9b640 1 -- 172.21.15.131:0/1665460022 learned_addr learned my addr 172.21.15.131:0/1665460022 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaa659c640 1 --2- 172.21.15.131:0/1665460022 >> v2:172.21.15.131:3300/0 conn(0x7fdaa81220c0 0x7fdaa81224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaa559a640 1 -- 172.21.15.131:0/1665460022 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991933216 0 0) 0x7fdaa8096240 con 0x7fdaa81229e0 2024-02-15T23:29:24.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaa559a640 1 -- 172.21.15.131:0/1665460022 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda90003530 con 0x7fdaa81229e0 2024-02-15T23:29:24.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaa659c640 1 -- 172.21.15.131:0/1665460022 >> v1:172.21.15.131:6789/0 conn(0x7fdaa81229e0 legacy=0x7fdaa8093090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.200+0000 7fdaa659c640 1 -- 172.21.15.131:0/1665460022 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa809a4d0 con 0x7fdaa81220c0 2024-02-15T23:29:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.204+0000 7fdaa659c640 1 --2- 172.21.15.131:0/1665460022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81220c0 0x7fdaa81224a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda98009740 tx=0x7fda9801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed34cec197148de2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.204+0000 7fdaa559a640 1 -- 172.21.15.131:0/1665460022 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda980ab530 con 0x7fdaa81220c0 2024-02-15T23:29:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.204+0000 7fdaa559a640 1 -- 172.21.15.131:0/1665460022 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda980a7050 con 0x7fdaa81220c0 2024-02-15T23:29:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.204+0000 7fdaa559a640 1 -- 172.21.15.131:0/1665460022 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda980ab7e0 con 0x7fdaa81220c0 2024-02-15T23:29:24.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.204+0000 7fdaac835640 1 -- 172.21.15.131:0/1665460022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81220c0 msgr2=0x7fdaa81224a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.204+0000 7fdaac835640 1 --2- 172.21.15.131:0/1665460022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81220c0 0x7fdaa81224a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda98009740 tx=0x7fda9801c370 comp rx=0 tx=0).stop 2024-02-15T23:29:24.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 -- 172.21.15.131:0/1665460022 shutdown_connections 2024-02-15T23:29:24.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 --2- 172.21.15.131:0/1665460022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81220c0 0x7fdaa81224a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 -- 172.21.15.131:0/1665460022 >> 172.21.15.131:0/1665460022 conn(0x7fdaa809d600 msgr2=0x7fdaa8099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 -- 172.21.15.131:0/1665460022 shutdown_connections 2024-02-15T23:29:24.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 -- 172.21.15.131:0/1665460022 wait complete. 2024-02-15T23:29:24.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 Processor -- start 2024-02-15T23:29:24.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 -- start start 2024-02-15T23:29:24.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81229e0 0x7fdaa81c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa808b250 con 0x7fdaa81229e0 2024-02-15T23:29:24.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaa659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81229e0 0x7fdaa81c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaa659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81229e0 0x7fdaa81c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55998/0 (socket says 172.21.15.131:55998) 2024-02-15T23:29:24.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaa659c640 1 -- 172.21.15.131:0/2608330604 learned_addr learned my addr 172.21.15.131:0/2608330604 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:24.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaa659c640 1 -- 172.21.15.131:0/2608330604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98009420 con 0x7fdaa81229e0 2024-02-15T23:29:24.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaa659c640 1 --2- 172.21.15.131:0/2608330604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81229e0 0x7fdaa81c3560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda98019fa0 tx=0x7fda9801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fda96ffd640 1 -- 172.21.15.131:0/2608330604 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda980abcc0 con 0x7fdaa81229e0 2024-02-15T23:29:24.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fda96ffd640 1 -- 172.21.15.131:0/2608330604 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda980abe20 con 0x7fdaa81229e0 2024-02-15T23:29:24.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa8095f30 con 0x7fdaa81229e0 2024-02-15T23:29:24.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fda96ffd640 1 -- 172.21.15.131:0/2608330604 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda980b75a0 con 0x7fdaa81229e0 2024-02-15T23:29:24.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.208+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa8131a00 con 0x7fdaa81229e0 2024-02-15T23:29:24.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.212+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa8062860 con 0x7fdaa81229e0 2024-02-15T23:29:24.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.212+0000 7fda96ffd640 1 -- 172.21.15.131:0/2608330604 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fda980b7700 con 0x7fdaa81229e0 2024-02-15T23:29:24.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.212+0000 7fda96ffd640 1 --2- 172.21.15.131:0/2608330604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda88035a10 0x7fda88037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.212+0000 7fda96ffd640 1 -- 172.21.15.131:0/2608330604 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fda980e2790 con 0x7fdaa81229e0 2024-02-15T23:29:24.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.212+0000 7fdaa5d9b640 1 --2- 172.21.15.131:0/2608330604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda88035a10 0x7fda88037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.212+0000 7fdaa5d9b640 1 --2- 172.21.15.131:0/2608330604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda88035a10 0x7fda88037ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda9c007fd0 tx=0x7fda9c007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.216+0000 7fda96ffd640 1 -- 172.21.15.131:0/2608330604 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fda980c8740 con 0x7fdaa81229e0 2024-02-15T23:29:24.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77db78b640 1 Processor -- start 2024-02-15T23:29:24.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77db78b640 1 -- start start 2024-02-15T23:29:24.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77db78b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f77d41274e0 0x7f77d41278c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77db78b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40975d0 con 0x7f77d4127e00 2024-02-15T23:29:24.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77db78b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d4096710 con 0x7f77d41274e0 2024-02-15T23:29:24.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77d9527640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f77d41274e0 0x7f77d41278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77d9527640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f77d41274e0 0x7f77d41278c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56006/0 (socket says 172.21.15.131:56006) 2024-02-15T23:29:24.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77d9527640 1 -- 172.21.15.131:0/521858449 learned_addr learned my addr 172.21.15.131:0/521858449 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:24.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77d9527640 1 -- 172.21.15.131:0/521858449 >> v1:172.21.15.131:6789/0 conn(0x7f77d4127e00 legacy=0x7f77d412a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.236+0000 7f77d9527640 1 -- 172.21.15.131:0/521858449 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4097330 con 0x7f77d41274e0 2024-02-15T23:29:24.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72b2761640 1 Processor -- start 2024-02-15T23:29:24.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72b2761640 1 -- start start 2024-02-15T23:29:24.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72b2761640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72ac12eaf0 0x7f72ac133100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72b2761640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac12dde0 con 0x7f72ac12e000 2024-02-15T23:29:24.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72b2761640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac09ced0 con 0x7f72ac12eaf0 2024-02-15T23:29:24.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72ab7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72ac12eaf0 0x7f72ac133100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72abfff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f72ac12e000 0x7f72ac12e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53820/0 (socket says 172.21.15.131:53820) 2024-02-15T23:29:24.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72abfff640 1 -- 172.21.15.131:0/3527857007 learned_addr learned my addr 172.21.15.131:0/3527857007 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:24.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77d9527640 1 --2- 172.21.15.131:0/521858449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41278c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f77d00097f0 tx=0x7f77d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0282e6dfb8cc7b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72aaffd640 1 -- 172.21.15.131:0/3527857007 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644208812 0 0) 0x7f72ac12dde0 con 0x7f72ac12e000 2024-02-15T23:29:24.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72aaffd640 1 -- 172.21.15.131:0/3527857007 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7294003530 con 0x7f72ac12e000 2024-02-15T23:29:24.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72ab7fe640 1 -- 172.21.15.131:0/3527857007 >> v1:172.21.15.131:6789/0 conn(0x7f72ac12e000 legacy=0x7f72ac12e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f72ab7fe640 1 -- 172.21.15.131:0/3527857007 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac091bb0 con 0x7f72ac12eaf0 2024-02-15T23:29:24.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77cbfff640 1 -- 172.21.15.131:0/521858449 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d00ab530 con 0x7f77d41274e0 2024-02-15T23:29:24.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77cbfff640 1 -- 172.21.15.131:0/521858449 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00a7050 con 0x7f77d41274e0 2024-02-15T23:29:24.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77cbfff640 1 -- 172.21.15.131:0/521858449 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d00ab7e0 con 0x7f77d41274e0 2024-02-15T23:29:24.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77db78b640 1 -- 172.21.15.131:0/521858449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 msgr2=0x7f77d41278c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77db78b640 1 --2- 172.21.15.131:0/521858449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41278c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f77d00097f0 tx=0x7f77d001c430 comp rx=0 tx=0).stop 2024-02-15T23:29:24.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77db78b640 1 -- 172.21.15.131:0/521858449 shutdown_connections 2024-02-15T23:29:24.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77db78b640 1 --2- 172.21.15.131:0/521858449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41278c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.240+0000 7f77db78b640 1 -- 172.21.15.131:0/521858449 >> 172.21.15.131:0/521858449 conn(0x7f77d409d4e0 msgr2=0x7f77d409d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 -- 172.21.15.131:0/521858449 shutdown_connections 2024-02-15T23:29:24.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 -- 172.21.15.131:0/521858449 wait complete. 2024-02-15T23:29:24.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72ab7fe640 1 --2- 172.21.15.131:0/3527857007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12eaf0 0x7f72ac133100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009740 tx=0x7f72a001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb28f1778d69c6ce server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72aaffd640 1 -- 172.21.15.131:0/3527857007 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72a00ab530 con 0x7f72ac12eaf0 2024-02-15T23:29:24.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72aaffd640 1 -- 172.21.15.131:0/3527857007 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a00a7050 con 0x7f72ac12eaf0 2024-02-15T23:29:24.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72aaffd640 1 -- 172.21.15.131:0/3527857007 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72a00ab7e0 con 0x7f72ac12eaf0 2024-02-15T23:29:24.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 Processor -- start 2024-02-15T23:29:24.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 -- start start 2024-02-15T23:29:24.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 -- 172.21.15.131:0/3527857007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12eaf0 msgr2=0x7f72ac133100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 --2- 172.21.15.131:0/3527857007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12eaf0 0x7f72ac133100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009740 tx=0x7f72a001c400 comp rx=0 tx=0).stop 2024-02-15T23:29:24.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 -- 172.21.15.131:0/3527857007 shutdown_connections 2024-02-15T23:29:24.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 --2- 172.21.15.131:0/3527857007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12eaf0 0x7f72ac133100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 -- 172.21.15.131:0/3527857007 >> 172.21.15.131:0/3527857007 conn(0x7f72ac09b1d0 msgr2=0x7f72ac09b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41221a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4124a30 con 0x7f77d41274e0 2024-02-15T23:29:24.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 -- 172.21.15.131:0/3527857007 shutdown_connections 2024-02-15T23:29:24.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 -- 172.21.15.131:0/3527857007 wait complete. 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77d9527640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77d9527640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41221a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56022/0 (socket says 172.21.15.131:56022) 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77d9527640 1 -- 172.21.15.131:0/3642985713 learned_addr learned my addr 172.21.15.131:0/3642985713 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77d9527640 1 -- 172.21.15.131:0/3642985713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00094d0 con 0x7f77d41274e0 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77d9527640 1 --2- 172.21.15.131:0/3642985713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41221a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f77d0019040 tx=0x7f77d00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77c9ffb640 1 -- 172.21.15.131:0/3642985713 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d00b4440 con 0x7f77d41274e0 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77c9ffb640 1 -- 172.21.15.131:0/3642985713 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00b45a0 con 0x7f77d41274e0 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77c9ffb640 1 -- 172.21.15.131:0/3642985713 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d00b4880 con 0x7f77d41274e0 2024-02-15T23:29:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 Processor -- start 2024-02-15T23:29:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d4123430 con 0x7f77d41274e0 2024-02-15T23:29:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 -- start start 2024-02-15T23:29:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d40995e0 con 0x7f77d41274e0 2024-02-15T23:29:24.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12e000 0x7f72ac1c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72b2761640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac131a70 con 0x7f72ac12e000 2024-02-15T23:29:24.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72abfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12e000 0x7f72ac1c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72abfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12e000 0x7f72ac1c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56034/0 (socket says 172.21.15.131:56034) 2024-02-15T23:29:24.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72abfff640 1 -- 172.21.15.131:0/210798633 learned_addr learned my addr 172.21.15.131:0/210798633 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:24.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d4124b70 con 0x7f77d41274e0 2024-02-15T23:29:24.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72abfff640 1 -- 172.21.15.131:0/210798633 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0009420 con 0x7f72ac12e000 2024-02-15T23:29:24.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.244+0000 7f72abfff640 1 --2- 172.21.15.131:0/210798633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12e000 0x7f72ac1c5500 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f729c00c450 tx=0x7f729c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.248+0000 7f77c9ffb640 1 -- 172.21.15.131:0/3642985713 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f77d00b2070 con 0x7f77d41274e0 2024-02-15T23:29:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.248+0000 7f77c9ffb640 1 --2- 172.21.15.131:0/3642985713 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f77b8035a10 0x7f77b8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.248+0000 7f77c9ffb640 1 -- 172.21.15.131:0/3642985713 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f77d00e2120 con 0x7f77d41274e0 2024-02-15T23:29:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.248+0000 7f77d8d26640 1 --2- 172.21.15.131:0/3642985713 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f77b8035a10 0x7f77b8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.248+0000 7f77d8d26640 1 --2- 172.21.15.131:0/3642985713 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f77b8035a10 0x7f77b8037ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000f70 tx=0x7f77c4007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72a8ff9640 1 -- 172.21.15.131:0/210798633 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f729c005c20 con 0x7f72ac12e000 2024-02-15T23:29:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72a8ff9640 1 -- 172.21.15.131:0/210798633 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c005d80 con 0x7f72ac12e000 2024-02-15T23:29:24.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac131790 con 0x7f72ac12e000 2024-02-15T23:29:24.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72a8ff9640 1 -- 172.21.15.131:0/210798633 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f729c0071a0 con 0x7f72ac12e000 2024-02-15T23:29:24.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac130d40 con 0x7f72ac12e000 2024-02-15T23:29:24.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f77c9ffb640 1 -- 172.21.15.131:0/3642985713 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f77d00c5750 con 0x7f77d41274e0 2024-02-15T23:29:24.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac131bb0 con 0x7f72ac12e000 2024-02-15T23:29:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72a8ff9640 1 -- 172.21.15.131:0/210798633 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f729c007300 con 0x7f72ac12e000 2024-02-15T23:29:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72a8ff9640 1 --2- 172.21.15.131:0/210798633 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7298035a10 0x7f7298037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72a8ff9640 1 -- 172.21.15.131:0/210798633 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f729c0471f0 con 0x7f72ac12e000 2024-02-15T23:29:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72ab7fe640 1 --2- 172.21.15.131:0/210798633 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7298035a10 0x7f7298037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.252+0000 7f72ab7fe640 1 --2- 172.21.15.131:0/210798633 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7298035a10 0x7f7298037ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72a00ad000 tx=0x7f72a00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.260+0000 7f72a8ff9640 1 -- 172.21.15.131:0/210798633 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72ac131bb0 con 0x7f72ac12e000 2024-02-15T23:29:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f635c3f6640 1 Processor -- start 2024-02-15T23:29:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f635c3f6640 1 -- start start 2024-02-15T23:29:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f635c3f6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6354098040 0x7f6354098420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f635c3f6640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635409a6d0 con 0x7f6354098960 2024-02-15T23:29:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f635c3f6640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635409a3c0 con 0x7f6354098040 2024-02-15T23:29:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f635a192640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6354098040 0x7f6354098420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f6359991640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6354098960 0x7f63541326e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53828/0 (socket says 172.21.15.131:53828) 2024-02-15T23:29:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f6359991640 1 -- 172.21.15.131:0/1219308411 learned_addr learned my addr 172.21.15.131:0/1219308411 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:24.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f635a192640 1 -- 172.21.15.131:0/1219308411 >> v1:172.21.15.131:6789/0 conn(0x7f6354098960 legacy=0x7f63541326e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.280+0000 7f635a192640 1 -- 172.21.15.131:0/1219308411 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354099810 con 0x7f6354098040 2024-02-15T23:29:24.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635a192640 1 --2- 172.21.15.131:0/1219308411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354098420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6350009740 tx=0x7f635001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab412ce25ad19dd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f6359190640 1 -- 172.21.15.131:0/1219308411 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63500ab530 con 0x7f6354098040 2024-02-15T23:29:24.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f6359190640 1 -- 172.21.15.131:0/1219308411 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63500a7050 con 0x7f6354098040 2024-02-15T23:29:24.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f6359190640 1 -- 172.21.15.131:0/1219308411 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63500ab7e0 con 0x7f6354098040 2024-02-15T23:29:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- 172.21.15.131:0/1219308411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 msgr2=0x7f6354098420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 --2- 172.21.15.131:0/1219308411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354098420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6350009740 tx=0x7f635001c370 comp rx=0 tx=0).stop 2024-02-15T23:29:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- 172.21.15.131:0/1219308411 shutdown_connections 2024-02-15T23:29:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 --2- 172.21.15.131:0/1219308411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354098420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- 172.21.15.131:0/1219308411 >> 172.21.15.131:0/1219308411 conn(0x7f635409e870 msgr2=0x7f635409ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- 172.21.15.131:0/1219308411 shutdown_connections 2024-02-15T23:29:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- 172.21.15.131:0/1219308411 wait complete. 2024-02-15T23:29:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 Processor -- start 2024-02-15T23:29:24.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- start start 2024-02-15T23:29:24.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354132360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6354093330 con 0x7f6354098040 2024-02-15T23:29:24.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635a192640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635a192640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354132360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56044/0 (socket says 172.21.15.131:56044) 2024-02-15T23:29:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635a192640 1 -- 172.21.15.131:0/2084653412 learned_addr learned my addr 172.21.15.131:0/2084653412 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635a192640 1 -- 172.21.15.131:0/2084653412 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6350009420 con 0x7f6354098040 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635a192640 1 --2- 172.21.15.131:0/2084653412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354132360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6350019fa0 tx=0x7f635001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f634affd640 1 -- 172.21.15.131:0/2084653412 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63500b7790 con 0x7f6354098040 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- 172.21.15.131:0/2084653412 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6354125d30 con 0x7f6354098040 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f634affd640 1 -- 172.21.15.131:0/2084653412 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63500b78f0 con 0x7f6354098040 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f634affd640 1 -- 172.21.15.131:0/2084653412 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63500b7b90 con 0x7f6354098040 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.284+0000 7f635c3f6640 1 -- 172.21.15.131:0/2084653412 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6354092e90 con 0x7f6354098040 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.288+0000 7f634affd640 1 -- 172.21.15.131:0/2084653412 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f63500b7cf0 con 0x7f6354098040 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.288+0000 7f6348ff9640 1 -- 172.21.15.131:0/2084653412 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6354125ba0 con 0x7f6354098040 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.288+0000 7f634affd640 1 --2- 172.21.15.131:0/2084653412 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f63380359c0 0x7f6338037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.288+0000 7f634affd640 1 -- 172.21.15.131:0/2084653412 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f63500e2970 con 0x7f6354098040 2024-02-15T23:29:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.288+0000 7f6359991640 1 --2- 172.21.15.131:0/2084653412 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f63380359c0 0x7f6338037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.288+0000 7f6359991640 1 --2- 172.21.15.131:0/2084653412 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f63380359c0 0x7f6338037e80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6344005890 tx=0x7f6344007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.292+0000 7f634affd640 1 -- 172.21.15.131:0/2084653412 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f63500c7d70 con 0x7f6354098040 2024-02-15T23:29:24.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.372+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdaa8073100 con 0x7fdaa81229e0 2024-02-15T23:29:24.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fda96ffd640 1 -- 172.21.15.131:0/2608330604 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda980b0070 con 0x7fdaa81229e0 2024-02-15T23:29:24.381 INFO:teuthology.orchestra.run.smithi131.stdout:38654705670 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda88035a10 msgr2=0x7fda88037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 --2- 172.21.15.131:0/2608330604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda88035a10 0x7fda88037ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda9c007fd0 tx=0x7fda9c007980 comp rx=0 tx=0).stop 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81229e0 msgr2=0x7fdaa81c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 --2- 172.21.15.131:0/2608330604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81229e0 0x7fdaa81c3560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda98019fa0 tx=0x7fda9801abb0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 shutdown_connections 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 --2- 172.21.15.131:0/2608330604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda88035a10 0x7fda88037ed0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 --2- 172.21.15.131:0/2608330604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa81229e0 0x7fdaa81c3560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 >> 172.21.15.131:0/2608330604 conn(0x7fdaa809d600 msgr2=0x7fdaa8071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 shutdown_connections 2024-02-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.376+0000 7fdaac835640 1 -- 172.21.15.131:0/2608330604 wait complete. 2024-02-15T23:29:24.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-02-15T23:29:24.398 DEBUG:teuthology.parallel:result is None 2024-02-15T23:29:24.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.444+0000 7f6348ff9640 1 -- 172.21.15.131:0/2084653412 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6354094200 con 0x7f6354098040 2024-02-15T23:29:24.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.444+0000 7f634affd640 1 -- 172.21.15.131:0/2084653412 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63500b0030 con 0x7f6354098040 2024-02-15T23:29:24.451 INFO:teuthology.orchestra.run.smithi131.stdout:38654705670 2024-02-15T23:29:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 -- 172.21.15.131:0/2084653412 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f63380359c0 msgr2=0x7f6338037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 --2- 172.21.15.131:0/2084653412 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f63380359c0 0x7f6338037e80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6344005890 tx=0x7f6344007a90 comp rx=0 tx=0).stop 2024-02-15T23:29:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 -- 172.21.15.131:0/2084653412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 msgr2=0x7f6354132360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 --2- 172.21.15.131:0/2084653412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354132360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6350019fa0 tx=0x7f635001abb0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 -- 172.21.15.131:0/2084653412 shutdown_connections 2024-02-15T23:29:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 --2- 172.21.15.131:0/2084653412 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f63380359c0 0x7f6338037e80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 --2- 172.21.15.131:0/2084653412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6354098040 0x7f6354132360 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 -- 172.21.15.131:0/2084653412 >> 172.21.15.131:0/2084653412 conn(0x7f635409e870 msgr2=0x7f635409b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 -- 172.21.15.131:0/2084653412 shutdown_connections 2024-02-15T23:29:24.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.448+0000 7f6348ff9640 1 -- 172.21.15.131:0/2084653412 wait complete. 2024-02-15T23:29:24.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-02-15T23:29:24.468 DEBUG:teuthology.parallel:result is None 2024-02-15T23:29:24.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.480+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f77d409da20 con 0x7f77d41274e0 2024-02-15T23:29:24.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.480+0000 7f77c9ffb640 1 -- 172.21.15.131:0/3642985713 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77d00b8020 con 0x7f77d41274e0 2024-02-15T23:29:24.487 INFO:teuthology.orchestra.run.smithi131.stdout:38654705669 2024-02-15T23:29:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f77b8035a10 msgr2=0x7f77b8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 --2- 172.21.15.131:0/3642985713 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f77b8035a10 0x7f77b8037ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000f70 tx=0x7f77c4007a40 comp rx=0 tx=0).stop 2024-02-15T23:29:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 msgr2=0x7f77d41221a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 --2- 172.21.15.131:0/3642985713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41221a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f77d0019040 tx=0x7f77d00191d0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 shutdown_connections 2024-02-15T23:29:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 --2- 172.21.15.131:0/3642985713 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f77b8035a10 0x7f77b8037ed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 --2- 172.21.15.131:0/3642985713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77d41274e0 0x7f77d41221a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 >> 172.21.15.131:0/3642985713 conn(0x7f77d409d4e0 msgr2=0x7f77d406f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 shutdown_connections 2024-02-15T23:29:24.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.484+0000 7f77db78b640 1 -- 172.21.15.131:0/3642985713 wait complete. 2024-02-15T23:29:24.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f72ac131bb0 con 0x7f72ac12e000 2024-02-15T23:29:24.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72a8ff9640 1 -- 172.21.15.131:0/210798633 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72ac131bb0 con 0x7f72ac12e000 2024-02-15T23:29:24.494 INFO:teuthology.orchestra.run.smithi131.stdout:38654705668 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7298035a10 msgr2=0x7f7298037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 --2- 172.21.15.131:0/210798633 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7298035a10 0x7f7298037ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72a00ad000 tx=0x7f72a00a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12e000 msgr2=0x7f72ac1c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 --2- 172.21.15.131:0/210798633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12e000 0x7f72ac1c5500 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f729c00c450 tx=0x7f729c00c910 comp rx=0 tx=0).stop 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 shutdown_connections 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 --2- 172.21.15.131:0/210798633 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7298035a10 0x7f7298037ed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 --2- 172.21.15.131:0/210798633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72ac12e000 0x7f72ac1c5500 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 >> 172.21.15.131:0/210798633 conn(0x7f72ac09b1d0 msgr2=0x7f72ac097b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 shutdown_connections 2024-02-15T23:29:24.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.488+0000 7f72b2761640 1 -- 172.21.15.131:0/210798633 wait complete. 2024-02-15T23:29:24.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-02-15T23:29:24.506 DEBUG:teuthology.parallel:result is None 2024-02-15T23:29:24.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2024-02-15T23:29:24.512 DEBUG:teuthology.parallel:result is None 2024-02-15T23:29:24.515 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-15T23:29:24.515 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:29:24.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.652+0000 7efdcc377640 1 Processor -- start 2024-02-15T23:29:24.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.652+0000 7efdcc377640 1 -- start start 2024-02-15T23:29:24.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.652+0000 7efdcc377640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efdc412b070 0x7efdc412b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.652+0000 7efdcc377640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc406cec0 con 0x7efdc41210b0 2024-02-15T23:29:24.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.652+0000 7efdcc377640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc4093d30 con 0x7efdc412b070 2024-02-15T23:29:24.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.652+0000 7efdca113640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efdc412b070 0x7efdc412b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdc9912640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efdc41210b0 0x7efdc4121490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53840/0 (socket says 172.21.15.131:53840) 2024-02-15T23:29:24.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdc9912640 1 -- 172.21.15.131:0/3553863840 learned_addr learned my addr 172.21.15.131:0/3553863840 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:24.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdca113640 1 -- 172.21.15.131:0/3553863840 >> v1:172.21.15.131:6789/0 conn(0x7efdc41210b0 legacy=0x7efdc4121490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdca113640 1 -- 172.21.15.131:0/3553863840 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc412ac20 con 0x7efdc412b070 2024-02-15T23:29:24.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdca113640 1 --2- 172.21.15.131:0/3553863840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc412b070 0x7efdc412b450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009740 tx=0x7efdc001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91f144b4a61fff0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdc9111640 1 -- 172.21.15.131:0/3553863840 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdc00ab530 con 0x7efdc412b070 2024-02-15T23:29:24.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdc9111640 1 -- 172.21.15.131:0/3553863840 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc00a7050 con 0x7efdc412b070 2024-02-15T23:29:24.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdc9111640 1 -- 172.21.15.131:0/3553863840 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdc00ab7e0 con 0x7efdc412b070 2024-02-15T23:29:24.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdcc377640 1 -- 172.21.15.131:0/3553863840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc412b070 msgr2=0x7efdc412b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdcc377640 1 --2- 172.21.15.131:0/3553863840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc412b070 0x7efdc412b450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009740 tx=0x7efdc001c3a0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdcc377640 1 -- 172.21.15.131:0/3553863840 shutdown_connections 2024-02-15T23:29:24.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdcc377640 1 --2- 172.21.15.131:0/3553863840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc412b070 0x7efdc412b450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdcc377640 1 -- 172.21.15.131:0/3553863840 >> 172.21.15.131:0/3553863840 conn(0x7efdc409a2f0 msgr2=0x7efdc409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdcc377640 1 -- 172.21.15.131:0/3553863840 shutdown_connections 2024-02-15T23:29:24.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.656+0000 7efdcc377640 1 -- 172.21.15.131:0/3553863840 wait complete. 2024-02-15T23:29:24.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdcc377640 1 Processor -- start 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdcc377640 1 -- start start 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdcc377640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc41210b0 0x7efdc41c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdcc377640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4124920 con 0x7efdc41210b0 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdca113640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc41210b0 0x7efdc41c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdca113640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc41210b0 0x7efdc41c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56070/0 (socket says 172.21.15.131:56070) 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdca113640 1 -- 172.21.15.131:0/3422363188 learned_addr learned my addr 172.21.15.131:0/3422363188 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdca113640 1 -- 172.21.15.131:0/3422363188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0009420 con 0x7efdc41210b0 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdca113640 1 --2- 172.21.15.131:0/3422363188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc41210b0 0x7efdc41c2970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efdc00ae040 tx=0x7efdc00191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdbaffd640 1 -- 172.21.15.131:0/3422363188 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdc00b4410 con 0x7efdc41210b0 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdbaffd640 1 -- 172.21.15.131:0/3422363188 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc00b4570 con 0x7efdc41210b0 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdbaffd640 1 -- 172.21.15.131:0/3422363188 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdc00b4850 con 0x7efdc41210b0 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc4130160 con 0x7efdc41210b0 2024-02-15T23:29:24.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc4124680 con 0x7efdc41210b0 2024-02-15T23:29:24.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdbaffd640 1 -- 172.21.15.131:0/3422363188 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efdc00b2040 con 0x7efdc41210b0 2024-02-15T23:29:24.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc41244e0 con 0x7efdc41210b0 2024-02-15T23:29:24.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdbaffd640 1 --2- 172.21.15.131:0/3422363188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efda8035a10 0x7efda8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdbaffd640 1 -- 172.21.15.131:0/3422363188 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7efdc00e1ed0 con 0x7efdc41210b0 2024-02-15T23:29:24.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdc9912640 1 --2- 172.21.15.131:0/3422363188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efda8035a10 0x7efda8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.660+0000 7efdc9912640 1 --2- 172.21.15.131:0/3422363188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efda8035a10 0x7efda8037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efdb4001610 tx=0x7efdb4007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.664+0000 7efdbaffd640 1 -- 172.21.15.131:0/3422363188 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efdc41244e0 con 0x7efdc41210b0 2024-02-15T23:29:24.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.808+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdc4133660 con 0x7efda8035a10 2024-02-15T23:29:24.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdbaffd640 1 -- 172.21.15.131:0/3422363188 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34663 (secure 0 0 0) 0x7efdb4001300 con 0x7efda8035a10 2024-02-15T23:29:24.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:29:24.818 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:29:24.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efda8035a10 msgr2=0x7efda8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 --2- 172.21.15.131:0/3422363188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efda8035a10 0x7efda8037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efdb4001610 tx=0x7efdb4007ad0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc41210b0 msgr2=0x7efdc41c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 --2- 172.21.15.131:0/3422363188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc41210b0 0x7efdc41c2970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efdc00ae040 tx=0x7efdc00191a0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 shutdown_connections 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 --2- 172.21.15.131:0/3422363188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efda8035a10 0x7efda8037ed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 --2- 172.21.15.131:0/3422363188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc41210b0 0x7efdc41c2970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 >> 172.21.15.131:0/3422363188 conn(0x7efdc409a2f0 msgr2=0x7efdc4129180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 shutdown_connections 2024-02-15T23:29:24.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.812+0000 7efdcc377640 1 -- 172.21.15.131:0/3422363188 wait complete. 2024-02-15T23:29:24.834 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-02-15T23:29:23.492777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109752,"kb_used_data":1672,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377608,"statfs":{"total":386547056640,"available":386434670592,"internally_reserved":0,"allocated":1712128,"data_stored":1340580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.884982"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.799472+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:29:21.799472+0000","last_peered":"2024-02-15T23:29:21.799472+0000","last_clean":"2024-02-15T23:29:21.799472+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:29:21.799472+0000","last_undegraded":"2024-02-15T23:29:21.799472+0000","last_fullsized":"2024-02-15T23:29:21.799472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:03:36.521012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T23:29:22.618830+0000","last_change":"2024-02-15T23:29:21.629944+0000","last_active":"2024-02-15T23:29:22.618830+0000","last_peered":"2024-02-15T23:29:22.618830+0000","last_clean":"2024-02-15T23:29:22.618830+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:29:22.618830+0000","last_undegraded":"2024-02-15T23:29:22.618830+0000","last_fullsized":"2024-02-15T23:29:22.618830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:34:24.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.625335+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:29:21.625335+0000","last_peered":"2024-02-15T23:29:21.625335+0000","last_clean":"2024-02-15T23:29:21.625335+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:29:21.625335+0000","last_undegraded":"2024-02-15T23:29:21.625335+0000","last_fullsized":"2024-02-15T23:29:21.625335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:05.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T23:29:22.618862+0000","last_change":"2024-02-15T23:29:21.627861+0000","last_active":"2024-02-15T23:29:22.618862+0000","last_peered":"2024-02-15T23:29:22.618862+0000","last_clean":"2024-02-15T23:29:22.618862+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:29:22.618862+0000","last_undegraded":"2024-02-15T23:29:22.618862+0000","last_fullsized":"2024-02-15T23:29:22.618862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:25:07.064306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.624383+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:29:21.624383+0000","last_peered":"2024-02-15T23:29:21.624383+0000","last_clean":"2024-02-15T23:29:21.624383+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:29:21.624383+0000","last_undegraded":"2024-02-15T23:29:21.624383+0000","last_fullsized":"2024-02-15T23:29:21.624383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:50:38.192815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.625018+0000","last_change":"2024-02-15T23:29:21.622454+0000","last_active":"2024-02-15T23:29:21.625018+0000","last_peered":"2024-02-15T23:29:21.625018+0000","last_clean":"2024-02-15T23:29:21.625018+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:29:21.625018+0000","last_undegraded":"2024-02-15T23:29:21.625018+0000","last_fullsized":"2024-02-15T23:29:21.625018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:50:38.192815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.626371+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:29:21.626371+0000","last_peered":"2024-02-15T23:29:21.626371+0000","last_clean":"2024-02-15T23:29:21.626371+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:29:21.626371+0000","last_undegraded":"2024-02-15T23:29:21.626371+0000","last_fullsized":"2024-02-15T23:29:21.626371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:34:24.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.627439+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:29:21.627439+0000","last_peered":"2024-02-15T23:29:21.627439+0000","last_clean":"2024-02-15T23:29:21.627439+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:29:21.627439+0000","last_undegraded":"2024-02-15T23:29:21.627439+0000","last_fullsized":"2024-02-15T23:29:21.627439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:25:07.064306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":166,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.793826+0000","last_change":"2024-02-15T23:29:17.391071+0000","last_active":"2024-02-15T23:29:21.793826+0000","last_peered":"2024-02-15T23:29:21.793826+0000","last_clean":"2024-02-15T23:29:21.793826+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:29:21.793826+0000","last_undegraded":"2024-02-15T23:29:21.793826+0000","last_fullsized":"2024-02-15T23:29:21.793826+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_clean_scrub_stamp":"2024-02-15T23:29:15.580621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:00.893203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:29:24.835 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:29:24.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.932+0000 7f6ca5d2a640 1 Processor -- start 2024-02-15T23:29:24.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.932+0000 7f6ca5d2a640 1 -- start start 2024-02-15T23:29:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.932+0000 7f6ca5d2a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6ca012a990 0x7f6ca012ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.932+0000 7f6ca5d2a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca012a790 con 0x7f6ca012b2b0 2024-02-15T23:29:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.932+0000 7f6ca5d2a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca0072210 con 0x7f6ca012a990 2024-02-15T23:29:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6ca012a990 0x7f6ca012ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9effd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6ca012b2b0 0x7f6ca012db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53850/0 (socket says 172.21.15.131:53850) 2024-02-15T23:29:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9effd640 1 -- 172.21.15.131:0/2446402249 learned_addr learned my addr 172.21.15.131:0/2446402249 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:29:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9f7fe640 1 -- 172.21.15.131:0/2446402249 >> v1:172.21.15.131:6789/0 conn(0x7f6ca012b2b0 legacy=0x7f6ca012db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9f7fe640 1 -- 172.21.15.131:0/2446402249 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0098bf0 con 0x7f6ca012a990 2024-02-15T23:29:24.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9f7fe640 1 --2- 172.21.15.131:0/2446402249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ad70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009740 tx=0x7f6c9001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bbac79f1850075 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9e7fc640 1 -- 172.21.15.131:0/2446402249 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c900ab530 con 0x7f6ca012a990 2024-02-15T23:29:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9e7fc640 1 -- 172.21.15.131:0/2446402249 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900a7050 con 0x7f6ca012a990 2024-02-15T23:29:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6c9e7fc640 1 -- 172.21.15.131:0/2446402249 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c900ab7e0 con 0x7f6ca012a990 2024-02-15T23:29:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/2446402249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 msgr2=0x7f6ca012ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6ca5d2a640 1 --2- 172.21.15.131:0/2446402249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ad70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009740 tx=0x7f6c9001c370 comp rx=0 tx=0).stop 2024-02-15T23:29:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/2446402249 shutdown_connections 2024-02-15T23:29:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6ca5d2a640 1 --2- 172.21.15.131:0/2446402249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ad70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/2446402249 >> 172.21.15.131:0/2446402249 conn(0x7f6ca009c220 msgr2=0x7f6ca0071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/2446402249 shutdown_connections 2024-02-15T23:29:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.936+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/2446402249 wait complete. 2024-02-15T23:29:24.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6ca5d2a640 1 Processor -- start 2024-02-15T23:29:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6ca5d2a640 1 -- start start 2024-02-15T23:29:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6ca5d2a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6ca5d2a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0131ed0 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c9f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c9f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56092/0 (socket says 172.21.15.131:56092) 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c9f7fe640 1 -- 172.21.15.131:0/515866531 learned_addr learned my addr 172.21.15.131:0/515866531 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c9f7fe640 1 -- 172.21.15.131:0/515866531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009420 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c9f7fe640 1 --2- 172.21.15.131:0/515866531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ef40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c900ae040 tx=0x7f6c90019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c87fff640 1 -- 172.21.15.131:0/515866531 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c900b4540 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c87fff640 1 -- 172.21.15.131:0/515866531 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900b46a0 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca01320c0 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c87fff640 1 -- 172.21.15.131:0/515866531 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c900b4980 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca0130e80 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c87fff640 1 -- 172.21.15.131:0/515866531 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c900b2040 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca0062860 con 0x7f6ca012a990 2024-02-15T23:29:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c87fff640 1 --2- 172.21.15.131:0/515866531 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6c8c035a10 0x7f6c8c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:24.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c87fff640 1 -- 172.21.15.131:0/515866531 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6c900e1f70 con 0x7f6ca012a990 2024-02-15T23:29:24.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c9effd640 1 --2- 172.21.15.131:0/515866531 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6c8c035a10 0x7f6c8c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:24.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.940+0000 7f6c9effd640 1 --2- 172.21.15.131:0/515866531 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6c8c035a10 0x7f6c8c037ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c94001610 tx=0x7f6c94007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:24.944+0000 7f6c87fff640 1 -- 172.21.15.131:0/515866531 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c900b4e60 con 0x7f6ca012a990 2024-02-15T23:29:25.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.084+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ca01298a0 con 0x7f6c8c035a10 2024-02-15T23:29:25.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.096+0000 7f6c87fff640 1 -- 172.21.15.131:0/515866531 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34663 (secure 0 0 0) 0x7f6ca01298a0 con 0x7f6c8c035a10 2024-02-15T23:29:25.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:29:25.105 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:29:25.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6c8c035a10 msgr2=0x7f6c8c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:25.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 --2- 172.21.15.131:0/515866531 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6c8c035a10 0x7f6c8c037ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c94001610 tx=0x7f6c94007ad0 comp rx=0 tx=0).stop 2024-02-15T23:29:25.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 msgr2=0x7f6ca012ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:25.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 --2- 172.21.15.131:0/515866531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ef40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c900ae040 tx=0x7f6c90019110 comp rx=0 tx=0).stop 2024-02-15T23:29:25.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 shutdown_connections 2024-02-15T23:29:25.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 --2- 172.21.15.131:0/515866531 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6c8c035a10 0x7f6c8c037ed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:25.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 --2- 172.21.15.131:0/515866531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ca012a990 0x7f6ca012ef40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 >> 172.21.15.131:0/515866531 conn(0x7f6ca009c220 msgr2=0x7f6ca0098ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 shutdown_connections 2024-02-15T23:29:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.100+0000 7f6ca5d2a640 1 -- 172.21.15.131:0/515866531 wait complete. 2024-02-15T23:29:25.121 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-02-15T23:29:23.492777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109752,"kb_used_data":1672,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377608,"statfs":{"total":386547056640,"available":386434670592,"internally_reserved":0,"allocated":1712128,"data_stored":1340580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.884982"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.799472+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:29:21.799472+0000","last_peered":"2024-02-15T23:29:21.799472+0000","last_clean":"2024-02-15T23:29:21.799472+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:29:21.799472+0000","last_undegraded":"2024-02-15T23:29:21.799472+0000","last_fullsized":"2024-02-15T23:29:21.799472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:03:36.521012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T23:29:22.618830+0000","last_change":"2024-02-15T23:29:21.629944+0000","last_active":"2024-02-15T23:29:22.618830+0000","last_peered":"2024-02-15T23:29:22.618830+0000","last_clean":"2024-02-15T23:29:22.618830+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:29:22.618830+0000","last_undegraded":"2024-02-15T23:29:22.618830+0000","last_fullsized":"2024-02-15T23:29:22.618830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:34:24.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.625335+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:29:21.625335+0000","last_peered":"2024-02-15T23:29:21.625335+0000","last_clean":"2024-02-15T23:29:21.625335+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:29:21.625335+0000","last_undegraded":"2024-02-15T23:29:21.625335+0000","last_fullsized":"2024-02-15T23:29:21.625335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:05.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T23:29:22.618862+0000","last_change":"2024-02-15T23:29:21.627861+0000","last_active":"2024-02-15T23:29:22.618862+0000","last_peered":"2024-02-15T23:29:22.618862+0000","last_clean":"2024-02-15T23:29:22.618862+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:29:22.618862+0000","last_undegraded":"2024-02-15T23:29:22.618862+0000","last_fullsized":"2024-02-15T23:29:22.618862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:25:07.064306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.624383+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:29:21.624383+0000","last_peered":"2024-02-15T23:29:21.624383+0000","last_clean":"2024-02-15T23:29:21.624383+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:29:21.624383+0000","last_undegraded":"2024-02-15T23:29:21.624383+0000","last_fullsized":"2024-02-15T23:29:21.624383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:50:38.192815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.625018+0000","last_change":"2024-02-15T23:29:21.622454+0000","last_active":"2024-02-15T23:29:21.625018+0000","last_peered":"2024-02-15T23:29:21.625018+0000","last_clean":"2024-02-15T23:29:21.625018+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:29:21.625018+0000","last_undegraded":"2024-02-15T23:29:21.625018+0000","last_fullsized":"2024-02-15T23:29:21.625018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:50:38.192815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.626371+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:29:21.626371+0000","last_peered":"2024-02-15T23:29:21.626371+0000","last_clean":"2024-02-15T23:29:21.626371+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:29:21.626371+0000","last_undegraded":"2024-02-15T23:29:21.626371+0000","last_fullsized":"2024-02-15T23:29:21.626371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:34:24.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.627439+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:29:21.627439+0000","last_peered":"2024-02-15T23:29:21.627439+0000","last_clean":"2024-02-15T23:29:21.627439+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:29:21.627439+0000","last_undegraded":"2024-02-15T23:29:21.627439+0000","last_fullsized":"2024-02-15T23:29:21.627439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:25:07.064306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":166,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-15T23:29:21.793826+0000","last_change":"2024-02-15T23:29:17.391071+0000","last_active":"2024-02-15T23:29:21.793826+0000","last_peered":"2024-02-15T23:29:21.793826+0000","last_clean":"2024-02-15T23:29:21.793826+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:29:21.793826+0000","last_undegraded":"2024-02-15T23:29:21.793826+0000","last_fullsized":"2024-02-15T23:29:21.793826+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_clean_scrub_stamp":"2024-02-15T23:29:15.580621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:00.893203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:29:25.121 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-15T23:29:25.122 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-15T23:29:25.122 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-15T23:29:25.122 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-15T23:29:25.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.224+0000 7fc8f5ed0640 1 Processor -- start 2024-02-15T23:29:25.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.224+0000 7fc8f5ed0640 1 -- start start 2024-02-15T23:29:25.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8f012ee50 0x7fc8f0131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:25.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f0070fa0 con 0x7fc8f0096510 2024-02-15T23:29:25.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f00704c0 con 0x7fc8f012ee50 2024-02-15T23:29:25.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8e6ffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8f012ee50 0x7fc8f0131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:25.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8e6ffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8f012ee50 0x7fc8f0131240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56108/0 (socket says 172.21.15.131:56108) 2024-02-15T23:29:25.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8e6ffd640 1 -- 172.21.15.131:0/1835985418 learned_addr learned my addr 172.21.15.131:0/1835985418 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:25.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8e6ffd640 1 -- 172.21.15.131:0/1835985418 >> v1:172.21.15.131:6789/0 conn(0x7fc8f0096510 legacy=0x7fc8f00968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:25.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8e6ffd640 1 -- 172.21.15.131:0/1835985418 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f00715e0 con 0x7fc8f012ee50 2024-02-15T23:29:25.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8e6ffd640 1 --2- 172.21.15.131:0/1835985418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f012ee50 0x7fc8f0131240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80097f0 tx=0x7fc8d801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3500c8fbb913c683 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8eeffd640 1 -- 172.21.15.131:0/1835985418 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc8d80ab530 con 0x7fc8f012ee50 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8eeffd640 1 -- 172.21.15.131:0/1835985418 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d80a7050 con 0x7fc8f012ee50 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8eeffd640 1 -- 172.21.15.131:0/1835985418 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc8d80ab7e0 con 0x7fc8f012ee50 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1835985418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f012ee50 msgr2=0x7fc8f0131240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 --2- 172.21.15.131:0/1835985418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f012ee50 0x7fc8f0131240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80097f0 tx=0x7fc8d801c430 comp rx=0 tx=0).stop 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1835985418 shutdown_connections 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 --2- 172.21.15.131:0/1835985418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f012ee50 0x7fc8f0131240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1835985418 >> 172.21.15.131:0/1835985418 conn(0x7fc8f009c870 msgr2=0x7fc8f009cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1835985418 shutdown_connections 2024-02-15T23:29:25.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.228+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1835985418 wait complete. 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8f5ed0640 1 Processor -- start 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8f5ed0640 1 -- start start 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8f5ed0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0096510 0x7fc8f01279b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8f5ed0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f012a980 con 0x7fc8f0096510 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ef7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0096510 0x7fc8f01279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ef7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0096510 0x7fc8f01279b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56116/0 (socket says 172.21.15.131:56116) 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ef7fe640 1 -- 172.21.15.131:0/1626116582 learned_addr learned my addr 172.21.15.131:0/1626116582 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ef7fe640 1 -- 172.21.15.131:0/1626116582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80094d0 con 0x7fc8f0096510 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ef7fe640 1 --2- 172.21.15.131:0/1626116582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0096510 0x7fc8f01279b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c340 tx=0x7fc8e000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:25.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ecff9640 1 -- 172.21.15.131:0/1626116582 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0005150 con 0x7fc8f0096510 2024-02-15T23:29:25.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ecff9640 1 -- 172.21.15.131:0/1626116582 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e00052b0 con 0x7fc8f0096510 2024-02-15T23:29:25.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ecff9640 1 -- 172.21.15.131:0/1626116582 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0007030 con 0x7fc8f0096510 2024-02-15T23:29:25.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f012a2a0 con 0x7fc8f0096510 2024-02-15T23:29:25.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f012a450 con 0x7fc8f0096510 2024-02-15T23:29:25.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f0062860 con 0x7fc8f0096510 2024-02-15T23:29:25.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ecff9640 1 -- 172.21.15.131:0/1626116582 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc8e00072a0 con 0x7fc8f0096510 2024-02-15T23:29:25.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ecff9640 1 --2- 172.21.15.131:0/1626116582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8d00359c0 0x7fc8d0037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:25.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8ecff9640 1 -- 172.21.15.131:0/1626116582 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fc8e0047170 con 0x7fc8f0096510 2024-02-15T23:29:25.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8e6ffd640 1 --2- 172.21.15.131:0/1626116582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8d00359c0 0x7fc8d0037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:25.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.232+0000 7fc8e6ffd640 1 --2- 172.21.15.131:0/1626116582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8d00359c0 0x7fc8d0037e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0073070 tx=0x7fc8d80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:25.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.236+0000 7fc8ecff9640 1 -- 172.21.15.131:0/1626116582 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc8e00104c0 con 0x7fc8f0096510 2024-02-15T23:29:25.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.412+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc8f0073100 con 0x7fc8f0096510 2024-02-15T23:29:25.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.412+0000 7fc8ecff9640 1 -- 172.21.15.131:0/1626116582 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc8e00102e0 con 0x7fc8f0096510 2024-02-15T23:29:25.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:29:25.420 INFO:teuthology.orchestra.run.smithi131.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-15T23:29:25.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8d00359c0 msgr2=0x7fc8d0037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:25.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 --2- 172.21.15.131:0/1626116582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8d00359c0 0x7fc8d0037e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0073070 tx=0x7fc8d80a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0096510 msgr2=0x7fc8f01279b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 --2- 172.21.15.131:0/1626116582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0096510 0x7fc8f01279b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c340 tx=0x7fc8e000c800 comp rx=0 tx=0).stop 2024-02-15T23:29:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 shutdown_connections 2024-02-15T23:29:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 --2- 172.21.15.131:0/1626116582 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8d00359c0 0x7fc8d0037e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 --2- 172.21.15.131:0/1626116582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8f0096510 0x7fc8f01279b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 >> 172.21.15.131:0/1626116582 conn(0x7fc8f009c870 msgr2=0x7fc8f012d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 shutdown_connections 2024-02-15T23:29:25.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:29:25.416+0000 7fc8f5ed0640 1 -- 172.21.15.131:0/1626116582 wait complete. 2024-02-15T23:29:25.437 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-15T23:29:25.438 INFO:teuthology.run_tasks:Running task rgw... 2024-02-15T23:29:25.452 DEBUG:tasks.rgw:config is {'client.0': None} 2024-02-15T23:29:25.452 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-02-15T23:29:25.452 INFO:tasks.rgw:Creating data pools 2024-02-15T23:29:25.452 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-02-15T23:29:25.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-02-15T23:29:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.575+0000 7f5efafac640 1 Processor -- start 2024-02-15T23:29:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.575+0000 7f5efafac640 1 -- start start 2024-02-15T23:29:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5efafac640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ef4113fb0 0x7f5ef4114460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5efafac640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef41149a0 con 0x7f5ef410e020 2024-02-15T23:29:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5efafac640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef410ec90 con 0x7f5ef4113fb0 2024-02-15T23:29:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5eebfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ef4113fb0 0x7f5ef4114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5eebfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ef4113fb0 0x7f5ef4114460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42494/0 (socket says 172.21.15.133:42494) 2024-02-15T23:29:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5eebfff640 1 -- 172.21.15.133:0/793647412 learned_addr learned my addr 172.21.15.133:0/793647412 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5eeb7fe640 1 -- 172.21.15.133:0/793647412 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475530547 0 0) 0x7f5ef41149a0 con 0x7f5ef410e020 2024-02-15T23:29:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5eeb7fe640 1 -- 172.21.15.133:0/793647412 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5edc003530 con 0x7f5ef410e020 2024-02-15T23:29:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5eebfff640 1 -- 172.21.15.133:0/793647412 >> v1:172.21.15.131:6789/0 conn(0x7f5ef410e020 legacy=0x7f5ef410e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.579+0000 7f5eebfff640 1 -- 172.21.15.133:0/793647412 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4114b60 con 0x7f5ef4113fb0 2024-02-15T23:29:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5eebfff640 1 --2- 172.21.15.133:0/793647412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef4113fb0 0x7f5ef4114460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40097f0 tx=0x7f5ee401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac35ca014dff989 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5eeb7fe640 1 -- 172.21.15.133:0/793647412 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ee40ab580 con 0x7f5ef4113fb0 2024-02-15T23:29:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5eeb7fe640 1 -- 172.21.15.133:0/793647412 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee40ab6e0 con 0x7f5ef4113fb0 2024-02-15T23:29:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5eeb7fe640 1 -- 172.21.15.133:0/793647412 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ee40ab980 con 0x7f5ef4113fb0 2024-02-15T23:29:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 -- 172.21.15.133:0/793647412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef4113fb0 msgr2=0x7f5ef4114460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 --2- 172.21.15.133:0/793647412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef4113fb0 0x7f5ef4114460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40097f0 tx=0x7f5ee401c430 comp rx=0 tx=0).stop 2024-02-15T23:29:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 -- 172.21.15.133:0/793647412 shutdown_connections 2024-02-15T23:29:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 --2- 172.21.15.133:0/793647412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef4113fb0 0x7f5ef4114460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 -- 172.21.15.133:0/793647412 >> 172.21.15.133:0/793647412 conn(0x7f5ef406e8d0 msgr2=0x7f5ef4070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 -- 172.21.15.133:0/793647412 shutdown_connections 2024-02-15T23:29:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 -- 172.21.15.133:0/793647412 wait complete. 2024-02-15T23:29:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 Processor -- start 2024-02-15T23:29:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 -- start start 2024-02-15T23:29:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef410e020 0x7f5ef41b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.583+0000 7f5efafac640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41b3620 con 0x7f5ef410e020 2024-02-15T23:29:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ef8d48640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef410e020 0x7f5ef41b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ef8d48640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef410e020 0x7f5ef41b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42508/0 (socket says 172.21.15.133:42508) 2024-02-15T23:29:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ef8d48640 1 -- 172.21.15.133:0/1450598733 learned_addr learned my addr 172.21.15.133:0/1450598733 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ef8d48640 1 -- 172.21.15.133:0/1450598733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee40094d0 con 0x7f5ef410e020 2024-02-15T23:29:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ef8d48640 1 --2- 172.21.15.133:0/1450598733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef410e020 0x7f5ef41b3050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c450 tx=0x7f5ef000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ee97fa640 1 -- 172.21.15.133:0/1450598733 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ef0005200 con 0x7f5ef410e020 2024-02-15T23:29:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef41b3820 con 0x7f5ef410e020 2024-02-15T23:29:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ee97fa640 1 -- 172.21.15.133:0/1450598733 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0005360 con 0x7f5ef410e020 2024-02-15T23:29:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ee97fa640 1 -- 172.21.15.133:0/1450598733 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ef00126f0 con 0x7f5ef410e020 2024-02-15T23:29:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef41acee0 con 0x7f5ef410e020 2024-02-15T23:29:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef4062860 con 0x7f5ef410e020 2024-02-15T23:29:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ee97fa640 1 -- 172.21.15.133:0/1450598733 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5ef0012920 con 0x7f5ef410e020 2024-02-15T23:29:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ee97fa640 1 --2- 172.21.15.133:0/1450598733 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ee00359c0 0x7f5ee0037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5ee97fa640 1 -- 172.21.15.133:0/1450598733 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f5ef00478d0 con 0x7f5ef410e020 2024-02-15T23:29:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5eebfff640 1 --2- 172.21.15.133:0/1450598733 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ee00359c0 0x7f5ee0037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.587+0000 7f5eebfff640 1 --2- 172.21.15.133:0/1450598733 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ee00359c0 0x7f5ee0037e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40af000 tx=0x7f5ee4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:25.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.599+0000 7f5ee97fa640 1 -- 172.21.15.133:0/1450598733 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5ef0012bd0 con 0x7f5ef410e020 2024-02-15T23:29:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:25.763+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) v1 -- 0x7f5ef41248e0 con 0x7f5ef410e020 2024-02-15T23:29:26.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.627+0000 7f5ee97fa640 1 -- 172.21.15.133:0/1450598733 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v17) v1 ==== 171+0+0 (secure 0 0 0) 0x7f5ef0010990 con 0x7f5ef410e020 2024-02-15T23:29:26.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ee00359c0 msgr2=0x7f5ee0037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:26.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 --2- 172.21.15.133:0/1450598733 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ee00359c0 0x7f5ee0037e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40af000 tx=0x7f5ee4008040 comp rx=0 tx=0).stop 2024-02-15T23:29:26.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef410e020 msgr2=0x7f5ef41b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:26.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 --2- 172.21.15.133:0/1450598733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef410e020 0x7f5ef41b3050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c450 tx=0x7f5ef000c910 comp rx=0 tx=0).stop 2024-02-15T23:29:26.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 shutdown_connections 2024-02-15T23:29:26.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 --2- 172.21.15.133:0/1450598733 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ee00359c0 0x7f5ee0037e80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:26.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 --2- 172.21.15.133:0/1450598733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef410e020 0x7f5ef41b3050 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:26.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 >> 172.21.15.133:0/1450598733 conn(0x7f5ef406e8d0 msgr2=0x7f5ef411e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:26.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 shutdown_connections 2024-02-15T23:29:26.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.631+0000 7f5efafac640 1 -- 172.21.15.133:0/1450598733 wait complete. 2024-02-15T23:29:26.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-02-15T23:29:26.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.771+0000 7f127ec69640 1 Processor -- start 2024-02-15T23:29:26.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.771+0000 7f127ec69640 1 -- start start 2024-02-15T23:29:26.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.771+0000 7f127ec69640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1278113fb0 0x7f1278114460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:26.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.771+0000 7f127ec69640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12781149a0 con 0x7f127810e020 2024-02-15T23:29:26.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.771+0000 7f127ec69640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127810ec90 con 0x7f1278113fb0 2024-02-15T23:29:26.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.771+0000 7f1277fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1278113fb0 0x7f1278114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.771+0000 7f127ca05640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f127810e020 0x7f127810e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:54074/0 (socket says 172.21.15.133:54074) 2024-02-15T23:29:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.771+0000 7f127ca05640 1 -- 172.21.15.133:0/549396860 learned_addr learned my addr 172.21.15.133:0/549396860 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f1277fff640 1 -- 172.21.15.133:0/549396860 >> v1:172.21.15.131:6789/0 conn(0x7f127810e020 legacy=0x7f127810e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f1277fff640 1 -- 172.21.15.133:0/549396860 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278114b60 con 0x7f1278113fb0 2024-02-15T23:29:26.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f1277fff640 1 --2- 172.21.15.133:0/549396860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1278113fb0 0x7f1278114460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f126c009740 tx=0x7f126c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9131e72081e921b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:26.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f12777fe640 1 -- 172.21.15.133:0/549396860 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f126c0a8050 con 0x7f1278113fb0 2024-02-15T23:29:26.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f12777fe640 1 -- 172.21.15.133:0/549396860 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c0ac520 con 0x7f1278113fb0 2024-02-15T23:29:26.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f12777fe640 1 -- 172.21.15.133:0/549396860 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f126c0ac7e0 con 0x7f1278113fb0 2024-02-15T23:29:26.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f127ec69640 1 -- 172.21.15.133:0/549396860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1278113fb0 msgr2=0x7f1278114460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f127ec69640 1 --2- 172.21.15.133:0/549396860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1278113fb0 0x7f1278114460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f126c009740 tx=0x7f126c01c370 comp rx=0 tx=0).stop 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f127ec69640 1 -- 172.21.15.133:0/549396860 shutdown_connections 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f127ec69640 1 --2- 172.21.15.133:0/549396860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1278113fb0 0x7f1278114460 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f127ec69640 1 -- 172.21.15.133:0/549396860 >> 172.21.15.133:0/549396860 conn(0x7f127806e8d0 msgr2=0x7f1278070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f127ec69640 1 -- 172.21.15.133:0/549396860 shutdown_connections 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.775+0000 7f127ec69640 1 -- 172.21.15.133:0/549396860 wait complete. 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ec69640 1 Processor -- start 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ec69640 1 -- start start 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ec69640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f127810e020 0x7f12781b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ec69640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12781b36a0 con 0x7f127810e020 2024-02-15T23:29:26.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ca05640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f127810e020 0x7f12781b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ca05640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f127810e020 0x7f12781b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:55568/0 (socket says 172.21.15.133:55568) 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ca05640 1 -- 172.21.15.133:0/2747889635 learned_addr learned my addr 172.21.15.133:0/2747889635 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ca05640 1 -- 172.21.15.133:0/2747889635 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c009420 con 0x7f127810e020 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ca05640 1 --2- 172.21.15.133:0/2747889635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f127810e020 0x7f12781b30d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f126800c450 tx=0x7f126800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f12757fa640 1 -- 172.21.15.133:0/2747889635 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1268005c20 con 0x7f127810e020 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12781b38a0 con 0x7f127810e020 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f12757fa640 1 -- 172.21.15.133:0/2747889635 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268005d80 con 0x7f127810e020 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f12757fa640 1 -- 172.21.15.133:0/2747889635 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1268007200 con 0x7f127810e020 2024-02-15T23:29:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12781acf60 con 0x7f127810e020 2024-02-15T23:29:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1278062860 con 0x7f127810e020 2024-02-15T23:29:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f12757fa640 1 -- 172.21.15.133:0/2747889635 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1268007360 con 0x7f127810e020 2024-02-15T23:29:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f12757fa640 1 --2- 172.21.15.133:0/2747889635 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f12640359c0 0x7f1264037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.779+0000 7f12757fa640 1 -- 172.21.15.133:0/2747889635 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3797+0+0 (secure 0 0 0) 0x7f12680478e0 con 0x7f127810e020 2024-02-15T23:29:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.783+0000 7f1277fff640 1 --2- 172.21.15.133:0/2747889635 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f12640359c0 0x7f1264037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.783+0000 7f1277fff640 1 --2- 172.21.15.133:0/2747889635 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f12640359c0 0x7f1264037e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ae000 tx=0x7f126c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:26.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.795+0000 7f12757fa640 1 -- 172.21.15.133:0/2747889635 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f126801b3b0 con 0x7f127810e020 2024-02-15T23:29:26.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:26.939+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7f1278067620 con 0x7f127810e020 2024-02-15T23:29:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.635+0000 7f12757fa640 1 -- 172.21.15.133:0/2747889635 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v19) v1 ==== 227+0+0 (secure 0 0 0) 0x7f1268017030 con 0x7f127810e020 2024-02-15T23:29:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'default.rgw.buckets.data' created 2024-02-15T23:29:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f12640359c0 msgr2=0x7f1264037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 --2- 172.21.15.133:0/2747889635 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f12640359c0 0x7f1264037e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ae000 tx=0x7f126c008040 comp rx=0 tx=0).stop 2024-02-15T23:29:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f127810e020 msgr2=0x7f12781b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 --2- 172.21.15.133:0/2747889635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f127810e020 0x7f12781b30d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f126800c450 tx=0x7f126800c910 comp rx=0 tx=0).stop 2024-02-15T23:29:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 shutdown_connections 2024-02-15T23:29:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 --2- 172.21.15.133:0/2747889635 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f12640359c0 0x7f1264037e80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 --2- 172.21.15.133:0/2747889635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f127810e020 0x7f12781b30d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 >> 172.21.15.133:0/2747889635 conn(0x7f127806e8d0 msgr2=0x7f127811fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 shutdown_connections 2024-02-15T23:29:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.639+0000 7f127ec69640 1 -- 172.21.15.133:0/2747889635 wait complete. 2024-02-15T23:29:28.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-02-15T23:29:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96ed8fd640 1 Processor -- start 2024-02-15T23:29:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96ed8fd640 1 -- start start 2024-02-15T23:29:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96ed8fd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96e81181b0 0x7f96e811a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96ed8fd640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e811aae0 con 0x7f96e810e020 2024-02-15T23:29:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96ed8fd640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e811bc80 con 0x7f96e81181b0 2024-02-15T23:29:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96dffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96e81181b0 0x7f96e811a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96dffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96e81181b0 0x7f96e811a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:55584/0 (socket says 172.21.15.133:55584) 2024-02-15T23:29:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96dffff640 1 -- 172.21.15.133:0/3673356988 learned_addr learned my addr 172.21.15.133:0/3673356988 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96dffff640 1 -- 172.21.15.133:0/3673356988 >> v1:172.21.15.131:6789/0 conn(0x7f96e810e020 legacy=0x7f96e810e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.787+0000 7f96dffff640 1 -- 172.21.15.133:0/3673356988 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e811bdc0 con 0x7f96e81181b0 2024-02-15T23:29:28.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96dffff640 1 --2- 172.21.15.133:0/3673356988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e81181b0 0x7f96e811a5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f96d00097f0 tx=0x7f96d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a897c5aa661f72f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:28.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e67fc640 1 -- 172.21.15.133:0/3673356988 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96d00ab580 con 0x7f96e81181b0 2024-02-15T23:29:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e67fc640 1 -- 172.21.15.133:0/3673356988 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00ab6e0 con 0x7f96e81181b0 2024-02-15T23:29:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e67fc640 1 -- 172.21.15.133:0/3673356988 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96d00ab9a0 con 0x7f96e81181b0 2024-02-15T23:29:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- 172.21.15.133:0/3673356988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e81181b0 msgr2=0x7f96e811a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 --2- 172.21.15.133:0/3673356988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e81181b0 0x7f96e811a5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f96d00097f0 tx=0x7f96d001c430 comp rx=0 tx=0).stop 2024-02-15T23:29:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- 172.21.15.133:0/3673356988 shutdown_connections 2024-02-15T23:29:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 --2- 172.21.15.133:0/3673356988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e81181b0 0x7f96e811a5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:28.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- 172.21.15.133:0/3673356988 >> 172.21.15.133:0/3673356988 conn(0x7f96e806e870 msgr2=0x7f96e8070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:28.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- 172.21.15.133:0/3673356988 shutdown_connections 2024-02-15T23:29:28.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- 172.21.15.133:0/3673356988 wait complete. 2024-02-15T23:29:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 Processor -- start 2024-02-15T23:29:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- start start 2024-02-15T23:29:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e810e020 0x7f96e81ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81ac9a0 con 0x7f96e810e020 2024-02-15T23:29:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e810e020 0x7f96e81ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e810e020 0x7f96e81ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:55596/0 (socket says 172.21.15.133:55596) 2024-02-15T23:29:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e6ffd640 1 -- 172.21.15.133:0/4138512665 learned_addr learned my addr 172.21.15.133:0/4138512665 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e6ffd640 1 -- 172.21.15.133:0/4138512665 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00094d0 con 0x7f96e810e020 2024-02-15T23:29:28.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e6ffd640 1 --2- 172.21.15.133:0/4138512665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e810e020 0x7f96e81ac3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96d800c3b0 tx=0x7f96d800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:28.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e4ff9640 1 -- 172.21.15.133:0/4138512665 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96d8005200 con 0x7f96e810e020 2024-02-15T23:29:28.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e81acb40 con 0x7f96e810e020 2024-02-15T23:29:28.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e4ff9640 1 -- 172.21.15.133:0/4138512665 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8005380 con 0x7f96e810e020 2024-02-15T23:29:28.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96e4ff9640 1 -- 172.21.15.133:0/4138512665 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96d8007020 con 0x7f96e810e020 2024-02-15T23:29:28.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.791+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e81a6260 con 0x7f96e810e020 2024-02-15T23:29:28.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.795+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e8062860 con 0x7f96e810e020 2024-02-15T23:29:28.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.795+0000 7f96e4ff9640 1 -- 172.21.15.133:0/4138512665 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f96d8007180 con 0x7f96e810e020 2024-02-15T23:29:28.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.795+0000 7f96e4ff9640 1 --2- 172.21.15.133:0/4138512665 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f96c80359c0 0x7f96c8037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:28.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.795+0000 7f96e4ff9640 1 -- 172.21.15.133:0/4138512665 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4272+0+0 (secure 0 0 0) 0x7f96d8047c20 con 0x7f96e810e020 2024-02-15T23:29:28.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.795+0000 7f96dffff640 1 --2- 172.21.15.133:0/4138512665 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f96c80359c0 0x7f96c8037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.795+0000 7f96dffff640 1 --2- 172.21.15.133:0/4138512665 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f96c80359c0 0x7f96c8037e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96d00af000 tx=0x7f96d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.807+0000 7f96e4ff9640 1 -- 172.21.15.133:0/4138512665 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96d8019c30 con 0x7f96e810e020 2024-02-15T23:29:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:28.967+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7f96e81181b0 con 0x7f96e810e020 2024-02-15T23:29:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.647+0000 7f96e4ff9640 1 -- 172.21.15.133:0/4138512665 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v20) v1 ==== 185+0+0 (secure 0 0 0) 0x7f96d8019e60 con 0x7f96e810e020 2024-02-15T23:29:29.657 INFO:teuthology.orchestra.run.smithi133.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f96c80359c0 msgr2=0x7f96c8037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 --2- 172.21.15.133:0/4138512665 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f96c80359c0 0x7f96c8037e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96d00af000 tx=0x7f96d0008040 comp rx=0 tx=0).stop 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e810e020 msgr2=0x7f96e81ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 --2- 172.21.15.133:0/4138512665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e810e020 0x7f96e81ac3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96d800c3b0 tx=0x7f96d800c870 comp rx=0 tx=0).stop 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 shutdown_connections 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 --2- 172.21.15.133:0/4138512665 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f96c80359c0 0x7f96c8037e80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 --2- 172.21.15.133:0/4138512665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e810e020 0x7f96e81ac3d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 >> 172.21.15.133:0/4138512665 conn(0x7f96e806e870 msgr2=0x7f96e8071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 shutdown_connections 2024-02-15T23:29:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.651+0000 7f96ed8fd640 1 -- 172.21.15.133:0/4138512665 wait complete. 2024-02-15T23:29:29.691 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-02-15T23:29:29.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.819+0000 7fea89d05640 1 Processor -- start 2024-02-15T23:29:29.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.819+0000 7fea89d05640 1 -- start start 2024-02-15T23:29:29.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea89d05640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fea841149e0 0x7fea84120d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:29.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea89d05640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea84121260 con 0x7fea84113ef0 2024-02-15T23:29:29.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea89d05640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea84122400 con 0x7fea841149e0 2024-02-15T23:29:29.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea7bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fea841149e0 0x7fea84120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:29.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea837fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fea84113ef0 0x7fea841142d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:54090/0 (socket says 172.21.15.133:54090) 2024-02-15T23:29:29.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea837fe640 1 -- 172.21.15.133:0/3800577631 learned_addr learned my addr 172.21.15.133:0/3800577631 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:29.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea7bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fea841149e0 0x7fea84120d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:55606/0 (socket says 172.21.15.133:55606) 2024-02-15T23:29:29.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea7bfff640 1 -- 172.21.15.133:0/3800577631 >> v1:172.21.15.131:6789/0 conn(0x7fea84113ef0 legacy=0x7fea841142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:29.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea7bfff640 1 -- 172.21.15.133:0/3800577631 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea84122540 con 0x7fea841149e0 2024-02-15T23:29:29.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea7bfff640 1 --2- 172.21.15.133:0/3800577631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea841149e0 0x7fea84120d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea74009740 tx=0x7fea7401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fa5afe04efa115 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:29.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea82ffd640 1 -- 172.21.15.133:0/3800577631 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea740a8050 con 0x7fea841149e0 2024-02-15T23:29:29.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea82ffd640 1 -- 172.21.15.133:0/3800577631 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea740ac520 con 0x7fea841149e0 2024-02-15T23:29:29.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.823+0000 7fea82ffd640 1 -- 172.21.15.133:0/3800577631 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea740ac7e0 con 0x7fea841149e0 2024-02-15T23:29:29.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- 172.21.15.133:0/3800577631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea841149e0 msgr2=0x7fea84120d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:29.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 --2- 172.21.15.133:0/3800577631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea841149e0 0x7fea84120d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea74009740 tx=0x7fea7401c370 comp rx=0 tx=0).stop 2024-02-15T23:29:29.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- 172.21.15.133:0/3800577631 shutdown_connections 2024-02-15T23:29:29.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 --2- 172.21.15.133:0/3800577631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea841149e0 0x7fea84120d20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:29.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- 172.21.15.133:0/3800577631 >> 172.21.15.133:0/3800577631 conn(0x7fea8406e870 msgr2=0x7fea84070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:29.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- 172.21.15.133:0/3800577631 shutdown_connections 2024-02-15T23:29:29.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- 172.21.15.133:0/3800577631 wait complete. 2024-02-15T23:29:29.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 Processor -- start 2024-02-15T23:29:29.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- start start 2024-02-15T23:29:29.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea84113ef0 0x7fea841acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:29.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea841ad0a0 con 0x7fea84113ef0 2024-02-15T23:29:29.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea837fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea84113ef0 0x7fea841acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:29.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea837fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea84113ef0 0x7fea841acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:55614/0 (socket says 172.21.15.133:55614) 2024-02-15T23:29:29.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea837fe640 1 -- 172.21.15.133:0/2811713113 learned_addr learned my addr 172.21.15.133:0/2811713113 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:29.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea837fe640 1 -- 172.21.15.133:0/2811713113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea74009420 con 0x7fea84113ef0 2024-02-15T23:29:29.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea837fe640 1 --2- 172.21.15.133:0/2811713113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea84113ef0 0x7fea841acb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c3b0 tx=0x7fea6c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea80ff9640 1 -- 172.21.15.133:0/2811713113 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea6c005c20 con 0x7fea84113ef0 2024-02-15T23:29:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea841ad2a0 con 0x7fea84113ef0 2024-02-15T23:29:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea841b13f0 con 0x7fea84113ef0 2024-02-15T23:29:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea80ff9640 1 -- 172.21.15.133:0/2811713113 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c005d80 con 0x7fea84113ef0 2024-02-15T23:29:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea80ff9640 1 -- 172.21.15.133:0/2811713113 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea6c004920 con 0x7fea84113ef0 2024-02-15T23:29:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.827+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea84062860 con 0x7fea84113ef0 2024-02-15T23:29:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.831+0000 7fea80ff9640 1 -- 172.21.15.133:0/2811713113 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea6c004a80 con 0x7fea84113ef0 2024-02-15T23:29:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.831+0000 7fea80ff9640 1 --2- 172.21.15.133:0/2811713113 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fea640359c0 0x7fea64037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.831+0000 7fea80ff9640 1 -- 172.21.15.133:0/2811713113 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4283+0+0 (secure 0 0 0) 0x7fea6c0481d0 con 0x7fea84113ef0 2024-02-15T23:29:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.831+0000 7fea7bfff640 1 --2- 172.21.15.133:0/2811713113 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fea640359c0 0x7fea64037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.831+0000 7fea7bfff640 1 --2- 172.21.15.133:0/2811713113 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fea640359c0 0x7fea64037e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea740ae000 tx=0x7fea74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.843+0000 7fea80ff9640 1 -- 172.21.15.133:0/2811713113 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fea6c011e10 con 0x7fea84113ef0 2024-02-15T23:29:30.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:29.999+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7fea84067620 con 0x7fea84113ef0 2024-02-15T23:29:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.655+0000 7fea80ff9640 1 -- 172.21.15.133:0/2811713113 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v21) v1 ==== 169+0+0 (secure 0 0 0) 0x7fea6c011c30 con 0x7fea84113ef0 2024-02-15T23:29:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'default.rgw.buckets.index' created 2024-02-15T23:29:30.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fea640359c0 msgr2=0x7fea64037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:30.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 --2- 172.21.15.133:0/2811713113 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fea640359c0 0x7fea64037e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea740ae000 tx=0x7fea74008040 comp rx=0 tx=0).stop 2024-02-15T23:29:30.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea84113ef0 msgr2=0x7fea841acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:30.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 --2- 172.21.15.133:0/2811713113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea84113ef0 0x7fea841acb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c3b0 tx=0x7fea6c00c870 comp rx=0 tx=0).stop 2024-02-15T23:29:30.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 shutdown_connections 2024-02-15T23:29:30.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 --2- 172.21.15.133:0/2811713113 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fea640359c0 0x7fea64037e80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:30.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 --2- 172.21.15.133:0/2811713113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea84113ef0 0x7fea841acb60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:30.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 >> 172.21.15.133:0/2811713113 conn(0x7fea8406e870 msgr2=0x7fea8410ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:30.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 shutdown_connections 2024-02-15T23:29:30.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.659+0000 7fea89d05640 1 -- 172.21.15.133:0/2811713113 wait complete. 2024-02-15T23:29:30.699 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-02-15T23:29:30.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25e02d9640 1 Processor -- start 2024-02-15T23:29:30.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25e02d9640 1 -- start start 2024-02-15T23:29:30.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25e02d9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25d811a310 0x7f25d811c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:30.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25e02d9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d811cc70 con 0x7f25d8116550 2024-02-15T23:29:30.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25e02d9640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d811de30 con 0x7f25d811a310 2024-02-15T23:29:30.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25dd874640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25d811a310 0x7f25d811c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:30.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25dd874640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25d811a310 0x7f25d811c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:55622/0 (socket says 172.21.15.133:55622) 2024-02-15T23:29:30.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25dd874640 1 -- 172.21.15.133:0/2578569463 learned_addr learned my addr 172.21.15.133:0/2578569463 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:30.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25dd874640 1 -- 172.21.15.133:0/2578569463 >> v1:172.21.15.131:6789/0 conn(0x7f25d8116550 legacy=0x7f25d8116930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:30.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.811+0000 7f25dd874640 1 -- 172.21.15.133:0/2578569463 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d811dfa0 con 0x7f25d811a310 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25dd874640 1 --2- 172.21.15.133:0/2578569463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d811a310 0x7f25d811c700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f25c80097f0 tx=0x7f25c801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d381c66a8f724a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25dd073640 1 -- 172.21.15.133:0/2578569463 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25c80ab580 con 0x7f25d811a310 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25dd073640 1 -- 172.21.15.133:0/2578569463 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c80ab6e0 con 0x7f25d811a310 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25dd073640 1 -- 172.21.15.133:0/2578569463 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25c80ab9a0 con 0x7f25d811a310 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 -- 172.21.15.133:0/2578569463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d811a310 msgr2=0x7f25d811c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 --2- 172.21.15.133:0/2578569463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d811a310 0x7f25d811c700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f25c80097f0 tx=0x7f25c801c430 comp rx=0 tx=0).stop 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 -- 172.21.15.133:0/2578569463 shutdown_connections 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 --2- 172.21.15.133:0/2578569463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d811a310 0x7f25d811c700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 -- 172.21.15.133:0/2578569463 >> 172.21.15.133:0/2578569463 conn(0x7f25d806dbe0 msgr2=0x7f25d806dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 -- 172.21.15.133:0/2578569463 shutdown_connections 2024-02-15T23:29:30.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 -- 172.21.15.133:0/2578569463 wait complete. 2024-02-15T23:29:30.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 Processor -- start 2024-02-15T23:29:30.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.815+0000 7f25e02d9640 1 -- start start 2024-02-15T23:29:30.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25e02d9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d8116550 0x7f25d81a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:30.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25e02d9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81a8cf0 con 0x7f25d8116550 2024-02-15T23:29:30.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25de075640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d8116550 0x7f25d81a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:30.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25de075640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d8116550 0x7f25d81a87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:55628/0 (socket says 172.21.15.133:55628) 2024-02-15T23:29:30.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25de075640 1 -- 172.21.15.133:0/315297303 learned_addr learned my addr 172.21.15.133:0/315297303 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25de075640 1 -- 172.21.15.133:0/315297303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c80094d0 con 0x7f25d8116550 2024-02-15T23:29:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25de075640 1 --2- 172.21.15.133:0/315297303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d8116550 0x7f25d81a87b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25d400c450 tx=0x7f25d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25ceffd640 1 -- 172.21.15.133:0/315297303 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25d4005150 con 0x7f25d8116550 2024-02-15T23:29:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d81a8f50 con 0x7f25d8116550 2024-02-15T23:29:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25ceffd640 1 -- 172.21.15.133:0/315297303 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d40052b0 con 0x7f25d8116550 2024-02-15T23:29:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25ceffd640 1 -- 172.21.15.133:0/315297303 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25d4007030 con 0x7f25d8116550 2024-02-15T23:29:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d81ad0d0 con 0x7f25d8116550 2024-02-15T23:29:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d8062860 con 0x7f25d8116550 2024-02-15T23:29:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25ceffd640 1 -- 172.21.15.133:0/315297303 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f25d4007260 con 0x7f25d8116550 2024-02-15T23:29:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25ceffd640 1 --2- 172.21.15.133:0/315297303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25bc0359c0 0x7f25bc037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25ceffd640 1 -- 172.21.15.133:0/315297303 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4647+0+0 (secure 0 0 0) 0x7f25d4047a00 con 0x7f25d8116550 2024-02-15T23:29:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.819+0000 7f25dd874640 1 --2- 172.21.15.133:0/315297303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25bc0359c0 0x7f25bc037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:30.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.823+0000 7f25dd874640 1 --2- 172.21.15.133:0/315297303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25bc0359c0 0x7f25bc037e80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25c80af000 tx=0x7f25c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:30.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.835+0000 7f25ceffd640 1 -- 172.21.15.133:0/315297303 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f25d40106f0 con 0x7f25d8116550 2024-02-15T23:29:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:30.991+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f25d8067620 con 0x7f25d8116550 2024-02-15T23:29:31.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.659+0000 7f25ceffd640 1 -- 172.21.15.133:0/315297303 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v22) v1 ==== 187+0+0 (secure 0 0 0) 0x7f25d40102e0 con 0x7f25d8116550 2024-02-15T23:29:31.670 INFO:teuthology.orchestra.run.smithi133.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-02-15T23:29:31.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25bc0359c0 msgr2=0x7f25bc037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:31.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 --2- 172.21.15.133:0/315297303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25bc0359c0 0x7f25bc037e80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25c80af000 tx=0x7f25c8008040 comp rx=0 tx=0).stop 2024-02-15T23:29:31.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d8116550 msgr2=0x7f25d81a87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:31.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 --2- 172.21.15.133:0/315297303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d8116550 0x7f25d81a87b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25d400c450 tx=0x7f25d400c910 comp rx=0 tx=0).stop 2024-02-15T23:29:31.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 shutdown_connections 2024-02-15T23:29:31.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 --2- 172.21.15.133:0/315297303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25bc0359c0 0x7f25bc037e80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:31.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 --2- 172.21.15.133:0/315297303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25d8116550 0x7f25d81a87b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:31.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 >> 172.21.15.133:0/315297303 conn(0x7f25d806dbe0 msgr2=0x7f25d81182e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:31.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 shutdown_connections 2024-02-15T23:29:31.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:31.663+0000 7f25e02d9640 1 -- 172.21.15.133:0/315297303 wait complete. 2024-02-15T23:29:31.707 DEBUG:tasks.rgw:Pools created 2024-02-15T23:29:31.708 INFO:tasks.rgw:Starting rgw... 2024-02-15T23:29:31.708 INFO:tasks.rgw:rgw client.0 config is {} 2024-02-15T23:29:31.708 INFO:tasks.rgw:Using beast as radosgw frontend 2024-02-15T23:29:31.708 DEBUG:teuthology.orchestra.run.smithi133:> sudo echo -n http://smithi133.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-02-15T23:29:31.725 INFO:teuthology.orchestra.run.smithi133.stdout:http://smithi133.front.sepia.ceph.com:80 2024-02-15T23:29:31.726 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-02-15T23:29:31.779 INFO:tasks.rgw.client.0:Restarting daemon 2024-02-15T23:29:31.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-02-15T23:29:31.823 INFO:tasks.rgw.client.0:Started 2024-02-15T23:29:31.823 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T23:29:31.823 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T23:29:31.854 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T23:29:31.854 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T23:29:31.854 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-15T23:29:31.855 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-15T23:29:31.855 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-15T23:29:32.856 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T23:29:32.868 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T23:29:32.868 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T23:29:32.869 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-15T23:29:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-15T23:29:32.869 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-15T23:29:34.870 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T23:29:34.882 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T23:29:34.882 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T23:29:34.882 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-15T23:29:34.882 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-15T23:29:34.883 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-15T23:29:38.885 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T23:29:38.897 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T23:29:38.897 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T23:29:38.897 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-15T23:29:38.897 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-15T23:29:38.897 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-15T23:29:46.898 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T23:29:46.910 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T23:29:46.910 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T23:29:46.913 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 61265 0 --:--:-- --:--:-- --:--:-- 71333 2024-02-15T23:29:46.914 INFO:teuthology.orchestra.run.smithi133.stdout:anonymous 2024-02-15T23:29:46.914 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-02-15T23:29:46.993 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-02-15T23:29:46.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-15T23:29:46.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-15T23:29:46.993 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-15T23:29:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fbd645980 1 Processor -- start 2024-02-15T23:29:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fbd645980 1 -- start start 2024-02-15T23:29:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fbd645980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5595f52f04d0 0x5595f52f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fbd645980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5595f52384b0 con 0x5595f52600b0 2024-02-15T23:29:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fbd645980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5595f51ff180 con 0x5595f52f04d0 2024-02-15T23:29:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fb295f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5595f52f04d0 0x5595f52f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fbb160640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5595f52600b0 0x5595f52eedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39612/0 (socket says 172.21.15.133:39612) 2024-02-15T23:29:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fb295f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5595f52f04d0 0x5595f52f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41420/0 (socket says 172.21.15.133:41420) 2024-02-15T23:29:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fbb160640 1 -- 172.21.15.133:0/2355254142 learned_addr learned my addr 172.21.15.133:0/2355254142 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fba95f640 1 -- 172.21.15.133:0/2355254142 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646151655 0 0) 0x5595f52384b0 con 0x5595f52600b0 2024-02-15T23:29:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fba95f640 1 -- 172.21.15.133:0/2355254142 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa8001e20 con 0x5595f52600b0 2024-02-15T23:29:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fb295f640 1 -- 172.21.15.133:0/2355254142 >> v1:172.21.15.131:6789/0 conn(0x5595f52600b0 legacy=0x5595f52eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.023+0000 7f7fb295f640 1 -- 172.21.15.133:0/2355254142 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f52f3ed0 con 0x5595f52f04d0 2024-02-15T23:29:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fb295f640 1 --2- 172.21.15.133:0/2355254142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52f28c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400a480 tx=0x7f7fa401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dafd05d6c7369d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fba95f640 1 -- 172.21.15.133:0/2355254142 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa40ab540 con 0x5595f52f04d0 2024-02-15T23:29:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fba95f640 1 -- 172.21.15.133:0/2355254142 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40ab6a0 con 0x5595f52f04d0 2024-02-15T23:29:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fba95f640 1 -- 172.21.15.133:0/2355254142 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa40ab940 con 0x5595f52f04d0 2024-02-15T23:29:47.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fbd645980 1 -- 172.21.15.133:0/2355254142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 msgr2=0x5595f52f28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fbd645980 1 --2- 172.21.15.133:0/2355254142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52f28c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400a480 tx=0x7f7fa401b280 comp rx=0 tx=0).stop 2024-02-15T23:29:47.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fbd645980 1 -- 172.21.15.133:0/2355254142 shutdown_connections 2024-02-15T23:29:47.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fbd645980 1 --2- 172.21.15.133:0/2355254142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52f28c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fbd645980 1 -- 172.21.15.133:0/2355254142 >> 172.21.15.133:0/2355254142 conn(0x5595f52e68d0 msgr2=0x5595f52e8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fbd645980 1 -- 172.21.15.133:0/2355254142 shutdown_connections 2024-02-15T23:29:47.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.027+0000 7f7fbd645980 1 -- 172.21.15.133:0/2355254142 wait complete. 2024-02-15T23:29:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.043+0000 7f7fbd645980 1 Processor -- start 2024-02-15T23:29:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.043+0000 7f7fbd645980 1 -- start start 2024-02-15T23:29:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.043+0000 7f7fbd645980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52600b0 0x5595f53d5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.043+0000 7f7fbd645980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f51fc6b0 con 0x5595f52600b0 2024-02-15T23:29:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.043+0000 7f7fbb160640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52600b0 0x5595f53d5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.043+0000 7f7fbb160640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52600b0 0x5595f53d5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41436/0 (socket says 172.21.15.133:41436) 2024-02-15T23:29:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.043+0000 7f7fbb160640 1 -- 172.21.15.133:0/3232903490 learned_addr learned my addr 172.21.15.133:0/3232903490 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbb160640 1 -- 172.21.15.133:0/3232903490 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4005d30 con 0x5595f52600b0 2024-02-15T23:29:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbb160640 1 --2- 172.21.15.133:0/3232903490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52600b0 0x5595f53d5ef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7fac001c30 tx=0x7f7fac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c10bf3a0eb34963 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7ea960a640 1 -- 172.21.15.133:0/3232903490 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fac00e690 con 0x5595f52600b0 2024-02-15T23:29:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7ea960a640 1 -- 172.21.15.133:0/3232903490 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00e7f0 con 0x5595f52600b0 2024-02-15T23:29:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7ea960a640 1 -- 172.21.15.133:0/3232903490 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fac00eb50 con 0x5595f52600b0 2024-02-15T23:29:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 -- 172.21.15.133:0/3232903490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52600b0 msgr2=0x5595f53d5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 --2- 172.21.15.133:0/3232903490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52600b0 0x5595f53d5ef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7fac001c30 tx=0x7f7fac00b6d0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 -- 172.21.15.133:0/3232903490 shutdown_connections 2024-02-15T23:29:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 --2- 172.21.15.133:0/3232903490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52600b0 0x5595f53d5ef0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 -- 172.21.15.133:0/3232903490 >> 172.21.15.133:0/3232903490 conn(0x5595f52e68d0 msgr2=0x5595f53d1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 -- 172.21.15.133:0/3232903490 shutdown_connections 2024-02-15T23:29:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 -- 172.21.15.133:0/3232903490 wait complete. 2024-02-15T23:29:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 Processor -- start 2024-02-15T23:29:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 -- start start 2024-02-15T23:29:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbd645980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f51f7e90 con 0x5595f52f04d0 2024-02-15T23:29:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbb160640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbb160640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52ec4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41438/0 (socket says 172.21.15.133:41438) 2024-02-15T23:29:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbb160640 1 -- 172.21.15.133:0/256911018 learned_addr learned my addr 172.21.15.133:0/256911018 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.047+0000 7f7fbb160640 1 -- 172.21.15.133:0/256911018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8001e20 con 0x5595f52f04d0 2024-02-15T23:29:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbb160640 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52ec4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00b710 tx=0x7f7fac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7ea7e07640 1 -- 172.21.15.133:0/256911018 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fac01f070 con 0x5595f52f04d0 2024-02-15T23:29:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7ea7e07640 1 -- 172.21.15.133:0/256911018 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac01a2e0 con 0x5595f52f04d0 2024-02-15T23:29:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595f52eca00 con 0x5595f52f04d0 2024-02-15T23:29:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7ea7e07640 1 -- 172.21.15.133:0/256911018 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fac01a780 con 0x5595f52f04d0 2024-02-15T23:29:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595f52eaf70 con 0x5595f52f04d0 2024-02-15T23:29:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7ea7e07640 1 -- 172.21.15.133:0/256911018 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7fac00a040 con 0x5595f52f04d0 2024-02-15T23:29:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7ea7e07640 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ea0034300 0x7f7ea00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7ea7e07640 1 -- 172.21.15.133:0/256911018 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7fac0494f0 con 0x5595f52f04d0 2024-02-15T23:29:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fb295f640 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ea0034300 0x7f7ea00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbd645980 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f53e3f10 0x5595f53e6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f53e6840 con 0x5595f53e3f10 2024-02-15T23:29:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbb961640 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f53e3f10 0x5595f53e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fb295f640 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ea0034300 0x7f7ea00367c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ad000 tx=0x7f7fa40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbb961640 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f53e3f10 0x5595f53e6300 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbb961640 1 -- 172.21.15.133:0/256911018 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fb400a4d0 con 0x5595f53e3f10 2024-02-15T23:29:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f53e6ba0 con 0x5595f53e3f10 2024-02-15T23:29:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbb961640 1 -- 172.21.15.133:0/256911018 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7fb400a4d0 con 0x5595f53e3f10 2024-02-15T23:29:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f53e8400 con 0x5595f53e3f10 2024-02-15T23:29:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbb961640 1 -- 172.21.15.133:0/256911018 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7fb400a4d0 con 0x5595f53e3f10 2024-02-15T23:29:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.051+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f53e7600 con 0x5595f53e3f10 2024-02-15T23:29:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbb961640 1 -- 172.21.15.133:0/256911018 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7fb400a4d0 con 0x5595f53e3f10 2024-02-15T23:29:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f53e7a10 con 0x5595f53e3f10 2024-02-15T23:29:47.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbb961640 1 -- 172.21.15.133:0/256911018 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7fb400a4d0 con 0x5595f53e3f10 2024-02-15T23:29:47.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbd645980 1 Processor -- start 2024-02-15T23:29:47.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbd645980 1 -- start start 2024-02-15T23:29:47.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbd645980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f53f6a40 0x5595f53f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbd645980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f5190f20 con 0x5595f53f6a40 2024-02-15T23:29:47.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fb295f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f53f6a40 0x5595f53f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fb295f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f53f6a40 0x5595f53f6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41452/0 (socket says 172.21.15.133:41452) 2024-02-15T23:29:47.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fb295f640 1 -- 172.21.15.133:0/2190719669 learned_addr learned my addr 172.21.15.133:0/2190719669 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fb295f640 1 -- 172.21.15.133:0/2190719669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f53f73a0 con 0x5595f53f6a40 2024-02-15T23:29:47.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fb295f640 1 --2- 172.21.15.133:0/2190719669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f53f6a40 0x5595f53f6e60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4096e80 tx=0x7f7fa4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7ea5602640 1 -- 172.21.15.133:0/2190719669 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa40be7c0 con 0x5595f53f6a40 2024-02-15T23:29:47.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbd645980 1 -- 172.21.15.133:0/2190719669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595f53f7590 con 0x5595f53f6a40 2024-02-15T23:29:47.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7ea5602640 1 -- 172.21.15.133:0/2190719669 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40be920 con 0x5595f53f6a40 2024-02-15T23:29:47.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7ea5602640 1 -- 172.21.15.133:0/2190719669 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa40bebc0 con 0x5595f53f6a40 2024-02-15T23:29:47.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.055+0000 7f7fbd645980 1 -- 172.21.15.133:0/2190719669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595f53f80e0 con 0x5595f53f6a40 2024-02-15T23:29:47.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7ea5602640 1 -- 172.21.15.133:0/2190719669 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7fa40bed20 con 0x5595f53f6a40 2024-02-15T23:29:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7ea5602640 1 --2- 172.21.15.133:0/2190719669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e940342b0 0x7f7e94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7ea5602640 1 -- 172.21.15.133:0/2190719669 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7fa40e6290 con 0x5595f53f6a40 2024-02-15T23:29:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbb961640 1 --2- 172.21.15.133:0/2190719669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e940342b0 0x7f7e94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 Processor -- start 2024-02-15T23:29:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 -- start start 2024-02-15T23:29:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbb961640 1 --2- 172.21.15.133:0/2190719669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e940342b0 0x7f7e94036770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5595f53e70a0 tx=0x7f7fb4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f5403e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f5184790 con 0x5595f5403a20 2024-02-15T23:29:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fb295f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f5403e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fb295f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f5403e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41468/0 (socket says 172.21.15.133:41468) 2024-02-15T23:29:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fb295f640 1 -- 172.21.15.133:0/294617922 learned_addr learned my addr 172.21.15.133:0/294617922 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fb295f640 1 -- 172.21.15.133:0/294617922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f5404410 con 0x5595f5403a20 2024-02-15T23:29:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fb295f640 1 --2- 172.21.15.133:0/294617922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f5403e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40e45f0 tx=0x7f7fa4006f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b149ec4c172ce4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7e9effd640 1 -- 172.21.15.133:0/294617922 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa40e60d0 con 0x5595f5403a20 2024-02-15T23:29:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7e9effd640 1 -- 172.21.15.133:0/294617922 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40ade40 con 0x5595f5403a20 2024-02-15T23:29:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7e9effd640 1 -- 172.21.15.133:0/294617922 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa40b4c50 con 0x5595f5403a20 2024-02-15T23:29:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 -- 172.21.15.133:0/294617922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 msgr2=0x5595f5403e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 --2- 172.21.15.133:0/294617922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f5403e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40e45f0 tx=0x7f7fa4006f30 comp rx=0 tx=0).stop 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 -- 172.21.15.133:0/294617922 shutdown_connections 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 --2- 172.21.15.133:0/294617922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f5403e40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 -- 172.21.15.133:0/294617922 >> 172.21.15.133:0/294617922 conn(0x5595f53ffdb0 msgr2=0x5595f53fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 -- 172.21.15.133:0/294617922 shutdown_connections 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 -- 172.21.15.133:0/294617922 wait complete. 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 Processor -- start 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.059+0000 7f7fbd645980 1 -- start start 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f540a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f540ae70 con 0x5595f5403a20 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fb295f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f540a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fb295f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f540a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41470/0 (socket says 172.21.15.133:41470) 2024-02-15T23:29:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 learned_addr learned my addr 172.21.15.133:0/786044567 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f53f80e0 con 0x5595f5403a20 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fb295f640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f540a930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b5f10 tx=0x7f7fa40e4550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7e9d7fa640 1 -- 172.21.15.133:0/786044567 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa40e60d0 con 0x5595f5403a20 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7e9d7fa640 1 -- 172.21.15.133:0/786044567 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40e31d0 con 0x5595f5403a20 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595f540b070 con 0x5595f5403a20 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7e9d7fa640 1 -- 172.21.15.133:0/786044567 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa40aad50 con 0x5595f5403a20 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595f540b4a0 con 0x5595f5403a20 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7e9d7fa640 1 -- 172.21.15.133:0/786044567 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7fa40b4370 con 0x5595f5403a20 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7e9d7fa640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e840342b0 0x7f7e84036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7e9d7fa640 1 -- 172.21.15.133:0/786044567 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7fa40f49c0 con 0x5595f5403a20 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbb961640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e840342b0 0x7f7e84036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f5415d50 0x5595f54181f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5418940 con 0x5595f5415d50 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbb160640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f5415d50 0x5595f54181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbb961640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e840342b0 0x7f7e84036770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4011010 tx=0x7f7fb4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbb160640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f5415d50 0x5595f54181f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fac014070 con 0x5595f5415d50 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.063+0000 7f7fbd645980 20 realm 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5418d10 con 0x5595f5415d50 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fac014070 con 0x5595f5415d50 2024-02-15T23:29:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5419560 con 0x5595f5415d50 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fac014070 con 0x5595f5415d50 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f54198c0 con 0x5595f5415d50 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7fac014070 con 0x5595f5415d50 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5419200 con 0x5595f5415d50 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7fac014070 con 0x5595f5415d50 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 20 searching for the correct realm 2024-02-15T23:29:47.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5595f541bb10 0x5595f541df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541e610 con 0x5595f541bb10 2024-02-15T23:29:47.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fb295f640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5595f541bb10 0x5595f541df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fb295f640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5595f541bb10 0x5595f541df40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40b49a0 con 0x5595f541bb10 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fb295f640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f7fa40c7070 0x7f7fa40dc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb961640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f7fa40c7070 0x7f7fa40dc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb961640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f7fa40c7070 0x7f7fa40dc830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb400a4d0 con 0x7f7fa40c7070 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb961640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7fb40141d0 0x7f7fb4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.067+0000 7f7fbb160640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7fb40141d0 0x7f7fb4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7fb40141d0 0x7f7fb4015940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac014070 con 0x7f7fb40141d0 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7fac03e040 con 0x5595f5415d50 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac03e040 con 0x5595f5415d50 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac03e040 con 0x7f7fb40141d0 2024-02-15T23:29:47.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac03e040 con 0x7f7fb40141d0 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb400a4d0 con 0x7f7fa40c7070 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7fac03e040 con 0x5595f5415d50 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.071+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac03e040 con 0x7f7fb40141d0 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac03e040 con 0x5595f5415d50 2024-02-15T23:29:47.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac03e040 con 0x7f7fb40141d0 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac03e040 con 0x5595f5415d50 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7fac03e040 con 0x5595f5415d50 2024-02-15T23:29:47.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.075+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.079+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541a760 con 0x5595f5415d50 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541a3e0 con 0x5595f5415d50 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541b0f0 con 0x5595f5415d50 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 zone default found 2024-02-15T23:29:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 4 Realm: () 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 zonegroup default 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541ea50 con 0x7f7fb40141d0 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f54207e0 con 0x5595f541bb10 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.083+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5420b40 con 0x5595f541bb10 2024-02-15T23:29:47.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fbd645980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fbd645980 20 started sync module instance, tier type = 2024-02-15T23:29:47.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fbd645980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:47.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f54200c0 con 0x7f7fa40c7070 2024-02-15T23:29:47.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94102553230368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5420470 con 0x7f7fa40c7070 2024-02-15T23:29:47.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5421830 con 0x5595f5415d50 2024-02-15T23:29:47.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.087+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94102553230368] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.091+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.091+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94102553235184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5421810 con 0x5595f5415d50 2024-02-15T23:29:47.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.091+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f54222b0 con 0x5595f541bb10 2024-02-15T23:29:47.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.091+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94102553235184] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.091+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.091+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94102553238928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5422690 con 0x5595f541bb10 2024-02-15T23:29:47.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.091+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5423000 con 0x7f7fa40c7070 2024-02-15T23:29:47.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.095+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.095+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94102553242768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5423850 con 0x7f7fa40c7070 2024-02-15T23:29:47.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.095+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5424250 con 0x5595f5415d50 2024-02-15T23:29:47.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.095+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94102553238928] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.099+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.099+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94102553247056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5424210 con 0x5595f5415d50 2024-02-15T23:29:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.099+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5424c10 con 0x7f7fb40141d0 2024-02-15T23:29:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.099+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94102553242768] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.099+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94102553247056] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.103+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.103+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94102553236240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5424770 con 0x7f7fb40141d0 2024-02-15T23:29:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.103+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5424f70 con 0x7f7fb40141d0 2024-02-15T23:29:47.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.107+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.107+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94102553250208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f54253e0 con 0x7f7fb40141d0 2024-02-15T23:29:47.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.107+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5425eb0 con 0x7f7fb40141d0 2024-02-15T23:29:47.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.107+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94102553236240] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94102553250208] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94102553254288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5425e70 con 0x7f7fb40141d0 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 20 add_watcher() i=0 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 20 add_watcher() i=1 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 20 add_watcher() i=2 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 20 add_watcher() i=3 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 20 add_watcher() i=4 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 20 add_watcher() i=5 2024-02-15T23:29:47.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 20 add_watcher() i=6 2024-02-15T23:29:47.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94102553254288] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 20 add_watcher() i=7 2024-02-15T23:29:47.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:47.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.111+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5424f40 con 0x5595f5415d50 2024-02-15T23:29:47.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94102553251648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f54234c0 con 0x5595f5415d50 2024-02-15T23:29:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94102553251648] v31'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbd645980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbd645980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbd645980 5 note: GC not initialized 2024-02-15T23:29:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7e70fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbd645980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbd645980 20 Filter name: none 2024-02-15T23:29:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7dea7fc640 20 reqs_thread_entry: start 2024-02-15T23:29:47.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.115+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f544a450 con 0x5595f541bb10 2024-02-15T23:29:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f544a450 con 0x5595f541bb10 2024-02-15T23:29:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f544a450 con 0x5595f5415d50 2024-02-15T23:29:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541a3e0 con 0x5595f5415d50 2024-02-15T23:29:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541a3e0 con 0x7f7fa40c7070 2024-02-15T23:29:47.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.119+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.123+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(80 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.127+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fb40141d0 2024-02-15T23:29:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f5415d50 2024-02-15T23:29:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x5595f541bb10 2024-02-15T23:29:47.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7fa40f4ca0 con 0x7f7fa40c7070 2024-02-15T23:29:47.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.131+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.135+0000 7f7e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.135+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94102553251648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541a3e0 con 0x5595f5415d50 2024-02-15T23:29:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.135+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94102553251648] v31'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.135+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94102553230368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f544a410 con 0x7f7fa40c7070 2024-02-15T23:29:47.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.139+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94102553230368] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.139+0000 7f7fbd645980 20 remove_watcher() i=0 2024-02-15T23:29:47.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.139+0000 7f7fbd645980 2 removed watcher, disabling cache 2024-02-15T23:29:47.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.139+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94102553235184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f544a410 con 0x5595f5415d50 2024-02-15T23:29:47.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.139+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94102553235184] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.139+0000 7f7fbd645980 20 remove_watcher() i=1 2024-02-15T23:29:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.139+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94102553238928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f544a410 con 0x5595f541bb10 2024-02-15T23:29:47.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.143+0000 7f7fb295f640 1 -- 172.21.15.133:0/786044567 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94102553238928] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fa40fd040 con 0x5595f541bb10 2024-02-15T23:29:47.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.143+0000 7f7fbd645980 20 remove_watcher() i=2 2024-02-15T23:29:47.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.143+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94102553242768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541fc20 con 0x7f7fa40c7070 2024-02-15T23:29:47.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.143+0000 7f7fbb961640 1 -- 172.21.15.133:0/786044567 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94102553242768] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb403a040 con 0x7f7fa40c7070 2024-02-15T23:29:47.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.143+0000 7f7fbd645980 20 remove_watcher() i=3 2024-02-15T23:29:47.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.143+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94102553247056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f5420ef0 con 0x5595f5415d50 2024-02-15T23:29:47.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.147+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94102553247056] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x5595f5415d50 2024-02-15T23:29:47.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.147+0000 7f7fbd645980 20 remove_watcher() i=4 2024-02-15T23:29:47.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.147+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94102553236240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541fc20 con 0x7f7fb40141d0 2024-02-15T23:29:47.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.147+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94102553236240] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.147+0000 7f7fbd645980 20 remove_watcher() i=5 2024-02-15T23:29:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.147+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94102553250208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f541fc20 con 0x7f7fb40141d0 2024-02-15T23:29:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94102553250208] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 20 remove_watcher() i=6 2024-02-15T23:29:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94102553254288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595f54249a0 con 0x7f7fb40141d0 2024-02-15T23:29:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94102553254288] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fac059040 con 0x7f7fb40141d0 2024-02-15T23:29:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 20 remove_watcher() i=7 2024-02-15T23:29:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7fb40141d0 msgr2=0x7f7fb4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7fb40141d0 0x7f7fb4015940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f5415d50 msgr2=0x5595f54181f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f5415d50 0x5595f54181f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f7fa40c7070 msgr2=0x7f7fa40dc830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f7fa40c7070 0x7f7fa40dc830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5595f541bb10 msgr2=0x5595f541df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5595f541bb10 0x5595f541df40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e840342b0 msgr2=0x7f7e84036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e840342b0 0x7f7e84036770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4011010 tx=0x7f7fb4020000 comp rx=0 tx=0).stop 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 msgr2=0x5595f540a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbb160640 1 -- 172.21.15.133:0/786044567 reap_dead start 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.151+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f540a930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b5f10 tx=0x7f7fa40e4550 comp rx=0 tx=0).stop 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 shutdown_connections 2024-02-15T23:29:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/786044567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f5403a20 0x5595f540a930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 >> 172.21.15.133:0/786044567 conn(0x5595f53ffdb0 msgr2=0x5595f53fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 shutdown_connections 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/786044567 wait complete. 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/2190719669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e940342b0 msgr2=0x7f7e94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/2190719669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e940342b0 0x7f7e94036770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5595f53e70a0 tx=0x7f7fb4005850 comp rx=0 tx=0).stop 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/2190719669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f53f6a40 msgr2=0x5595f53f6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/2190719669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f53f6a40 0x5595f53f6e60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4096e80 tx=0x7f7fa4018020 comp rx=0 tx=0).stop 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/2190719669 shutdown_connections 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/2190719669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7e940342b0 0x7f7e94036770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/2190719669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f53f6a40 0x5595f53f6e60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/2190719669 >> 172.21.15.133:0/2190719669 conn(0x5595f53eb850 msgr2=0x5595f53ec360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/2190719669 shutdown_connections 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/2190719669 wait complete. 2024-02-15T23:29:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f53e3f10 msgr2=0x5595f53e6300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f53e3f10 0x5595f53e6300 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ea0034300 msgr2=0x7f7ea00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ea0034300 0x7f7ea00367c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ad000 tx=0x7f7fa40a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 msgr2=0x5595f52ec4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52ec4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00b710 tx=0x7f7fac000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 shutdown_connections 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5595f53e3f10 0x5595f53e6300 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ea0034300 0x7f7ea00367c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 --2- 172.21.15.133:0/256911018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f52f04d0 0x5595f52ec4c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 >> 172.21.15.133:0/256911018 conn(0x5595f52e68d0 msgr2=0x5595f53d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 shutdown_connections 2024-02-15T23:29:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.155+0000 7f7fbd645980 1 -- 172.21.15.133:0/256911018 wait complete. 2024-02-15T23:29:47.177 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-02-15T23:29:47.177 DEBUG:tasks.util.rgw: json result: [] 2024-02-15T23:29:47.177 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-02-15T23:29:47.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-02-15T23:29:47.178 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-02-15T23:29:47.259 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:47.259 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:47.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a885df980 1 Processor -- start 2024-02-15T23:29:47.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a885df980 1 -- start start 2024-02-15T23:29:47.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a885df980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5590412006a0 0x55904128dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a885df980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5590411d74c0 con 0x5590412019e0 2024-02-15T23:29:47.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a885df980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55904119e180 con 0x5590412006a0 2024-02-15T23:29:47.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a858f9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5590412006a0 0x55904128dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a858f9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5590412006a0 0x55904128dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41482/0 (socket says 172.21.15.133:41482) 2024-02-15T23:29:47.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a860fa640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5590412019e0 0x5590411fff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39624/0 (socket says 172.21.15.133:39624) 2024-02-15T23:29:47.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a858f9640 1 -- 172.21.15.133:0/1133448858 learned_addr learned my addr 172.21.15.133:0/1133448858 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a858f9640 1 -- 172.21.15.133:0/1133448858 >> v1:172.21.15.131:6789/0 conn(0x5590412019e0 legacy=0x5590411fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.251+0000 7f2a858f9640 1 -- 172.21.15.133:0/1133448858 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559041200ab0 con 0x5590412006a0 2024-02-15T23:29:47.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a858f9640 1 --2- 172.21.15.133:0/1133448858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904128dd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000a5c0 tx=0x7f2a7001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520986a416a83227 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a850f8640 1 -- 172.21.15.133:0/1133448858 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a700ac460 con 0x5590412006a0 2024-02-15T23:29:47.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a850f8640 1 -- 172.21.15.133:0/1133448858 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a700ac5c0 con 0x5590412006a0 2024-02-15T23:29:47.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a850f8640 1 -- 172.21.15.133:0/1133448858 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a700ac880 con 0x5590412006a0 2024-02-15T23:29:47.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a885df980 1 -- 172.21.15.133:0/1133448858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 msgr2=0x55904128dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a885df980 1 --2- 172.21.15.133:0/1133448858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904128dd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000a5c0 tx=0x7f2a7001b340 comp rx=0 tx=0).stop 2024-02-15T23:29:47.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a885df980 1 -- 172.21.15.133:0/1133448858 shutdown_connections 2024-02-15T23:29:47.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a885df980 1 --2- 172.21.15.133:0/1133448858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904128dd20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a885df980 1 -- 172.21.15.133:0/1133448858 >> 172.21.15.133:0/1133448858 conn(0x559041286a00 msgr2=0x559041288e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a885df980 1 -- 172.21.15.133:0/1133448858 shutdown_connections 2024-02-15T23:29:47.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.255+0000 7f2a885df980 1 -- 172.21.15.133:0/1133448858 wait complete. 2024-02-15T23:29:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a885df980 1 Processor -- start 2024-02-15T23:29:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a885df980 1 -- start start 2024-02-15T23:29:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a885df980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904137b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a885df980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904119b6b0 con 0x5590412006a0 2024-02-15T23:29:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a860fa640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904137b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a860fa640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904137b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41490/0 (socket says 172.21.15.133:41490) 2024-02-15T23:29:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a860fa640 1 -- 172.21.15.133:0/2162624562 learned_addr learned my addr 172.21.15.133:0/2162624562 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a860fa640 1 -- 172.21.15.133:0/2162624562 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70005df0 con 0x5590412006a0 2024-02-15T23:29:47.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.271+0000 7f2a860fa640 1 --2- 172.21.15.133:0/2162624562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904137b9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a78006fc0 tx=0x7f2a780019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ec14fda4fd2882 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2974608640 1 -- 172.21.15.133:0/2162624562 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a78013420 con 0x5590412006a0 2024-02-15T23:29:47.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2974608640 1 -- 172.21.15.133:0/2162624562 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a78013580 con 0x5590412006a0 2024-02-15T23:29:47.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2974608640 1 -- 172.21.15.133:0/2162624562 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a78013880 con 0x5590412006a0 2024-02-15T23:29:47.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- 172.21.15.133:0/2162624562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 msgr2=0x55904137b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 --2- 172.21.15.133:0/2162624562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904137b9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a78006fc0 tx=0x7f2a780019b0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- 172.21.15.133:0/2162624562 shutdown_connections 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 --2- 172.21.15.133:0/2162624562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x55904137b9d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- 172.21.15.133:0/2162624562 >> 172.21.15.133:0/2162624562 conn(0x559041286a00 msgr2=0x559041377560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- 172.21.15.133:0/2162624562 shutdown_connections 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- 172.21.15.133:0/2162624562 wait complete. 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 Processor -- start 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- start start 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x559041382860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559041196e90 con 0x5590412006a0 2024-02-15T23:29:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a860fa640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x559041382860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a860fa640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x559041382860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41494/0 (socket says 172.21.15.133:41494) 2024-02-15T23:29:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a860fa640 1 -- 172.21.15.133:0/4290030567 learned_addr learned my addr 172.21.15.133:0/4290030567 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a860fa640 1 -- 172.21.15.133:0/4290030567 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590411d74c0 con 0x5590412006a0 2024-02-15T23:29:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a860fa640 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x559041382860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a780012f0 tx=0x7f2a78001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2972e05640 1 -- 172.21.15.133:0/4290030567 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a78006320 con 0x5590412006a0 2024-02-15T23:29:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2972e05640 1 -- 172.21.15.133:0/4290030567 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a78006840 con 0x5590412006a0 2024-02-15T23:29:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559041382da0 con 0x5590412006a0 2024-02-15T23:29:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2972e05640 1 -- 172.21.15.133:0/4290030567 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a78004c90 con 0x5590412006a0 2024-02-15T23:29:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.275+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590413831f0 con 0x5590412006a0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2972e05640 1 -- 172.21.15.133:0/4290030567 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2a7801e3f0 con 0x5590412006a0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2972e05640 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f296c034300 0x7f296c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2972e05640 1 -- 172.21.15.133:0/4290030567 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2a78049860 con 0x5590412006a0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a858f9640 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f296c034300 0x7f296c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a885df980 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590412019e0 0x5590413894b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413899f0 con 0x5590412019e0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a868fb640 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590412019e0 0x5590413894b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a858f9640 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f296c034300 0x7f296c0367c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a700ae000 tx=0x7f2a700a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a868fb640 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590412019e0 0x5590413894b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a868fb640 1 -- 172.21.15.133:0/4290030567 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2a800083f0 con 0x5590412019e0 2024-02-15T23:29:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559041386be0 con 0x5590412019e0 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a868fb640 1 -- 172.21.15.133:0/4290030567 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2a800083f0 con 0x5590412019e0 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55904138b6f0 con 0x5590412019e0 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a868fb640 1 -- 172.21.15.133:0/4290030567 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2a800083f0 con 0x5590412019e0 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55904138a8f0 con 0x5590412019e0 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a868fb640 1 -- 172.21.15.133:0/4290030567 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2a800083f0 con 0x5590412019e0 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55904138ad00 con 0x5590412019e0 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a868fb640 1 -- 172.21.15.133:0/4290030567 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2a80012040 con 0x5590412019e0 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.279+0000 7f2a885df980 1 Processor -- start 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a885df980 1 -- start start 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a885df980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559041399db0 0x55904139a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a885df980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904112ff20 con 0x559041399db0 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a858f9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559041399db0 0x55904139a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a858f9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559041399db0 0x55904139a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41504/0 (socket says 172.21.15.133:41504) 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a858f9640 1 -- 172.21.15.133:0/1010383003 learned_addr learned my addr 172.21.15.133:0/1010383003 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a858f9640 1 -- 172.21.15.133:0/1010383003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55904139a710 con 0x559041399db0 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a858f9640 1 --2- 172.21.15.133:0/1010383003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559041399db0 0x55904139a1d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2a7001b380 tx=0x7f2a700180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f296bfff640 1 -- 172.21.15.133:0/1010383003 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a700bf5b0 con 0x559041399db0 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a885df980 1 -- 172.21.15.133:0/1010383003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55904139a900 con 0x559041399db0 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f296bfff640 1 -- 172.21.15.133:0/1010383003 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a700bf710 con 0x559041399db0 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f296bfff640 1 -- 172.21.15.133:0/1010383003 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a700bf9b0 con 0x559041399db0 2024-02-15T23:29:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a885df980 1 -- 172.21.15.133:0/1010383003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55904139b3f0 con 0x559041399db0 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f296bfff640 1 -- 172.21.15.133:0/1010383003 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2a700bfb60 con 0x559041399db0 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f296bfff640 1 --2- 172.21.15.133:0/1010383003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29600342b0 0x7f2960036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f296bfff640 1 -- 172.21.15.133:0/1010383003 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2a700e6030 con 0x559041399db0 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a868fb640 1 --2- 172.21.15.133:0/1010383003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29600342b0 0x7f2960036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a885df980 1 Processor -- start 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a885df980 1 -- start start 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.283+0000 7f2a868fb640 1 --2- 172.21.15.133:0/1010383003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29600342b0 0x7f2960036770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55904138a330 tx=0x7f2a80003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413a7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559041123790 con 0x5590413a6df0 2024-02-15T23:29:47.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413a7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41514/0 (socket says 172.21.15.133:41514) 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 -- 172.21.15.133:0/2233207045 learned_addr learned my addr 172.21.15.133:0/2233207045 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 -- 172.21.15.133:0/2233207045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590413a77e0 con 0x5590413a6df0 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 --2- 172.21.15.133:0/2233207045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413a7210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a700e4450 tx=0x7f2a70006450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c382fa4389f03b0c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2969ffb640 1 -- 172.21.15.133:0/2233207045 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a700be510 con 0x5590413a6df0 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2969ffb640 1 -- 172.21.15.133:0/2233207045 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a700bd360 con 0x5590413a6df0 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2969ffb640 1 -- 172.21.15.133:0/2233207045 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a700bd6f0 con 0x5590413a6df0 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 -- 172.21.15.133:0/2233207045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 msgr2=0x5590413a7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 --2- 172.21.15.133:0/2233207045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413a7210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a700e4450 tx=0x7f2a70006450 comp rx=0 tx=0).stop 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 -- 172.21.15.133:0/2233207045 shutdown_connections 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 --2- 172.21.15.133:0/2233207045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413a7210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 -- 172.21.15.133:0/2233207045 >> 172.21.15.133:0/2233207045 conn(0x5590413a3180 msgr2=0x5590413a11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 -- 172.21.15.133:0/2233207045 shutdown_connections 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 -- 172.21.15.133:0/2233207045 wait complete. 2024-02-15T23:29:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 Processor -- start 2024-02-15T23:29:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 -- start start 2024-02-15T23:29:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a885df980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590413ae270 con 0x5590413a6df0 2024-02-15T23:29:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41518/0 (socket says 172.21.15.133:41518) 2024-02-15T23:29:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 learned_addr learned my addr 172.21.15.133:0/401511919 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55904139b3f0 con 0x5590413a6df0 2024-02-15T23:29:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2a858f9640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413add30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a700b6bd0 tx=0x7f2a700e43b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.287+0000 7f2957fff640 1 -- 172.21.15.133:0/401511919 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a700ec070 con 0x5590413a6df0 2024-02-15T23:29:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590413ae470 con 0x5590413a6df0 2024-02-15T23:29:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2957fff640 1 -- 172.21.15.133:0/401511919 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a700bd4d0 con 0x5590413a6df0 2024-02-15T23:29:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2957fff640 1 -- 172.21.15.133:0/401511919 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a700e2070 con 0x5590413a6df0 2024-02-15T23:29:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590413ae8a0 con 0x5590413a6df0 2024-02-15T23:29:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2957fff640 1 -- 172.21.15.133:0/401511919 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2a700b8b40 con 0x5590413a6df0 2024-02-15T23:29:47.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2957fff640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29500342b0 0x7f2950036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2957fff640 1 -- 172.21.15.133:0/401511919 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2a700e9ce0 con 0x5590413a6df0 2024-02-15T23:29:47.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a868fb640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29500342b0 0x7f2950036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590413b92b0 0x5590413bb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413bbec0 con 0x5590413b92b0 2024-02-15T23:29:47.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a860fa640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590413b92b0 0x5590413bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a868fb640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29500342b0 0x7f2950036770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a80008fd0 tx=0x7f2a8001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a860fa640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590413b92b0 0x5590413bb770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 realm 2024-02-15T23:29:47.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413bc290 con 0x5590413b92b0 2024-02-15T23:29:47.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:47.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413bcb10 con 0x5590413b92b0 2024-02-15T23:29:47.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413bce70 con 0x5590413b92b0 2024-02-15T23:29:47.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:47.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.291+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413bd670 con 0x5590413b92b0 2024-02-15T23:29:47.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a885df980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:47.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a885df980 20 searching for the correct realm 2024-02-15T23:29:47.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5590413bf500 0x5590413c1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a858f9640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5590413bf500 0x5590413c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a858f9640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5590413bf500 0x5590413c1990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a858f9640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2a700c8070 0x7f2a700d5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a700c8070 2024-02-15T23:29:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a868fb640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2a700c8070 0x7f2a700d5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a868fb640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2a700c8070 0x7f2a700d5810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a8002c040 con 0x7f2a700c8070 2024-02-15T23:29:47.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a868fb640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2a80027940 0x7f2a800333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a860fa640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2a80027940 0x7f2a800333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a860fa640 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2a80027940 0x7f2a800333c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x7f2a80027940 2024-02-15T23:29:47.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413b92b0 2024-02-15T23:29:47.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.295+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413b92b0 2024-02-15T23:29:47.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x7f2a80027940 2024-02-15T23:29:47.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x7f2a80027940 2024-02-15T23:29:47.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a700c8070 2024-02-15T23:29:47.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a8002c040 con 0x7f2a700c8070 2024-02-15T23:29:47.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413b92b0 2024-02-15T23:29:47.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x7f2a80027940 2024-02-15T23:29:47.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413b92b0 2024-02-15T23:29:47.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a700c8070 2024-02-15T23:29:47.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.299+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2a8002c040 con 0x7f2a700c8070 2024-02-15T23:29:47.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x7f2a80027940 2024-02-15T23:29:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413b92b0 2024-02-15T23:29:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413b92b0 2024-02-15T23:29:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x7f2a80027940 2024-02-15T23:29:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a700c8070 2024-02-15T23:29:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a8002c040 con 0x7f2a700c8070 2024-02-15T23:29:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413b92b0 2024-02-15T23:29:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78024070 con 0x5590413b92b0 2024-02-15T23:29:47.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.303+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a700c8070 2024-02-15T23:29:47.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a8002c040 con 0x7f2a700c8070 2024-02-15T23:29:47.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413bf500 2024-02-15T23:29:47.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a80027940 2024-02-15T23:29:47.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x5590413b92b0 2024-02-15T23:29:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c2060 con 0x7f2a700c8070 2024-02-15T23:29:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2a8002c040 con 0x7f2a700c8070 2024-02-15T23:29:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a885df980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a885df980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a885df980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a885df980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a885df980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a885df980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.307+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413bdfa0 con 0x5590413b92b0 2024-02-15T23:29:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413be7f0 con 0x5590413b92b0 2024-02-15T23:29:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c24a0 con 0x5590413b92b0 2024-02-15T23:29:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 zone default found 2024-02-15T23:29:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 4 Realm: () 2024-02-15T23:29:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:47.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:47.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:47.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 zonegroup default 2024-02-15T23:29:47.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c24a0 con 0x7f2a80027940 2024-02-15T23:29:47.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c4230 con 0x5590413bf500 2024-02-15T23:29:47.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c4600 con 0x5590413bf500 2024-02-15T23:29:47.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 started sync module instance, tier type = 2024-02-15T23:29:47.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:47.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c3b10 con 0x7f2a700c8070 2024-02-15T23:29:47.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94078058116720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c3ec0 con 0x7f2a700c8070 2024-02-15T23:29:47.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.311+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c5360 con 0x5590413b92b0 2024-02-15T23:29:47.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.315+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94078058116720] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.315+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.315+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94078058121760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c5320 con 0x5590413b92b0 2024-02-15T23:29:47.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.315+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c5d70 con 0x5590413bf500 2024-02-15T23:29:47.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94078058121760] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94078058125424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c6120 con 0x5590413bf500 2024-02-15T23:29:47.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c6a90 con 0x7f2a700c8070 2024-02-15T23:29:47.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94078058129184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c72e0 con 0x7f2a700c8070 2024-02-15T23:29:47.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c7d00 con 0x5590413b92b0 2024-02-15T23:29:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94078058125424] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94078058129184] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.319+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.323+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94078058133472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c6e40 con 0x5590413b92b0 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.323+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c8550 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.323+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94078058133472] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.323+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.323+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94078058122816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c6e40 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.323+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c8a60 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94078058122816] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94078058136896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c8a20 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c9390 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94078058136896] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94078058135216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c9390 con 0x7f2a80027940 2024-02-15T23:29:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 20 add_watcher() i=0 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 20 add_watcher() i=1 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 20 add_watcher() i=2 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 20 add_watcher() i=3 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 20 add_watcher() i=4 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 20 add_watcher() i=5 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.327+0000 7f2a885df980 20 add_watcher() i=6 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94078058135216] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a885df980 20 add_watcher() i=7 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a885df980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413cc780 con 0x5590413b92b0 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94078058139840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c9c90 con 0x5590413b92b0 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94078058139840] v31'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f293cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a885df980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.331+0000 7f2a885df980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.335+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d4da0 con 0x5590413b92b0 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.335+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.335+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d4e50 con 0x7f2a80027940 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.339+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.339+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d5950 con 0x5590413bf500 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.339+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.339+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d6150 con 0x5590413b92b0 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.339+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.339+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2e20 con 0x7f2a700c8070 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.343+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.343+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2e20 con 0x5590413bf500 2024-02-15T23:29:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.343+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'13 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.343+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d7330 con 0x5590413b92b0 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.343+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.343+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d7330 con 0x7f2a80027940 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.347+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'13 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.347+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d73c0 con 0x7f2a700c8070 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.347+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.351+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d78f0 con 0x5590413bf500 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.351+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.351+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d80f0 con 0x7f2a700c8070 2024-02-15T23:29:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.351+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.351+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d1e10 con 0x7f2a80027940 2024-02-15T23:29:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.355+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.355+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x7f2a700c8070 2024-02-15T23:29:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.355+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.355+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x7f2a80027940 2024-02-15T23:29:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.359+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'19 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.359+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413b92b0 2024-02-15T23:29:47.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.359+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.359+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.363+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.363+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x7f2a700c8070 2024-02-15T23:29:47.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.363+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.363+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.363+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.363+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413b92b0 2024-02-15T23:29:47.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.367+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.367+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413b92b0 2024-02-15T23:29:47.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.367+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.367+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.371+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'15 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.371+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x7f2a700c8070 2024-02-15T23:29:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.375+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.375+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.375+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.375+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.379+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.379+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.379+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.379+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.379+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.379+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x7f2a80027940 2024-02-15T23:29:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.383+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.383+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.383+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.383+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x7f2a80027940 2024-02-15T23:29:47.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.387+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.387+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x5590413bf500 2024-02-15T23:29:47.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.391+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.391+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x7f2a80027940 2024-02-15T23:29:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.391+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'20 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.391+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d2400 con 0x7f2a700c8070 2024-02-15T23:29:47.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f28b77fe640 20 reqs_thread_entry: start 2024-02-15T23:29:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a885df980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:47.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a885df980 20 Filter name: none 2024-02-15T23:29:47.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f28b57fa640 20 reqs_thread_entry: start 2024-02-15T23:29:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a885df980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-15T23:29:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a885df980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d42b0 con 0x7f2a700c8070 2024-02-15T23:29:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a885df980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a885df980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-02-15T23:29:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.395+0000 7f2a885df980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T23:29:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, user does not exist 2024-02-15T23:29:47.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.399+0000 7f293cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:47.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.399+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94078058139840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413d3e10 con 0x5590413b92b0 2024-02-15T23:29:47.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.399+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94078058139840] v31'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.399+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94078058116720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413b6b30 con 0x7f2a700c8070 2024-02-15T23:29:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.403+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94078058116720] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.403+0000 7f2a885df980 20 remove_watcher() i=0 2024-02-15T23:29:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.403+0000 7f2a885df980 2 removed watcher, disabling cache 2024-02-15T23:29:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.403+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94078058121760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c3670 con 0x5590413b92b0 2024-02-15T23:29:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.403+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94078058121760] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.403+0000 7f2a885df980 20 remove_watcher() i=1 2024-02-15T23:29:47.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.403+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94078058125424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c3670 con 0x5590413bf500 2024-02-15T23:29:47.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.407+0000 7f2a858f9640 1 -- 172.21.15.133:0/401511919 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94078058125424] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a700a9070 con 0x5590413bf500 2024-02-15T23:29:47.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.407+0000 7f2a885df980 20 remove_watcher() i=2 2024-02-15T23:29:47.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.407+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94078058129184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c3670 con 0x7f2a700c8070 2024-02-15T23:29:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.407+0000 7f2a868fb640 1 -- 172.21.15.133:0/401511919 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94078058129184] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a8003f040 con 0x7f2a700c8070 2024-02-15T23:29:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.407+0000 7f2a885df980 20 remove_watcher() i=3 2024-02-15T23:29:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.407+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94078058133472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c3670 con 0x5590413b92b0 2024-02-15T23:29:47.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.411+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94078058133472] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x5590413b92b0 2024-02-15T23:29:47.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.411+0000 7f2a885df980 20 remove_watcher() i=4 2024-02-15T23:29:47.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.411+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94078058122816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c77e0 con 0x7f2a80027940 2024-02-15T23:29:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.411+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94078058122816] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.411+0000 7f2a885df980 20 remove_watcher() i=5 2024-02-15T23:29:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.411+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94078058136896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c77e0 con 0x7f2a80027940 2024-02-15T23:29:47.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.415+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94078058136896] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.415+0000 7f2a885df980 20 remove_watcher() i=6 2024-02-15T23:29:47.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.415+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94078058135216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590413c8540 con 0x7f2a80027940 2024-02-15T23:29:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94078058135216] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2a78058040 con 0x7f2a80027940 2024-02-15T23:29:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 20 remove_watcher() i=7 2024-02-15T23:29:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2a80027940 msgr2=0x7f2a800333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2a80027940 0x7f2a800333c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590413b92b0 msgr2=0x5590413bb770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590413b92b0 0x5590413bb770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2a700c8070 msgr2=0x7f2a700d5810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2a700c8070 0x7f2a700d5810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5590413bf500 msgr2=0x5590413c1990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5590413bf500 0x5590413c1990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29500342b0 msgr2=0x7f2950036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29500342b0 0x7f2950036770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a80008fd0 tx=0x7f2a8001c070 comp rx=0 tx=0).stop 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 msgr2=0x5590413add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413add30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a700b6bd0 tx=0x7f2a700e43b0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a860fa640 1 -- 172.21.15.133:0/401511919 reap_dead start 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 shutdown_connections 2024-02-15T23:29:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/401511919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590413a6df0 0x5590413add30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 >> 172.21.15.133:0/401511919 conn(0x5590413a3180 msgr2=0x5590413a07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 shutdown_connections 2024-02-15T23:29:47.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/401511919 wait complete. 2024-02-15T23:29:47.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/1010383003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29600342b0 msgr2=0x7f2960036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/1010383003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29600342b0 0x7f2960036770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55904138a330 tx=0x7f2a80003070 comp rx=0 tx=0).stop 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/1010383003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559041399db0 msgr2=0x55904139a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/1010383003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559041399db0 0x55904139a1d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2a7001b380 tx=0x7f2a700180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/1010383003 shutdown_connections 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/1010383003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f29600342b0 0x7f2960036770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/1010383003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559041399db0 0x55904139a1d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/1010383003 >> 172.21.15.133:0/1010383003 conn(0x55904138ebc0 msgr2=0x55904138f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/1010383003 shutdown_connections 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/1010383003 wait complete. 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590412019e0 msgr2=0x5590413894b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590412019e0 0x5590413894b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f296c034300 msgr2=0x7f296c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f296c034300 0x7f296c0367c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a700ae000 tx=0x7f2a700a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 msgr2=0x559041382860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x559041382860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a780012f0 tx=0x7f2a78001260 comp rx=0 tx=0).stop 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 shutdown_connections 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5590412019e0 0x5590413894b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f296c034300 0x7f296c0367c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 --2- 172.21.15.133:0/4290030567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590412006a0 0x559041382860 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 >> 172.21.15.133:0/4290030567 conn(0x559041286a00 msgr2=0x559041376070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 shutdown_connections 2024-02-15T23:29:47.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.419+0000 7f2a885df980 1 -- 172.21.15.133:0/4290030567 wait complete. 2024-02-15T23:29:47.445 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-15T23:29:47.446 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-02-15T23:29:47.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-02-15T23:29:47.446 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-02-15T23:29:47.526 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:47.527 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc8743980 1 Processor -- start 2024-02-15T23:29:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc8743980 1 -- start start 2024-02-15T23:29:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc8743980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556511b0e0c0 0x556511b9f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc8743980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556511ae64c0 con 0x556511b9f700 2024-02-15T23:29:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc8743980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x556511aad180 con 0x556511b0e0c0 2024-02-15T23:29:47.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc625e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556511b0e0c0 0x556511b9f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc625e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556511b0e0c0 0x556511b9f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41524/0 (socket says 172.21.15.133:41524) 2024-02-15T23:29:47.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc625e640 1 -- 172.21.15.133:0/1268754679 learned_addr learned my addr 172.21.15.133:0/1268754679 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc5a5d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x556511b9f700 0x556511ba1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39626/0 (socket says 172.21.15.133:39626) 2024-02-15T23:29:47.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc625e640 1 -- 172.21.15.133:0/1268754679 >> v1:172.21.15.131:6789/0 conn(0x556511b9f700 legacy=0x556511ba1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.519+0000 7f4bc625e640 1 -- 172.21.15.133:0/1268754679 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556511ba4220 con 0x556511b0e0c0 2024-02-15T23:29:47.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc625e640 1 --2- 172.21.15.133:0/1268754679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511b9f1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800a5c0 tx=0x7f4bb801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca20c8bab434d53b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc525c640 1 -- 172.21.15.133:0/1268754679 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bb80aa470 con 0x556511b0e0c0 2024-02-15T23:29:47.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc525c640 1 -- 172.21.15.133:0/1268754679 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb80aa5d0 con 0x556511b0e0c0 2024-02-15T23:29:47.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc525c640 1 -- 172.21.15.133:0/1268754679 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bb80aa890 con 0x556511b0e0c0 2024-02-15T23:29:47.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc8743980 1 -- 172.21.15.133:0/1268754679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 msgr2=0x556511b9f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc8743980 1 --2- 172.21.15.133:0/1268754679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511b9f1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800a5c0 tx=0x7f4bb801b340 comp rx=0 tx=0).stop 2024-02-15T23:29:47.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc8743980 1 -- 172.21.15.133:0/1268754679 shutdown_connections 2024-02-15T23:29:47.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc8743980 1 --2- 172.21.15.133:0/1268754679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511b9f1c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc8743980 1 -- 172.21.15.133:0/1268754679 >> 172.21.15.133:0/1268754679 conn(0x556511b948e0 msgr2=0x556511b96d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc8743980 1 -- 172.21.15.133:0/1268754679 shutdown_connections 2024-02-15T23:29:47.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.523+0000 7f4bc8743980 1 -- 172.21.15.133:0/1268754679 wait complete. 2024-02-15T23:29:47.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.539+0000 7f4bc8743980 1 Processor -- start 2024-02-15T23:29:47.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.539+0000 7f4bc8743980 1 -- start start 2024-02-15T23:29:47.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.539+0000 7f4bc8743980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c862f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.539+0000 7f4bc8743980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511aaa6b0 con 0x556511b0e0c0 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.539+0000 7f4bc625e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.539+0000 7f4bc625e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c862f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41534/0 (socket says 172.21.15.133:41534) 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.539+0000 7f4bc625e640 1 -- 172.21.15.133:0/979677187 learned_addr learned my addr 172.21.15.133:0/979677187 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc625e640 1 -- 172.21.15.133:0/979677187 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8005df0 con 0x556511b0e0c0 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc625e640 1 --2- 172.21.15.133:0/979677187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c862f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80ac040 tx=0x7f4bb8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274ee78a3d4b3782 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4ab4608640 1 -- 172.21.15.133:0/979677187 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bb80aa9b0 con 0x556511b0e0c0 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4ab4608640 1 -- 172.21.15.133:0/979677187 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb80aab30 con 0x556511b0e0c0 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4ab4608640 1 -- 172.21.15.133:0/979677187 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bb80aae10 con 0x556511b0e0c0 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 -- 172.21.15.133:0/979677187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 msgr2=0x556511c862f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 --2- 172.21.15.133:0/979677187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c862f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80ac040 tx=0x7f4bb8003030 comp rx=0 tx=0).stop 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 -- 172.21.15.133:0/979677187 shutdown_connections 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 --2- 172.21.15.133:0/979677187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c862f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 -- 172.21.15.133:0/979677187 >> 172.21.15.133:0/979677187 conn(0x556511b948e0 msgr2=0x556511c81e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 -- 172.21.15.133:0/979677187 shutdown_connections 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 -- 172.21.15.133:0/979677187 wait complete. 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 Processor -- start 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 -- start start 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c8d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc8743980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511aa5e90 con 0x556511b0e0c0 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc625e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c8d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc625e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c8d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41540/0 (socket says 172.21.15.133:41540) 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc625e640 1 -- 172.21.15.133:0/2092090591 learned_addr learned my addr 172.21.15.133:0/2092090591 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.543+0000 7f4bc625e640 1 -- 172.21.15.133:0/2092090591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556511ba4220 con 0x556511b0e0c0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc625e640 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c8d000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4bb801b820 tx=0x7f4bb80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4ab2e05640 1 -- 172.21.15.133:0/2092090591 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bb80c6710 con 0x556511b0e0c0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4ab2e05640 1 -- 172.21.15.133:0/2092090591 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb80c6870 con 0x556511b0e0c0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556511c8d540 con 0x556511b0e0c0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4ab2e05640 1 -- 172.21.15.133:0/2092090591 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bb80c6b50 con 0x556511b0e0c0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556511c8d970 con 0x556511b0e0c0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4ab2e05640 1 -- 172.21.15.133:0/2092090591 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4bb80d0410 con 0x556511b0e0c0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4ab2e05640 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aac0342b0 0x7f4aac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4ab2e05640 1 -- 172.21.15.133:0/2092090591 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4bb80e51b0 con 0x556511b0e0c0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc5a5d640 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aac0342b0 0x7f4aac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511b9f700 0x556511c93c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511c941d0 con 0x556511b9f700 2024-02-15T23:29:47.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511b9f700 0x556511c93c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc5a5d640 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aac0342b0 0x7f4aac036770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001e50 tx=0x7f4bbc0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511b9f700 0x556511c93c90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2092090591 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4bc000a4d0 con 0x556511b9f700 2024-02-15T23:29:47.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511c94570 con 0x556511b9f700 2024-02-15T23:29:47.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2092090591 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4bc000a4d0 con 0x556511b9f700 2024-02-15T23:29:47.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511c95e20 con 0x556511b9f700 2024-02-15T23:29:47.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2092090591 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4bc000a4d0 con 0x556511b9f700 2024-02-15T23:29:47.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.547+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511c95020 con 0x556511b9f700 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2092090591 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4bc000a4d0 con 0x556511b9f700 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511c95430 con 0x556511b9f700 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2092090591 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4bc000a4d0 con 0x556511b9f700 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc8743980 1 Processor -- start 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc8743980 1 -- start start 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc8743980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511ca44e0 0x556511ca4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc8743980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511a3ef20 con 0x556511ca44e0 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc5a5d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511ca44e0 0x556511ca4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc5a5d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511ca44e0 0x556511ca4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41544/0 (socket says 172.21.15.133:41544) 2024-02-15T23:29:47.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/3307383695 learned_addr learned my addr 172.21.15.133:0/3307383695 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/3307383695 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556511ca4e40 con 0x556511ca44e0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc5a5d640 1 --2- 172.21.15.133:0/3307383695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511ca44e0 0x556511ca4900 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00e640 tx=0x7f4bbc00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4aabfff640 1 -- 172.21.15.133:0/3307383695 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bbc007040 con 0x556511ca44e0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4aabfff640 1 -- 172.21.15.133:0/3307383695 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc00d660 con 0x556511ca44e0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc8743980 1 -- 172.21.15.133:0/3307383695 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556511ca5090 con 0x556511ca44e0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4aabfff640 1 -- 172.21.15.133:0/3307383695 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bbc00d920 con 0x556511ca44e0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4bc8743980 1 -- 172.21.15.133:0/3307383695 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556511ca5be0 con 0x556511ca44e0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.551+0000 7f4aabfff640 1 -- 172.21.15.133:0/3307383695 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4bbc01a070 con 0x556511ca44e0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4aabfff640 1 --2- 172.21.15.133:0/3307383695 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aa00342b0 0x7f4aa0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4aabfff640 1 -- 172.21.15.133:0/3307383695 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4bbc017050 con 0x556511ca44e0 2024-02-15T23:29:47.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/3307383695 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aa00342b0 0x7f4aa0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 Processor -- start 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- start start 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/3307383695 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aa00342b0 0x7f4aa0036770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x556511c94a60 tx=0x7f4bc0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511a32790 con 0x556511cb14b0 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc5a5d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc5a5d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41560/0 (socket says 172.21.15.133:41560) 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/464411690 learned_addr learned my addr 172.21.15.133:0/464411690 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/464411690 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556511cb1e60 con 0x556511cb14b0 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc5a5d640 1 --2- 172.21.15.133:0/464411690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb1890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00ff70 tx=0x7f4bbc01ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889694bd89a64eed server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4aa9ffb640 1 -- 172.21.15.133:0/464411690 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bbc025360 con 0x556511cb14b0 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4aa9ffb640 1 -- 172.21.15.133:0/464411690 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc00de00 con 0x556511cb14b0 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4aa9ffb640 1 -- 172.21.15.133:0/464411690 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bbc03ad00 con 0x556511cb14b0 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- 172.21.15.133:0/464411690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 msgr2=0x556511cb1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 --2- 172.21.15.133:0/464411690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb1890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00ff70 tx=0x7f4bbc01ae40 comp rx=0 tx=0).stop 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- 172.21.15.133:0/464411690 shutdown_connections 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 --2- 172.21.15.133:0/464411690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb1890 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- 172.21.15.133:0/464411690 >> 172.21.15.133:0/464411690 conn(0x556511cad7f0 msgr2=0x556511cab850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- 172.21.15.133:0/464411690 shutdown_connections 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- 172.21.15.133:0/464411690 wait complete. 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 Processor -- start 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- start start 2024-02-15T23:29:47.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc8743980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511cb8880 con 0x556511cb14b0 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc5a5d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc5a5d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41562/0 (socket says 172.21.15.133:41562) 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.555+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 learned_addr learned my addr 172.21.15.133:0/2308792708 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556511ca5be0 con 0x556511cb14b0 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc5a5d640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb8340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00eed0 tx=0x7f4bbc048c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4a97fff640 1 -- 172.21.15.133:0/2308792708 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bbc025360 con 0x556511cb14b0 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4a97fff640 1 -- 172.21.15.133:0/2308792708 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc0246d0 con 0x556511cb14b0 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556511cb8a80 con 0x556511cb14b0 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4a97fff640 1 -- 172.21.15.133:0/2308792708 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bbc024e70 con 0x556511cb14b0 2024-02-15T23:29:47.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556511cb8f10 con 0x556511cb14b0 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4a97fff640 1 -- 172.21.15.133:0/2308792708 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4bbc04aa30 con 0x556511cb14b0 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4a97fff640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4a90034260 0x7f4a90036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4a97fff640 1 -- 172.21.15.133:0/2308792708 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4bbc010070 con 0x556511cb14b0 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4a90034260 0x7f4a90036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511cc38d0 0x556511cc5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc64e0 con 0x556511cc38d0 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4a90034260 0x7f4a90036720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0011010 tx=0x7f4bc0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc625e640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511cc38d0 0x556511cc5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.559+0000 7f4bc625e640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511cc38d0 0x556511cc5d90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4bb80b0020 con 0x556511cc38d0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 realm 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc68b0 con 0x556511cc38d0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4bb80b0020 con 0x556511cc38d0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc7130 con 0x556511cc38d0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4bb80b0020 con 0x556511cc38d0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc7490 con 0x556511cc38d0 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4bb80b0020 con 0x556511cc38d0 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc7c90 con 0x556511cc38d0 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4bb80b0020 con 0x556511cc38d0 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 20 searching for the correct realm 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556511cc9b20 0x556511ccbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc5a5d640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556511cc9b20 0x556511ccbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc5a5d640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556511cc9b20 0x556511ccbf10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc5a5d640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4bbc027060 0x7f4bbc0308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bbc027060 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4bbc027060 0x7f4bbc0308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4bbc027060 0x7f4bbc0308b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bc000a4d0 con 0x7f4bbc027060 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc6a5f640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4bc00141d0 0x7f4bc0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.563+0000 7f4bc625e640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4bc00141d0 0x7f4bc0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4bc00141d0 0x7f4bc0015940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80b0020 con 0x7f4bc00141d0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc38d0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4bb80ed080 con 0x556511cc38d0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc38d0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x556511cc38d0 2024-02-15T23:29:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x7f4bc00141d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x7f4bc00141d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bbc027060 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bc000a4d0 con 0x7f4bbc027060 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc38d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.567+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4bb80ed080 con 0x556511cc38d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x7f4bc00141d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc38d0 2024-02-15T23:29:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x556511cc38d0 2024-02-15T23:29:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bbc027060 2024-02-15T23:29:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x7f4bc00141d0 2024-02-15T23:29:47.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc38d0 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x556511cc38d0 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.571+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc38d0 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4bb80ed080 con 0x556511cc38d0 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x7f4bc00141d0 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bbc027060 2024-02-15T23:29:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc38d0 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x556511cc38d0 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x7f4bc00141d0 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ed080 con 0x7f4bc00141d0 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.575+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bbc027060 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc9b20 2024-02-15T23:29:47.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bc00141d0 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x556511cc38d0 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccc5c0 con 0x7f4bbc027060 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:47.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc85f0 con 0x556511cc38d0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc8e40 con 0x556511cc38d0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc8e40 con 0x556511cc38d0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 zone default found 2024-02-15T23:29:47.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 4 Realm: () 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 zonegroup default 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc8e40 con 0x7f4bc00141d0 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.579+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cce430 con 0x556511cc9b20 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cce790 con 0x556511cc9b20 2024-02-15T23:29:47.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 20 started sync module instance, tier type = 2024-02-15T23:29:47.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:47.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccdd10 con 0x7f4bbc027060 2024-02-15T23:29:47.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93892578695280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccdc90 con 0x7f4bbc027060 2024-02-15T23:29:47.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.583+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccf4a0 con 0x556511cc38d0 2024-02-15T23:29:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.587+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.587+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93892578701312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccf8c0 con 0x556511cc38d0 2024-02-15T23:29:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.587+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd0100 con 0x556511cc9b20 2024-02-15T23:29:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.587+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93892578695280] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.587+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93892578701312] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.591+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.591+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93892578702368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccfce0 con 0x556511cc9b20 2024-02-15T23:29:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.591+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd0950 con 0x7f4bbc027060 2024-02-15T23:29:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.591+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.591+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93892578706880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd1060 con 0x7f4bbc027060 2024-02-15T23:29:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.591+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd1b30 con 0x556511cc38d0 2024-02-15T23:29:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.591+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93892578702368] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.595+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.595+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93892578711056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd1af0 con 0x556511cc38d0 2024-02-15T23:29:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.595+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd24f0 con 0x7f4bc00141d0 2024-02-15T23:29:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.599+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93892578706880] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.599+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93892578711056] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.599+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.599+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93892578703424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd2050 con 0x7f4bc00141d0 2024-02-15T23:29:47.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.599+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd2d40 con 0x7f4bc00141d0 2024-02-15T23:29:47.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.603+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93892578703424] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.607+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.607+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93892578708160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd2050 con 0x7f4bc00141d0 2024-02-15T23:29:47.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.607+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3350 con 0x7f4bc00141d0 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.607+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93892578708160] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93892578715728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3350 con 0x7f4bc00141d0 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 20 add_watcher() i=0 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 20 add_watcher() i=1 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 20 add_watcher() i=2 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 20 add_watcher() i=3 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 20 add_watcher() i=4 2024-02-15T23:29:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 20 add_watcher() i=5 2024-02-15T23:29:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 20 add_watcher() i=6 2024-02-15T23:29:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93892578715728] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 20 add_watcher() i=7 2024-02-15T23:29:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd6660 con 0x556511cc38d0 2024-02-15T23:29:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.611+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93892578717728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd38e0 con 0x556511cc38d0 2024-02-15T23:29:47.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.615+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93892578717728] v31'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.615+0000 7f4a7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:47.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.615+0000 7f4bc8743980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:47.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.615+0000 7f4bc8743980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:47.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.615+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdeca0 con 0x556511cc38d0 2024-02-15T23:29:47.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.615+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.615+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cded00 con 0x7f4bc00141d0 2024-02-15T23:29:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.619+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.619+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdf330 con 0x556511cc9b20 2024-02-15T23:29:47.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.623+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.623+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdfd00 con 0x556511cc38d0 2024-02-15T23:29:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.623+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'32 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.623+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdcd20 con 0x7f4bbc027060 2024-02-15T23:29:47.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.627+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.627+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdcd20 con 0x556511cc9b20 2024-02-15T23:29:47.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.627+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'15 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.627+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce0ee0 con 0x556511cc38d0 2024-02-15T23:29:47.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.631+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.631+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce0ee0 con 0x7f4bc00141d0 2024-02-15T23:29:47.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.635+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'15 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.635+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce0ee0 con 0x7f4bbc027060 2024-02-15T23:29:47.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.635+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.635+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce1410 con 0x556511cc9b20 2024-02-15T23:29:47.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.639+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.639+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce18b0 con 0x7f4bbc027060 2024-02-15T23:29:47.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.639+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.639+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbd10 con 0x7f4bc00141d0 2024-02-15T23:29:47.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.643+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.643+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbd10 con 0x7f4bbc027060 2024-02-15T23:29:47.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.647+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.647+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbd10 con 0x7f4bc00141d0 2024-02-15T23:29:47.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.647+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'21 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.647+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbda0 con 0x556511cc38d0 2024-02-15T23:29:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.651+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.651+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbda0 con 0x556511cc9b20 2024-02-15T23:29:47.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.651+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.651+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbda0 con 0x7f4bbc027060 2024-02-15T23:29:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.655+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.655+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbda0 con 0x556511cc9b20 2024-02-15T23:29:47.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.659+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.659+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbda0 con 0x556511cc38d0 2024-02-15T23:29:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.659+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.659+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x556511cc38d0 2024-02-15T23:29:47.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.663+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.663+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x556511cc9b20 2024-02-15T23:29:47.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.663+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'18 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.663+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x7f4bbc027060 2024-02-15T23:29:47.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.667+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.667+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x556511cc9b20 2024-02-15T23:29:47.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.667+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.667+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x556511cc9b20 2024-02-15T23:29:47.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.671+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.671+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x556511cc9b20 2024-02-15T23:29:47.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.675+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.675+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x556511cc9b20 2024-02-15T23:29:47.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.675+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.675+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x7f4bc00141d0 2024-02-15T23:29:47.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.679+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.679+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x556511cc9b20 2024-02-15T23:29:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.683+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.683+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x7f4bc00141d0 2024-02-15T23:29:47.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.683+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.683+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ce2420 con 0x556511cc9b20 2024-02-15T23:29:47.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.687+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.687+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbb40 con 0x7f4bc00141d0 2024-02-15T23:29:47.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.691+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'22 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.691+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdbb40 con 0x7f4bbc027060 2024-02-15T23:29:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.691+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.691+0000 7f49f77fe640 20 reqs_thread_entry: start 2024-02-15T23:29:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.691+0000 7f4bc8743980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc8743980 20 Filter name: none 2024-02-15T23:29:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f49f57fa640 20 reqs_thread_entry: start 2024-02-15T23:29:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc8743980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-15T23:29:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc8743980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cdaba0 con 0x7f4bc00141d0 2024-02-15T23:29:47.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc8743980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc8743980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-15T23:29:47.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc8743980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T23:29:47.703 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, user does not exist 2024-02-15T23:29:47.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4a7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:47.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.695+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93892578717728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cc0a90 con 0x556511cc38d0 2024-02-15T23:29:47.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93892578717728] v31'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93892578695280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3020 con 0x7f4bbc027060 2024-02-15T23:29:47.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93892578695280] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc8743980 20 remove_watcher() i=0 2024-02-15T23:29:47.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc8743980 2 removed watcher, disabling cache 2024-02-15T23:29:47.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93892578701312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3020 con 0x556511cc38d0 2024-02-15T23:29:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93892578701312] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc8743980 20 remove_watcher() i=1 2024-02-15T23:29:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.699+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93892578702368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511ccf000 con 0x556511cc9b20 2024-02-15T23:29:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.703+0000 7f4bc5a5d640 1 -- 172.21.15.133:0/2308792708 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93892578702368] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bbc02d040 con 0x556511cc9b20 2024-02-15T23:29:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.703+0000 7f4bc8743980 20 remove_watcher() i=2 2024-02-15T23:29:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.703+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93892578706880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3020 con 0x7f4bbc027060 2024-02-15T23:29:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.703+0000 7f4bc6a5f640 1 -- 172.21.15.133:0/2308792708 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93892578706880] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bc003a040 con 0x7f4bbc027060 2024-02-15T23:29:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.703+0000 7f4bc8743980 20 remove_watcher() i=3 2024-02-15T23:29:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.703+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93892578711056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3020 con 0x556511cc38d0 2024-02-15T23:29:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.707+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93892578711056] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x556511cc38d0 2024-02-15T23:29:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.707+0000 7f4bc8743980 20 remove_watcher() i=4 2024-02-15T23:29:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.707+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93892578703424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3020 con 0x7f4bc00141d0 2024-02-15T23:29:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.711+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93892578703424] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.711+0000 7f4bc8743980 20 remove_watcher() i=5 2024-02-15T23:29:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.711+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93892578708160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3020 con 0x7f4bc00141d0 2024-02-15T23:29:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.711+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93892578708160] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.711+0000 7f4bc8743980 20 remove_watcher() i=6 2024-02-15T23:29:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.711+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93892578715728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556511cd3020 con 0x7f4bc00141d0 2024-02-15T23:29:47.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93892578715728] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bb80ff040 con 0x7f4bc00141d0 2024-02-15T23:29:47.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 20 remove_watcher() i=7 2024-02-15T23:29:47.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4bc00141d0 msgr2=0x7f4bc0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4bc00141d0 0x7f4bc0015940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511cc38d0 msgr2=0x556511cc5d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511cc38d0 0x556511cc5d90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4bbc027060 msgr2=0x7f4bbc0308b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4bbc027060 0x7f4bbc0308b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556511cc9b20 msgr2=0x556511ccbf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556511cc9b20 0x556511ccbf10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4a90034260 msgr2=0x7f4a90036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4a90034260 0x7f4a90036720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0011010 tx=0x7f4bc0020000 comp rx=0 tx=0).stop 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc625e640 1 -- 172.21.15.133:0/2308792708 reap_dead start 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 msgr2=0x556511cb8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb8340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00eed0 tx=0x7f4bbc048c10 comp rx=0 tx=0).stop 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 shutdown_connections 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2308792708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511cb14b0 0x556511cb8340 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00eed0 tx=0x7f4bbc048c10 comp rx=0 tx=0).stop 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 >> 172.21.15.133:0/2308792708 conn(0x556511cad7f0 msgr2=0x556511caae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 shutdown_connections 2024-02-15T23:29:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2308792708 wait complete. 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/3307383695 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aa00342b0 msgr2=0x7f4aa0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/3307383695 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aa00342b0 0x7f4aa0036770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x556511c94a60 tx=0x7f4bc0005850 comp rx=0 tx=0).stop 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/3307383695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511ca44e0 msgr2=0x556511ca4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/3307383695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511ca44e0 0x556511ca4900 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00e640 tx=0x7f4bbc00ea40 comp rx=0 tx=0).stop 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/3307383695 shutdown_connections 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/3307383695 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aa00342b0 0x7f4aa0036770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/3307383695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511ca44e0 0x556511ca4900 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/3307383695 >> 172.21.15.133:0/3307383695 conn(0x556511c992f0 msgr2=0x556511c99e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/3307383695 shutdown_connections 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/3307383695 wait complete. 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511b9f700 msgr2=0x556511c93c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511b9f700 0x556511c93c90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aac0342b0 msgr2=0x7f4aac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aac0342b0 0x7f4aac036770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001e50 tx=0x7f4bbc0013b0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 msgr2=0x556511c8d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c8d000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4bb801b820 tx=0x7f4bb80180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 shutdown_connections 2024-02-15T23:29:47.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556511b9f700 0x556511c93c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4aac0342b0 0x7f4aac036770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 --2- 172.21.15.133:0/2092090591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556511b0e0c0 0x556511c8d000 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.715+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 >> 172.21.15.133:0/2092090591 conn(0x556511b948e0 msgr2=0x556511c80990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.719+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 shutdown_connections 2024-02-15T23:29:47.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.719+0000 7f4bc8743980 1 -- 172.21.15.133:0/2092090591 wait complete. 2024-02-15T23:29:47.737 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-15T23:29:47.738 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-15T23:29:47.738 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-15T23:29:47.738 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-15T23:29:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:47.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f828450f980 1 Processor -- start 2024-02-15T23:29:47.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f828450f980 1 -- start start 2024-02-15T23:29:47.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f828450f980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55e5a1374350 0x55e5a1374730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f828450f980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e5a12be4c0 con 0x55e5a1374c70 2024-02-15T23:29:47.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f828450f980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e5a1285180 con 0x55e5a1374350 2024-02-15T23:29:47.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f828202a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55e5a1374350 0x55e5a1374730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f8281829640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55e5a1374c70 0x55e5a1375620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39630/0 (socket says 172.21.15.133:39630) 2024-02-15T23:29:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f8281829640 1 -- 172.21.15.133:0/1569015344 learned_addr learned my addr 172.21.15.133:0/1569015344 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f8281028640 1 -- 172.21.15.133:0/1569015344 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138247973 0 0) 0x55e5a12be4c0 con 0x55e5a1374c70 2024-02-15T23:29:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f8281028640 1 -- 172.21.15.133:0/1569015344 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f826c001e20 con 0x55e5a1374c70 2024-02-15T23:29:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f828202a640 1 -- 172.21.15.133:0/1569015344 >> v1:172.21.15.131:6789/0 conn(0x55e5a1374c70 legacy=0x55e5a1375620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.807+0000 7f828202a640 1 -- 172.21.15.133:0/1569015344 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a1375e50 con 0x55e5a1374350 2024-02-15T23:29:47.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f828202a640 1 --2- 172.21.15.133:0/1569015344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a1374730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f827400a480 tx=0x7f827401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b132fb2dcf47e840 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f8281028640 1 -- 172.21.15.133:0/1569015344 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82740ab540 con 0x55e5a1374350 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f8281028640 1 -- 172.21.15.133:0/1569015344 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82740ab6a0 con 0x55e5a1374350 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f8281028640 1 -- 172.21.15.133:0/1569015344 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82740ab960 con 0x55e5a1374350 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f828450f980 1 -- 172.21.15.133:0/1569015344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 msgr2=0x55e5a1374730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f828450f980 1 --2- 172.21.15.133:0/1569015344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a1374730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f827400a480 tx=0x7f827401b280 comp rx=0 tx=0).stop 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f828450f980 1 -- 172.21.15.133:0/1569015344 shutdown_connections 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f828450f980 1 --2- 172.21.15.133:0/1569015344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a1374730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f828450f980 1 -- 172.21.15.133:0/1569015344 >> 172.21.15.133:0/1569015344 conn(0x55e5a12e7a40 msgr2=0x55e5a12e7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f828450f980 1 -- 172.21.15.133:0/1569015344 shutdown_connections 2024-02-15T23:29:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.811+0000 7f828450f980 1 -- 172.21.15.133:0/1569015344 wait complete. 2024-02-15T23:29:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 Processor -- start 2024-02-15T23:29:47.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 -- start start 2024-02-15T23:29:47.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a145e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a12826b0 con 0x55e5a1374350 2024-02-15T23:29:47.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828202a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a145e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828202a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a145e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41580/0 (socket says 172.21.15.133:41580) 2024-02-15T23:29:47.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828202a640 1 -- 172.21.15.133:0/3814930768 learned_addr learned my addr 172.21.15.133:0/3814930768 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828202a640 1 -- 172.21.15.133:0/3814930768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274005d30 con 0x55e5a1374350 2024-02-15T23:29:47.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828202a640 1 --2- 172.21.15.133:0/3814930768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a145e6f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8274018eb0 tx=0x7f8274003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb5773fde7daa5b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f8170608640 1 -- 172.21.15.133:0/3814930768 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82740ab810 con 0x55e5a1374350 2024-02-15T23:29:47.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f8170608640 1 -- 172.21.15.133:0/3814930768 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82740ab970 con 0x55e5a1374350 2024-02-15T23:29:47.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f8170608640 1 -- 172.21.15.133:0/3814930768 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82740abc10 con 0x55e5a1374350 2024-02-15T23:29:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 -- 172.21.15.133:0/3814930768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 msgr2=0x55e5a145e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 --2- 172.21.15.133:0/3814930768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a145e6f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8274018eb0 tx=0x7f8274003030 comp rx=0 tx=0).stop 2024-02-15T23:29:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 -- 172.21.15.133:0/3814930768 shutdown_connections 2024-02-15T23:29:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 --2- 172.21.15.133:0/3814930768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a145e6f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 -- 172.21.15.133:0/3814930768 >> 172.21.15.133:0/3814930768 conn(0x55e5a12e7a40 msgr2=0x55e5a145a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 -- 172.21.15.133:0/3814930768 shutdown_connections 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 -- 172.21.15.133:0/3814930768 wait complete. 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.827+0000 7f828450f980 1 Processor -- start 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828450f980 1 -- start start 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828450f980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a14653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828450f980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a127de90 con 0x55e5a1374350 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828202a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a14653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828202a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a14653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41592/0 (socket says 172.21.15.133:41592) 2024-02-15T23:29:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828202a640 1 -- 172.21.15.133:0/1802961965 learned_addr learned my addr 172.21.15.133:0/1802961965 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828202a640 1 -- 172.21.15.133:0/1802961965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a1375e50 con 0x55e5a1374350 2024-02-15T23:29:47.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828202a640 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a14653e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f827400a480 tx=0x7f8274018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f816ee05640 1 -- 172.21.15.133:0/1802961965 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82740c3070 con 0x55e5a1374350 2024-02-15T23:29:47.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f816ee05640 1 -- 172.21.15.133:0/1802961965 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82740be970 con 0x55e5a1374350 2024-02-15T23:29:47.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e5a1465920 con 0x55e5a1374350 2024-02-15T23:29:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f816ee05640 1 -- 172.21.15.133:0/1802961965 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82740bec50 con 0x55e5a1374350 2024-02-15T23:29:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5a1465d50 con 0x55e5a1374350 2024-02-15T23:29:47.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f816ee05640 1 -- 172.21.15.133:0/1802961965 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f82740b2070 con 0x55e5a1374350 2024-02-15T23:29:47.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f816ee05640 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81680342b0 0x7f8168036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f816ee05640 1 -- 172.21.15.133:0/1802961965 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f82740e37e0 con 0x55e5a1374350 2024-02-15T23:29:47.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f8281829640 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81680342b0 0x7f8168036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828450f980 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a1374c70 0x55e5a146c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a146c560 con 0x55e5a1374c70 2024-02-15T23:29:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.831+0000 7f828282b640 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a1374c70 0x55e5a146c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f8281829640 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81680342b0 0x7f8168036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8278001dc0 tx=0x7f8278001360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828282b640 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a1374c70 0x55e5a146c020 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828282b640 1 -- 172.21.15.133:0/1802961965 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55e5a1374c70 2024-02-15T23:29:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a146c8c0 con 0x55e5a1374c70 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828282b640 1 -- 172.21.15.133:0/1802961965 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f827c00a4d0 con 0x55e5a1374c70 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a146e0d0 con 0x55e5a1374c70 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828282b640 1 -- 172.21.15.133:0/1802961965 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f827c00a4d0 con 0x55e5a1374c70 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a146d2d0 con 0x55e5a1374c70 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828282b640 1 -- 172.21.15.133:0/1802961965 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f827c00a4d0 con 0x55e5a1374c70 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a146d6e0 con 0x55e5a1374c70 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828282b640 1 -- 172.21.15.133:0/1802961965 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f827c00a4d0 con 0x55e5a1374c70 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828450f980 1 Processor -- start 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828450f980 1 -- start start 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828450f980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a147c810 0x55e5a147cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f828450f980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a1216f20 con 0x55e5a147c810 2024-02-15T23:29:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f8281829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a147c810 0x55e5a147cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f8281829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a147c810 0x55e5a147cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41600/0 (socket says 172.21.15.133:41600) 2024-02-15T23:29:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f8281829640 1 -- 172.21.15.133:0/3551861548 learned_addr learned my addr 172.21.15.133:0/3551861548 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f8281829640 1 -- 172.21.15.133:0/3551861548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a147d170 con 0x55e5a147c810 2024-02-15T23:29:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.835+0000 7f8281829640 1 --2- 172.21.15.133:0/3551861548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a147c810 0x55e5a147cc30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f827800d660 tx=0x7f827800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8167fff640 1 -- 172.21.15.133:0/3551861548 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8278020070 con 0x55e5a147c810 2024-02-15T23:29:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8167fff640 1 -- 172.21.15.133:0/3551861548 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827800c770 con 0x55e5a147c810 2024-02-15T23:29:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f828450f980 1 -- 172.21.15.133:0/3551861548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e5a147d3c0 con 0x55e5a147c810 2024-02-15T23:29:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8167fff640 1 -- 172.21.15.133:0/3551861548 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8278013040 con 0x55e5a147c810 2024-02-15T23:29:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f828450f980 1 -- 172.21.15.133:0/3551861548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5a147df10 con 0x55e5a147c810 2024-02-15T23:29:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8167fff640 1 -- 172.21.15.133:0/3551861548 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f827800a040 con 0x55e5a147c810 2024-02-15T23:29:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8167fff640 1 --2- 172.21.15.133:0/3551861548 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f815c034300 0x7f815c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8167fff640 1 -- 172.21.15.133:0/3551861548 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f827804b650 con 0x55e5a147c810 2024-02-15T23:29:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f828282b640 1 --2- 172.21.15.133:0/3551861548 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f815c034300 0x7f815c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f828450f980 1 Processor -- start 2024-02-15T23:29:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f828450f980 1 -- start start 2024-02-15T23:29:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f828282b640 1 --2- 172.21.15.133:0/3551861548 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f815c034300 0x7f815c0367c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55e5a146ccb0 tx=0x7f827c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f828450f980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1489c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f828450f980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a120a790 con 0x55e5a14897e0 2024-02-15T23:29:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8281829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1489c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8281829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1489c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41602/0 (socket says 172.21.15.133:41602) 2024-02-15T23:29:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8281829640 1 -- 172.21.15.133:0/1841421782 learned_addr learned my addr 172.21.15.133:0/1841421782 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.839+0000 7f8281829640 1 -- 172.21.15.133:0/1841421782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a148a1d0 con 0x55e5a14897e0 2024-02-15T23:29:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8281829640 1 --2- 172.21.15.133:0/1841421782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1489c00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8278049980 tx=0x7f8278019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e447211863c2e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8165ffb640 1 -- 172.21.15.133:0/1841421782 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8278019320 con 0x55e5a14897e0 2024-02-15T23:29:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8165ffb640 1 -- 172.21.15.133:0/1841421782 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8278019480 con 0x55e5a14897e0 2024-02-15T23:29:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8165ffb640 1 -- 172.21.15.133:0/1841421782 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8278024c70 con 0x55e5a14897e0 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- 172.21.15.133:0/1841421782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 msgr2=0x55e5a1489c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 --2- 172.21.15.133:0/1841421782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1489c00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8278049980 tx=0x7f8278019a70 comp rx=0 tx=0).stop 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- 172.21.15.133:0/1841421782 shutdown_connections 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 --2- 172.21.15.133:0/1841421782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1489c00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- 172.21.15.133:0/1841421782 >> 172.21.15.133:0/1841421782 conn(0x55e5a1485b70 msgr2=0x55e5a1483bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- 172.21.15.133:0/1841421782 shutdown_connections 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- 172.21.15.133:0/1841421782 wait complete. 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 Processor -- start 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- start start 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1490740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a1490c80 con 0x55e5a14897e0 2024-02-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8281829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1490740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8281829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1490740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41616/0 (socket says 172.21.15.133:41616) 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 learned_addr learned my addr 172.21.15.133:0/133558564 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a147df10 con 0x55e5a14897e0 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8281829640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1490740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8278047040 tx=0x7f8278049910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8153fff640 1 -- 172.21.15.133:0/133558564 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8278019320 con 0x55e5a14897e0 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e5a1490e80 con 0x55e5a14897e0 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5a14912b0 con 0x55e5a14897e0 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8153fff640 1 -- 172.21.15.133:0/133558564 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827801b420 con 0x55e5a14897e0 2024-02-15T23:29:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.843+0000 7f8153fff640 1 -- 172.21.15.133:0/133558564 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82780480d0 con 0x55e5a14897e0 2024-02-15T23:29:47.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f8153fff640 1 -- 172.21.15.133:0/133558564 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8278048230 con 0x55e5a14897e0 2024-02-15T23:29:47.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f8153fff640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f814c0342b0 0x7f814c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f8153fff640 1 -- 172.21.15.133:0/133558564 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f827801c070 con 0x55e5a14897e0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828282b640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f814c0342b0 0x7f814c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a149bcc0 0x55e5a149e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a149e8d0 con 0x55e5a149bcc0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828202a640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a149bcc0 0x55e5a149e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828282b640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f814c0342b0 0x7f814c036770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f827c011010 tx=0x7f827c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828202a640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a149bcc0 0x55e5a149e180 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82740a6d60 con 0x55e5a149bcc0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 realm 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a149eca0 con 0x55e5a149bcc0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82740a6d60 con 0x55e5a149bcc0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a149f520 con 0x55e5a149bcc0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82740a6d60 con 0x55e5a149bcc0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a149f880 con 0x55e5a149bcc0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f82740d6040 con 0x55e5a149bcc0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a0080 con 0x55e5a149bcc0 2024-02-15T23:29:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f82740d6040 con 0x55e5a149bcc0 2024-02-15T23:29:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 20 searching for the correct realm 2024-02-15T23:29:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e5a14a1f10 0x55e5a14a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f8281829640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e5a14a1f10 0x55e5a14a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.847+0000 7f8281829640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e5a14a1f10 0x55e5a14a4300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278022070 con 0x55e5a14a1f10 2024-02-15T23:29:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f8281829640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f827803a020 0x7f827804b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827803a020 2024-02-15T23:29:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828282b640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f827803a020 0x7f827804b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828282b640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f827803a020 0x7f827804b8b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f827803a020 2024-02-15T23:29:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828282b640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f827c0141d0 0x7f827c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828202a640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f827c0141d0 0x7f827c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828202a640 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f827c0141d0 0x7f827c015940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740d6040 con 0x7f827c0141d0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a149bcc0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f82740e0080 con 0x55e5a149bcc0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a149bcc0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x55e5a149bcc0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.851+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x7f827c0141d0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x7f827c0141d0 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827803a020 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f827803a020 2024-02-15T23:29:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278022070 con 0x55e5a14a1f10 2024-02-15T23:29:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a149bcc0 2024-02-15T23:29:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f82740e0080 con 0x55e5a149bcc0 2024-02-15T23:29:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x7f827c0141d0 2024-02-15T23:29:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a149bcc0 2024-02-15T23:29:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x55e5a149bcc0 2024-02-15T23:29:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827803a020 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278022070 con 0x55e5a14a1f10 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278022070 con 0x55e5a14a1f10 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.855+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x7f827c0141d0 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278022070 con 0x55e5a14a1f10 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a149bcc0 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x55e5a149bcc0 2024-02-15T23:29:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a149bcc0 2024-02-15T23:29:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f82740e0080 con 0x55e5a149bcc0 2024-02-15T23:29:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x7f827c0141d0 2024-02-15T23:29:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827803a020 2024-02-15T23:29:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a149bcc0 2024-02-15T23:29:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x55e5a149bcc0 2024-02-15T23:29:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x7f827c0141d0 2024-02-15T23:29:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.859+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x7f827c0141d0 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827803a020 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a14a1f10 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827c0141d0 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f82740e0080 con 0x7f827c0141d0 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x55e5a149bcc0 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a49b0 con 0x7f827803a020 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a0980 con 0x55e5a149bcc0 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a11d0 con 0x55e5a149bcc0 2024-02-15T23:29:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.863+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a0600 con 0x55e5a149bcc0 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 zone default found 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 4 Realm: () 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 zonegroup default 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a4dd0 con 0x7f827c0141d0 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a6c50 con 0x55e5a14a1f10 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a6fb0 con 0x55e5a14a1f10 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 started sync module instance, tier type = 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a6220 con 0x7f827803a020 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94444741879296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a6220 con 0x7f827803a020 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.867+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a7920 con 0x55e5a149bcc0 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.871+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94444741879296] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.871+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.871+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94444741883280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a6220 con 0x55e5a149bcc0 2024-02-15T23:29:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.871+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a82e0 con 0x55e5a14a1f10 2024-02-15T23:29:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.871+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.871+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94444741885504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a8b30 con 0x55e5a14a1f10 2024-02-15T23:29:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.871+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a94e0 con 0x7f827803a020 2024-02-15T23:29:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.871+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94444741883280] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.875+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.875+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94444741877120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a98c0 con 0x7f827803a020 2024-02-15T23:29:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.875+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14aa230 con 0x55e5a149bcc0 2024-02-15T23:29:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.875+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94444741885504] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.875+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.875+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94444741877120] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.875+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94444741890048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14a9d90 con 0x55e5a149bcc0 2024-02-15T23:29:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.875+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14aa610 con 0x7f827c0141d0 2024-02-15T23:29:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.879+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94444741890048] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.879+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.879+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94444741887632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14aa230 con 0x7f827c0141d0 2024-02-15T23:29:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.879+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14aafd0 con 0x7f827c0141d0 2024-02-15T23:29:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.879+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.879+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94444741897008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ab3f0 con 0x7f827c0141d0 2024-02-15T23:29:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.879+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14abda0 con 0x7f827c0141d0 2024-02-15T23:29:47.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.879+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94444741887632] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94444741897008] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94444741893520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14abaa0 con 0x7f827c0141d0 2024-02-15T23:29:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 20 add_watcher() i=0 2024-02-15T23:29:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 20 add_watcher() i=1 2024-02-15T23:29:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 20 add_watcher() i=2 2024-02-15T23:29:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 20 add_watcher() i=3 2024-02-15T23:29:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 20 add_watcher() i=4 2024-02-15T23:29:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 20 add_watcher() i=5 2024-02-15T23:29:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 20 add_watcher() i=6 2024-02-15T23:29:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94444741893520] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 20 add_watcher() i=7 2024-02-15T23:29:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14aee60 con 0x55e5a149bcc0 2024-02-15T23:29:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.883+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94444741900688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ac250 con 0x55e5a149bcc0 2024-02-15T23:29:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.887+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94444741900688] v31'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.887+0000 7f8138fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.887+0000 7f828450f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.887+0000 7f828450f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.887+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b72c0 con 0x55e5a149bcc0 2024-02-15T23:29:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.887+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.887+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b7700 con 0x7f827c0141d0 2024-02-15T23:29:47.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.891+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.891+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b7ba0 con 0x55e5a14a1f10 2024-02-15T23:29:47.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.891+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.891+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b83a0 con 0x55e5a149bcc0 2024-02-15T23:29:47.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.891+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.891+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b5310 con 0x7f827803a020 2024-02-15T23:29:47.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.895+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.895+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b5310 con 0x55e5a14a1f10 2024-02-15T23:29:47.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.895+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'17 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.895+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b90e0 con 0x55e5a149bcc0 2024-02-15T23:29:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.899+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.899+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b9580 con 0x7f827c0141d0 2024-02-15T23:29:47.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.899+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'17 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.899+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b9580 con 0x7f827803a020 2024-02-15T23:29:47.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.903+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.903+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b4410 con 0x55e5a14a1f10 2024-02-15T23:29:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.903+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.903+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b4410 con 0x7f827803a020 2024-02-15T23:29:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.907+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.907+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba2c0 con 0x7f827c0141d0 2024-02-15T23:29:47.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.911+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.911+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba2c0 con 0x7f827803a020 2024-02-15T23:29:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.911+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.911+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x7f827c0141d0 2024-02-15T23:29:47.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.915+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'23 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.915+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a149bcc0 2024-02-15T23:29:47.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.915+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.915+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.919+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.919+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x7f827803a020 2024-02-15T23:29:47.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.919+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.919+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.919+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.923+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a149bcc0 2024-02-15T23:29:47.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.923+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.923+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a149bcc0 2024-02-15T23:29:47.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.923+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.923+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.927+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.927+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x7f827803a020 2024-02-15T23:29:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.927+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.931+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.931+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.931+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.931+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.931+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.935+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.935+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.935+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.935+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x7f827c0141d0 2024-02-15T23:29:47.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.939+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.939+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.943+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.943+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x7f827c0141d0 2024-02-15T23:29:47.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.943+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.943+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x55e5a14a1f10 2024-02-15T23:29:47.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.947+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.947+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x7f827c0141d0 2024-02-15T23:29:47.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.947+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'24 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14ba760 con 0x7f827803a020 2024-02-15T23:29:47.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f80b37fe640 20 reqs_thread_entry: start 2024-02-15T23:29:47.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f828450f980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:47.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f828450f980 20 Filter name: none 2024-02-15T23:29:47.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f80b17fa640 20 reqs_thread_entry: start 2024-02-15T23:29:47.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f828450f980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:29:47.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f828450f980 20 rados->read ofs=0 len=0 2024-02-15T23:29:47.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.951+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3890 con 0x7f827c0141d0 2024-02-15T23:29:47.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.955+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.955+0000 7f828450f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:47.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.955+0000 7f828450f980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-15T23:29:47.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.955+0000 7f828450f980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:47.962 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, user does not exist 2024-02-15T23:29:47.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.955+0000 7f8138fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:47.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.955+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94444741900688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3890 con 0x55e5a149bcc0 2024-02-15T23:29:47.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.955+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94444741900688] v31'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.955+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94444741879296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3890 con 0x7f827803a020 2024-02-15T23:29:47.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.959+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94444741879296] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.959+0000 7f828450f980 20 remove_watcher() i=0 2024-02-15T23:29:47.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.959+0000 7f828450f980 2 removed watcher, disabling cache 2024-02-15T23:29:47.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.959+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94444741883280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3850 con 0x55e5a149bcc0 2024-02-15T23:29:47.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.959+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94444741883280] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.959+0000 7f828450f980 20 remove_watcher() i=1 2024-02-15T23:29:47.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.959+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94444741885504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3850 con 0x55e5a14a1f10 2024-02-15T23:29:47.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.963+0000 7f8281829640 1 -- 172.21.15.133:0/133558564 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94444741885504] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8278060040 con 0x55e5a14a1f10 2024-02-15T23:29:47.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.963+0000 7f828450f980 20 remove_watcher() i=2 2024-02-15T23:29:47.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.963+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94444741877120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3850 con 0x7f827803a020 2024-02-15T23:29:47.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.963+0000 7f828282b640 1 -- 172.21.15.133:0/133558564 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94444741877120] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827c03a040 con 0x7f827803a020 2024-02-15T23:29:47.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.963+0000 7f828450f980 20 remove_watcher() i=3 2024-02-15T23:29:47.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.963+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94444741890048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3850 con 0x55e5a149bcc0 2024-02-15T23:29:47.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.963+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94444741890048] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x55e5a149bcc0 2024-02-15T23:29:47.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.967+0000 7f828450f980 20 remove_watcher() i=4 2024-02-15T23:29:47.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.967+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94444741887632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3850 con 0x7f827c0141d0 2024-02-15T23:29:47.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.967+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94444741887632] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.967+0000 7f828450f980 20 remove_watcher() i=5 2024-02-15T23:29:47.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.967+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94444741897008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3850 con 0x7f827c0141d0 2024-02-15T23:29:47.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94444741897008] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 20 remove_watcher() i=6 2024-02-15T23:29:47.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94444741893520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e5a14b3850 con 0x7f827c0141d0 2024-02-15T23:29:47.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94444741893520] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f82740f2080 con 0x7f827c0141d0 2024-02-15T23:29:47.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 20 remove_watcher() i=7 2024-02-15T23:29:47.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f827c0141d0 msgr2=0x7f827c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f827c0141d0 0x7f827c015940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a149bcc0 msgr2=0x55e5a149e180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a149bcc0 0x55e5a149e180 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f827803a020 msgr2=0x7f827804b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f827803a020 0x7f827804b8b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e5a14a1f10 msgr2=0x55e5a14a4300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e5a14a1f10 0x55e5a14a4300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f814c0342b0 msgr2=0x7f814c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f814c0342b0 0x7f814c036770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f827c011010 tx=0x7f827c020000 comp rx=0 tx=0).stop 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 msgr2=0x55e5a1490740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828202a640 1 -- 172.21.15.133:0/133558564 reap_dead start 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.971+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1490740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8278047040 tx=0x7f8278049910 comp rx=0 tx=0).stop 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 shutdown_connections 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/133558564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a14897e0 0x55e5a1490740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 >> 172.21.15.133:0/133558564 conn(0x55e5a1485b70 msgr2=0x55e5a14831d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 shutdown_connections 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/133558564 wait complete. 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/3551861548 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f815c034300 msgr2=0x7f815c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/3551861548 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f815c034300 0x7f815c0367c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55e5a146ccb0 tx=0x7f827c005850 comp rx=0 tx=0).stop 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/3551861548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a147c810 msgr2=0x55e5a147cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/3551861548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a147c810 0x55e5a147cc30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f827800d660 tx=0x7f827800da60 comp rx=0 tx=0).stop 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/3551861548 shutdown_connections 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/3551861548 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f815c034300 0x7f815c0367c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/3551861548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a147c810 0x55e5a147cc30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/3551861548 >> 172.21.15.133:0/3551861548 conn(0x55e5a1471620 msgr2=0x55e5a1472130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/3551861548 shutdown_connections 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/3551861548 wait complete. 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a1374c70 msgr2=0x55e5a146c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a1374c70 0x55e5a146c020 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81680342b0 msgr2=0x7f8168036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81680342b0 0x7f8168036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8278001dc0 tx=0x7f8278001360 comp rx=0 tx=0).stop 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 msgr2=0x55e5a14653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a14653e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f827400a480 tx=0x7f8274018020 comp rx=0 tx=0).stop 2024-02-15T23:29:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 shutdown_connections 2024-02-15T23:29:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e5a1374c70 0x55e5a146c020 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81680342b0 0x7f8168036770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 --2- 172.21.15.133:0/1802961965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1374350 0x55e5a14653e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 >> 172.21.15.133:0/1802961965 conn(0x55e5a12e7a40 msgr2=0x55e5a1458d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 shutdown_connections 2024-02-15T23:29:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:47.975+0000 7f828450f980 1 -- 172.21.15.133:0/1802961965 wait complete. 2024-02-15T23:29:48.000 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-15T23:29:48.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-15T23:29:48.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-15T23:29:48.001 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-15T23:29:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:48.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc49bc980 1 Processor -- start 2024-02-15T23:29:48.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc49bc980 1 -- start start 2024-02-15T23:29:48.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc49bc980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557a21447130 0x557a21447510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc49bc980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557a213934c0 con 0x557a21447a50 2024-02-15T23:29:48.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc49bc980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x557a2135a180 con 0x557a21447130 2024-02-15T23:29:48.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc24d7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557a21447130 0x557a21447510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc24d7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557a21447130 0x557a21447510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41628/0 (socket says 172.21.15.133:41628) 2024-02-15T23:29:48.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc24d7640 1 -- 172.21.15.133:0/45151148 learned_addr learned my addr 172.21.15.133:0/45151148 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc24d7640 1 -- 172.21.15.133:0/45151148 >> v1:172.21.15.131:6789/0 conn(0x557a21447a50 legacy=0x557a21448410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.071+0000 7f6fc24d7640 1 -- 172.21.15.133:0/45151148 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a21448c40 con 0x557a21447130 2024-02-15T23:29:48.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc24d7640 1 --2- 172.21.15.133:0/45151148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21447510 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00a4e0 tx=0x7f6fbc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2768080ba38f4a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc14d5640 1 -- 172.21.15.133:0/45151148 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc0aa540 con 0x557a21447130 2024-02-15T23:29:48.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc14d5640 1 -- 172.21.15.133:0/45151148 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc0a6070 con 0x557a21447130 2024-02-15T23:29:48.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc14d5640 1 -- 172.21.15.133:0/45151148 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc0aa850 con 0x557a21447130 2024-02-15T23:29:48.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc49bc980 1 -- 172.21.15.133:0/45151148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 msgr2=0x557a21447510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/45151148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21447510 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00a4e0 tx=0x7f6fbc01b090 comp rx=0 tx=0).stop 2024-02-15T23:29:48.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc49bc980 1 -- 172.21.15.133:0/45151148 shutdown_connections 2024-02-15T23:29:48.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/45151148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21447510 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc49bc980 1 -- 172.21.15.133:0/45151148 >> 172.21.15.133:0/45151148 conn(0x557a21442a00 msgr2=0x557a21444e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc49bc980 1 -- 172.21.15.133:0/45151148 shutdown_connections 2024-02-15T23:29:48.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.075+0000 7f6fc49bc980 1 -- 172.21.15.133:0/45151148 wait complete. 2024-02-15T23:29:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc49bc980 1 Processor -- start 2024-02-15T23:29:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc49bc980 1 -- start start 2024-02-15T23:29:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc49bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21531670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc49bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a213576b0 con 0x557a21447130 2024-02-15T23:29:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc24d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21531670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc24d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21531670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41632/0 (socket says 172.21.15.133:41632) 2024-02-15T23:29:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc24d7640 1 -- 172.21.15.133:0/4148010122 learned_addr learned my addr 172.21.15.133:0/4148010122 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc24d7640 1 -- 172.21.15.133:0/4148010122 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc00a1c0 con 0x557a21447130 2024-02-15T23:29:48.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.091+0000 7f6fc24d7640 1 --2- 172.21.15.133:0/4148010122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21531670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc017ca0 tx=0x7f6fbc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0e12cf4db565d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6eb0608640 1 -- 172.21.15.133:0/4148010122 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc0aa750 con 0x557a21447130 2024-02-15T23:29:48.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6eb0608640 1 -- 172.21.15.133:0/4148010122 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc0aa8b0 con 0x557a21447130 2024-02-15T23:29:48.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6eb0608640 1 -- 172.21.15.133:0/4148010122 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc0aab70 con 0x557a21447130 2024-02-15T23:29:48.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- 172.21.15.133:0/4148010122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 msgr2=0x557a21531670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/4148010122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21531670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc017ca0 tx=0x7f6fbc0033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- 172.21.15.133:0/4148010122 shutdown_connections 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/4148010122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21531670 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- 172.21.15.133:0/4148010122 >> 172.21.15.133:0/4148010122 conn(0x557a21442a00 msgr2=0x557a2152d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- 172.21.15.133:0/4148010122 shutdown_connections 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- 172.21.15.133:0/4148010122 wait complete. 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 Processor -- start 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- start start 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21538390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a21352e90 con 0x557a21447130 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc24d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21538390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc24d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21538390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41638/0 (socket says 172.21.15.133:41638) 2024-02-15T23:29:48.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc24d7640 1 -- 172.21.15.133:0/1411383182 learned_addr learned my addr 172.21.15.133:0/1411383182 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc24d7640 1 -- 172.21.15.133:0/1411383182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a21448c40 con 0x557a21447130 2024-02-15T23:29:48.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc24d7640 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21538390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc01b930 tx=0x7f6fbc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6eaee05640 1 -- 172.21.15.133:0/1411383182 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc0c4070 con 0x557a21447130 2024-02-15T23:29:48.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6eaee05640 1 -- 172.21.15.133:0/1411383182 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc0c8580 con 0x557a21447130 2024-02-15T23:29:48.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6eaee05640 1 -- 172.21.15.133:0/1411383182 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc0c8820 con 0x557a21447130 2024-02-15T23:29:48.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a215388d0 con 0x557a21447130 2024-02-15T23:29:48.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.095+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a21538d20 con 0x557a21447130 2024-02-15T23:29:48.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6eaee05640 1 -- 172.21.15.133:0/1411383182 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fbc0a8070 con 0x557a21447130 2024-02-15T23:29:48.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6eaee05640 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6ea80342b0 0x7f6ea8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6eaee05640 1 -- 172.21.15.133:0/1411383182 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6fbc0e38b0 con 0x557a21447130 2024-02-15T23:29:48.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc1cd6640 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6ea80342b0 0x7f6ea8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21447a50 0x557a2153efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2153f520 con 0x557a21447a50 2024-02-15T23:29:48.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21447a50 0x557a2153efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc1cd6640 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6ea80342b0 0x7f6ea8036770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8001e20 tx=0x7f6fb80013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21447a50 0x557a2153efe0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/1411383182 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fb40083f0 con 0x557a21447a50 2024-02-15T23:29:48.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2153c700 con 0x557a21447a50 2024-02-15T23:29:48.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/1411383182 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6fb40083f0 con 0x557a21447a50 2024-02-15T23:29:48.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21541250 con 0x557a21447a50 2024-02-15T23:29:48.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/1411383182 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6fb40083f0 con 0x557a21447a50 2024-02-15T23:29:48.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21540450 con 0x557a21447a50 2024-02-15T23:29:48.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/1411383182 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6fb40083f0 con 0x557a21447a50 2024-02-15T23:29:48.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21540860 con 0x557a21447a50 2024-02-15T23:29:48.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.099+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/1411383182 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6fb4012040 con 0x557a21447a50 2024-02-15T23:29:48.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc49bc980 1 Processor -- start 2024-02-15T23:29:48.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc49bc980 1 -- start start 2024-02-15T23:29:48.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc49bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a2154f8d0 0x557a2154fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc49bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a212ebf20 con 0x557a2154f8d0 2024-02-15T23:29:48.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc1cd6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a2154f8d0 0x557a2154fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc1cd6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a2154f8d0 0x557a2154fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41642/0 (socket says 172.21.15.133:41642) 2024-02-15T23:29:48.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/949465422 learned_addr learned my addr 172.21.15.133:0/949465422 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/949465422 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a21550230 con 0x557a2154f8d0 2024-02-15T23:29:48.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc1cd6640 1 --2- 172.21.15.133:0/949465422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a2154f8d0 0x557a2154fcf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8001780 tx=0x7f6fb800f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6ea7fff640 1 -- 172.21.15.133:0/949465422 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fb800e580 con 0x557a2154f8d0 2024-02-15T23:29:48.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6ea7fff640 1 -- 172.21.15.133:0/949465422 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb800e6e0 con 0x557a2154f8d0 2024-02-15T23:29:48.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc49bc980 1 -- 172.21.15.133:0/949465422 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a21550480 con 0x557a2154f8d0 2024-02-15T23:29:48.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6ea7fff640 1 -- 172.21.15.133:0/949465422 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fb800e980 con 0x557a2154f8d0 2024-02-15T23:29:48.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6fc49bc980 1 -- 172.21.15.133:0/949465422 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a21550fd0 con 0x557a2154f8d0 2024-02-15T23:29:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.103+0000 7f6ea7fff640 1 -- 172.21.15.133:0/949465422 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fb800eae0 con 0x557a2154f8d0 2024-02-15T23:29:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6ea7fff640 1 --2- 172.21.15.133:0/949465422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e9c034300 0x7f6e9c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6ea7fff640 1 -- 172.21.15.133:0/949465422 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6fb8018040 con 0x557a2154f8d0 2024-02-15T23:29:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/949465422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e9c034300 0x7f6e9c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 Processor -- start 2024-02-15T23:29:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- start start 2024-02-15T23:29:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/949465422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e9c034300 0x7f6e9c0367c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x557a2153fe90 tx=0x7f6fb4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a213bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a212df790 con 0x557a213bd5e0 2024-02-15T23:29:48.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc1cd6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a213bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc1cd6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a213bd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41644/0 (socket says 172.21.15.133:41644) 2024-02-15T23:29:48.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/1748300665 learned_addr learned my addr 172.21.15.133:0/1748300665 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/1748300665 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a213bbe10 con 0x557a213bd5e0 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc1cd6640 1 --2- 172.21.15.133:0/1748300665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a213bd9e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6fb801cfd0 tx=0x7f6fb801aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcafe11d8b0bf9c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6ea5ffb640 1 -- 172.21.15.133:0/1748300665 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fb800ed90 con 0x557a213bd5e0 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6ea5ffb640 1 -- 172.21.15.133:0/1748300665 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb801bc10 con 0x557a213bd5e0 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6ea5ffb640 1 -- 172.21.15.133:0/1748300665 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fb8023ec0 con 0x557a213bd5e0 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1748300665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 msgr2=0x557a213bd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1748300665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a213bd9e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6fb801cfd0 tx=0x7f6fb801aa60 comp rx=0 tx=0).stop 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1748300665 shutdown_connections 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1748300665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a213bd9e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1748300665 >> 172.21.15.133:0/1748300665 conn(0x557a21558c70 msgr2=0x557a21556cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1748300665 shutdown_connections 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1748300665 wait complete. 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 Processor -- start 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- start start 2024-02-15T23:29:48.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a21565a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc49bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a21565f90 con 0x557a213bd5e0 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc1cd6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a21565a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc1cd6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a21565a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41652/0 (socket says 172.21.15.133:41652) 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.107+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 learned_addr learned my addr 172.21.15.133:0/3683068964 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a21550fd0 con 0x557a213bd5e0 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc1cd6640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a21565a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6fb801af40 tx=0x7f6fb8049400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6e93fff640 1 -- 172.21.15.133:0/3683068964 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fb801c790 con 0x557a213bd5e0 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a21566190 con 0x557a213bd5e0 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6e93fff640 1 -- 172.21.15.133:0/3683068964 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb801c8f0 con 0x557a213bd5e0 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6e93fff640 1 -- 172.21.15.133:0/3683068964 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fb801a440 con 0x557a213bd5e0 2024-02-15T23:29:48.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a215665c0 con 0x557a213bd5e0 2024-02-15T23:29:48.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6e93fff640 1 -- 172.21.15.133:0/3683068964 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fb8024c60 con 0x557a213bd5e0 2024-02-15T23:29:48.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6e93fff640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e8c0342b0 0x7f6e8c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6e93fff640 1 -- 172.21.15.133:0/3683068964 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6fb8053c90 con 0x557a213bd5e0 2024-02-15T23:29:48.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e8c0342b0 0x7f6e8c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21570ec0 0x557a21573380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21573ad0 con 0x557a21570ec0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc24d7640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21570ec0 0x557a21573380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc24d7640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21570ec0 0x557a21573380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e8c0342b0 0x7f6e8c036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4008fd0 tx=0x7f6fb401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fbc0b58a0 con 0x557a21570ec0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 20 realm 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21573ea0 con 0x557a21570ec0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fbc0d0390 con 0x557a21570ec0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21574720 con 0x557a21570ec0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fbc0d0390 con 0x557a21570ec0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.111+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21574a80 con 0x557a21570ec0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6fbc0d0390 con 0x557a21570ec0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc49bc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21575280 con 0x557a21570ec0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6fbc0d0390 con 0x557a21570ec0 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc49bc980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc49bc980 20 searching for the correct realm 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557a21577110 0x557a21579580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc1cd6640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557a21577110 0x557a21579580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc1cd6640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557a21577110 0x557a21579580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc1cd6640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f6fb801c030 0x7f6fb803c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb801c030 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f6fb801c030 0x7f6fb803c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f6fb801c030 0x7f6fb803c410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb402c040 con 0x7f6fb801c030 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc2cd8640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6fb4027940 0x7f6fb40333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc24d7640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6fb4027940 0x7f6fb40333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.115+0000 7f6fc24d7640 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6fb4027940 0x7f6fb40333c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0da040 con 0x7f6fb4027940 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21570ec0 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6fbc0da040 con 0x557a21570ec0 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21570ec0 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0da040 con 0x557a21570ec0 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0da040 con 0x7f6fb4027940 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0da040 con 0x7f6fb4027940 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb801c030 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb402c040 con 0x7f6fb801c030 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21570ec0 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6fbc0da040 con 0x557a21570ec0 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0da040 con 0x7f6fb4027940 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21570ec0 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0da040 con 0x557a21570ec0 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb801c030 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6fb402c040 con 0x7f6fb801c030 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.119+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0da040 con 0x7f6fb4027940 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21570ec0 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0da040 con 0x557a21570ec0 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21570ec0 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6fbc0da040 con 0x557a21570ec0 2024-02-15T23:29:48.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb801c030 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb402c040 con 0x7f6fb801c030 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21570ec0 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.123+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb801c030 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb402c040 con 0x7f6fb801c030 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21577110 2024-02-15T23:29:48.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb4027940 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x557a21570ec0 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21579c50 con 0x7f6fb801c030 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fb402c040 con 0x7f6fb801c030 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21575b80 con 0x557a21570ec0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a215763d0 con 0x557a21570ec0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.127+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a215763d0 con 0x557a21570ec0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 zone default found 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 4 Realm: () 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 zonegroup default 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a215763d0 con 0x7f6fb4027940 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157ba70 con 0x557a21577110 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157bdd0 con 0x557a21577110 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 started sync module instance, tier type = 2024-02-15T23:29:48.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:48.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157b350 con 0x7f6fb801c030 2024-02-15T23:29:48.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93983033765552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157b2d0 con 0x7f6fb801c030 2024-02-15T23:29:48.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.131+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157cae0 con 0x557a21570ec0 2024-02-15T23:29:48.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.135+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93983033765552] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.135+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.135+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93983033770400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157b2d0 con 0x557a21570ec0 2024-02-15T23:29:48.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.135+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157d160 con 0x557a21577110 2024-02-15T23:29:48.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.135+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93983033770400] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.135+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.135+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93983033771456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157d510 con 0x557a21577110 2024-02-15T23:29:48.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.135+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157de80 con 0x7f6fb801c030 2024-02-15T23:29:48.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.139+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93983033771456] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.139+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.139+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93983033776608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157de00 con 0x7f6fb801c030 2024-02-15T23:29:48.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.139+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157eb70 con 0x557a21570ec0 2024-02-15T23:29:48.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.143+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93983033776608] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.143+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.143+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93983033778736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157eaf0 con 0x557a21570ec0 2024-02-15T23:29:48.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.143+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157f530 con 0x7f6fb4027940 2024-02-15T23:29:48.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.143+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.143+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93983033782416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157f4b0 con 0x7f6fb4027940 2024-02-15T23:29:48.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.143+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21580390 con 0x7f6fb4027940 2024-02-15T23:29:48.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.143+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93983033778736] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93983033782416] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93983033784544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157fef0 con 0x7f6fb4027940 2024-02-15T23:29:48.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21580730 con 0x7f6fb4027940 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93983033784544] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93983033779792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21580910 con 0x7f6fb4027940 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 20 add_watcher() i=0 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 20 add_watcher() i=1 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 20 add_watcher() i=2 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 20 add_watcher() i=3 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 20 add_watcher() i=4 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 20 add_watcher() i=5 2024-02-15T23:29:48.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.147+0000 7f6fc49bc980 20 add_watcher() i=6 2024-02-15T23:29:48.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93983033779792] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc49bc980 20 add_watcher() i=7 2024-02-15T23:29:48.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc49bc980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:48.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21583cd0 con 0x557a21570ec0 2024-02-15T23:29:48.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93983033788416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a215810c0 con 0x557a21570ec0 2024-02-15T23:29:48.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93983033788416] v31'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6e78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:48.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc49bc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:48.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc49bc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:48.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.151+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158c160 con 0x557a21570ec0 2024-02-15T23:29:48.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.155+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.155+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158c580 con 0x7f6fb4027940 2024-02-15T23:29:48.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.155+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.155+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158ca20 con 0x557a21577110 2024-02-15T23:29:48.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.159+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.159+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158d220 con 0x557a21570ec0 2024-02-15T23:29:48.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.163+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.163+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158a210 con 0x7f6fb801c030 2024-02-15T23:29:48.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.163+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.163+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158a210 con 0x557a21577110 2024-02-15T23:29:48.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.167+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'19 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.167+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158e400 con 0x557a21570ec0 2024-02-15T23:29:48.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.167+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.167+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158e400 con 0x7f6fb4027940 2024-02-15T23:29:48.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.171+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.171+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158e400 con 0x7f6fb801c030 2024-02-15T23:29:48.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.171+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.171+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158e930 con 0x557a21577110 2024-02-15T23:29:48.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.175+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.175+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158ee60 con 0x7f6fb801c030 2024-02-15T23:29:48.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.175+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.175+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f390 con 0x7f6fb4027940 2024-02-15T23:29:48.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.179+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.179+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f390 con 0x7f6fb801c030 2024-02-15T23:29:48.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.179+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.179+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f4d0 con 0x7f6fb4027940 2024-02-15T23:29:48.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.183+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'25 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.183+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f300 con 0x557a21570ec0 2024-02-15T23:29:48.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.183+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.183+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f300 con 0x557a21577110 2024-02-15T23:29:48.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.187+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.187+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f870 con 0x7f6fb801c030 2024-02-15T23:29:48.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.191+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.191+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21577110 2024-02-15T23:29:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.191+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.191+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21570ec0 2024-02-15T23:29:48.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.195+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.195+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21570ec0 2024-02-15T23:29:48.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.195+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.195+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21577110 2024-02-15T23:29:48.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.199+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.199+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x7f6fb801c030 2024-02-15T23:29:48.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.203+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.203+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21577110 2024-02-15T23:29:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.203+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.203+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21577110 2024-02-15T23:29:48.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.207+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.207+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21577110 2024-02-15T23:29:48.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.207+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.207+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21577110 2024-02-15T23:29:48.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.207+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.207+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f9c0 con 0x7f6fb4027940 2024-02-15T23:29:48.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.211+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.211+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f9c0 con 0x557a21577110 2024-02-15T23:29:48.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.215+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.215+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f9c0 con 0x7f6fb4027940 2024-02-15T23:29:48.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.215+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.215+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x557a21577110 2024-02-15T23:29:48.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.219+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.219+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x7f6fb4027940 2024-02-15T23:29:48.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'26 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2158f7f0 con 0x7f6fb801c030 2024-02-15T23:29:48.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6df37fe640 20 reqs_thread_entry: start 2024-02-15T23:29:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6fc49bc980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6fc49bc980 20 Filter name: none 2024-02-15T23:29:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6df17fa640 20 reqs_thread_entry: start 2024-02-15T23:29:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6fc49bc980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6fc49bc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.223+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a215884a0 con 0x557a21570ec0 2024-02-15T23:29:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.227+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.227+0000 7f6fc49bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.227+0000 7f6fc49bc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-15T23:29:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.227+0000 7f6fc49bc980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, user does not exist 2024-02-15T23:29:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.227+0000 7f6e78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.227+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93983033788416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21588ce0 con 0x557a21570ec0 2024-02-15T23:29:48.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.227+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93983033788416] v31'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.227+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93983033765552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21580800 con 0x7f6fb801c030 2024-02-15T23:29:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.231+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93983033765552] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.231+0000 7f6fc49bc980 20 remove_watcher() i=0 2024-02-15T23:29:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.231+0000 7f6fc49bc980 2 removed watcher, disabling cache 2024-02-15T23:29:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.231+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93983033770400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a21580800 con 0x557a21570ec0 2024-02-15T23:29:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.231+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93983033770400] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.231+0000 7f6fc49bc980 20 remove_watcher() i=1 2024-02-15T23:29:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.231+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93983033771456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157c1a0 con 0x557a21577110 2024-02-15T23:29:48.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.235+0000 7f6fc1cd6640 1 -- 172.21.15.133:0/3683068964 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93983033771456] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb8023530 con 0x557a21577110 2024-02-15T23:29:48.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.235+0000 7f6fc49bc980 20 remove_watcher() i=2 2024-02-15T23:29:48.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.235+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93983033776608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157c640 con 0x7f6fb801c030 2024-02-15T23:29:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.235+0000 7f6fc2cd8640 1 -- 172.21.15.133:0/3683068964 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93983033776608] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fb403f040 con 0x7f6fb801c030 2024-02-15T23:29:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.235+0000 7f6fc49bc980 20 remove_watcher() i=3 2024-02-15T23:29:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.235+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93983033778736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157c640 con 0x557a21570ec0 2024-02-15T23:29:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.239+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93983033778736] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x557a21570ec0 2024-02-15T23:29:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.239+0000 7f6fc49bc980 20 remove_watcher() i=4 2024-02-15T23:29:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.239+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93983033782416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157c640 con 0x7f6fb4027940 2024-02-15T23:29:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.239+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93983033782416] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.239+0000 7f6fc49bc980 20 remove_watcher() i=5 2024-02-15T23:29:48.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.239+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93983033784544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157c640 con 0x7f6fb4027940 2024-02-15T23:29:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93983033784544] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 20 remove_watcher() i=6 2024-02-15T23:29:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93983033779792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a2157c640 con 0x7f6fb4027940 2024-02-15T23:29:48.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93983033779792] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fbc0e9040 con 0x7f6fb4027940 2024-02-15T23:29:48.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 20 remove_watcher() i=7 2024-02-15T23:29:48.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6fb4027940 msgr2=0x7f6fb40333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6fb4027940 0x7f6fb40333c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21570ec0 msgr2=0x557a21573380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21570ec0 0x557a21573380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f6fb801c030 msgr2=0x7f6fb803c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f6fb801c030 0x7f6fb803c410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557a21577110 msgr2=0x557a21579580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557a21577110 0x557a21579580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e8c0342b0 msgr2=0x7f6e8c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e8c0342b0 0x7f6e8c036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4008fd0 tx=0x7f6fb401c070 comp rx=0 tx=0).stop 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc24d7640 1 -- 172.21.15.133:0/3683068964 reap_dead start 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 msgr2=0x557a21565a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a21565a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6fb801af40 tx=0x7f6fb8049400 comp rx=0 tx=0).stop 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 shutdown_connections 2024-02-15T23:29:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/3683068964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a213bd5e0 0x557a21565a50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 >> 172.21.15.133:0/3683068964 conn(0x557a21558c70 msgr2=0x557a215562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 shutdown_connections 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.243+0000 7f6fc49bc980 1 -- 172.21.15.133:0/3683068964 wait complete. 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/949465422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e9c034300 msgr2=0x7f6e9c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/949465422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e9c034300 0x7f6e9c0367c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x557a2153fe90 tx=0x7f6fb4003070 comp rx=0 tx=0).stop 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/949465422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a2154f8d0 msgr2=0x557a2154fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/949465422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a2154f8d0 0x557a2154fcf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8001780 tx=0x7f6fb800f7a0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/949465422 shutdown_connections 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/949465422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6e9c034300 0x7f6e9c0367c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/949465422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a2154f8d0 0x557a2154fcf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/949465422 >> 172.21.15.133:0/949465422 conn(0x557a215446e0 msgr2=0x557a215451f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/949465422 shutdown_connections 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/949465422 wait complete. 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21447a50 msgr2=0x557a2153efe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21447a50 0x557a2153efe0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6ea80342b0 msgr2=0x7f6ea8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6ea80342b0 0x7f6ea8036770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8001e20 tx=0x7f6fb80013a0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 msgr2=0x557a21538390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21538390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc01b930 tx=0x7f6fbc017e30 comp rx=0 tx=0).stop 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 shutdown_connections 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557a21447a50 0x557a2153efe0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6ea80342b0 0x7f6ea8036770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 --2- 172.21.15.133:0/1411383182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a21447130 0x557a21538390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 >> 172.21.15.133:0/1411383182 conn(0x557a21442a00 msgr2=0x557a2152bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 shutdown_connections 2024-02-15T23:29:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.247+0000 7f6fc49bc980 1 -- 172.21.15.133:0/1411383182 wait complete. 2024-02-15T23:29:48.266 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-15T23:29:48.267 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-15T23:29:48.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-15T23:29:48.267 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-15T23:29:48.348 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:48.348 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:48.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.339+0000 7f49fbfd4980 1 Processor -- start 2024-02-15T23:29:48.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.339+0000 7f49fbfd4980 1 -- start start 2024-02-15T23:29:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.339+0000 7f49fbfd4980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5629a4029010 0x5629a40293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.339+0000 7f49fbfd4980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5629a3f76460 con 0x5629a4029930 2024-02-15T23:29:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.339+0000 7f49fbfd4980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5629a3f3d180 con 0x5629a4029010 2024-02-15T23:29:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f9aef640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5629a4029010 0x5629a40293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f92ee640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5629a4029930 0x5629a402a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39656/0 (socket says 172.21.15.133:39656) 2024-02-15T23:29:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f92ee640 1 -- 172.21.15.133:0/3368152126 learned_addr learned my addr 172.21.15.133:0/3368152126 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f9aef640 1 -- 172.21.15.133:0/3368152126 >> v1:172.21.15.131:6789/0 conn(0x5629a4029930 legacy=0x5629a402a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f9aef640 1 -- 172.21.15.133:0/3368152126 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629a402ab70 con 0x5629a4029010 2024-02-15T23:29:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f9aef640 1 --2- 172.21.15.133:0/3368152126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a40293f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00a480 tx=0x7f49ec01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fed6c12f90338b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f8aed640 1 -- 172.21.15.133:0/3368152126 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ec0ab540 con 0x5629a4029010 2024-02-15T23:29:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f8aed640 1 -- 172.21.15.133:0/3368152126 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec0ab6a0 con 0x5629a4029010 2024-02-15T23:29:48.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.343+0000 7f49f8aed640 1 -- 172.21.15.133:0/3368152126 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ec0ab960 con 0x5629a4029010 2024-02-15T23:29:48.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.347+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3368152126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 msgr2=0x5629a40293f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.347+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/3368152126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a40293f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00a480 tx=0x7f49ec01b280 comp rx=0 tx=0).stop 2024-02-15T23:29:48.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.347+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3368152126 shutdown_connections 2024-02-15T23:29:48.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.347+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/3368152126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a40293f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.347+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3368152126 >> 172.21.15.133:0/3368152126 conn(0x5629a40248e0 msgr2=0x5629a4026d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.347+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3368152126 shutdown_connections 2024-02-15T23:29:48.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.347+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3368152126 wait complete. 2024-02-15T23:29:48.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.359+0000 7f49fbfd4980 1 Processor -- start 2024-02-15T23:29:48.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.359+0000 7f49fbfd4980 1 -- start start 2024-02-15T23:29:48.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a3f9d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a3f3a6b0 con 0x5629a4029010 2024-02-15T23:29:48.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49f9aef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a3f9d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49f9aef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a3f9d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41668/0 (socket says 172.21.15.133:41668) 2024-02-15T23:29:48.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49f9aef640 1 -- 172.21.15.133:0/217540503 learned_addr learned my addr 172.21.15.133:0/217540503 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49f9aef640 1 -- 172.21.15.133:0/217540503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec005d30 con 0x5629a4029010 2024-02-15T23:29:48.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49f9aef640 1 --2- 172.21.15.133:0/217540503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a3f9d880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f49ec018eb0 tx=0x7f49ec003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f014cf400f994a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f48e7e07640 1 -- 172.21.15.133:0/217540503 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ec0ab810 con 0x5629a4029010 2024-02-15T23:29:48.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f48e7e07640 1 -- 172.21.15.133:0/217540503 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec0ab970 con 0x5629a4029010 2024-02-15T23:29:48.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f48e7e07640 1 -- 172.21.15.133:0/217540503 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ec0abc30 con 0x5629a4029010 2024-02-15T23:29:48.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 -- 172.21.15.133:0/217540503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 msgr2=0x5629a3f9d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/217540503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a3f9d880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f49ec018eb0 tx=0x7f49ec003030 comp rx=0 tx=0).stop 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 -- 172.21.15.133:0/217540503 shutdown_connections 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/217540503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a3f9d880 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 -- 172.21.15.133:0/217540503 >> 172.21.15.133:0/217540503 conn(0x5629a40248e0 msgr2=0x5629a410f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 -- 172.21.15.133:0/217540503 shutdown_connections 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 -- 172.21.15.133:0/217540503 wait complete. 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 Processor -- start 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 -- start start 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a411b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49fbfd4980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a3f35e90 con 0x5629a4029010 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49f9aef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a411b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49f9aef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a411b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41680/0 (socket says 172.21.15.133:41680) 2024-02-15T23:29:48.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.363+0000 7f49f9aef640 1 -- 172.21.15.133:0/2751592453 learned_addr learned my addr 172.21.15.133:0/2751592453 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49f9aef640 1 -- 172.21.15.133:0/2751592453 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629a402ab70 con 0x5629a4029010 2024-02-15T23:29:48.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49f9aef640 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a411b460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49ec01b2c0 tx=0x7f49ec018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48e6604640 1 -- 172.21.15.133:0/2751592453 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ec0c3070 con 0x5629a4029010 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48e6604640 1 -- 172.21.15.133:0/2751592453 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec0beaa0 con 0x5629a4029010 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629a411b9a0 con 0x5629a4029010 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48e6604640 1 -- 172.21.15.133:0/2751592453 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ec0bed40 con 0x5629a4029010 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629a411bdf0 con 0x5629a4029010 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 Processor -- start 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- start start 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a4128820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a3ecef20 con 0x5629a4128400 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48e6604640 1 -- 172.21.15.133:0/2751592453 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f49ec0b2070 con 0x5629a4029010 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fa2f0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a4128820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fa2f0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a4128820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41690/0 (socket says 172.21.15.133:41690) 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fa2f0640 1 -- 172.21.15.133:0/3145751922 learned_addr learned my addr 172.21.15.133:0/3145751922 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48e6604640 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48e00342b0 0x7f48e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48e6604640 1 -- 172.21.15.133:0/2751592453 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f49ec0e3a10 con 0x5629a4029010 2024-02-15T23:29:48.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49f9aef640 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48e00342b0 0x7f48e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fa2f0640 1 -- 172.21.15.133:0/3145751922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629a4128d60 con 0x5629a4128400 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fa2f0640 1 --2- 172.21.15.133:0/3145751922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a4128820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49f400a430 tx=0x7f49f400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f26a8df09b25d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49f9aef640 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48e00342b0 0x7f48e0036770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0d0000 tx=0x7f49ec0cff70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48dffff640 1 -- 172.21.15.133:0/3145751922 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49f400f6e0 con 0x5629a4128400 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48dffff640 1 -- 172.21.15.133:0/3145751922 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f400f860 con 0x5629a4128400 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f48dffff640 1 -- 172.21.15.133:0/3145751922 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49f400fb40 con 0x5629a4128400 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3145751922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 msgr2=0x5629a4128820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/3145751922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a4128820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49f400a430 tx=0x7f49f400a8f0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3145751922 shutdown_connections 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/3145751922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a4128820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3145751922 >> 172.21.15.133:0/3145751922 conn(0x5629a4029930 msgr2=0x5629a4123870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3145751922 shutdown_connections 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.367+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3145751922 wait complete. 2024-02-15T23:29:48.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 Processor -- start 2024-02-15T23:29:48.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 -- start start 2024-02-15T23:29:48.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a412f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a3ec2790 con 0x5629a4128400 2024-02-15T23:29:48.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fa2f0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a412f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fa2f0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a412f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41694/0 (socket says 172.21.15.133:41694) 2024-02-15T23:29:48.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fa2f0640 1 -- 172.21.15.133:0/647764978 learned_addr learned my addr 172.21.15.133:0/647764978 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fa2f0640 1 -- 172.21.15.133:0/647764978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f400a0e0 con 0x5629a4128400 2024-02-15T23:29:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fa2f0640 1 --2- 172.21.15.133:0/647764978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a412f3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x5629a41291e0 tx=0x7f49f4003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f48de7fc640 1 -- 172.21.15.133:0/647764978 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49f4010a20 con 0x5629a4128400 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 -- 172.21.15.133:0/647764978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629a412f910 con 0x5629a4128400 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f48de7fc640 1 -- 172.21.15.133:0/647764978 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f4010b80 con 0x5629a4128400 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f48de7fc640 1 -- 172.21.15.133:0/647764978 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49f401a480 con 0x5629a4128400 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 -- 172.21.15.133:0/647764978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629a412fda0 con 0x5629a4128400 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f48de7fc640 1 -- 172.21.15.133:0/647764978 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f49f401a6f0 con 0x5629a4128400 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f48de7fc640 1 --2- 172.21.15.133:0/647764978 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48d40342b0 0x7f48d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 Processor -- start 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f48de7fc640 1 -- 172.21.15.133:0/647764978 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f49f4049d10 con 0x5629a4128400 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fa2f0640 1 --2- 172.21.15.133:0/647764978 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48d40342b0 0x7f48d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 -- start start 2024-02-15T23:29:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4114fc0 0x5629a4113460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.371+0000 7f49fbfd4980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a41139a0 con 0x5629a4114fc0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49fa2f0640 1 --2- 172.21.15.133:0/647764978 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48d40342b0 0x7f48d4036770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49f4025000 tx=0x7f49f4024f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49f9aef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4114fc0 0x5629a4113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49f9aef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4114fc0 0x5629a4113460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41700/0 (socket says 172.21.15.133:41700) 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49f9aef640 1 -- 172.21.15.133:0/3929693246 learned_addr learned my addr 172.21.15.133:0/3929693246 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49f9aef640 1 -- 172.21.15.133:0/3929693246 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629a4113ae0 con 0x5629a4114fc0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49f9aef640 1 --2- 172.21.15.133:0/3929693246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4114fc0 0x5629a4113460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0b4a80 tx=0x7f49ec0b4740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f48be7e4640 1 -- 172.21.15.133:0/3929693246 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ec0beea0 con 0x5629a4114fc0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3929693246 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629a4113d30 con 0x5629a4114fc0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f48be7e4640 1 -- 172.21.15.133:0/3929693246 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec006760 con 0x5629a4114fc0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f48be7e4640 1 -- 172.21.15.133:0/3929693246 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ec006a00 con 0x5629a4114fc0 2024-02-15T23:29:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3929693246 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629a41141c0 con 0x5629a4114fc0 2024-02-15T23:29:48.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f48be7e4640 1 -- 172.21.15.133:0/3929693246 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f49ec0e2ed0 con 0x5629a4114fc0 2024-02-15T23:29:48.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f48be7e4640 1 --2- 172.21.15.133:0/3929693246 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f483c0342b0 0x7f483c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f48be7e4640 1 -- 172.21.15.133:0/3929693246 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f49ec0edc60 con 0x5629a4114fc0 2024-02-15T23:29:48.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49f92ee640 1 --2- 172.21.15.133:0/3929693246 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f483c0342b0 0x7f483c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f482ffff640 20 reqs_thread_entry: start 2024-02-15T23:29:48.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5629a414ffb0 0x5629a41523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5629a4152990 con 0x5629a414ffb0 2024-02-15T23:29:48.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49f92ee640 1 --2- 172.21.15.133:0/3929693246 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f483c0342b0 0x7f483c036770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x5629a41244b0 tx=0x7f49f0001280 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49fa2f0640 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5629a414ffb0 0x5629a41523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.375+0000 7f49fa2f0640 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5629a414ffb0 0x5629a41523a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fa2f0640 1 -- 172.21.15.133:0/2751592453 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f49f4016020 con 0x5629a414ffb0 2024-02-15T23:29:48.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5629a41541a0 con 0x5629a414ffb0 2024-02-15T23:29:48.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fa2f0640 1 -- 172.21.15.133:0/2751592453 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f49f4016020 con 0x5629a414ffb0 2024-02-15T23:29:48.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5629a41589e0 con 0x5629a414ffb0 2024-02-15T23:29:48.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fa2f0640 1 -- 172.21.15.133:0/2751592453 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [stat,call,call,writefull 0~875] v31'2 uv2 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f49f4016020 con 0x5629a414ffb0 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 -- 172.21.15.133:0/647764978 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48d40342b0 msgr2=0x7f48d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/647764978 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48d40342b0 0x7f48d4036770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49f4025000 tx=0x7f49f4024f30 comp rx=0 tx=0).stop 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 -- 172.21.15.133:0/647764978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 msgr2=0x5629a412f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/647764978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a412f3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x5629a41291e0 tx=0x7f49f4003380 comp rx=0 tx=0).stop 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 -- 172.21.15.133:0/647764978 shutdown_connections 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/647764978 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48d40342b0 0x7f48d4036770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/647764978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4128400 0x5629a412f3d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.379+0000 7f49fbfd4980 1 -- 172.21.15.133:0/647764978 >> 172.21.15.133:0/647764978 conn(0x5629a4029930 msgr2=0x5629a4122670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/647764978 shutdown_connections 2024-02-15T23:29:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/647764978 wait complete. 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3929693246 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f483c0342b0 msgr2=0x7f483c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/3929693246 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f483c0342b0 0x7f483c036770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x5629a41244b0 tx=0x7f49f0001280 comp rx=0 tx=0).stop 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3929693246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4114fc0 msgr2=0x5629a4113460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/3929693246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4114fc0 0x5629a4113460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0b4a80 tx=0x7f49ec0b4740 comp rx=0 tx=0).stop 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3929693246 shutdown_connections 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/3929693246 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f483c0342b0 0x7f483c036770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/3929693246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4114fc0 0x5629a4113460 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3929693246 >> 172.21.15.133:0/3929693246 conn(0x5629a413de90 msgr2=0x5629a413e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3929693246 shutdown_connections 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/3929693246 wait complete. 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5629a414ffb0 msgr2=0x5629a41523a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5629a414ffb0 0x5629a41523a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48e00342b0 msgr2=0x7f48e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48e00342b0 0x7f48e0036770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0d0000 tx=0x7f49ec0cff70 comp rx=0 tx=0).stop 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 msgr2=0x5629a411b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a411b460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49ec01b2c0 tx=0x7f49ec018020 comp rx=0 tx=0).stop 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 shutdown_connections 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5629a414ffb0 0x5629a41523a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48e00342b0 0x7f48e0036770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 --2- 172.21.15.133:0/2751592453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629a4029010 0x5629a411b460 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 >> 172.21.15.133:0/2751592453 conn(0x5629a40248e0 msgr2=0x5629a410dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 shutdown_connections 2024-02-15T23:29:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.383+0000 7f49fbfd4980 1 -- 172.21.15.133:0/2751592453 wait complete. 2024-02-15T23:29:48.401 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"cd69b486-4810-48ae-b5d4-5bce307169d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T23:29:48.401 DEBUG:tasks.util.rgw: json result: {'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T23:29:48.403 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-15T23:29:48.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-15T23:29:48.403 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-15T23:29:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:48.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa765f35980 1 Processor -- start 2024-02-15T23:29:48.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa765f35980 1 -- start start 2024-02-15T23:29:48.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa765f35980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5628de755340 0x5628de755720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa765f35980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5628de69f4b0 con 0x5628de755c60 2024-02-15T23:29:48.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa765f35980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5628de666180 con 0x5628de755340 2024-02-15T23:29:48.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa763a50640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5628de755340 0x5628de755720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa763a50640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5628de755340 0x5628de755720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41704/0 (socket says 172.21.15.133:41704) 2024-02-15T23:29:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa76324f640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5628de755c60 0x5628de756610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39670/0 (socket says 172.21.15.133:39670) 2024-02-15T23:29:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa763a50640 1 -- 172.21.15.133:0/2216647529 learned_addr learned my addr 172.21.15.133:0/2216647529 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa763a50640 1 -- 172.21.15.133:0/2216647529 >> v1:172.21.15.131:6789/0 conn(0x5628de755c60 legacy=0x5628de756610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.463+0000 7fa763a50640 1 -- 172.21.15.133:0/2216647529 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628de756e40 con 0x5628de755340 2024-02-15T23:29:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa763a50640 1 --2- 172.21.15.133:0/2216647529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de755720 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00a5c0 tx=0x7fa75c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea89542411fb204 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa762a4e640 1 -- 172.21.15.133:0/2216647529 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75c0aa470 con 0x5628de755340 2024-02-15T23:29:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa762a4e640 1 -- 172.21.15.133:0/2216647529 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0aa5d0 con 0x5628de755340 2024-02-15T23:29:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa762a4e640 1 -- 172.21.15.133:0/2216647529 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75c0aa890 con 0x5628de755340 2024-02-15T23:29:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa765f35980 1 -- 172.21.15.133:0/2216647529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 msgr2=0x5628de755720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa765f35980 1 --2- 172.21.15.133:0/2216647529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de755720 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00a5c0 tx=0x7fa75c01b340 comp rx=0 tx=0).stop 2024-02-15T23:29:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa765f35980 1 -- 172.21.15.133:0/2216647529 shutdown_connections 2024-02-15T23:29:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa765f35980 1 --2- 172.21.15.133:0/2216647529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de755720 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa765f35980 1 -- 172.21.15.133:0/2216647529 >> 172.21.15.133:0/2216647529 conn(0x5628de6c8a30 msgr2=0x5628de6c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa765f35980 1 -- 172.21.15.133:0/2216647529 shutdown_connections 2024-02-15T23:29:48.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.467+0000 7fa765f35980 1 -- 172.21.15.133:0/2216647529 wait complete. 2024-02-15T23:29:48.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.479+0000 7fa765f35980 1 Processor -- start 2024-02-15T23:29:48.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.479+0000 7fa765f35980 1 -- start start 2024-02-15T23:29:48.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.479+0000 7fa765f35980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de83f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de6636b0 con 0x5628de755340 2024-02-15T23:29:48.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa763a50640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de83f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa763a50640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de83f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41710/0 (socket says 172.21.15.133:41710) 2024-02-15T23:29:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa763a50640 1 -- 172.21.15.133:0/1315270590 learned_addr learned my addr 172.21.15.133:0/1315270590 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa763a50640 1 -- 172.21.15.133:0/1315270590 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c005df0 con 0x5628de755340 2024-02-15T23:29:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa763a50640 1 --2- 172.21.15.133:0/1315270590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de83f820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0ac040 tx=0x7fa75c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286a8f4eb62344f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa651e0b640 1 -- 172.21.15.133:0/1315270590 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75c0aa9b0 con 0x5628de755340 2024-02-15T23:29:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa651e0b640 1 -- 172.21.15.133:0/1315270590 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0aab30 con 0x5628de755340 2024-02-15T23:29:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa651e0b640 1 -- 172.21.15.133:0/1315270590 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75c0aae10 con 0x5628de755340 2024-02-15T23:29:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 -- 172.21.15.133:0/1315270590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 msgr2=0x5628de83f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 --2- 172.21.15.133:0/1315270590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de83f820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0ac040 tx=0x7fa75c003030 comp rx=0 tx=0).stop 2024-02-15T23:29:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 -- 172.21.15.133:0/1315270590 shutdown_connections 2024-02-15T23:29:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 --2- 172.21.15.133:0/1315270590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de83f820 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 -- 172.21.15.133:0/1315270590 >> 172.21.15.133:0/1315270590 conn(0x5628de6c8a30 msgr2=0x5628de83b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 -- 172.21.15.133:0/1315270590 shutdown_connections 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 -- 172.21.15.133:0/1315270590 wait complete. 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 Processor -- start 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 -- start start 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de846500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa765f35980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de65ee90 con 0x5628de755340 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa763a50640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de846500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa763a50640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de846500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41726/0 (socket says 172.21.15.133:41726) 2024-02-15T23:29:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.483+0000 7fa763a50640 1 -- 172.21.15.133:0/900634898 learned_addr learned my addr 172.21.15.133:0/900634898 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa763a50640 1 -- 172.21.15.133:0/900634898 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628de756e40 con 0x5628de755340 2024-02-15T23:29:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa763a50640 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de846500 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa75c005940 tx=0x7fa75c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa64bfff640 1 -- 172.21.15.133:0/900634898 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75c0c6690 con 0x5628de755340 2024-02-15T23:29:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa64bfff640 1 -- 172.21.15.133:0/900634898 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0c67f0 con 0x5628de755340 2024-02-15T23:29:48.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5628de846a40 con 0x5628de755340 2024-02-15T23:29:48.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa64bfff640 1 -- 172.21.15.133:0/900634898 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75c0c6ab0 con 0x5628de755340 2024-02-15T23:29:48.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628de846e70 con 0x5628de755340 2024-02-15T23:29:48.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa64bfff640 1 -- 172.21.15.133:0/900634898 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa75c0c6c10 con 0x5628de755340 2024-02-15T23:29:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa64bfff640 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa64c0342b0 0x7fa64c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa64bfff640 1 -- 172.21.15.133:0/900634898 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa75c0e4180 con 0x5628de755340 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa76324f640 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa64c0342b0 0x7fa64c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa765f35980 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de755c60 0x5628de84d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de84d6d0 con 0x5628de755c60 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa764251640 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de755c60 0x5628de84d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa76324f640 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa64c0342b0 0x7fa64c036770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa7540012f0 tx=0x7fa754006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa764251640 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de755c60 0x5628de84d190 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa764251640 1 -- 172.21.15.133:0/900634898 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa74c0083f0 con 0x5628de755c60 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de84da70 con 0x5628de755c60 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa764251640 1 -- 172.21.15.133:0/900634898 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa74c0083f0 con 0x5628de755c60 2024-02-15T23:29:48.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de84f320 con 0x5628de755c60 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa764251640 1 -- 172.21.15.133:0/900634898 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa74c0083f0 con 0x5628de755c60 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.487+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de84e520 con 0x5628de755c60 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa764251640 1 -- 172.21.15.133:0/900634898 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa74c0083f0 con 0x5628de755c60 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de84e930 con 0x5628de755c60 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa764251640 1 -- 172.21.15.133:0/900634898 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa74c012040 con 0x5628de755c60 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa765f35980 1 Processor -- start 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa765f35980 1 -- start start 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa765f35980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de85da00 0x5628de85de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa765f35980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de5f7f20 con 0x5628de85da00 2024-02-15T23:29:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa76324f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de85da00 0x5628de85de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa76324f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de85da00 0x5628de85de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41738/0 (socket says 172.21.15.133:41738) 2024-02-15T23:29:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa76324f640 1 -- 172.21.15.133:0/1610073627 learned_addr learned my addr 172.21.15.133:0/1610073627 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa76324f640 1 -- 172.21.15.133:0/1610073627 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628de85e360 con 0x5628de85da00 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa76324f640 1 --2- 172.21.15.133:0/1610073627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de85da00 0x5628de85de20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa754006420 tx=0x7fa754015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa6497fa640 1 -- 172.21.15.133:0/1610073627 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75401a070 con 0x5628de85da00 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa6497fa640 1 -- 172.21.15.133:0/1610073627 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754011440 con 0x5628de85da00 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa765f35980 1 -- 172.21.15.133:0/1610073627 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5628de85e5b0 con 0x5628de85da00 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa6497fa640 1 -- 172.21.15.133:0/1610073627 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa754011720 con 0x5628de85da00 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa765f35980 1 -- 172.21.15.133:0/1610073627 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628de85f100 con 0x5628de85da00 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.491+0000 7fa6497fa640 1 -- 172.21.15.133:0/1610073627 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa754011880 con 0x5628de85da00 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa6497fa640 1 --2- 172.21.15.133:0/1610073627 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa63c0342b0 0x7fa63c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa6497fa640 1 -- 172.21.15.133:0/1610073627 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa75404aae0 con 0x5628de85da00 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa764251640 1 --2- 172.21.15.133:0/1610073627 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa63c0342b0 0x7fa63c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 Processor -- start 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- start start 2024-02-15T23:29:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa764251640 1 --2- 172.21.15.133:0/1610073627 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa63c0342b0 0x7fa63c036770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5628de84df60 tx=0x7fa74c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de86add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de5eb790 con 0x5628de86a9b0 2024-02-15T23:29:48.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa76324f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de86add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa76324f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de86add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41746/0 (socket says 172.21.15.133:41746) 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa76324f640 1 -- 172.21.15.133:0/4207584077 learned_addr learned my addr 172.21.15.133:0/4207584077 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa76324f640 1 -- 172.21.15.133:0/4207584077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628de86b3a0 con 0x5628de86a9b0 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa76324f640 1 --2- 172.21.15.133:0/4207584077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de86add0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa754048e10 tx=0x7fa75401ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d077ce9d9168b21 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa642ffd640 1 -- 172.21.15.133:0/4207584077 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa754047070 con 0x5628de86a9b0 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa642ffd640 1 -- 172.21.15.133:0/4207584077 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754020430 con 0x5628de86a9b0 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa642ffd640 1 -- 172.21.15.133:0/4207584077 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7540205e0 con 0x5628de86a9b0 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- 172.21.15.133:0/4207584077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 msgr2=0x5628de86add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 --2- 172.21.15.133:0/4207584077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de86add0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa754048e10 tx=0x7fa75401ef00 comp rx=0 tx=0).stop 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- 172.21.15.133:0/4207584077 shutdown_connections 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 --2- 172.21.15.133:0/4207584077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de86add0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- 172.21.15.133:0/4207584077 >> 172.21.15.133:0/4207584077 conn(0x5628de866d40 msgr2=0x5628de864da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- 172.21.15.133:0/4207584077 shutdown_connections 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- 172.21.15.133:0/4207584077 wait complete. 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 Processor -- start 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- start start 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de871980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa765f35980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de871ec0 con 0x5628de86a9b0 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa76324f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de871980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa76324f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de871980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41752/0 (socket says 172.21.15.133:41752) 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.495+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 learned_addr learned my addr 172.21.15.133:0/304631750 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628de85f100 con 0x5628de86a9b0 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa76324f640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de871980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5628de867440 tx=0x7fa754048da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa6417fa640 1 -- 172.21.15.133:0/304631750 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75402e070 con 0x5628de86a9b0 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5628de8720c0 con 0x5628de86a9b0 2024-02-15T23:29:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa6417fa640 1 -- 172.21.15.133:0/304631750 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75402f040 con 0x5628de86a9b0 2024-02-15T23:29:48.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa6417fa640 1 -- 172.21.15.133:0/304631750 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75401e9e0 con 0x5628de86a9b0 2024-02-15T23:29:48.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628de8724f0 con 0x5628de86a9b0 2024-02-15T23:29:48.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa6417fa640 1 -- 172.21.15.133:0/304631750 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa75401f7d0 con 0x5628de86a9b0 2024-02-15T23:29:48.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa6417fa640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa62c0342b0 0x7fa62c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa6417fa640 1 -- 172.21.15.133:0/304631750 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa754042e40 con 0x5628de86a9b0 2024-02-15T23:29:48.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa764251640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa62c0342b0 0x7fa62c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de87cef0 0x5628de87f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de87fae0 con 0x5628de87cef0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa763a50640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de87cef0 0x5628de87f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa764251640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa62c0342b0 0x7fa62c036770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa74c008fd0 tx=0x7fa74c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa763a50640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de87cef0 0x5628de87f390 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 20 realm 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de87feb0 con 0x5628de87cef0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de880700 con 0x5628de87cef0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.499+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de880a60 con 0x5628de87cef0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa765f35980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8803a0 con 0x5628de87cef0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa765f35980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa765f35980 20 searching for the correct realm 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa765f35980 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628de882cb0 0x5628de8850c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa76324f640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628de882cb0 0x5628de8850c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa76324f640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628de882cb0 0x5628de8850c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa76324f640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa75401d320 0x7fa754047400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa75401d320 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa764251640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa75401d320 0x7fa754047400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa764251640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa75401d320 0x7fa754047400 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa74c02c040 con 0x7fa75401d320 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa764251640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa74c027940 0x7fa74c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa763a50640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa74c027940 0x7fa74c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa763a50640 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa74c027940 0x7fa74c0333c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.503+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de87cef0 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de87cef0 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa75401d320 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa74c02c040 con 0x7fa75401d320 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de87cef0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de87cef0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa75401d320 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa74c02c040 con 0x7fa75401d320 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.507+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de87cef0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de87cef0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa75401d320 2024-02-15T23:29:48.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa74c02c040 con 0x7fa75401d320 2024-02-15T23:29:48.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de87cef0 2024-02-15T23:29:48.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.511+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa75401d320 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa74c02c040 con 0x7fa75401d320 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de882cb0 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa74c027940 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x5628de87cef0 2024-02-15T23:29:48.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de885790 con 0x7fa75401d320 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa74c02c040 con 0x7fa75401d320 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8818d0 con 0x5628de87cef0 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de881550 con 0x5628de87cef0 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.515+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8821a0 con 0x5628de87cef0 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 zone default found 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 4 Realm: () 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 zonegroup default 2024-02-15T23:29:48.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8821a0 con 0x7fa74c027940 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8875b0 con 0x5628de882cb0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de887910 con 0x5628de882cb0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 started sync module instance, tier type = 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de886e90 con 0x7fa75401d320 2024-02-15T23:29:48.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94733532162544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de887240 con 0x7fa75401d320 2024-02-15T23:29:48.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.519+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de888640 con 0x5628de87cef0 2024-02-15T23:29:48.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.523+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94733532162544] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.523+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.523+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94733532167424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8885c0 con 0x5628de87cef0 2024-02-15T23:29:48.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.523+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de889010 con 0x5628de882cb0 2024-02-15T23:29:48.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.523+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.523+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94733532167424] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.523+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94733532171024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de889370 con 0x5628de882cb0 2024-02-15T23:29:48.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.523+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de889ce0 con 0x7fa75401d320 2024-02-15T23:29:48.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.527+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.527+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94733532174704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88a530 con 0x7fa75401d320 2024-02-15T23:29:48.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.527+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88af30 con 0x5628de87cef0 2024-02-15T23:29:48.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.527+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94733532171024] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.527+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94733532174704] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.527+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.527+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94733532178992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88a090 con 0x5628de87cef0 2024-02-15T23:29:48.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.527+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88b7b0 con 0x7fa74c027940 2024-02-15T23:29:48.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.531+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94733532178992] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.531+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.531+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94733532168480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88a090 con 0x7fa74c027940 2024-02-15T23:29:48.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.531+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88bc90 con 0x7fa74c027940 2024-02-15T23:29:48.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.531+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.531+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94733532182448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88bc30 con 0x7fa74c027940 2024-02-15T23:29:48.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.531+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88cc30 con 0x7fa74c027940 2024-02-15T23:29:48.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.531+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94733532168480] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94733532182448] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94733532186416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88c020 con 0x7fa74c027940 2024-02-15T23:29:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 20 add_watcher() i=0 2024-02-15T23:29:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 20 add_watcher() i=1 2024-02-15T23:29:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 20 add_watcher() i=2 2024-02-15T23:29:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 20 add_watcher() i=3 2024-02-15T23:29:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 20 add_watcher() i=4 2024-02-15T23:29:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 20 add_watcher() i=5 2024-02-15T23:29:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 20 add_watcher() i=6 2024-02-15T23:29:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94733532186416] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 20 add_watcher() i=7 2024-02-15T23:29:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88fc20 con 0x5628de87cef0 2024-02-15T23:29:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.535+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94733532180800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de88d090 con 0x5628de87cef0 2024-02-15T23:29:48.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94733532180800] v31'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:48.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:48.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:48.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 5 note: GC not initialized 2024-02-15T23:29:48.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa618fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:48.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:48.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 20 Filter name: none 2024-02-15T23:29:48.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa5927fc640 20 reqs_thread_entry: start 2024-02-15T23:29:48.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b20b0 con 0x5628de87cef0 2024-02-15T23:29:48.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2470 con 0x7fa75401d320 2024-02-15T23:29:48.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2470 con 0x5628de87cef0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2470 con 0x5628de882cb0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b27d0 con 0x5628de882cb0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b80 con 0x5628de882cb0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b80 con 0x5628de87cef0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.539+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b80 con 0x5628de87cef0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b80 con 0x5628de882cb0 2024-02-15T23:29:48.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b70 con 0x7fa74c027940 2024-02-15T23:29:48.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa75401d320 2024-02-15T23:29:48.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.543+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa75401d320 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.547+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:48.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94733532180800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94733532180800] v31'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.551+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94733532162544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa75401d320 2024-02-15T23:29:48.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.555+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94733532162544] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.555+0000 7fa765f35980 20 remove_watcher() i=0 2024-02-15T23:29:48.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.555+0000 7fa765f35980 2 removed watcher, disabling cache 2024-02-15T23:29:48.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.555+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94733532167424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.555+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94733532167424] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.555+0000 7fa765f35980 20 remove_watcher() i=1 2024-02-15T23:29:48.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.555+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94733532171024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de882cb0 2024-02-15T23:29:48.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.559+0000 7fa76324f640 1 -- 172.21.15.133:0/304631750 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94733532171024] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa754031070 con 0x5628de882cb0 2024-02-15T23:29:48.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.559+0000 7fa765f35980 20 remove_watcher() i=2 2024-02-15T23:29:48.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.559+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94733532174704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa75401d320 2024-02-15T23:29:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.559+0000 7fa764251640 1 -- 172.21.15.133:0/304631750 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94733532174704] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa74c03f040 con 0x7fa75401d320 2024-02-15T23:29:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.559+0000 7fa765f35980 20 remove_watcher() i=3 2024-02-15T23:29:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.559+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94733532178992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x5628de87cef0 2024-02-15T23:29:48.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.563+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94733532178992] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x5628de87cef0 2024-02-15T23:29:48.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.563+0000 7fa765f35980 20 remove_watcher() i=4 2024-02-15T23:29:48.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.563+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94733532168480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.563+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94733532168480] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.563+0000 7fa765f35980 20 remove_watcher() i=5 2024-02-15T23:29:48.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.563+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94733532182448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94733532182448] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 20 remove_watcher() i=6 2024-02-15T23:29:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94733532186416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628de8b2b30 con 0x7fa74c027940 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94733532186416] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c0b0020 con 0x7fa74c027940 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 20 remove_watcher() i=7 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa74c027940 msgr2=0x7fa74c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa74c027940 0x7fa74c0333c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de87cef0 msgr2=0x5628de87f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de87cef0 0x5628de87f390 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa75401d320 msgr2=0x7fa754047400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa75401d320 0x7fa754047400 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628de882cb0 msgr2=0x5628de8850c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628de882cb0 0x5628de8850c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa62c0342b0 msgr2=0x7fa62c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa62c0342b0 0x7fa62c036770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa74c008fd0 tx=0x7fa74c01c070 comp rx=0 tx=0).stop 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 msgr2=0x5628de871980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/304631750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de86a9b0 0x5628de871980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5628de867440 tx=0x7fa754048da0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 reap_dead start 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa763a50640 1 -- 172.21.15.133:0/304631750 reap_dead start 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 shutdown_connections 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 >> 172.21.15.133:0/304631750 conn(0x5628de866d40 msgr2=0x5628de8643a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 shutdown_connections 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/304631750 wait complete. 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/1610073627 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa63c0342b0 msgr2=0x7fa63c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/1610073627 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa63c0342b0 0x7fa63c036770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5628de84df60 tx=0x7fa74c003070 comp rx=0 tx=0).stop 2024-02-15T23:29:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/1610073627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de85da00 msgr2=0x5628de85de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/1610073627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de85da00 0x5628de85de20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa754006420 tx=0x7fa754015820 comp rx=0 tx=0).stop 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/1610073627 shutdown_connections 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/1610073627 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa63c0342b0 0x7fa63c036770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 --2- 172.21.15.133:0/1610073627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de85da00 0x5628de85de20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/1610073627 >> 172.21.15.133:0/1610073627 conn(0x5628de852810 msgr2=0x5628de853320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/1610073627 shutdown_connections 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.567+0000 7fa765f35980 1 -- 172.21.15.133:0/1610073627 wait complete. 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de755c60 msgr2=0x5628de84d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de755c60 0x5628de84d190 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa64c0342b0 msgr2=0x7fa64c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa64c0342b0 0x7fa64c036770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa7540012f0 tx=0x7fa754006700 comp rx=0 tx=0).stop 2024-02-15T23:29:48.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 msgr2=0x5628de846500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de846500 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa75c005940 tx=0x7fa75c0180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 shutdown_connections 2024-02-15T23:29:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628de755c60 0x5628de84d190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa64c0342b0 0x7fa64c036770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 --2- 172.21.15.133:0/900634898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628de755340 0x5628de846500 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 >> 172.21.15.133:0/900634898 conn(0x5628de6c8a30 msgr2=0x5628de839ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 shutdown_connections 2024-02-15T23:29:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.571+0000 7fa765f35980 1 -- 172.21.15.133:0/900634898 wait complete. 2024-02-15T23:29:48.588 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[],"summary":[]} 2024-02-15T23:29:48.589 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-15T23:29:48.589 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:29:48.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:29:48.589 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:29:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1dd137980 1 Processor -- start 2024-02-15T23:29:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1dd137980 1 -- start start 2024-02-15T23:29:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1dd137980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x559479f036a0 0x559479f03a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1dd137980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559479e504c0 con 0x559479f03fc0 2024-02-15T23:29:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1dd137980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x559479e17180 con 0x559479f036a0 2024-02-15T23:29:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1dac52640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x559479f036a0 0x559479f03a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1d3fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x559479f03fc0 0x559479f043d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39686/0 (socket says 172.21.15.133:39686) 2024-02-15T23:29:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1d3fff640 1 -- 172.21.15.133:0/3285552636 learned_addr learned my addr 172.21.15.133:0/3285552636 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1dac52640 1 -- 172.21.15.133:0/3285552636 >> v1:172.21.15.131:6789/0 conn(0x559479f03fc0 legacy=0x559479f043d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.655+0000 7fd1dac52640 1 -- 172.21.15.133:0/3285552636 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559479f04b70 con 0x559479f036a0 2024-02-15T23:29:48.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1dac52640 1 --2- 172.21.15.133:0/3285552636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479f03a80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00a480 tx=0x7fd1cc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4343adb393745bfb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1da451640 1 -- 172.21.15.133:0/3285552636 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0ab540 con 0x559479f036a0 2024-02-15T23:29:48.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1da451640 1 -- 172.21.15.133:0/3285552636 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0ab6a0 con 0x559479f036a0 2024-02-15T23:29:48.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1da451640 1 -- 172.21.15.133:0/3285552636 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0ab960 con 0x559479f036a0 2024-02-15T23:29:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1dd137980 1 -- 172.21.15.133:0/3285552636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 msgr2=0x559479f03a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1dd137980 1 --2- 172.21.15.133:0/3285552636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479f03a80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00a480 tx=0x7fd1cc01b280 comp rx=0 tx=0).stop 2024-02-15T23:29:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1dd137980 1 -- 172.21.15.133:0/3285552636 shutdown_connections 2024-02-15T23:29:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1dd137980 1 --2- 172.21.15.133:0/3285552636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479f03a80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1dd137980 1 -- 172.21.15.133:0/3285552636 >> 172.21.15.133:0/3285552636 conn(0x559479efe060 msgr2=0x559479f00480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1dd137980 1 -- 172.21.15.133:0/3285552636 shutdown_connections 2024-02-15T23:29:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.659+0000 7fd1dd137980 1 -- 172.21.15.133:0/3285552636 wait complete. 2024-02-15T23:29:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 Processor -- start 2024-02-15T23:29:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 -- start start 2024-02-15T23:29:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479fed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559479e146b0 con 0x559479f036a0 2024-02-15T23:29:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dac52640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479fed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dac52640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479fed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41782/0 (socket says 172.21.15.133:41782) 2024-02-15T23:29:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dac52640 1 -- 172.21.15.133:0/2411455456 learned_addr learned my addr 172.21.15.133:0/2411455456 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dac52640 1 -- 172.21.15.133:0/2411455456 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc005d30 con 0x559479f036a0 2024-02-15T23:29:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dac52640 1 --2- 172.21.15.133:0/2411455456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479fed5f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0ae040 tx=0x7fd1cc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb7320c899297f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd0c8e09640 1 -- 172.21.15.133:0/2411455456 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0ab810 con 0x559479f036a0 2024-02-15T23:29:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd0c8e09640 1 -- 172.21.15.133:0/2411455456 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0ab970 con 0x559479f036a0 2024-02-15T23:29:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd0c8e09640 1 -- 172.21.15.133:0/2411455456 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0abc10 con 0x559479f036a0 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 -- 172.21.15.133:0/2411455456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 msgr2=0x559479fed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 --2- 172.21.15.133:0/2411455456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479fed5f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0ae040 tx=0x7fd1cc003030 comp rx=0 tx=0).stop 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 -- 172.21.15.133:0/2411455456 shutdown_connections 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 --2- 172.21.15.133:0/2411455456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479fed5f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 -- 172.21.15.133:0/2411455456 >> 172.21.15.133:0/2411455456 conn(0x559479efe060 msgr2=0x559479fe9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 -- 172.21.15.133:0/2411455456 shutdown_connections 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 -- 172.21.15.133:0/2411455456 wait complete. 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 Processor -- start 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.675+0000 7fd1dd137980 1 -- start start 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dd137980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479ff42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dd137980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559479e0fe90 con 0x559479f036a0 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dac52640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479ff42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dac52640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479ff42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41794/0 (socket says 172.21.15.133:41794) 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dac52640 1 -- 172.21.15.133:0/794758602 learned_addr learned my addr 172.21.15.133:0/794758602 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dac52640 1 -- 172.21.15.133:0/794758602 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559479f04b70 con 0x559479f036a0 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dac52640 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479ff42e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc01bb20 tx=0x7fd1cc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd0c7606640 1 -- 172.21.15.133:0/794758602 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0c4070 con 0x559479f036a0 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559479ff4820 con 0x559479f036a0 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd0c7606640 1 -- 172.21.15.133:0/794758602 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0b5750 con 0x559479f036a0 2024-02-15T23:29:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd0c7606640 1 -- 172.21.15.133:0/794758602 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0b59f0 con 0x559479f036a0 2024-02-15T23:29:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559479ff4cd0 con 0x559479f036a0 2024-02-15T23:29:48.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd0c7606640 1 -- 172.21.15.133:0/794758602 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd1cc0b2070 con 0x559479f036a0 2024-02-15T23:29:48.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd0c7606640 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0c00342b0 0x7fd0c0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd0c7606640 1 -- 172.21.15.133:0/794758602 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd1cc0e5dd0 con 0x559479f036a0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1d3fff640 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0c00342b0 0x7fd0c0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dd137980 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559479f03fc0 0x559479ffa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559479ffa5a0 con 0x559479f03fc0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1db453640 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559479f03fc0 0x559479ffa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.679+0000 7fd1d3fff640 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0c00342b0 0x7fd0c0036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000f70 tx=0x7fd1c40012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1db453640 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559479f03fc0 0x559479ffa060 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1db453640 1 -- 172.21.15.133:0/794758602 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1d400a4d0 con 0x559479f03fc0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559479ffa900 con 0x559479f03fc0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1db453640 1 -- 172.21.15.133:0/794758602 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd1d400a4d0 con 0x559479f03fc0 2024-02-15T23:29:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559479ffbd30 con 0x559479f03fc0 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1db453640 1 -- 172.21.15.133:0/794758602 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd1d400a4d0 con 0x559479f03fc0 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559479ffb100 con 0x559479f03fc0 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1db453640 1 -- 172.21.15.133:0/794758602 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd1d400a4d0 con 0x559479f03fc0 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559479ffb510 con 0x559479f03fc0 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1db453640 1 -- 172.21.15.133:0/794758602 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd1d400a4d0 con 0x559479f03fc0 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1dd137980 1 Processor -- start 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1dd137980 1 -- start start 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1dd137980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a00a6d0 0x55947a00aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1dd137980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559479da8f20 con 0x55947a00a6d0 2024-02-15T23:29:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a00a6d0 0x55947a00aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a00a6d0 0x55947a00aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41810/0 (socket says 172.21.15.133:41810) 2024-02-15T23:29:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1d3fff640 1 -- 172.21.15.133:0/43537086 learned_addr learned my addr 172.21.15.133:0/43537086 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1d3fff640 1 -- 172.21.15.133:0/43537086 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55947a00b030 con 0x55947a00a6d0 2024-02-15T23:29:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.683+0000 7fd1d3fff640 1 --2- 172.21.15.133:0/43537086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a00a6d0 0x55947a00aaf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4001ee0 tx=0x7fd1c400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0c4e01640 1 -- 172.21.15.133:0/43537086 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c4020070 con 0x55947a00a6d0 2024-02-15T23:29:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1dd137980 1 -- 172.21.15.133:0/43537086 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55947a00b280 con 0x55947a00a6d0 2024-02-15T23:29:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0c4e01640 1 -- 172.21.15.133:0/43537086 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c400c770 con 0x55947a00a6d0 2024-02-15T23:29:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1dd137980 1 -- 172.21.15.133:0/43537086 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55947a00bdd0 con 0x55947a00a6d0 2024-02-15T23:29:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0c4e01640 1 -- 172.21.15.133:0/43537086 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c4013040 con 0x55947a00a6d0 2024-02-15T23:29:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0c4e01640 1 -- 172.21.15.133:0/43537086 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd1c400a040 con 0x55947a00a6d0 2024-02-15T23:29:48.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0c4e01640 1 --2- 172.21.15.133:0/43537086 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0b40342b0 0x7fd0b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0c4e01640 1 -- 172.21.15.133:0/43537086 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd1c404b6d0 con 0x55947a00a6d0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1db453640 1 --2- 172.21.15.133:0/43537086 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0b40342b0 0x7fd0b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1dd137980 1 Processor -- start 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1dd137980 1 -- start start 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1db453640 1 --2- 172.21.15.133:0/43537086 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0b40342b0 0x7fd0b4036770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x559479ff7910 tx=0x7fd1d4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1dd137980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a017ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1dd137980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559479d9c790 con 0x55947a0176a0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a017ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a017ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41822/0 (socket says 172.21.15.133:41822) 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1d3fff640 1 -- 172.21.15.133:0/823027901 learned_addr learned my addr 172.21.15.133:0/823027901 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1d3fff640 1 -- 172.21.15.133:0/823027901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55947a018090 con 0x55947a0176a0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd1d3fff640 1 --2- 172.21.15.133:0/823027901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a017ac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4049af0 tx=0x7fd1c4019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9c242e7faba23 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0be7fc640 1 -- 172.21.15.133:0/823027901 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c403a2f0 con 0x55947a0176a0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0be7fc640 1 -- 172.21.15.133:0/823027901 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c403a450 con 0x55947a0176a0 2024-02-15T23:29:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.687+0000 7fd0be7fc640 1 -- 172.21.15.133:0/823027901 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c401b8d0 con 0x55947a0176a0 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- 172.21.15.133:0/823027901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 msgr2=0x55947a017ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 --2- 172.21.15.133:0/823027901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a017ac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4049af0 tx=0x7fd1c4019a70 comp rx=0 tx=0).stop 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- 172.21.15.133:0/823027901 shutdown_connections 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 --2- 172.21.15.133:0/823027901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a017ac0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- 172.21.15.133:0/823027901 >> 172.21.15.133:0/823027901 conn(0x55947a013a30 msgr2=0x55947a011a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- 172.21.15.133:0/823027901 shutdown_connections 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- 172.21.15.133:0/823027901 wait complete. 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 Processor -- start 2024-02-15T23:29:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- start start 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a01e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55947a01eb40 con 0x55947a0176a0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a01e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a01e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41826/0 (socket says 172.21.15.133:41826) 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 learned_addr learned my addr 172.21.15.133:0/435793636 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55947a00bdd0 con 0x55947a0176a0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1d3fff640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a01e600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400df80 tx=0x7fd1c4049a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd0bcff9640 1 -- 172.21.15.133:0/435793636 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c40194e0 con 0x55947a0176a0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55947a01ed40 con 0x55947a0176a0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55947a01f170 con 0x55947a0176a0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd0bcff9640 1 -- 172.21.15.133:0/435793636 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4024e80 con 0x55947a0176a0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd0bcff9640 1 -- 172.21.15.133:0/435793636 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c4025bf0 con 0x55947a0176a0 2024-02-15T23:29:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd0bcff9640 1 -- 172.21.15.133:0/435793636 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd1c4025d50 con 0x55947a0176a0 2024-02-15T23:29:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd0bcff9640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0a4034300 0x7fd0a40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd0bcff9640 1 -- 172.21.15.133:0/435793636 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd1c4040020 con 0x55947a0176a0 2024-02-15T23:29:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1db453640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0a4034300 0x7fd0a40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.691+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55947a029bb0 0x55947a02c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02c7c0 con 0x55947a029bb0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dac52640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55947a029bb0 0x55947a02c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1db453640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0a4034300 0x7fd0a40367c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4011010 tx=0x7fd1d4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dac52640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55947a029bb0 0x55947a02c070 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1cc0b5ce0 con 0x55947a029bb0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 realm 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02cb90 con 0x55947a029bb0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1cc0b5ce0 con 0x55947a029bb0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02d3e0 con 0x55947a029bb0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1cc0b5ce0 con 0x55947a029bb0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02d740 con 0x55947a029bb0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02df40 con 0x55947a029bb0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 20 searching for the correct realm 2024-02-15T23:29:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55947a02fc60 0x55947a032050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a032590 con 0x55947a02fc60 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1d3fff640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55947a02fc60 0x55947a032050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1d3fff640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55947a02fc60 0x55947a032050 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1d3fff640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd1c403b050 0x7fd1c400ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a032590 con 0x7fd1c403b050 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1db453640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd1c403b050 0x7fd1c400ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1db453640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd1c403b050 0x7fd1c400ca10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d400a4d0 con 0x7fd1c403b050 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1db453640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd1d40141d0 0x7fd1d4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.695+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a032590 con 0x7fd1d40141d0 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd1d40141d0 0x7fd1d4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd1d40141d0 0x7fd1d4015940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x7fd1d40141d0 2024-02-15T23:29:48.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a032590 con 0x55947a029bb0 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a032590 con 0x55947a029bb0 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x7fd1d40141d0 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x7fd1d40141d0 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1c403b050 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d400a4d0 con 0x7fd1c403b050 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a02fc60 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.699+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a029bb0 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x7fd1d40141d0 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a029bb0 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1c403b050 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a02fc60 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a02fc60 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x7fd1d40141d0 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a02fc60 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a02fc60 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a029bb0 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a029bb0 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.703+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x7fd1d40141d0 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a02fc60 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1c403b050 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a029bb0 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x55947a029bb0 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x7fd1d40141d0 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a02fc60 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0db040 con 0x7fd1d40141d0 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1c403b050 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a02fc60 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.707+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x55947a029bb0 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd1cc0eb040 con 0x7fd1c403b050 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02e840 con 0x55947a029bb0 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02e4c0 con 0x55947a029bb0 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02f110 con 0x55947a029bb0 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 zone default found 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 4 Realm: () 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 zonegroup default 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a02f110 con 0x7fd1d40141d0 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a0342d0 con 0x55947a02fc60 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a034630 con 0x55947a02fc60 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 started sync module instance, tier type = 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.711+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a033bb0 con 0x7fd1c403b050 2024-02-15T23:29:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.715+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.715+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94096190551824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a033f60 con 0x7fd1c403b050 2024-02-15T23:29:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.715+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a035320 con 0x55947a029bb0 2024-02-15T23:29:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.715+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.715+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94096190557824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a0357e0 con 0x55947a029bb0 2024-02-15T23:29:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.715+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a0362b0 con 0x55947a02fc60 2024-02-15T23:29:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.715+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94096190551824] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.719+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94096190557824] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.719+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.719+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94096190558880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a0349e0 con 0x55947a02fc60 2024-02-15T23:29:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.719+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a036b00 con 0x7fd1c403b050 2024-02-15T23:29:48.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.723+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94096190558880] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.723+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.723+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94096190563936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a036f20 con 0x7fd1c403b050 2024-02-15T23:29:48.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.723+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a0377a0 con 0x55947a029bb0 2024-02-15T23:29:48.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94096190566176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a037340 con 0x55947a029bb0 2024-02-15T23:29:48.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a038660 con 0x7fd1d40141d0 2024-02-15T23:29:48.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94096190563936] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94096190570848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a038620 con 0x7fd1d40141d0 2024-02-15T23:29:48.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a039050 con 0x7fd1d40141d0 2024-02-15T23:29:48.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94096190566176] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.727+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94096190570848] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94096190564992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a038bb0 con 0x7fd1d40141d0 2024-02-15T23:29:48.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a039430 con 0x7fd1d40141d0 2024-02-15T23:29:48.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94096190573488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a039ab0 con 0x7fd1d40141d0 2024-02-15T23:29:48.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 20 add_watcher() i=0 2024-02-15T23:29:48.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 20 add_watcher() i=1 2024-02-15T23:29:48.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 20 add_watcher() i=2 2024-02-15T23:29:48.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 20 add_watcher() i=3 2024-02-15T23:29:48.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 20 add_watcher() i=4 2024-02-15T23:29:48.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 20 add_watcher() i=5 2024-02-15T23:29:48.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94096190564992] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dd137980 20 add_watcher() i=6 2024-02-15T23:29:48.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.731+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94096190573488] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 20 add_watcher() i=7 2024-02-15T23:29:48.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:48.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a03c9d0 con 0x55947a029bb0 2024-02-15T23:29:48.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94096190575872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a039dc0 con 0x55947a029bb0 2024-02-15T23:29:48.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94096190575872] v31'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd0917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 5 note: GC not initialized 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd00bfff640 20 reqs_thread_entry: start 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 20 Filter name: none 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd009ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a05e390 con 0x55947a029bb0 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.745 INFO:teuthology.orchestra.run.smithi133.stderr:could not fetch user info: no user info saved 2024-02-15T23:29:48.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd0917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:48.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.735+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94096190575872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a05e350 con 0x55947a029bb0 2024-02-15T23:29:48.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.739+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94096190575872] v31'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.739+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94096190551824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a05e350 con 0x7fd1c403b050 2024-02-15T23:29:48.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.739+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94096190551824] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.739+0000 7fd1dd137980 20 remove_watcher() i=0 2024-02-15T23:29:48.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.739+0000 7fd1dd137980 2 removed watcher, disabling cache 2024-02-15T23:29:48.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.739+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94096190557824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a05e350 con 0x55947a029bb0 2024-02-15T23:29:48.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.743+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94096190557824] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.743+0000 7fd1dd137980 20 remove_watcher() i=1 2024-02-15T23:29:48.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.743+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94096190558880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a05e350 con 0x55947a02fc60 2024-02-15T23:29:48.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.743+0000 7fd1d3fff640 1 -- 172.21.15.133:0/435793636 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94096190558880] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55947a02fc60 2024-02-15T23:29:48.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.743+0000 7fd1dd137980 20 remove_watcher() i=2 2024-02-15T23:29:48.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.743+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94096190563936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a033710 con 0x7fd1c403b050 2024-02-15T23:29:48.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.747+0000 7fd1db453640 1 -- 172.21.15.133:0/435793636 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94096190563936] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403a040 con 0x7fd1c403b050 2024-02-15T23:29:48.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.747+0000 7fd1dd137980 20 remove_watcher() i=3 2024-02-15T23:29:48.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.747+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94096190566176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a036660 con 0x55947a029bb0 2024-02-15T23:29:48.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.747+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94096190566176] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x55947a029bb0 2024-02-15T23:29:48.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.747+0000 7fd1dd137980 20 remove_watcher() i=4 2024-02-15T23:29:48.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.747+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94096190570848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a033710 con 0x7fd1d40141d0 2024-02-15T23:29:48.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.751+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94096190570848] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.751+0000 7fd1dd137980 20 remove_watcher() i=5 2024-02-15T23:29:48.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.751+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94096190564992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a036660 con 0x7fd1d40141d0 2024-02-15T23:29:48.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.751+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94096190564992] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.751+0000 7fd1dd137980 20 remove_watcher() i=6 2024-02-15T23:29:48.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.751+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94096190573488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55947a036660 con 0x7fd1d40141d0 2024-02-15T23:29:48.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94096190573488] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0fb040 con 0x7fd1d40141d0 2024-02-15T23:29:48.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 20 remove_watcher() i=7 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd1d40141d0 msgr2=0x7fd1d4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd1d40141d0 0x7fd1d4015940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55947a029bb0 msgr2=0x55947a02c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55947a029bb0 0x55947a02c070 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd1c403b050 msgr2=0x7fd1c400ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd1c403b050 0x7fd1c400ca10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55947a02fc60 msgr2=0x55947a032050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55947a02fc60 0x55947a032050 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0a4034300 msgr2=0x7fd0a40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0a4034300 0x7fd0a40367c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4011010 tx=0x7fd1d4020000 comp rx=0 tx=0).stop 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 msgr2=0x55947a01e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a01e600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400df80 tx=0x7fd1c4049a50 comp rx=0 tx=0).stop 2024-02-15T23:29:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dac52640 1 -- 172.21.15.133:0/435793636 reap_dead start 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 shutdown_connections 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/435793636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a0176a0 0x55947a01e600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 >> 172.21.15.133:0/435793636 conn(0x55947a013a30 msgr2=0x55947a011090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 shutdown_connections 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/435793636 wait complete. 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/43537086 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0b40342b0 msgr2=0x7fd0b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/43537086 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0b40342b0 0x7fd0b4036770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x559479ff7910 tx=0x7fd1d4005850 comp rx=0 tx=0).stop 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/43537086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a00a6d0 msgr2=0x55947a00aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/43537086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a00a6d0 0x55947a00aaf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4001ee0 tx=0x7fd1c400da30 comp rx=0 tx=0).stop 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/43537086 shutdown_connections 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/43537086 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0b40342b0 0x7fd0b4036770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/43537086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55947a00a6d0 0x55947a00aaf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/43537086 >> 172.21.15.133:0/43537086 conn(0x559479fff4e0 msgr2=0x559479fffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/43537086 shutdown_connections 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/43537086 wait complete. 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559479f03fc0 msgr2=0x559479ffa060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559479f03fc0 0x559479ffa060 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0c00342b0 msgr2=0x7fd0c0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0c00342b0 0x7fd0c0036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000f70 tx=0x7fd1c40012c0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 msgr2=0x559479ff42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479ff42e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc01bb20 tx=0x7fd1cc018020 comp rx=0 tx=0).stop 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 shutdown_connections 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559479f03fc0 0x559479ffa060 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd0c00342b0 0x7fd0c0036770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 --2- 172.21.15.133:0/794758602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559479f036a0 0x559479ff42e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 >> 172.21.15.133:0/794758602 conn(0x559479efe060 msgr2=0x559479fe7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 shutdown_connections 2024-02-15T23:29:48.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.755+0000 7fd1dd137980 1 -- 172.21.15.133:0/794758602 wait complete. 2024-02-15T23:29:48.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-15T23:29:48.775 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-15T23:29:48.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-15T23:29:48.775 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-02-15T23:29:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb702721980 1 Processor -- start 2024-02-15T23:29:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb702721980 1 -- start start 2024-02-15T23:29:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb702721980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5593c8b49510 0x5593c8b4b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb702721980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5593c8a92460 con 0x5593c8b44fb0 2024-02-15T23:29:48.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb702721980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5593c8a59180 con 0x5593c8b49510 2024-02-15T23:29:48.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb6ffa3b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5593c8b49510 0x5593c8b4b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb70023c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5593c8b44fb0 0x5593c8b45390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39702/0 (socket says 172.21.15.133:39702) 2024-02-15T23:29:48.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb70023c640 1 -- 172.21.15.133:0/2130203732 learned_addr learned my addr 172.21.15.133:0/2130203732 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:48.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/2130203732 >> v1:172.21.15.131:6789/0 conn(0x5593c8b44fb0 legacy=0x5593c8b45390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.859+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/2130203732 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c8b4ce50 con 0x5593c8b49510 2024-02-15T23:29:48.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/2130203732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b49510 0x5593c8b4b900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800a480 tx=0x7fb6e801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e370f09d09c99fd1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb6ff23a640 1 -- 172.21.15.133:0/2130203732 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e80ab540 con 0x5593c8b49510 2024-02-15T23:29:48.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb6ff23a640 1 -- 172.21.15.133:0/2130203732 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80ab6a0 con 0x5593c8b49510 2024-02-15T23:29:48.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb6ff23a640 1 -- 172.21.15.133:0/2130203732 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e80ab960 con 0x5593c8b49510 2024-02-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb702721980 1 -- 172.21.15.133:0/2130203732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b49510 msgr2=0x5593c8b4b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb702721980 1 --2- 172.21.15.133:0/2130203732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b49510 0x5593c8b4b900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800a480 tx=0x7fb6e801b280 comp rx=0 tx=0).stop 2024-02-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb702721980 1 -- 172.21.15.133:0/2130203732 shutdown_connections 2024-02-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb702721980 1 --2- 172.21.15.133:0/2130203732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b49510 0x5593c8b4b900 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb702721980 1 -- 172.21.15.133:0/2130203732 >> 172.21.15.133:0/2130203732 conn(0x5593c8b40880 msgr2=0x5593c8b42ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb702721980 1 -- 172.21.15.133:0/2130203732 shutdown_connections 2024-02-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.863+0000 7fb702721980 1 -- 172.21.15.133:0/2130203732 wait complete. 2024-02-15T23:29:48.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb702721980 1 Processor -- start 2024-02-15T23:29:48.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb702721980 1 -- start start 2024-02-15T23:29:48.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb702721980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8ab9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb702721980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c8a566b0 con 0x5593c8b44fb0 2024-02-15T23:29:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb70023c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8ab9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb70023c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8ab9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41836/0 (socket says 172.21.15.133:41836) 2024-02-15T23:29:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb70023c640 1 -- 172.21.15.133:0/2082382591 learned_addr learned my addr 172.21.15.133:0/2082382591 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb70023c640 1 -- 172.21.15.133:0/2082382591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e8005d30 con 0x5593c8b44fb0 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb70023c640 1 --2- 172.21.15.133:0/2082382591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8ab9730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0006fb0 tx=0x7fb6f0001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5dcea4c5dc44b79 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb5ee60c640 1 -- 172.21.15.133:0/2082382591 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f0004530 con 0x5593c8b44fb0 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb5ee60c640 1 -- 172.21.15.133:0/2082382591 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0004690 con 0x5593c8b44fb0 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.879+0000 7fb5ee60c640 1 -- 172.21.15.133:0/2082382591 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f00049b0 con 0x5593c8b44fb0 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- 172.21.15.133:0/2082382591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 msgr2=0x5593c8ab9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 --2- 172.21.15.133:0/2082382591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8ab9730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0006fb0 tx=0x7fb6f0001940 comp rx=0 tx=0).stop 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- 172.21.15.133:0/2082382591 shutdown_connections 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 --2- 172.21.15.133:0/2082382591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8ab9730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- 172.21.15.133:0/2082382591 >> 172.21.15.133:0/2082382591 conn(0x5593c8b40880 msgr2=0x5593c8c2abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- 172.21.15.133:0/2082382591 shutdown_connections 2024-02-15T23:29:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- 172.21.15.133:0/2082382591 wait complete. 2024-02-15T23:29:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 Processor -- start 2024-02-15T23:29:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- start start 2024-02-15T23:29:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8c306a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c8a51e90 con 0x5593c8b44fb0 2024-02-15T23:29:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb70023c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8c306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb70023c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8c306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41844/0 (socket says 172.21.15.133:41844) 2024-02-15T23:29:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb70023c640 1 -- 172.21.15.133:0/3530384448 learned_addr learned my addr 172.21.15.133:0/3530384448 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb70023c640 1 -- 172.21.15.133:0/3530384448 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c8a92460 con 0x5593c8b44fb0 2024-02-15T23:29:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb70023c640 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8c306a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5593c8c30fd0 tx=0x7fb6f0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb5ece09640 1 -- 172.21.15.133:0/3530384448 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f0013760 con 0x5593c8b44fb0 2024-02-15T23:29:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5593c8c30be0 con 0x5593c8b44fb0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb5ece09640 1 -- 172.21.15.133:0/3530384448 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f00138c0 con 0x5593c8b44fb0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb5ece09640 1 -- 172.21.15.133:0/3530384448 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f0013b60 con 0x5593c8b44fb0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593c8c2f0e0 con 0x5593c8b44fb0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb5ece09640 1 -- 172.21.15.133:0/3530384448 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb6f0028460 con 0x5593c8b44fb0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb5ece09640 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5e80342b0 0x7fb5e8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb5ece09640 1 -- 172.21.15.133:0/3530384448 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb6f0049630 con 0x5593c8b44fb0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5e80342b0 0x7fb5e8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8b49510 0x5593c8c3fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.883+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c40420 con 0x5593c8b49510 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8b49510 0x5593c8c3fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5e80342b0 0x7fb5e8036770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80ad000 tx=0x7fb6e80a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8b49510 0x5593c8c3fee0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb700a3d640 1 -- 172.21.15.133:0/3530384448 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f80083f0 con 0x5593c8b49510 2024-02-15T23:29:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c40780 con 0x5593c8b49510 2024-02-15T23:29:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb700a3d640 1 -- 172.21.15.133:0/3530384448 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb6f80083f0 con 0x5593c8b49510 2024-02-15T23:29:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c42010 con 0x5593c8b49510 2024-02-15T23:29:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb700a3d640 1 -- 172.21.15.133:0/3530384448 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb6f80083f0 con 0x5593c8b49510 2024-02-15T23:29:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c41210 con 0x5593c8b49510 2024-02-15T23:29:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb700a3d640 1 -- 172.21.15.133:0/3530384448 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb6f80083f0 con 0x5593c8b49510 2024-02-15T23:29:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c41620 con 0x5593c8b49510 2024-02-15T23:29:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb700a3d640 1 -- 172.21.15.133:0/3530384448 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb6f8012040 con 0x5593c8b49510 2024-02-15T23:29:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb702721980 1 Processor -- start 2024-02-15T23:29:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb702721980 1 -- start start 2024-02-15T23:29:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb702721980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c506d0 0x5593c8c50af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb702721980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c89eaf20 con 0x5593c8c506d0 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb6ffa3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c506d0 0x5593c8c50af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb6ffa3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c506d0 0x5593c8c50af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41860/0 (socket says 172.21.15.133:41860) 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3510009038 learned_addr learned my addr 172.21.15.133:0/3510009038 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.887+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3510009038 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c8c51030 con 0x5593c8c506d0 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/3510009038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c506d0 0x5593c8c50af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8000c10 tx=0x7fb6e8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb5e5ffb640 1 -- 172.21.15.133:0/3510009038 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e80bf410 con 0x5593c8c506d0 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb702721980 1 -- 172.21.15.133:0/3510009038 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5593c8c51220 con 0x5593c8c506d0 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb5e5ffb640 1 -- 172.21.15.133:0/3510009038 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80bf570 con 0x5593c8c506d0 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb5e5ffb640 1 -- 172.21.15.133:0/3510009038 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e80bf850 con 0x5593c8c506d0 2024-02-15T23:29:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb702721980 1 -- 172.21.15.133:0/3510009038 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593c8c51d70 con 0x5593c8c506d0 2024-02-15T23:29:48.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb5e5ffb640 1 -- 172.21.15.133:0/3510009038 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb6e80bfa00 con 0x5593c8c506d0 2024-02-15T23:29:48.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb5e5ffb640 1 --2- 172.21.15.133:0/3510009038 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d80342b0 0x7fb5d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb5e5ffb640 1 -- 172.21.15.133:0/3510009038 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb6e80e5f20 con 0x5593c8c506d0 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3510009038 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d80342b0 0x7fb5d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb702721980 1 Processor -- start 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb702721980 1 -- start start 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb702721980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c5db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb702721980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c89de790 con 0x5593c8c5d730 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3510009038 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d80342b0 0x7fb5d8036770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5593c8c40c50 tx=0x7fb6f8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb6ffa3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c5db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb6ffa3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c5db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41870/0 (socket says 172.21.15.133:41870) 2024-02-15T23:29:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/2095479054 learned_addr learned my addr 172.21.15.133:0/2095479054 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/2095479054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c8c5e0e0 con 0x5593c8c5d730 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.891+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/2095479054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c5db10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8005730 tx=0x7fb6e8006590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7c4e166be57d85 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb5df7fe640 1 -- 172.21.15.133:0/2095479054 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e8006990 con 0x5593c8c5d730 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb5df7fe640 1 -- 172.21.15.133:0/2095479054 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e8006af0 con 0x5593c8c5d730 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb5df7fe640 1 -- 172.21.15.133:0/2095479054 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e8006dd0 con 0x5593c8c5d730 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- 172.21.15.133:0/2095479054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 msgr2=0x5593c8c5db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 --2- 172.21.15.133:0/2095479054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c5db10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8005730 tx=0x7fb6e8006590 comp rx=0 tx=0).stop 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- 172.21.15.133:0/2095479054 shutdown_connections 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 --2- 172.21.15.133:0/2095479054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c5db10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- 172.21.15.133:0/2095479054 >> 172.21.15.133:0/2095479054 conn(0x5593c8c59a70 msgr2=0x5593c8c57ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- 172.21.15.133:0/2095479054 shutdown_connections 2024-02-15T23:29:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- 172.21.15.133:0/2095479054 wait complete. 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 Processor -- start 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- start start 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c645e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c8c64b20 con 0x5593c8c5d730 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb6ffa3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb6ffa3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41880/0 (socket says 172.21.15.133:41880) 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 learned_addr learned my addr 172.21.15.133:0/3138281450 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c8c51d70 con 0x5593c8c5d730 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c645e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb6e801b0b0 tx=0x7fb6e80e42e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb5ddffb640 1 -- 172.21.15.133:0/3138281450 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e80c68b0 con 0x5593c8c5d730 2024-02-15T23:29:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5593c8c64d20 con 0x5593c8c5d730 2024-02-15T23:29:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593c8c65150 con 0x5593c8c5d730 2024-02-15T23:29:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb5ddffb640 1 -- 172.21.15.133:0/3138281450 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80e1040 con 0x5593c8c5d730 2024-02-15T23:29:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.895+0000 7fb5ddffb640 1 -- 172.21.15.133:0/3138281450 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e80b5730 con 0x5593c8c5d730 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb5ddffb640 1 -- 172.21.15.133:0/3138281450 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb6e80e7030 con 0x5593c8c5d730 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb5ddffb640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d00342b0 0x7fb5d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb5ddffb640 1 -- 172.21.15.133:0/3138281450 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb6e80dd3b0 con 0x5593c8c5d730 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d00342b0 0x7fb5d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8c6f980 0x5593c8c71e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c72590 con 0x5593c8c6f980 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb70023c640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8c6f980 0x5593c8c71e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d00342b0 0x7fb5d0036770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8008fd0 tx=0x7fb6f801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb70023c640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8c6f980 0x5593c8c71e40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f0024020 con 0x5593c8c6f980 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 realm 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c72960 con 0x5593c8c6f980 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f0024020 con 0x5593c8c6f980 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c731e0 con 0x5593c8c6f980 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f0024020 con 0x5593c8c6f980 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c73540 con 0x5593c8c6f980 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb6f0024020 con 0x5593c8c6f980 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c73d40 con 0x5593c8c6f980 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb6f0024020 con 0x5593c8c6f980 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 20 searching for the correct realm 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593c8c75bf0 0x5593c8c780b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593c8c75bf0 0x5593c8c780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593c8c75bf0 0x5593c8c780b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb6ffa3b640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb6e80c8070 0x7fb6e80ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6e80c8070 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.899+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb6e80c8070 0x7fb6e80ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb6e80c8070 0x7fb6e80ed180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f802c040 con 0x7fb6e80c8070 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb700a3d640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb6f8027940 0x7fb6f80333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb6f8027940 0x7fb6f80333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb6f8027940 0x7fb6f80333c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f0024020 con 0x7fb6f8027940 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c6f980 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb6f0024020 con 0x5593c8c6f980 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c6f980 2024-02-15T23:29:48.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6e80c8070 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f802c040 con 0x7fb6e80c8070 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.903+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c6f980 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c6f980 2024-02-15T23:29:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6e80c8070 2024-02-15T23:29:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb6f802c040 con 0x7fb6e80c8070 2024-02-15T23:29:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c6f980 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c6f980 2024-02-15T23:29:48.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.907+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6e80c8070 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f802c040 con 0x7fb6e80c8070 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c6f980 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6e80c8070 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f802c040 con 0x7fb6e80c8070 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c75bf0 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.911+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6f8027940 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x5593c8c6f980 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78780 con 0x7fb6e80c8070 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f802c040 con 0x7fb6e80c8070 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c74640 con 0x5593c8c6f980 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c74e90 con 0x5593c8c6f980 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c742c0 con 0x5593c8c6f980 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 zone default found 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 4 Realm: () 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 zonegroup default 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c78bc0 con 0x7fb6f8027940 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7aa40 con 0x5593c8c75bf0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7ada0 con 0x5593c8c75bf0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 started sync module instance, tier type = 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.915+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7a010 con 0x7fb6e80c8070 2024-02-15T23:29:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.919+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.919+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94093217080256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7a010 con 0x7fb6e80c8070 2024-02-15T23:29:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.919+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7b600 con 0x5593c8c6f980 2024-02-15T23:29:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.919+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94093217080256] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.919+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.919+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94093217083648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7a010 con 0x5593c8c6f980 2024-02-15T23:29:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.919+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7c000 con 0x5593c8c75bf0 2024-02-15T23:29:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94093217083648] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94093217078128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c79f90 con 0x5593c8c75bf0 2024-02-15T23:29:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7ccf0 con 0x7fb6e80c8070 2024-02-15T23:29:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94093217089888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7d540 con 0x7fb6e80c8070 2024-02-15T23:29:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7df40 con 0x5593c8c6f980 2024-02-15T23:29:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94093217078128] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.923+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94093217089888] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.927+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.927+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94093217094208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7d0a0 con 0x5593c8c6f980 2024-02-15T23:29:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.927+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7e790 con 0x7fb6f8027940 2024-02-15T23:29:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.927+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.927+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94093217096016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7ea10 con 0x7fb6f8027940 2024-02-15T23:29:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.927+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7f250 con 0x7fb6f8027940 2024-02-15T23:29:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.927+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94093217094208] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94093217088432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7f360 con 0x7fb6f8027940 2024-02-15T23:29:48.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7fb60 con 0x7fb6f8027940 2024-02-15T23:29:48.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94093217096016] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94093217100640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7ff10 con 0x7fb6f8027940 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 20 add_watcher() i=0 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 20 add_watcher() i=1 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 20 add_watcher() i=2 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 20 add_watcher() i=3 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 20 add_watcher() i=4 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 20 add_watcher() i=5 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94093217088432] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.931+0000 7fb702721980 20 add_watcher() i=6 2024-02-15T23:29:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94093217100640] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 add_watcher() i=7 2024-02-15T23:29:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:48.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7ea50 con 0x5593c8c6f980 2024-02-15T23:29:48.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94093217101696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7fef0 con 0x5593c8c6f980 2024-02-15T23:29:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94093217101696] v31'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb5b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 5 note: GC not initialized 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb5b57e2640 20 reqs_thread_entry: start 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 Filter name: none 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb526ffd640 20 reqs_thread_entry: start 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca4a30 con 0x5593c8c6f980 2024-02-15T23:29:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca4a30 con 0x5593c8c6f980 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 20 rados->read ofs=0 len=0 2024-02-15T23:29:48.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.935+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca3270 con 0x7fb6f8027940 2024-02-15T23:29:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-02-15T23:29:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-15T23:29:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-15T23:29:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-15T23:29:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca36a0 con 0x5593c8c6f980 2024-02-15T23:29:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~358] v31'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94093217252496 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca7e30 con 0x5593c8c6f980 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== watch-notify(notify (1) cookie 94093217094208 notify 133143986176 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x5593c8c2f0e0 con 0x5593c8c6f980 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb5df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94093217094208 notifier 4290 bl.length()=534 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb5df7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb5df7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb5df7fe640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5c4003ea0 con 0x5593c8c6f980 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(66 notify.4 [notify cookie 94093217252496 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== watch-notify(notify_complete (2) cookie 94093217252496 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb6f002d070 con 0x5593c8c6f980 2024-02-15T23:29:48.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.939+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca4490 con 0x5593c8c6f980 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb702721980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb702721980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb702721980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94093217252496 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca7e30 con 0x7fb6e80c8070 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== watch-notify(notify (1) cookie 94093217089888 notify 133143986176 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x7fb6f8027d80 con 0x7fb6e80c8070 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(69 notify.3 [notify cookie 94093217252496 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb5deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94093217089888 notifier 4290 bl.length()=169 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb5deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb5deffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-15T23:29:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb5deffd640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb534003400 con 0x7fb6e80c8070 2024-02-15T23:29:48.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== watch-notify(notify_complete (2) cookie 94093217252496 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb6f801a990 con 0x7fb6e80c8070 2024-02-15T23:29:48.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.943+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca5e10 con 0x7fb6f8027940 2024-02-15T23:29:48.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb702721980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-15T23:29:48.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb702721980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-15T23:29:48.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb702721980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-15T23:29:48.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94093217249856 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8ca82d0 con 0x7fb6e80c8070 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== watch-notify(notify (1) cookie 94093217089888 notify 133143986177 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7fb6f801a990 con 0x7fb6e80c8070 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb5deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94093217089888 notifier 4290 bl.length()=177 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb5deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb5deffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 notify.3 [notify cookie 94093217249856 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb5deffd640 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb534003430 con 0x7fb6e80c8070 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== watch-notify(notify_complete (2) cookie 94093217249856 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb6f8033900 con 0x7fb6e80c8070 2024-02-15T23:29:48.956 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:48.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb5b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:48.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94093217101696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c85240 con 0x5593c8c6f980 2024-02-15T23:29:48.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94093217101696] v31'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.947+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94093217080256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c84da0 con 0x7fb6e80c8070 2024-02-15T23:29:48.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.951+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94093217080256] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.951+0000 7fb702721980 20 remove_watcher() i=0 2024-02-15T23:29:48.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.951+0000 7fb702721980 2 removed watcher, disabling cache 2024-02-15T23:29:48.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.951+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94093217083648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7a3c0 con 0x5593c8c6f980 2024-02-15T23:29:48.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.951+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94093217083648] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.951+0000 7fb702721980 20 remove_watcher() i=1 2024-02-15T23:29:48.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.951+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94093217078128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7b100 con 0x5593c8c75bf0 2024-02-15T23:29:48.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.955+0000 7fb6ffa3b640 1 -- 172.21.15.133:0/3138281450 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94093217078128] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6e80ef020 con 0x5593c8c75bf0 2024-02-15T23:29:48.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.955+0000 7fb702721980 20 remove_watcher() i=2 2024-02-15T23:29:48.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.955+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94093217089888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c79b70 con 0x7fb6e80c8070 2024-02-15T23:29:48.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.955+0000 7fb700a3d640 1 -- 172.21.15.133:0/3138281450 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94093217089888] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f803f040 con 0x7fb6e80c8070 2024-02-15T23:29:48.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.955+0000 7fb702721980 20 remove_watcher() i=3 2024-02-15T23:29:48.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.955+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94093217094208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c79b70 con 0x5593c8c6f980 2024-02-15T23:29:48.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.959+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94093217094208] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x5593c8c6f980 2024-02-15T23:29:48.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.959+0000 7fb702721980 20 remove_watcher() i=4 2024-02-15T23:29:48.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.959+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94093217096016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c79b70 con 0x7fb6f8027940 2024-02-15T23:29:48.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.959+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94093217096016] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.959+0000 7fb702721980 20 remove_watcher() i=5 2024-02-15T23:29:48.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.959+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94093217088432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c7e150 con 0x7fb6f8027940 2024-02-15T23:29:48.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94093217088432] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 20 remove_watcher() i=6 2024-02-15T23:29:48.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94093217100640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593c8c79b70 con 0x7fb6f8027940 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94093217100640] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f003f040 con 0x7fb6f8027940 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 20 remove_watcher() i=7 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb6f8027940 msgr2=0x7fb6f80333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb6f8027940 0x7fb6f80333c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8c6f980 msgr2=0x5593c8c71e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8c6f980 0x5593c8c71e40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb6e80c8070 msgr2=0x7fb6e80ed180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb6e80c8070 0x7fb6e80ed180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593c8c75bf0 msgr2=0x5593c8c780b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593c8c75bf0 0x5593c8c780b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d00342b0 msgr2=0x7fb5d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d00342b0 0x7fb5d0036770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8008fd0 tx=0x7fb6f801c070 comp rx=0 tx=0).stop 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 msgr2=0x5593c8c645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3138281450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c5d730 0x5593c8c645e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb6e801b0b0 tx=0x7fb6e80e42e0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb70023c640 1 -- 172.21.15.133:0/3138281450 reap_dead start 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 shutdown_connections 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 >> 172.21.15.133:0/3138281450 conn(0x5593c8c59a70 msgr2=0x5593c8c570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 shutdown_connections 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3138281450 wait complete. 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3510009038 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d80342b0 msgr2=0x7fb5d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3510009038 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d80342b0 0x7fb5d8036770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5593c8c40c50 tx=0x7fb6f8003070 comp rx=0 tx=0).stop 2024-02-15T23:29:48.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3510009038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c506d0 msgr2=0x5593c8c50af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3510009038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c506d0 0x5593c8c50af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8000c10 tx=0x7fb6e8018020 comp rx=0 tx=0).stop 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3510009038 shutdown_connections 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3510009038 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5d80342b0 0x7fb5d8036770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 --2- 172.21.15.133:0/3510009038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8c506d0 0x5593c8c50af0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3510009038 >> 172.21.15.133:0/3510009038 conn(0x5593c8c454e0 msgr2=0x5593c8c45ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3510009038 shutdown_connections 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.963+0000 7fb702721980 1 -- 172.21.15.133:0/3510009038 wait complete. 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8b49510 msgr2=0x5593c8c3fee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8b49510 0x5593c8c3fee0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5e80342b0 msgr2=0x7fb5e8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5e80342b0 0x7fb5e8036770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80ad000 tx=0x7fb6e80a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 msgr2=0x5593c8c306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8c306a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5593c8c30fd0 tx=0x7fb6f0000f50 comp rx=0 tx=0).stop 2024-02-15T23:29:48.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 shutdown_connections 2024-02-15T23:29:48.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593c8b49510 0x5593c8c3fee0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb5e80342b0 0x7fb5e8036770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 --2- 172.21.15.133:0/3530384448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c8b44fb0 0x5593c8c306a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:48.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 >> 172.21.15.133:0/3530384448 conn(0x5593c8b40880 msgr2=0x5593c8c296c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:48.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 shutdown_connections 2024-02-15T23:29:48.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:48.967+0000 7fb702721980 1 -- 172.21.15.133:0/3530384448 wait complete. 2024-02-15T23:29:48.985 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:48.986 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-15T23:29:48.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-15T23:29:48.986 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-02-15T23:29:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:49.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.011+0000 7f52a32b9980 1 Processor -- start 2024-02-15T23:29:49.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.011+0000 7f52a32b9980 1 -- start start 2024-02-15T23:29:49.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.011+0000 7f52a32b9980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5610e0d8c810 0x5610e0d8ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.011+0000 7f52a32b9980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5610e0cd4460 con 0x5610e0d89850 2024-02-15T23:29:49.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.011+0000 7f52a32b9980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5610e0c9b180 con 0x5610e0d8c810 2024-02-15T23:29:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f52a05d3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5610e0d8c810 0x5610e0d8ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f52a0dd4640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5610e0d89850 0x5610e0d89c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39714/0 (socket says 172.21.15.133:39714) 2024-02-15T23:29:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f52a0dd4640 1 -- 172.21.15.133:0/444976972 learned_addr learned my addr 172.21.15.133:0/444976972 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f52a05d3640 1 -- 172.21.15.133:0/444976972 >> v1:172.21.15.131:6789/0 conn(0x5610e0d89850 legacy=0x5610e0d89c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f52a05d3640 1 -- 172.21.15.133:0/444976972 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610e0d8a340 con 0x5610e0d8c810 2024-02-15T23:29:49.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f52a05d3640 1 --2- 172.21.15.133:0/444976972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d8ec00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f529400a480 tx=0x7f529401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce97f091780962f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f529fdd2640 1 -- 172.21.15.133:0/444976972 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52940ab540 con 0x5610e0d8c810 2024-02-15T23:29:49.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f529fdd2640 1 -- 172.21.15.133:0/444976972 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52940ab6a0 con 0x5610e0d8c810 2024-02-15T23:29:49.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.015+0000 7f529fdd2640 1 -- 172.21.15.133:0/444976972 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52940ab960 con 0x5610e0d8c810 2024-02-15T23:29:49.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.019+0000 7f52a32b9980 1 -- 172.21.15.133:0/444976972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 msgr2=0x5610e0d8ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.019+0000 7f52a32b9980 1 --2- 172.21.15.133:0/444976972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d8ec00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f529400a480 tx=0x7f529401b280 comp rx=0 tx=0).stop 2024-02-15T23:29:49.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.019+0000 7f52a32b9980 1 -- 172.21.15.133:0/444976972 shutdown_connections 2024-02-15T23:29:49.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.019+0000 7f52a32b9980 1 --2- 172.21.15.133:0/444976972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d8ec00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.019+0000 7f52a32b9980 1 -- 172.21.15.133:0/444976972 >> 172.21.15.133:0/444976972 conn(0x5610e0d82000 msgr2=0x5610e0d84420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.019+0000 7f52a32b9980 1 -- 172.21.15.133:0/444976972 shutdown_connections 2024-02-15T23:29:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.019+0000 7f52a32b9980 1 -- 172.21.15.133:0/444976972 wait complete. 2024-02-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.031+0000 7f52a32b9980 1 Processor -- start 2024-02-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.031+0000 7f52a32b9980 1 -- start start 2024-02-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.031+0000 7f52a32b9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d89850 0x5610e0e72060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.031+0000 7f52a32b9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610e0c986b0 con 0x5610e0d89850 2024-02-15T23:29:49.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.031+0000 7f52a0dd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d89850 0x5610e0e72060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.031+0000 7f52a0dd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d89850 0x5610e0e72060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41898/0 (socket says 172.21.15.133:41898) 2024-02-15T23:29:49.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.031+0000 7f52a0dd4640 1 -- 172.21.15.133:0/2213227396 learned_addr learned my addr 172.21.15.133:0/2213227396 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a0dd4640 1 -- 172.21.15.133:0/2213227396 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294005d30 con 0x5610e0d89850 2024-02-15T23:29:49.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a0dd4640 1 --2- 172.21.15.133:0/2213227396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d89850 0x5610e0e72060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5290001c00 tx=0x7f529000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4784ad73915b5b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f518ee0d640 1 -- 172.21.15.133:0/2213227396 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f529000e690 con 0x5610e0d89850 2024-02-15T23:29:49.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f518ee0d640 1 -- 172.21.15.133:0/2213227396 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529000e810 con 0x5610e0d89850 2024-02-15T23:29:49.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f518ee0d640 1 -- 172.21.15.133:0/2213227396 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f529000eb30 con 0x5610e0d89850 2024-02-15T23:29:49.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 -- 172.21.15.133:0/2213227396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d89850 msgr2=0x5610e0e72060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2213227396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d89850 0x5610e0e72060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5290001c00 tx=0x7f529000b6d0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 -- 172.21.15.133:0/2213227396 shutdown_connections 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2213227396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d89850 0x5610e0e72060 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 -- 172.21.15.133:0/2213227396 >> 172.21.15.133:0/2213227396 conn(0x5610e0d82000 msgr2=0x5610e0e6dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 -- 172.21.15.133:0/2213227396 shutdown_connections 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 -- 172.21.15.133:0/2213227396 wait complete. 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 Processor -- start 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 -- start start 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d88d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a32b9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610e0c93e90 con 0x5610e0d8c810 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a0dd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d88d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a0dd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d88d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41908/0 (socket says 172.21.15.133:41908) 2024-02-15T23:29:49.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a0dd4640 1 -- 172.21.15.133:0/2291321861 learned_addr learned my addr 172.21.15.133:0/2291321861 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a0dd4640 1 -- 172.21.15.133:0/2291321861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610e0cd4460 con 0x5610e0d8c810 2024-02-15T23:29:49.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.035+0000 7f52a0dd4640 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d88d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f529000b710 tx=0x7f5290000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f518d60a640 1 -- 172.21.15.133:0/2291321861 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f529001f070 con 0x5610e0d8c810 2024-02-15T23:29:49.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f518d60a640 1 -- 172.21.15.133:0/2291321861 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290001410 con 0x5610e0d8c810 2024-02-15T23:29:49.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610e0d89240 con 0x5610e0d8c810 2024-02-15T23:29:49.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f518d60a640 1 -- 172.21.15.133:0/2291321861 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f529001a9f0 con 0x5610e0d8c810 2024-02-15T23:29:49.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610e0d877b0 con 0x5610e0d8c810 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f518d60a640 1 -- 172.21.15.133:0/2291321861 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f529000a040 con 0x5610e0d8c810 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f518d60a640 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f51880342b0 0x7f5188036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f518d60a640 1 -- 172.21.15.133:0/2291321861 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f5290049df0 con 0x5610e0d8c810 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a05d3640 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f51880342b0 0x7f5188036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0e80110 0x5610e0e82500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0e82a40 con 0x5610e0e80110 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a15d5640 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0e80110 0x5610e0e82500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a05d3640 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f51880342b0 0x7f5188036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f52940ad000 tx=0x7f52940a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a15d5640 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0e80110 0x5610e0e82500 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a15d5640 1 -- 172.21.15.133:0/2291321861 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f529800a4d0 con 0x5610e0e80110 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0e82da0 con 0x5610e0e80110 2024-02-15T23:29:49.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a15d5640 1 -- 172.21.15.133:0/2291321861 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f529800a4d0 con 0x5610e0e80110 2024-02-15T23:29:49.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0e84600 con 0x5610e0e80110 2024-02-15T23:29:49.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a15d5640 1 -- 172.21.15.133:0/2291321861 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f529800a4d0 con 0x5610e0e80110 2024-02-15T23:29:49.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0e83800 con 0x5610e0e80110 2024-02-15T23:29:49.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a15d5640 1 -- 172.21.15.133:0/2291321861 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f529800a4d0 con 0x5610e0e80110 2024-02-15T23:29:49.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.039+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0e83c10 con 0x5610e0e80110 2024-02-15T23:29:49.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a15d5640 1 -- 172.21.15.133:0/2291321861 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f529800a4d0 con 0x5610e0e80110 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a32b9980 1 Processor -- start 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a32b9980 1 -- start start 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a32b9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e92c40 0x5610e0e93060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a32b9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610e0c2cf20 con 0x5610e0e92c40 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a05d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e92c40 0x5610e0e93060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a05d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e92c40 0x5610e0e93060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41924/0 (socket says 172.21.15.133:41924) 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a05d3640 1 -- 172.21.15.133:0/3697472051 learned_addr learned my addr 172.21.15.133:0/3697472051 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a05d3640 1 -- 172.21.15.133:0/3697472051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610e0e935a0 con 0x5610e0e92c40 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a05d3640 1 --2- 172.21.15.133:0/3697472051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e92c40 0x5610e0e93060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5294096e80 tx=0x7f5294018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f51867fc640 1 -- 172.21.15.133:0/3697472051 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52940bd8a0 con 0x5610e0e92c40 2024-02-15T23:29:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f51867fc640 1 -- 172.21.15.133:0/3697472051 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52940bda00 con 0x5610e0e92c40 2024-02-15T23:29:49.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a32b9980 1 -- 172.21.15.133:0/3697472051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610e0e93790 con 0x5610e0e92c40 2024-02-15T23:29:49.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f51867fc640 1 -- 172.21.15.133:0/3697472051 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52940bdca0 con 0x5610e0e92c40 2024-02-15T23:29:49.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a32b9980 1 -- 172.21.15.133:0/3697472051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610e0e942e0 con 0x5610e0e92c40 2024-02-15T23:29:49.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f51867fc640 1 -- 172.21.15.133:0/3697472051 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f52940be480 con 0x5610e0e92c40 2024-02-15T23:29:49.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f51867fc640 1 --2- 172.21.15.133:0/3697472051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5178034300 0x7f51780367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f51867fc640 1 -- 172.21.15.133:0/3697472051 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f52940e6320 con 0x5610e0e92c40 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.043+0000 7f52a15d5640 1 --2- 172.21.15.133:0/3697472051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5178034300 0x7f51780367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 Processor -- start 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- start start 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a15d5640 1 --2- 172.21.15.133:0/3697472051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5178034300 0x7f51780367c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x5610e0e832a0 tx=0x7f5298005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610e0c20790 con 0x5610e0e9fc70 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41938/0 (socket says 172.21.15.133:41938) 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 -- 172.21.15.133:0/4062555213 learned_addr learned my addr 172.21.15.133:0/4062555213 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 -- 172.21.15.133:0/4062555213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610e0ea0620 con 0x5610e0e9fc70 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 --2- 172.21.15.133:0/4062555213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea0050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5294006c40 tx=0x7f52940aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb9d7d83d2ea9c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f5177fff640 1 -- 172.21.15.133:0/4062555213 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52940be860 con 0x5610e0e9fc70 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f5177fff640 1 -- 172.21.15.133:0/4062555213 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294006cb0 con 0x5610e0e9fc70 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f5177fff640 1 -- 172.21.15.133:0/4062555213 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52940b4c50 con 0x5610e0e9fc70 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- 172.21.15.133:0/4062555213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 msgr2=0x5610e0ea0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 --2- 172.21.15.133:0/4062555213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea0050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5294006c40 tx=0x7f52940aae30 comp rx=0 tx=0).stop 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- 172.21.15.133:0/4062555213 shutdown_connections 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 --2- 172.21.15.133:0/4062555213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea0050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- 172.21.15.133:0/4062555213 >> 172.21.15.133:0/4062555213 conn(0x5610e0e9bfb0 msgr2=0x5610e0e9a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- 172.21.15.133:0/4062555213 shutdown_connections 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- 172.21.15.133:0/4062555213 wait complete. 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 Processor -- start 2024-02-15T23:29:49.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- start start 2024-02-15T23:29:49.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a32b9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610e0ea7030 con 0x5610e0e9fc70 2024-02-15T23:29:49.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41944/0 (socket says 172.21.15.133:41944) 2024-02-15T23:29:49.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 learned_addr learned my addr 172.21.15.133:0/3592542880 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.047+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610e0e942e0 con 0x5610e0e9fc70 2024-02-15T23:29:49.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a05d3640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea6af0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f52940b5fb0 tx=0x7f52940e46a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f51767fc640 1 -- 172.21.15.133:0/3592542880 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52940e4e90 con 0x5610e0e9fc70 2024-02-15T23:29:49.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610e0ea7230 con 0x5610e0e9fc70 2024-02-15T23:29:49.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610e0ea76c0 con 0x5610e0e9fc70 2024-02-15T23:29:49.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f51767fc640 1 -- 172.21.15.133:0/3592542880 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294006890 con 0x5610e0e9fc70 2024-02-15T23:29:49.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f51767fc640 1 -- 172.21.15.133:0/3592542880 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52940b4d80 con 0x5610e0e9fc70 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f51767fc640 1 -- 172.21.15.133:0/3592542880 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f52940b4370 con 0x5610e0e9fc70 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f51767fc640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f516c0342b0 0x7f516c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f51767fc640 1 -- 172.21.15.133:0/3592542880 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f52940dd4a0 con 0x5610e0e9fc70 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a15d5640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f516c0342b0 0x7f516c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0eb2160 0x5610e0eb45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0eb4d40 con 0x5610e0eb2160 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a0dd4640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0eb2160 0x5610e0eb45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a15d5640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f516c0342b0 0x7f516c036770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5298011010 tx=0x7f5298020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a0dd4640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0eb2160 0x5610e0eb45f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 realm 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0eb5110 con 0x5610e0eb2160 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0eb5960 con 0x5610e0eb2160 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0eb5cc0 con 0x5610e0eb2160 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.051+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0eb64c0 con 0x5610e0eb2160 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a32b9980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a32b9980 20 searching for the correct realm 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5610e0eb8380 0x5610e0eba800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a05d3640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5610e0eb8380 0x5610e0eba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a05d3640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5610e0eb8380 0x5610e0eba800 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a05d3640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f52940f0060 0x7f52940de0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52940f0060 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a15d5640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f52940f0060 0x7f52940de0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a15d5640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f52940f0060 0x7f52940de0d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f529800a4d0 con 0x7f52940f0060 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a15d5640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f52980141d0 0x7f5298015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a0dd4640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f52980141d0 0x7f5298015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a0dd4640 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f52980141d0 0x7f5298015940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.055+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb2160 2024-02-15T23:29:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb2160 2024-02-15T23:29:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52940f0060 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f529800a4d0 con 0x7f52940f0060 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb2160 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb2160 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52940f0060 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.059+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb2160 2024-02-15T23:29:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb2160 2024-02-15T23:29:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52940f0060 2024-02-15T23:29:49.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb2160 2024-02-15T23:29:49.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.063+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52940f0060 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb8380 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52980141d0 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x5610e0eb2160 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebae80 con 0x7f52940f0060 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:49.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0eb7990 con 0x5610e0eb2160 2024-02-15T23:29:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0eb71b0 con 0x5610e0eb2160 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebb2c0 con 0x5610e0eb2160 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.067+0000 7f52a32b9980 20 zone default found 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 4 Realm: () 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 zonegroup default 2024-02-15T23:29:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebb620 con 0x7f52980141d0 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebd3e0 con 0x5610e0eb8380 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebd740 con 0x5610e0eb8380 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 started sync module instance, tier type = 2024-02-15T23:29:49.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:49.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebccc0 con 0x7f52940f0060 2024-02-15T23:29:49.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94630493014048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebcc40 con 0x7f52940f0060 2024-02-15T23:29:49.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebe470 con 0x5610e0eb2160 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.071+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94630493014048] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.075+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.075+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94630493018928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebe3f0 con 0x5610e0eb2160 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.075+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebebf0 con 0x5610e0eb8380 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.075+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.075+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94630493021440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebf3f0 con 0x5610e0eb8380 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.075+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebfd60 con 0x7f52940f0060 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.075+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94630493018928] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.079+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.079+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94630493026496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebfce0 con 0x7f52940f0060 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.079+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec0b00 con 0x5610e0eb2160 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.079+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94630493021440] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.079+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94630493026496] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.079+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.079+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94630493024080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec0ac0 con 0x5610e0eb2160 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.079+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec1350 con 0x7f52980141d0 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.083+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.083+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94630493031104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec1380 con 0x7f52980141d0 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.083+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec1d70 con 0x7f52980141d0 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.083+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94630493024080] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.083+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94630493031104] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.083+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.083+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94630493034576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec0ee0 con 0x7f52980141d0 2024-02-15T23:29:49.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.083+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec25c0 con 0x7f52980141d0 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94630493034576] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94630493028672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec0ee0 con 0x7f52980141d0 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 20 add_watcher() i=0 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 20 add_watcher() i=1 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 20 add_watcher() i=2 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 20 add_watcher() i=3 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 20 add_watcher() i=4 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 20 add_watcher() i=5 2024-02-15T23:29:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 20 add_watcher() i=6 2024-02-15T23:29:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94630493028672] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 20 add_watcher() i=7 2024-02-15T23:29:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec5570 con 0x5610e0eb2160 2024-02-15T23:29:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.087+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94630493036256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ec2a10 con 0x5610e0eb2160 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94630493036256] v31'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f5156fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 5 note: GC not initialized 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f5155fe3640 20 reqs_thread_entry: start 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 Filter name: none 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f50c77fe640 20 reqs_thread_entry: start 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ee74d0 con 0x7f52980141d0 2024-02-15T23:29:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ee74d0 con 0x5610e0eb2160 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 rados_obj.operate() r=0 bl.length=7 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ee5da0 con 0x5610e0eb2160 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 foo [call out=48b,read 0~358 out=358b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+406 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:49.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-02-15T23:29:49.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:49.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-02-15T23:29:49.103 INFO:teuthology.orchestra.run.smithi133.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-02-15T23:29:49.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f5156fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.091+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94630493036256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ee69b0 con 0x5610e0eb2160 2024-02-15T23:29:49.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.095+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94630493036256] v31'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.095+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94630493014048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ee69b0 con 0x7f52940f0060 2024-02-15T23:29:49.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.095+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94630493014048] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.095+0000 7f52a32b9980 20 remove_watcher() i=0 2024-02-15T23:29:49.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.095+0000 7f52a32b9980 2 removed watcher, disabling cache 2024-02-15T23:29:49.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.095+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94630493018928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ee69b0 con 0x5610e0eb2160 2024-02-15T23:29:49.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94630493018928] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a32b9980 20 remove_watcher() i=1 2024-02-15T23:29:49.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94630493021440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ee69b0 con 0x5610e0eb8380 2024-02-15T23:29:49.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a05d3640 1 -- 172.21.15.133:0/3592542880 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94630493021440] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52940d1610 con 0x5610e0eb8380 2024-02-15T23:29:49.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a32b9980 20 remove_watcher() i=2 2024-02-15T23:29:49.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94630493026496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebc820 con 0x7f52940f0060 2024-02-15T23:29:49.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a15d5640 1 -- 172.21.15.133:0/3592542880 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94630493026496] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f529803a040 con 0x7f52940f0060 2024-02-15T23:29:49.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a32b9980 20 remove_watcher() i=3 2024-02-15T23:29:49.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.099+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94630493024080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebdb30 con 0x5610e0eb2160 2024-02-15T23:29:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.103+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94630493024080] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x5610e0eb2160 2024-02-15T23:29:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.103+0000 7f52a32b9980 20 remove_watcher() i=4 2024-02-15T23:29:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.103+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94630493031104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebe500 con 0x7f52980141d0 2024-02-15T23:29:49.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.103+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94630493031104] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.103+0000 7f52a32b9980 20 remove_watcher() i=5 2024-02-15T23:29:49.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.103+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94630493034576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebf8c0 con 0x7f52980141d0 2024-02-15T23:29:49.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94630493034576] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 20 remove_watcher() i=6 2024-02-15T23:29:49.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94630493028672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5610e0ebf8c0 con 0x7f52980141d0 2024-02-15T23:29:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94630493028672] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5290017900 con 0x7f52980141d0 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 20 remove_watcher() i=7 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f52980141d0 msgr2=0x7f5298015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f52980141d0 0x7f5298015940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0eb2160 msgr2=0x5610e0eb45f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0eb2160 0x5610e0eb45f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f52940f0060 msgr2=0x7f52940de0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f52940f0060 0x7f52940de0d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5610e0eb8380 msgr2=0x5610e0eba800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5610e0eb8380 0x5610e0eba800 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f516c0342b0 msgr2=0x7f516c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f516c0342b0 0x7f516c036770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5298011010 tx=0x7f5298020000 comp rx=0 tx=0).stop 2024-02-15T23:29:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 msgr2=0x5610e0ea6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a0dd4640 1 -- 172.21.15.133:0/3592542880 reap_dead start 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea6af0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f52940b5fb0 tx=0x7f52940e46a0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 shutdown_connections 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3592542880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e9fc70 0x5610e0ea6af0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.107+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 >> 172.21.15.133:0/3592542880 conn(0x5610e0e9bfb0 msgr2=0x5610e0e99610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 shutdown_connections 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/3592542880 wait complete. 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/3697472051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5178034300 msgr2=0x7f51780367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3697472051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5178034300 0x7f51780367c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x5610e0e832a0 tx=0x7f5298005850 comp rx=0 tx=0).stop 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/3697472051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e92c40 msgr2=0x5610e0e93060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3697472051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e92c40 0x5610e0e93060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5294096e80 tx=0x7f5294018020 comp rx=0 tx=0).stop 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/3697472051 shutdown_connections 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3697472051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5178034300 0x7f51780367c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/3697472051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0e92c40 0x5610e0e93060 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/3697472051 >> 172.21.15.133:0/3697472051 conn(0x5610e0e87a50 msgr2=0x5610e0e88560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/3697472051 shutdown_connections 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/3697472051 wait complete. 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0e80110 msgr2=0x5610e0e82500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0e80110 0x5610e0e82500 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f51880342b0 msgr2=0x7f5188036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f51880342b0 0x7f5188036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f52940ad000 tx=0x7f52940a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 msgr2=0x5610e0d88d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d88d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f529000b710 tx=0x7f5290000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 shutdown_connections 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5610e0e80110 0x5610e0e82500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f51880342b0 0x7f5188036770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 --2- 172.21.15.133:0/2291321861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610e0d8c810 0x5610e0d88d00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 >> 172.21.15.133:0/2291321861 conn(0x5610e0d82000 msgr2=0x5610e0e6c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 shutdown_connections 2024-02-15T23:29:49.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.111+0000 7f52a32b9980 1 -- 172.21.15.133:0/2291321861 wait complete. 2024-02-15T23:29:49.129 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-02-15T23:29:49.130 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:29:49.130 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:29:49.130 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:29:49.209 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:49.209 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c651fb980 1 Processor -- start 2024-02-15T23:29:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c651fb980 1 -- start start 2024-02-15T23:29:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c651fb980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x562c07d77130 0x562c07d77510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c651fb980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562c07cc34c0 con 0x562c07d77a50 2024-02-15T23:29:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c651fb980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x562c07c8a180 con 0x562c07d77130 2024-02-15T23:29:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c62d16640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x562c07d77130 0x562c07d77510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c62515640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x562c07d77a50 0x562c07d78410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39730/0 (socket says 172.21.15.133:39730) 2024-02-15T23:29:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c62515640 1 -- 172.21.15.133:0/3138861815 learned_addr learned my addr 172.21.15.133:0/3138861815 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c62d16640 1 -- 172.21.15.133:0/3138861815 >> v1:172.21.15.131:6789/0 conn(0x562c07d77a50 legacy=0x562c07d78410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.203+0000 7f9c62d16640 1 -- 172.21.15.133:0/3138861815 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c07d78c40 con 0x562c07d77130 2024-02-15T23:29:49.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c62d16640 1 --2- 172.21.15.133:0/3138861815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07d77510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400a480 tx=0x7f9c5401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d33cd61f315b62 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c61d14640 1 -- 172.21.15.133:0/3138861815 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c540ab540 con 0x562c07d77130 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c61d14640 1 -- 172.21.15.133:0/3138861815 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540ab6a0 con 0x562c07d77130 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c61d14640 1 -- 172.21.15.133:0/3138861815 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c540ab960 con 0x562c07d77130 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c651fb980 1 -- 172.21.15.133:0/3138861815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 msgr2=0x562c07d77510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c651fb980 1 --2- 172.21.15.133:0/3138861815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07d77510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400a480 tx=0x7f9c5401b280 comp rx=0 tx=0).stop 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c651fb980 1 -- 172.21.15.133:0/3138861815 shutdown_connections 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c651fb980 1 --2- 172.21.15.133:0/3138861815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07d77510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c651fb980 1 -- 172.21.15.133:0/3138861815 >> 172.21.15.133:0/3138861815 conn(0x562c07d72a00 msgr2=0x562c07d74e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c651fb980 1 -- 172.21.15.133:0/3138861815 shutdown_connections 2024-02-15T23:29:49.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.207+0000 7f9c651fb980 1 -- 172.21.15.133:0/3138861815 wait complete. 2024-02-15T23:29:49.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 Processor -- start 2024-02-15T23:29:49.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- start start 2024-02-15T23:29:49.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e61610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c07c876b0 con 0x562c07d77130 2024-02-15T23:29:49.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c62d16640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e61610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c62d16640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e61610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41952/0 (socket says 172.21.15.133:41952) 2024-02-15T23:29:49.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c62d16640 1 -- 172.21.15.133:0/2155900084 learned_addr learned my addr 172.21.15.133:0/2155900084 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c62d16640 1 -- 172.21.15.133:0/2155900084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54005d30 con 0x562c07d77130 2024-02-15T23:29:49.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c62d16640 1 --2- 172.21.15.133:0/2155900084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e61610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c540ae040 tx=0x7f9c54003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72437ee511739aa5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9b50e09640 1 -- 172.21.15.133:0/2155900084 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c540ab810 con 0x562c07d77130 2024-02-15T23:29:49.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9b50e09640 1 -- 172.21.15.133:0/2155900084 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540ab970 con 0x562c07d77130 2024-02-15T23:29:49.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9b50e09640 1 -- 172.21.15.133:0/2155900084 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c540abc10 con 0x562c07d77130 2024-02-15T23:29:49.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- 172.21.15.133:0/2155900084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 msgr2=0x562c07e61610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 --2- 172.21.15.133:0/2155900084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e61610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c540ae040 tx=0x7f9c54003030 comp rx=0 tx=0).stop 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- 172.21.15.133:0/2155900084 shutdown_connections 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 --2- 172.21.15.133:0/2155900084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e61610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- 172.21.15.133:0/2155900084 >> 172.21.15.133:0/2155900084 conn(0x562c07d72a00 msgr2=0x562c07e5d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- 172.21.15.133:0/2155900084 shutdown_connections 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- 172.21.15.133:0/2155900084 wait complete. 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 Processor -- start 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- start start 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.223+0000 7f9c651fb980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c07c82e90 con 0x562c07d77130 2024-02-15T23:29:49.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c62d16640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c62d16640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e683c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41966/0 (socket says 172.21.15.133:41966) 2024-02-15T23:29:49.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c62d16640 1 -- 172.21.15.133:0/1928086003 learned_addr learned my addr 172.21.15.133:0/1928086003 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c62d16640 1 -- 172.21.15.133:0/1928086003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c07d78c40 con 0x562c07d77130 2024-02-15T23:29:49.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c62d16640 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e683c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c54018eb0 tx=0x7f9c54018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9b4f606640 1 -- 172.21.15.133:0/1928086003 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c540c2070 con 0x562c07d77130 2024-02-15T23:29:49.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9b4f606640 1 -- 172.21.15.133:0/1928086003 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540b5aa0 con 0x562c07d77130 2024-02-15T23:29:49.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c07e68900 con 0x562c07d77130 2024-02-15T23:29:49.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9b4f606640 1 -- 172.21.15.133:0/1928086003 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c540b5d40 con 0x562c07d77130 2024-02-15T23:29:49.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c07e68db0 con 0x562c07d77130 2024-02-15T23:29:49.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9b4f606640 1 -- 172.21.15.133:0/1928086003 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9c540b2070 con 0x562c07d77130 2024-02-15T23:29:49.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9b4f606640 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b48034300 0x7f9b480367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9b4f606640 1 -- 172.21.15.133:0/1928086003 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9c540e3430 con 0x562c07d77130 2024-02-15T23:29:49.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c62515640 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b48034300 0x7f9b480367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c651fb980 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07d77a50 0x562c07e6efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07e6f520 con 0x562c07d77a50 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c63517640 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07d77a50 0x562c07e6efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c62515640 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b48034300 0x7f9b480367c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9c58000f70 tx=0x7f9c580012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c63517640 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07d77a50 0x562c07e6efe0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.227+0000 7f9c63517640 1 -- 172.21.15.133:0/1928086003 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c5c00a4d0 con 0x562c07d77a50 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07e6c710 con 0x562c07d77a50 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c63517640 1 -- 172.21.15.133:0/1928086003 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9c5c00a4d0 con 0x562c07d77a50 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07e71250 con 0x562c07d77a50 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c63517640 1 -- 172.21.15.133:0/1928086003 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f9c5c00a4d0 con 0x562c07d77a50 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07e70450 con 0x562c07d77a50 2024-02-15T23:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c63517640 1 -- 172.21.15.133:0/1928086003 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9c5c00a4d0 con 0x562c07d77a50 2024-02-15T23:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07e70860 con 0x562c07d77a50 2024-02-15T23:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c63517640 1 -- 172.21.15.133:0/1928086003 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9c5c00a4d0 con 0x562c07d77a50 2024-02-15T23:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c651fb980 1 Processor -- start 2024-02-15T23:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c651fb980 1 -- start start 2024-02-15T23:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c651fb980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e7f930 0x562c07e7fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c651fb980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c07c1bf20 con 0x562c07e7f930 2024-02-15T23:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c62515640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e7f930 0x562c07e7fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c62515640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e7f930 0x562c07e7fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41970/0 (socket says 172.21.15.133:41970) 2024-02-15T23:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c62515640 1 -- 172.21.15.133:0/2014499209 learned_addr learned my addr 172.21.15.133:0/2014499209 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c62515640 1 -- 172.21.15.133:0/2014499209 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c07e80290 con 0x562c07e7f930 2024-02-15T23:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9c62515640 1 --2- 172.21.15.133:0/2014499209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e7f930 0x562c07e7fd50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c58001ee0 tx=0x7f9c5800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9b4ce01640 1 -- 172.21.15.133:0/2014499209 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c58020070 con 0x562c07e7f930 2024-02-15T23:29:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.231+0000 7f9b4ce01640 1 -- 172.21.15.133:0/2014499209 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5800c770 con 0x562c07e7f930 2024-02-15T23:29:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c651fb980 1 -- 172.21.15.133:0/2014499209 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c07e804e0 con 0x562c07e7f930 2024-02-15T23:29:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9b4ce01640 1 -- 172.21.15.133:0/2014499209 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c58013040 con 0x562c07e7f930 2024-02-15T23:29:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c651fb980 1 -- 172.21.15.133:0/2014499209 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c07e81030 con 0x562c07e7f930 2024-02-15T23:29:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9b4ce01640 1 -- 172.21.15.133:0/2014499209 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9c5800a040 con 0x562c07e7f930 2024-02-15T23:29:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9b4ce01640 1 --2- 172.21.15.133:0/2014499209 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b3c034300 0x7f9b3c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9b4ce01640 1 -- 172.21.15.133:0/2014499209 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9c5804b6b0 con 0x562c07e7f930 2024-02-15T23:29:49.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c63517640 1 --2- 172.21.15.133:0/2014499209 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b3c034300 0x7f9b3c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c651fb980 1 Processor -- start 2024-02-15T23:29:49.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c651fb980 1 -- start start 2024-02-15T23:29:49.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c651fb980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e8ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c63517640 1 --2- 172.21.15.133:0/2014499209 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b3c034300 0x7f9b3c0367c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x562c07e6fe90 tx=0x7f9c5c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c651fb980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c07c0f790 con 0x562c07e8e880 2024-02-15T23:29:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c62515640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e8ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c62515640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e8ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41972/0 (socket says 172.21.15.133:41972) 2024-02-15T23:29:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c62515640 1 -- 172.21.15.133:0/2839040724 learned_addr learned my addr 172.21.15.133:0/2839040724 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c62515640 1 -- 172.21.15.133:0/2839040724 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c07e8f230 con 0x562c07e8e880 2024-02-15T23:29:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9c62515640 1 --2- 172.21.15.133:0/2839040724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e8ec60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9c58049ad0 tx=0x7f9c58019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d0e706b29bc88b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9b467fc640 1 -- 172.21.15.133:0/2839040724 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c58048070 con 0x562c07e8e880 2024-02-15T23:29:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9b467fc640 1 -- 172.21.15.133:0/2839040724 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5801b7a0 con 0x562c07e8e880 2024-02-15T23:29:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.235+0000 7f9b467fc640 1 -- 172.21.15.133:0/2839040724 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c58019320 con 0x562c07e8e880 2024-02-15T23:29:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- 172.21.15.133:0/2839040724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 msgr2=0x562c07e8ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 --2- 172.21.15.133:0/2839040724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e8ec60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9c58049ad0 tx=0x7f9c58019a70 comp rx=0 tx=0).stop 2024-02-15T23:29:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- 172.21.15.133:0/2839040724 shutdown_connections 2024-02-15T23:29:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 --2- 172.21.15.133:0/2839040724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e8ec60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- 172.21.15.133:0/2839040724 >> 172.21.15.133:0/2839040724 conn(0x562c07cec110 msgr2=0x562c07cec4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- 172.21.15.133:0/2839040724 shutdown_connections 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- 172.21.15.133:0/2839040724 wait complete. 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 Processor -- start 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- start start 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e95a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c07e95fc0 con 0x562c07e8e880 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c62515640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e95a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c62515640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e95a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41978/0 (socket says 172.21.15.133:41978) 2024-02-15T23:29:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 learned_addr learned my addr 172.21.15.133:0/774361819 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c07e81030 con 0x562c07e8e880 2024-02-15T23:29:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c62515640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e95a80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c5803e040 tx=0x7f9c58049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9b44ff9640 1 -- 172.21.15.133:0/774361819 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c5804b450 con 0x562c07e8e880 2024-02-15T23:29:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c07e961c0 con 0x562c07e8e880 2024-02-15T23:29:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9b44ff9640 1 -- 172.21.15.133:0/774361819 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c58025ac0 con 0x562c07e8e880 2024-02-15T23:29:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c07e965f0 con 0x562c07e8e880 2024-02-15T23:29:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9b44ff9640 1 -- 172.21.15.133:0/774361819 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c58025d60 con 0x562c07e8e880 2024-02-15T23:29:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9b44ff9640 1 -- 172.21.15.133:0/774361819 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9c58042050 con 0x562c07e8e880 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9b44ff9640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b2c034300 0x7f9b2c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9b44ff9640 1 -- 172.21.15.133:0/774361819 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9c5802f070 con 0x562c07e8e880 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c63517640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b2c034300 0x7f9b2c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07ea0fa0 0x562c07ea3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea3bb0 con 0x562c07ea0fa0 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.239+0000 7f9c62d16640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07ea0fa0 0x562c07ea3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c63517640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b2c034300 0x7f9b2c0367c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c011010 tx=0x7f9c5c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62d16640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07ea0fa0 0x562c07ea3460 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 realm 2024-02-15T23:29:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea3f80 con 0x562c07ea0fa0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea47d0 con 0x562c07ea0fa0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea4b30 con 0x562c07ea0fa0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea4470 con 0x562c07ea0fa0 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 20 searching for the correct realm 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562c07ea6d80 0x562c07ea91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62515640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562c07ea6d80 0x562c07ea91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62515640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562c07ea6d80 0x562c07ea91b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62515640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9c58037020 0x7f9c58027060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c58037020 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c63517640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9c58037020 0x7f9c58027060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c63517640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9c58037020 0x7f9c58027060 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c5c00a4d0 con 0x7f9c58037020 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c63517640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9c5c0141d0 0x7f9c5c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.243+0000 7f9c62d16640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9c5c0141d0 0x7f9c5c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9c5c0141d0 0x7f9c5c015940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea0fa0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea0fa0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c58037020 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c5c00a4d0 con 0x7f9c58037020 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea0fa0 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.247+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea0fa0 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c58037020 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea0fa0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea0fa0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.251+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c58037020 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea0fa0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c58037020 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea6d80 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.255+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c5c0141d0 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x562c07ea0fa0 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9880 con 0x7f9c58037020 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea59a0 con 0x562c07ea0fa0 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea5620 con 0x562c07ea0fa0 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea6330 con 0x562c07ea0fa0 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 zone default found 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 4 Realm: () 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 zonegroup default 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ea9cc0 con 0x7f9c5c0141d0 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eabb40 con 0x562c07ea6d80 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eabea0 con 0x562c07ea6d80 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 started sync module instance, tier type = 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eab110 con 0x7f9c58037020 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.259+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.263+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94747111371968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eab110 con 0x7f9c58037020 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.263+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eac810 con 0x562c07ea0fa0 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.263+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94747111371968] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.263+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.263+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94747111376000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eab110 con 0x562c07ea0fa0 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.263+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ead1d0 con 0x562c07ea6d80 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94747111378224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eada20 con 0x562c07ea6d80 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eae3f0 con 0x7f9c58037020 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94747111376000] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94747111382768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eae7a0 con 0x7f9c58037020 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eaf110 con 0x562c07ea0fa0 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94747111378224] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94747111382768] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94747111369840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eaec70 con 0x562c07ea0fa0 2024-02-15T23:29:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.267+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eaf960 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.271+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94747111369840] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.271+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.271+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94747111380352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eaf690 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.271+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eafe90 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94747111380352] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94747111388112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eafd90 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eb0830 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94747111392016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eb0c90 con 0x7f9c5c0141d0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 20 add_watcher() i=0 2024-02-15T23:29:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 20 add_watcher() i=1 2024-02-15T23:29:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 20 add_watcher() i=2 2024-02-15T23:29:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 20 add_watcher() i=3 2024-02-15T23:29:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 20 add_watcher() i=4 2024-02-15T23:29:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 20 add_watcher() i=5 2024-02-15T23:29:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94747111388112] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.275+0000 7f9c651fb980 20 add_watcher() i=6 2024-02-15T23:29:49.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94747111392016] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 20 add_watcher() i=7 2024-02-15T23:29:49.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:49.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eb0c90 con 0x562c07ea0fa0 2024-02-15T23:29:49.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94747111393264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eb0c10 con 0x562c07ea0fa0 2024-02-15T23:29:49.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94747111393264] v31'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9b197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:49.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:49.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 5 note: GC not initialized 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9a93fff640 20 reqs_thread_entry: start 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 20 Filter name: none 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9a91ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07ed5730 con 0x562c07ea0fa0 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.279+0000 7f9c651fb980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:49.291 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:49.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.283+0000 7f9b197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.283+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94747111393264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eb62e0 con 0x562c07ea0fa0 2024-02-15T23:29:49.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.283+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94747111393264] v31'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.283+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94747111371968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eb07f0 con 0x7f9c58037020 2024-02-15T23:29:49.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.283+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94747111371968] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.283+0000 7f9c651fb980 20 remove_watcher() i=0 2024-02-15T23:29:49.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.283+0000 7f9c651fb980 2 removed watcher, disabling cache 2024-02-15T23:29:49.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.283+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94747111376000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eb07f0 con 0x562c07ea0fa0 2024-02-15T23:29:49.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.287+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94747111376000] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.287+0000 7f9c651fb980 20 remove_watcher() i=1 2024-02-15T23:29:49.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.287+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94747111378224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eb07f0 con 0x562c07ea6d80 2024-02-15T23:29:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.287+0000 7f9c62515640 1 -- 172.21.15.133:0/774361819 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94747111378224] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c58034070 con 0x562c07ea6d80 2024-02-15T23:29:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.287+0000 7f9c651fb980 20 remove_watcher() i=2 2024-02-15T23:29:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.287+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94747111382768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eacd30 con 0x7f9c58037020 2024-02-15T23:29:49.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.291+0000 7f9c63517640 1 -- 172.21.15.133:0/774361819 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94747111382768] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c5c03a040 con 0x7f9c58037020 2024-02-15T23:29:49.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.291+0000 7f9c651fb980 20 remove_watcher() i=3 2024-02-15T23:29:49.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.291+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94747111369840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eacd30 con 0x562c07ea0fa0 2024-02-15T23:29:49.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.291+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94747111369840] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x562c07ea0fa0 2024-02-15T23:29:49.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.291+0000 7f9c651fb980 20 remove_watcher() i=4 2024-02-15T23:29:49.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.291+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94747111380352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eaac70 con 0x7f9c5c0141d0 2024-02-15T23:29:49.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.295+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94747111380352] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.295+0000 7f9c651fb980 20 remove_watcher() i=5 2024-02-15T23:29:49.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.295+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94747111388112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eacd30 con 0x7f9c5c0141d0 2024-02-15T23:29:49.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.295+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94747111388112] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.295+0000 7f9c651fb980 20 remove_watcher() i=6 2024-02-15T23:29:49.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.295+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94747111392016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562c07eaac70 con 0x7f9c5c0141d0 2024-02-15T23:29:49.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94747111392016] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c540c6460 con 0x7f9c5c0141d0 2024-02-15T23:29:49.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 20 remove_watcher() i=7 2024-02-15T23:29:49.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9c5c0141d0 msgr2=0x7f9c5c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9c5c0141d0 0x7f9c5c015940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07ea0fa0 msgr2=0x562c07ea3460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07ea0fa0 0x562c07ea3460 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9c58037020 msgr2=0x7f9c58027060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9c58037020 0x7f9c58027060 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562c07ea6d80 msgr2=0x562c07ea91b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562c07ea6d80 0x562c07ea91b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b2c034300 msgr2=0x7f9b2c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b2c034300 0x7f9b2c0367c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c011010 tx=0x7f9c5c020000 comp rx=0 tx=0).stop 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 msgr2=0x562c07e95a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c62d16640 1 -- 172.21.15.133:0/774361819 reap_dead start 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e95a80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c5803e040 tx=0x7f9c58049a30 comp rx=0 tx=0).stop 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 shutdown_connections 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/774361819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e8e880 0x562c07e95a80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 >> 172.21.15.133:0/774361819 conn(0x562c07cec110 msgr2=0x562c07cec4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 shutdown_connections 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/774361819 wait complete. 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/2014499209 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b3c034300 msgr2=0x7f9b3c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/2014499209 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b3c034300 0x7f9b3c0367c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x562c07e6fe90 tx=0x7f9c5c005850 comp rx=0 tx=0).stop 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/2014499209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e7f930 msgr2=0x562c07e7fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/2014499209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e7f930 0x562c07e7fd50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c58001ee0 tx=0x7f9c5800da30 comp rx=0 tx=0).stop 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/2014499209 shutdown_connections 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/2014499209 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b3c034300 0x7f9b3c0367c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/2014499209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07e7f930 0x562c07e7fd50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/2014499209 >> 172.21.15.133:0/2014499209 conn(0x562c07e74740 msgr2=0x562c07e75250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/2014499209 shutdown_connections 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/2014499209 wait complete. 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07d77a50 msgr2=0x562c07e6efe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07d77a50 0x562c07e6efe0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b48034300 msgr2=0x7f9b480367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b48034300 0x7f9b480367c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9c58000f70 tx=0x7f9c580012c0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 msgr2=0x562c07e683c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e683c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c54018eb0 tx=0x7f9c54018020 comp rx=0 tx=0).stop 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 shutdown_connections 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562c07d77a50 0x562c07e6efe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9b48034300 0x7f9b480367c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 --2- 172.21.15.133:0/1928086003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c07d77130 0x562c07e683c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 >> 172.21.15.133:0/1928086003 conn(0x562c07d72a00 msgr2=0x562c07e5bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 shutdown_connections 2024-02-15T23:29:49.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.299+0000 7f9c651fb980 1 -- 172.21.15.133:0/1928086003 wait complete. 2024-02-15T23:29:49.319 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:49.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-15T23:29:49.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-15T23:29:49.320 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-15T23:29:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.383+0000 7fe1dcf14980 1 Processor -- start 2024-02-15T23:29:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.383+0000 7fe1dcf14980 1 -- start start 2024-02-15T23:29:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1dcf14980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ef08430170 0x55ef08430550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1dcf14980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ef0837c4c0 con 0x55ef08430a90 2024-02-15T23:29:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1dcf14980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ef08343180 con 0x55ef08430170 2024-02-15T23:29:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1daa2f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ef08430170 0x55ef08430550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1daa2f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ef08430170 0x55ef08430550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41988/0 (socket says 172.21.15.133:41988) 2024-02-15T23:29:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1daa2f640 1 -- 172.21.15.133:0/4110798472 learned_addr learned my addr 172.21.15.133:0/4110798472 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1daa2f640 1 -- 172.21.15.133:0/4110798472 >> v1:172.21.15.131:6789/0 conn(0x55ef08430a90 legacy=0x55ef08431450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1daa2f640 1 -- 172.21.15.133:0/4110798472 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef08431c80 con 0x55ef08430170 2024-02-15T23:29:49.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1daa2f640 1 --2- 172.21.15.133:0/4110798472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef08430550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400a4e0 tx=0x7fe1d401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634fb5fc7f2c7e9a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1d9a2d640 1 -- 172.21.15.133:0/4110798472 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d40aa540 con 0x55ef08430170 2024-02-15T23:29:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.387+0000 7fe1d9a2d640 1 -- 172.21.15.133:0/4110798472 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d40a6070 con 0x55ef08430170 2024-02-15T23:29:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.391+0000 7fe1d9a2d640 1 -- 172.21.15.133:0/4110798472 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d40aa850 con 0x55ef08430170 2024-02-15T23:29:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.391+0000 7fe1dcf14980 1 -- 172.21.15.133:0/4110798472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 msgr2=0x55ef08430550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.391+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/4110798472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef08430550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400a4e0 tx=0x7fe1d401b090 comp rx=0 tx=0).stop 2024-02-15T23:29:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.391+0000 7fe1dcf14980 1 -- 172.21.15.133:0/4110798472 shutdown_connections 2024-02-15T23:29:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.391+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/4110798472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef08430550 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.391+0000 7fe1dcf14980 1 -- 172.21.15.133:0/4110798472 >> 172.21.15.133:0/4110798472 conn(0x55ef0842ba40 msgr2=0x55ef0842de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.391+0000 7fe1dcf14980 1 -- 172.21.15.133:0/4110798472 shutdown_connections 2024-02-15T23:29:49.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.391+0000 7fe1dcf14980 1 -- 172.21.15.133:0/4110798472 wait complete. 2024-02-15T23:29:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.403+0000 7fe1dcf14980 1 Processor -- start 2024-02-15T23:29:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.403+0000 7fe1dcf14980 1 -- start start 2024-02-15T23:29:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef0851a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef083406b0 con 0x55ef08430170 2024-02-15T23:29:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1daa2f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef0851a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1daa2f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef0851a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:41992/0 (socket says 172.21.15.133:41992) 2024-02-15T23:29:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3013348274 learned_addr learned my addr 172.21.15.133:0/3013348274 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3013348274 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d400a1c0 con 0x55ef08430170 2024-02-15T23:29:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1daa2f640 1 --2- 172.21.15.133:0/3013348274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef0851a610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4017ca0 tx=0x7fe1d40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fa167bc9cfc144 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe0c8e09640 1 -- 172.21.15.133:0/3013348274 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d40aa780 con 0x55ef08430170 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe0c8e09640 1 -- 172.21.15.133:0/3013348274 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d40aa8e0 con 0x55ef08430170 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe0c8e09640 1 -- 172.21.15.133:0/3013348274 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d40aab80 con 0x55ef08430170 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3013348274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 msgr2=0x55ef0851a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3013348274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef0851a610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4017ca0 tx=0x7fe1d40033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3013348274 shutdown_connections 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3013348274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef0851a610 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3013348274 >> 172.21.15.133:0/3013348274 conn(0x55ef0842ba40 msgr2=0x55ef085161a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3013348274 shutdown_connections 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3013348274 wait complete. 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 Processor -- start 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 -- start start 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef085213a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1dcf14980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef0833be90 con 0x55ef08430170 2024-02-15T23:29:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1daa2f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef085213a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1daa2f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef085213a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42000/0 (socket says 172.21.15.133:42000) 2024-02-15T23:29:49.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.407+0000 7fe1daa2f640 1 -- 172.21.15.133:0/322033906 learned_addr learned my addr 172.21.15.133:0/322033906 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1daa2f640 1 -- 172.21.15.133:0/322033906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef08431c80 con 0x55ef08430170 2024-02-15T23:29:49.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1daa2f640 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef085213a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4017ca0 tx=0x7fe1d4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe0c7606640 1 -- 172.21.15.133:0/322033906 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d40c4070 con 0x55ef08430170 2024-02-15T23:29:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe0c7606640 1 -- 172.21.15.133:0/322033906 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d40b5650 con 0x55ef08430170 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef085218e0 con 0x55ef08430170 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe0c7606640 1 -- 172.21.15.133:0/322033906 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d40b5910 con 0x55ef08430170 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef08521d30 con 0x55ef08430170 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe0c7606640 1 -- 172.21.15.133:0/322033906 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe1d40a8070 con 0x55ef08430170 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe0c7606640 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0c0034300 0x7fe0c00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe0c7606640 1 -- 172.21.15.133:0/322033906 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe1d40e3800 con 0x55ef08430170 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1da22e640 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0c0034300 0x7fe0c00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08430a90 0x55ef08528010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08528550 con 0x55ef08430a90 2024-02-15T23:29:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1db230640 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08430a90 0x55ef08528010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1da22e640 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0c0034300 0x7fe0c00367c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0001e20 tx=0x7fe1d00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1db230640 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08430a90 0x55ef08528010 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1db230640 1 -- 172.21.15.133:0/322033906 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1cc0083f0 con 0x55ef08430a90 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.411+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08525710 con 0x55ef08430a90 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1db230640 1 -- 172.21.15.133:0/322033906 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1cc0083f0 con 0x55ef08430a90 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0852a250 con 0x55ef08430a90 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1db230640 1 -- 172.21.15.133:0/322033906 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe1cc0083f0 con 0x55ef08430a90 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08529450 con 0x55ef08430a90 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1db230640 1 -- 172.21.15.133:0/322033906 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1cc0083f0 con 0x55ef08430a90 2024-02-15T23:29:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08529860 con 0x55ef08430a90 2024-02-15T23:29:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1db230640 1 -- 172.21.15.133:0/322033906 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe1cc012040 con 0x55ef08430a90 2024-02-15T23:29:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 Processor -- start 2024-02-15T23:29:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 -- start start 2024-02-15T23:29:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef085388d0 0x55ef08538cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef082d4f20 con 0x55ef085388d0 2024-02-15T23:29:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1da22e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef085388d0 0x55ef08538cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1da22e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef085388d0 0x55ef08538cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42014/0 (socket says 172.21.15.133:42014) 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1da22e640 1 -- 172.21.15.133:0/3053147662 learned_addr learned my addr 172.21.15.133:0/3053147662 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1da22e640 1 -- 172.21.15.133:0/3053147662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef08539230 con 0x55ef085388d0 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1da22e640 1 --2- 172.21.15.133:0/3053147662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef085388d0 0x55ef08538cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0001780 tx=0x7fe1d000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe0c4e01640 1 -- 172.21.15.133:0/3053147662 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d000e580 con 0x55ef085388d0 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3053147662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef08539480 con 0x55ef085388d0 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe0c4e01640 1 -- 172.21.15.133:0/3053147662 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d000e6e0 con 0x55ef085388d0 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe0c4e01640 1 -- 172.21.15.133:0/3053147662 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d000e980 con 0x55ef085388d0 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.415+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3053147662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef08539fd0 con 0x55ef085388d0 2024-02-15T23:29:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe0c4e01640 1 -- 172.21.15.133:0/3053147662 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe1d000eae0 con 0x55ef085388d0 2024-02-15T23:29:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe0c4e01640 1 --2- 172.21.15.133:0/3053147662 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0b40342b0 0x7fe0b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe0c4e01640 1 -- 172.21.15.133:0/3053147662 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe1d0018040 con 0x55ef085388d0 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1db230640 1 --2- 172.21.15.133:0/3053147662 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0b40342b0 0x7fe0b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 Processor -- start 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 -- start start 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef083a6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef082c8790 con 0x55ef083a5d50 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1db230640 1 --2- 172.21.15.133:0/3053147662 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0b40342b0 0x7fe0b4036770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55ef08528e90 tx=0x7fe1cc003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1da22e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef083a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1da22e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef083a6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42024/0 (socket says 172.21.15.133:42024) 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1da22e640 1 -- 172.21.15.133:0/689107045 learned_addr learned my addr 172.21.15.133:0/689107045 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1da22e640 1 -- 172.21.15.133:0/689107045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef083a4580 con 0x55ef083a5d50 2024-02-15T23:29:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1da22e640 1 --2- 172.21.15.133:0/689107045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef083a6130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0049510 tx=0x7fe1d001aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a9cfaa2a5c56b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe0be7fc640 1 -- 172.21.15.133:0/689107045 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d001bbf0 con 0x55ef083a5d50 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe0be7fc640 1 -- 172.21.15.133:0/689107045 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d0023d90 con 0x55ef083a5d50 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe0be7fc640 1 -- 172.21.15.133:0/689107045 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d003b110 con 0x55ef083a5d50 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 -- 172.21.15.133:0/689107045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 msgr2=0x55ef083a6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/689107045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef083a6130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0049510 tx=0x7fe1d001aa60 comp rx=0 tx=0).stop 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 -- 172.21.15.133:0/689107045 shutdown_connections 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/689107045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef083a6130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 -- 172.21.15.133:0/689107045 >> 172.21.15.133:0/689107045 conn(0x55ef08541c10 msgr2=0x55ef0853fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 -- 172.21.15.133:0/689107045 shutdown_connections 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 -- 172.21.15.133:0/689107045 wait complete. 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 Processor -- start 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.419+0000 7fe1dcf14980 1 -- start start 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1dcf14980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef0854e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1dcf14980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef0854ef00 con 0x55ef083a5d50 2024-02-15T23:29:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1da22e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef0854e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1da22e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef0854e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42028/0 (socket says 172.21.15.133:42028) 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 learned_addr learned my addr 172.21.15.133:0/3215376369 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef08539fd0 con 0x55ef083a5d50 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1da22e640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef0854e9c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000fcc0 tx=0x7fe1d0049470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe0bcff9640 1 -- 172.21.15.133:0/3215376369 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d001c790 con 0x55ef083a5d50 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef0854f100 con 0x55ef083a5d50 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe0bcff9640 1 -- 172.21.15.133:0/3215376369 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d001c8f0 con 0x55ef083a5d50 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe0bcff9640 1 -- 172.21.15.133:0/3215376369 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d001a440 con 0x55ef083a5d50 2024-02-15T23:29:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef0854f530 con 0x55ef083a5d50 2024-02-15T23:29:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe0bcff9640 1 -- 172.21.15.133:0/3215376369 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe1d0042050 con 0x55ef083a5d50 2024-02-15T23:29:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe0bcff9640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0a4034260 0x7fe0a4036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe0bcff9640 1 -- 172.21.15.133:0/3215376369 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe1d002f210 con 0x55ef083a5d50 2024-02-15T23:29:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08559e60 0x55ef0855c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1db230640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0a4034260 0x7fe0a4036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855ca70 con 0x55ef08559e60 2024-02-15T23:29:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1daa2f640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08559e60 0x55ef0855c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1daa2f640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08559e60 0x55ef0855c320 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.423+0000 7fe1db230640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0a4034260 0x7fe0a4036720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc008fd0 tx=0x7fe1cc01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 realm 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855ce40 con 0x55ef08559e60 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855d6c0 con 0x55ef08559e60 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855da20 con 0x55ef08559e60 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855e220 con 0x55ef08559e60 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 20 searching for the correct realm 2024-02-15T23:29:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ef085600b0 0x55ef08562540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1da22e640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ef085600b0 0x55ef08562540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1da22e640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ef085600b0 0x55ef08562540 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1da22e640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe1d0037020 0x7fe1d00459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1d0037020 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1db230640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe1d0037020 0x7fe1d00459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1db230640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe1d0037020 0x7fe1d00459d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1cc02c040 con 0x7fe1d0037020 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1db230640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe1cc027940 0x7fe1cc0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.427+0000 7fe1daa2f640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe1cc027940 0x7fe1cc0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe1cc027940 0x7fe1cc0333c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef08559e60 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef08559e60 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1d0037020 2024-02-15T23:29:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1cc02c040 con 0x7fe1d0037020 2024-02-15T23:29:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef08559e60 2024-02-15T23:29:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.431+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef08559e60 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1d0037020 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe1cc02c040 con 0x7fe1d0037020 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef08559e60 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef08559e60 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.435+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1d0037020 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1cc02c040 con 0x7fe1d0037020 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef08559e60 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1d0037020 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1cc02c040 con 0x7fe1d0037020 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef085600b0 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1cc027940 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x55ef08559e60 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08562c10 con 0x7fe1d0037020 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1cc02c040 con 0x7fe1d0037020 2024-02-15T23:29:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1dcf14980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1dcf14980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1dcf14980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1dcf14980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1dcf14980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1dcf14980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.439+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855eb20 con 0x55ef08559e60 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855f370 con 0x55ef08559e60 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855e7a0 con 0x55ef08559e60 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 zone default found 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 4 Realm: () 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 zonegroup default 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855f370 con 0x7fe1cc027940 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08564a30 con 0x55ef085600b0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08564d90 con 0x55ef085600b0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 started sync module instance, tier type = 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0855f180 con 0x7fe1d0037020 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1cc03f040 con 0x7fe1d0037020 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94485125414512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef085651b0 con 0x7fe1d0037020 2024-02-15T23:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.443+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08565b60 con 0x55ef08559e60 2024-02-15T23:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.447+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94485125414512] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1cc03f040 con 0x7fe1d0037020 2024-02-15T23:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.447+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.447+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94485125415840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08565b20 con 0x55ef08559e60 2024-02-15T23:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.447+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08566520 con 0x55ef085600b0 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94485125415840] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94485125420672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08565aa0 con 0x55ef085600b0 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08567240 con 0x7fe1d0037020 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1cc03f040 con 0x7fe1d0037020 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94485125426896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08567a90 con 0x7fe1d0037020 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef085684b0 con 0x55ef08559e60 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94485125420672] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94485125426896] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1cc03f040 con 0x7fe1d0037020 2024-02-15T23:29:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94485125431184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef085675f0 con 0x55ef08559e60 2024-02-15T23:29:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.451+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08568d00 con 0x7fe1cc027940 2024-02-15T23:29:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.455+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94485125431184] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.455+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.455+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94485125425408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef085675f0 con 0x7fe1cc027940 2024-02-15T23:29:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.455+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08569210 con 0x7fe1cc027940 2024-02-15T23:29:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94485125434608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08569670 con 0x7fe1cc027940 2024-02-15T23:29:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0856a070 con 0x7fe1cc027940 2024-02-15T23:29:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94485125425408] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94485125434608] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94485125438320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef085691d0 con 0x7fe1cc027940 2024-02-15T23:29:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 20 add_watcher() i=0 2024-02-15T23:29:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 20 add_watcher() i=1 2024-02-15T23:29:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 20 add_watcher() i=2 2024-02-15T23:29:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 20 add_watcher() i=3 2024-02-15T23:29:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 20 add_watcher() i=4 2024-02-15T23:29:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 20 add_watcher() i=5 2024-02-15T23:29:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.459+0000 7fe1dcf14980 20 add_watcher() i=6 2024-02-15T23:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94485125438320] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 20 add_watcher() i=7 2024-02-15T23:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0856d170 con 0x55ef08559e60 2024-02-15T23:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94485125432928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0856a5e0 con 0x55ef08559e60 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94485125432928] v31'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe0917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 5 note: GC not initialized 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe00bfff640 20 reqs_thread_entry: start 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 20 Filter name: none 2024-02-15T23:29:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe009ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0858ee80 con 0x55ef08559e60 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.463+0000 7fe1dcf14980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08591240 con 0x7fe1d0037020 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe1cc03f040 con 0x7fe1d0037020 2024-02-15T23:29:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef085948c0 con 0x55ef08559e60 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v31'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1dcf14980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1dcf14980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1dcf14980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94485125612480 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef085916e0 con 0x55ef08559e60 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94485125431184 notify 133143986177 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7fe1d40e7040 con 0x55ef08559e60 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe0be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94485125431184 notifier 4311 bl.length()=534 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe0be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe0be7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe0be7fc640 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe0a0003ea0 con 0x55ef08559e60 2024-02-15T23:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(65 notify.4 [notify cookie 94485125612480 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 94485125612480 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ef08521d30 con 0x55ef08559e60 2024-02-15T23:29:49.478 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe0917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.467+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94485125432928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef0858de10 con 0x55ef08559e60 2024-02-15T23:29:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.471+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94485125432928] v31'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.471+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94485125414512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08568660 con 0x7fe1d0037020 2024-02-15T23:29:49.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.471+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94485125414512] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1cc03f040 con 0x7fe1d0037020 2024-02-15T23:29:49.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.471+0000 7fe1dcf14980 20 remove_watcher() i=0 2024-02-15T23:29:49.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.471+0000 7fe1dcf14980 2 removed watcher, disabling cache 2024-02-15T23:29:49.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.471+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94485125415840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08568660 con 0x55ef08559e60 2024-02-15T23:29:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94485125415840] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1dcf14980 20 remove_watcher() i=1 2024-02-15T23:29:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94485125420672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08568660 con 0x55ef085600b0 2024-02-15T23:29:49.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1da22e640 1 -- 172.21.15.133:0/3215376369 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94485125420672] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d0054040 con 0x55ef085600b0 2024-02-15T23:29:49.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1dcf14980 20 remove_watcher() i=2 2024-02-15T23:29:49.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94485125426896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08565680 con 0x7fe1d0037020 2024-02-15T23:29:49.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1db230640 1 -- 172.21.15.133:0/3215376369 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94485125426896] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1cc03f040 con 0x7fe1d0037020 2024-02-15T23:29:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1dcf14980 20 remove_watcher() i=3 2024-02-15T23:29:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.475+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94485125431184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08565680 con 0x55ef08559e60 2024-02-15T23:29:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.479+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94485125431184] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x55ef08559e60 2024-02-15T23:29:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.479+0000 7fe1dcf14980 20 remove_watcher() i=4 2024-02-15T23:29:49.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.479+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94485125425408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08567f90 con 0x7fe1cc027940 2024-02-15T23:29:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.479+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94485125425408] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.483+0000 7fe1dcf14980 20 remove_watcher() i=5 2024-02-15T23:29:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.483+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94485125434608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08565680 con 0x7fe1cc027940 2024-02-15T23:29:49.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.483+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94485125434608] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.483+0000 7fe1dcf14980 20 remove_watcher() i=6 2024-02-15T23:29:49.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.483+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94485125438320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ef08565680 con 0x7fe1cc027940 2024-02-15T23:29:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.483+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94485125438320] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1d40d09f0 con 0x7fe1cc027940 2024-02-15T23:29:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.483+0000 7fe1dcf14980 20 remove_watcher() i=7 2024-02-15T23:29:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe1cc027940 msgr2=0x7fe1cc0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe1cc027940 0x7fe1cc0333c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08559e60 msgr2=0x55ef0855c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08559e60 0x55ef0855c320 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe1d0037020 msgr2=0x7fe1d00459d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe1d0037020 0x7fe1d00459d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ef085600b0 msgr2=0x55ef08562540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ef085600b0 0x55ef08562540 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0a4034260 msgr2=0x7fe0a4036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0a4034260 0x7fe0a4036720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc008fd0 tx=0x7fe1cc01c070 comp rx=0 tx=0).stop 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 msgr2=0x55ef0854e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1daa2f640 1 -- 172.21.15.133:0/3215376369 reap_dead start 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef0854e9c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000fcc0 tx=0x7fe1d0049470 comp rx=0 tx=0).stop 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 shutdown_connections 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3215376369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef083a5d50 0x55ef0854e9c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 >> 172.21.15.133:0/3215376369 conn(0x55ef08541c10 msgr2=0x55ef0853fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 shutdown_connections 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3215376369 wait complete. 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3053147662 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0b40342b0 msgr2=0x7fe0b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3053147662 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0b40342b0 0x7fe0b4036770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55ef08528e90 tx=0x7fe1cc003070 comp rx=0 tx=0).stop 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3053147662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef085388d0 msgr2=0x55ef08538cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3053147662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef085388d0 0x55ef08538cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0001780 tx=0x7fe1d000f7a0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3053147662 shutdown_connections 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3053147662 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0b40342b0 0x7fe0b4036770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/3053147662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef085388d0 0x55ef08538cf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3053147662 >> 172.21.15.133:0/3053147662 conn(0x55ef0852d6e0 msgr2=0x55ef0852e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3053147662 shutdown_connections 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/3053147662 wait complete. 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08430a90 msgr2=0x55ef08528010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08430a90 0x55ef08528010 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0c0034300 msgr2=0x7fe0c00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0c0034300 0x7fe0c00367c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0001e20 tx=0x7fe1d00013a0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 msgr2=0x55ef085213a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef085213a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4017ca0 tx=0x7fe1d4017e30 comp rx=0 tx=0).stop 2024-02-15T23:29:49.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 shutdown_connections 2024-02-15T23:29:49.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ef08430a90 0x55ef08528010 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe0c0034300 0x7fe0c00367c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 --2- 172.21.15.133:0/322033906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef08430170 0x55ef085213a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 >> 172.21.15.133:0/322033906 conn(0x55ef0842ba40 msgr2=0x55ef08514cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 shutdown_connections 2024-02-15T23:29:49.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.487+0000 7fe1dcf14980 1 -- 172.21.15.133:0/322033906 wait complete. 2024-02-15T23:29:49.506 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:49.506 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:29:49.506 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:29:49.506 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:29:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41b0ed1980 1 Processor -- start 2024-02-15T23:29:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41b0ed1980 1 -- start start 2024-02-15T23:29:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41b0ed1980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5628047ab170 0x5628047ab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41b0ed1980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5628046f74c0 con 0x5628047aba90 2024-02-15T23:29:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41b0ed1980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5628046be180 con 0x5628047ab170 2024-02-15T23:29:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41ae9ec640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5628047ab170 0x5628047ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41ae1eb640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5628047aba90 0x5628047ac450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39746/0 (socket says 172.21.15.133:39746) 2024-02-15T23:29:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41ae1eb640 1 -- 172.21.15.133:0/3455231087 learned_addr learned my addr 172.21.15.133:0/3455231087 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41ae9ec640 1 -- 172.21.15.133:0/3455231087 >> v1:172.21.15.131:6789/0 conn(0x5628047aba90 legacy=0x5628047ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41ad9ea640 1 -- 172.21.15.133:0/3455231087 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378132795 0 0) 0x5628046f74c0 con 0x5628047aba90 2024-02-15T23:29:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.583+0000 7f41ae9ec640 1 -- 172.21.15.133:0/3455231087 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628047acc80 con 0x5628047ab170 2024-02-15T23:29:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41ae9ec640 1 --2- 172.21.15.133:0/3455231087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628047ab550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f41a000a480 tx=0x7f41a001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a0b0499ca9ed19 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41ad9ea640 1 -- 172.21.15.133:0/3455231087 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a00ab540 con 0x5628047ab170 2024-02-15T23:29:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41ad9ea640 1 -- 172.21.15.133:0/3455231087 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a00ab6a0 con 0x5628047ab170 2024-02-15T23:29:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41ad9ea640 1 -- 172.21.15.133:0/3455231087 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a00ab960 con 0x5628047ab170 2024-02-15T23:29:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3455231087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 msgr2=0x5628047ab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3455231087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628047ab550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f41a000a480 tx=0x7f41a001b280 comp rx=0 tx=0).stop 2024-02-15T23:29:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3455231087 shutdown_connections 2024-02-15T23:29:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3455231087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628047ab550 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3455231087 >> 172.21.15.133:0/3455231087 conn(0x5628047a6a40 msgr2=0x5628047a8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3455231087 shutdown_connections 2024-02-15T23:29:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.587+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3455231087 wait complete. 2024-02-15T23:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 Processor -- start 2024-02-15T23:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 -- start start 2024-02-15T23:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628048953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628046bb6b0 con 0x5628047ab170 2024-02-15T23:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41ae9ec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628048953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41ae9ec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628048953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42042/0 (socket says 172.21.15.133:42042) 2024-02-15T23:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41ae9ec640 1 -- 172.21.15.133:0/3663794604 learned_addr learned my addr 172.21.15.133:0/3663794604 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41ae9ec640 1 -- 172.21.15.133:0/3663794604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a0005d30 con 0x5628047ab170 2024-02-15T23:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41ae9ec640 1 --2- 172.21.15.133:0/3663794604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628048953f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f41a0018eb0 tx=0x7f41a0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1986994ec15c19ac server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f409ce09640 1 -- 172.21.15.133:0/3663794604 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a00ab810 con 0x5628047ab170 2024-02-15T23:29:49.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f409ce09640 1 -- 172.21.15.133:0/3663794604 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a00ab970 con 0x5628047ab170 2024-02-15T23:29:49.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f409ce09640 1 -- 172.21.15.133:0/3663794604 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a00abc10 con 0x5628047ab170 2024-02-15T23:29:49.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3663794604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 msgr2=0x5628048953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3663794604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628048953f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f41a0018eb0 tx=0x7f41a0003030 comp rx=0 tx=0).stop 2024-02-15T23:29:49.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3663794604 shutdown_connections 2024-02-15T23:29:49.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3663794604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x5628048953f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3663794604 >> 172.21.15.133:0/3663794604 conn(0x5628047a6a40 msgr2=0x562804890f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3663794604 shutdown_connections 2024-02-15T23:29:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3663794604 wait complete. 2024-02-15T23:29:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 Processor -- start 2024-02-15T23:29:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.603+0000 7f41b0ed1980 1 -- start start 2024-02-15T23:29:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41b0ed1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x562804720ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41b0ed1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628046b6e90 con 0x5628047ab170 2024-02-15T23:29:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41ae9ec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x562804720ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41ae9ec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x562804720ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42050/0 (socket says 172.21.15.133:42050) 2024-02-15T23:29:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41ae9ec640 1 -- 172.21.15.133:0/3507634654 learned_addr learned my addr 172.21.15.133:0/3507634654 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41ae9ec640 1 -- 172.21.15.133:0/3507634654 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628047acc80 con 0x5628047ab170 2024-02-15T23:29:49.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41ae9ec640 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x562804720ef0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f41a001bb20 tx=0x7f41a0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f409b606640 1 -- 172.21.15.133:0/3507634654 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a00b5970 con 0x5628047ab170 2024-02-15T23:29:49.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562804721430 con 0x5628047ab170 2024-02-15T23:29:49.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f409b606640 1 -- 172.21.15.133:0/3507634654 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a00c5070 con 0x5628047ab170 2024-02-15T23:29:49.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f409b606640 1 -- 172.21.15.133:0/3507634654 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a00b5c00 con 0x5628047ab170 2024-02-15T23:29:49.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56280471f960 con 0x5628047ab170 2024-02-15T23:29:49.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f409b606640 1 -- 172.21.15.133:0/3507634654 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f41a00c7030 con 0x5628047ab170 2024-02-15T23:29:49.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f409b606640 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40940342b0 0x7f4094036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f409b606640 1 -- 172.21.15.133:0/3507634654 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f41a00e4410 con 0x5628047ab170 2024-02-15T23:29:49.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41ae1eb640 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40940342b0 0x7f4094036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628047aba90 0x5628048a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048a5530 con 0x5628047aba90 2024-02-15T23:29:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41af1ed640 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628047aba90 0x5628048a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41ae1eb640 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40940342b0 0x7f4094036770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c10 tx=0x7f41a40013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.607+0000 7f41af1ed640 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628047aba90 0x5628048a4ff0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41af1ed640 1 -- 172.21.15.133:0/3507634654 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41a800a4d0 con 0x5628047aba90 2024-02-15T23:29:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048a5890 con 0x5628047aba90 2024-02-15T23:29:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41af1ed640 1 -- 172.21.15.133:0/3507634654 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f41a800a4d0 con 0x5628047aba90 2024-02-15T23:29:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048a70a0 con 0x5628047aba90 2024-02-15T23:29:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41af1ed640 1 -- 172.21.15.133:0/3507634654 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f41a800a4d0 con 0x5628047aba90 2024-02-15T23:29:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048a61e0 con 0x5628047aba90 2024-02-15T23:29:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41af1ed640 1 -- 172.21.15.133:0/3507634654 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f41a800a4d0 con 0x5628047aba90 2024-02-15T23:29:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048a65f0 con 0x5628047aba90 2024-02-15T23:29:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41af1ed640 1 -- 172.21.15.133:0/3507634654 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f41a800a4d0 con 0x5628047aba90 2024-02-15T23:29:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 Processor -- start 2024-02-15T23:29:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 -- start start 2024-02-15T23:29:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048b5750 0x5628048b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280464ff20 con 0x5628048b5750 2024-02-15T23:29:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41ae1eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048b5750 0x5628048b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41ae1eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048b5750 0x5628048b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42058/0 (socket says 172.21.15.133:42058) 2024-02-15T23:29:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2790997281 learned_addr learned my addr 172.21.15.133:0/2790997281 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2790997281 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628048b60b0 con 0x5628048b5750 2024-02-15T23:29:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41ae1eb640 1 --2- 172.21.15.133:0/2790997281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048b5750 0x5628048b5b70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f41a400e620 tx=0x7f41a400e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f4098e01640 1 -- 172.21.15.133:0/2790997281 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a401b380 con 0x5628048b5750 2024-02-15T23:29:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f4098e01640 1 -- 172.21.15.133:0/2790997281 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a401b4e0 con 0x5628048b5750 2024-02-15T23:29:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2790997281 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5628048b6300 con 0x5628048b5750 2024-02-15T23:29:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f4098e01640 1 -- 172.21.15.133:0/2790997281 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a401b780 con 0x5628048b5750 2024-02-15T23:29:49.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.611+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2790997281 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628048b6e50 con 0x5628048b5750 2024-02-15T23:29:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f4098e01640 1 -- 172.21.15.133:0/2790997281 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f41a401a070 con 0x5628048b5750 2024-02-15T23:29:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f4098e01640 1 --2- 172.21.15.133:0/2790997281 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4088034300 0x7f40880367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f4098e01640 1 -- 172.21.15.133:0/2790997281 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f41a4017050 con 0x5628048b5750 2024-02-15T23:29:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41af1ed640 1 --2- 172.21.15.133:0/2790997281 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4088034300 0x7f40880367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 Processor -- start 2024-02-15T23:29:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- start start 2024-02-15T23:29:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41af1ed640 1 --2- 172.21.15.133:0/2790997281 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4088034300 0x7f40880367c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5628048a5c20 tx=0x7f41a8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562804643790 con 0x5628048c2730 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41ae1eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41ae1eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42064/0 (socket says 172.21.15.133:42064) 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41ae1eb640 1 -- 172.21.15.133:0/1526053672 learned_addr learned my addr 172.21.15.133:0/1526053672 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41ae1eb640 1 -- 172.21.15.133:0/1526053672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628048c30e0 con 0x5628048c2730 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41ae1eb640 1 --2- 172.21.15.133:0/1526053672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c2b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f41a4027030 tx=0x7f41a400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbec3b02347e242d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f40927fc640 1 -- 172.21.15.133:0/1526053672 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a4047070 con 0x5628048c2730 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f40927fc640 1 -- 172.21.15.133:0/1526053672 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a400d300 con 0x5628048c2730 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f40927fc640 1 -- 172.21.15.133:0/1526053672 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a400d470 con 0x5628048c2730 2024-02-15T23:29:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- 172.21.15.133:0/1526053672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 msgr2=0x5628048c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/1526053672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c2b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f41a4027030 tx=0x7f41a400ded0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- 172.21.15.133:0/1526053672 shutdown_connections 2024-02-15T23:29:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/1526053672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c2b10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- 172.21.15.133:0/1526053672 >> 172.21.15.133:0/1526053672 conn(0x5628048bea70 msgr2=0x5628048bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- 172.21.15.133:0/1526053672 shutdown_connections 2024-02-15T23:29:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- 172.21.15.133:0/1526053672 wait complete. 2024-02-15T23:29:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 Processor -- start 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- start start 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.615+0000 7f41b0ed1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628048c9b20 con 0x5628048c2730 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae1eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae1eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42074/0 (socket says 172.21.15.133:42074) 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 learned_addr learned my addr 172.21.15.133:0/2018632590 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628048b6e50 con 0x5628048c2730 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae1eb640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c95e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41a403c040 tx=0x7f41a4048a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f4090ff9640 1 -- 172.21.15.133:0/2018632590 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a403ae80 con 0x5628048c2730 2024-02-15T23:29:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5628048c9d20 con 0x5628048c2730 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f4090ff9640 1 -- 172.21.15.133:0/2018632590 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a400d470 con 0x5628048c2730 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f4090ff9640 1 -- 172.21.15.133:0/2018632590 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a404a0f0 con 0x5628048c2730 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628048ca150 con 0x5628048c2730 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f4090ff9640 1 -- 172.21.15.133:0/2018632590 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f41a4032020 con 0x5628048c2730 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f4090ff9640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 0x7f4078036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f4090ff9640 1 -- 172.21.15.133:0/2018632590 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f41a4009050 con 0x5628048c2730 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41af1ed640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 0x7f4078036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628048d4b70 0x5628048d7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d7760 con 0x5628048d4b70 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae9ec640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628048d4b70 0x5628048d7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41af1ed640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 0x7f4078036770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41a8011010 tx=0x7f41a8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae9ec640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628048d4b70 0x5628048d7010 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 20 realm 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d7b30 con 0x5628048d4b70 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.619+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d8380 con 0x5628048d4b70 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d86e0 con 0x5628048d4b70 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d8020 con 0x5628048d4b70 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 20 searching for the correct realm 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628048da930 0x5628048dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048dd410 con 0x5628048da930 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae1eb640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628048da930 0x5628048dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae1eb640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628048da930 0x5628048dcd40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a400c040 con 0x5628048da930 2024-02-15T23:29:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae1eb640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f41a4027060 0x7f41a4027870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048dd410 con 0x7f41a4027060 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41af1ed640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f41a4027060 0x7f41a4027870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41af1ed640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f41a4027060 0x7f41a4027870 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a800a4d0 con 0x7f41a4027060 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41af1ed640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41a80141d0 0x7f41a8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048dd410 con 0x7f41a80141d0 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae9ec640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41a80141d0 0x7f41a8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae9ec640 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41a80141d0 0x7f41a8015940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x7f41a80141d0 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.623+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048dd410 con 0x5628048d4b70 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048dd410 con 0x5628048d4b70 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a80141d0 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x7f41a80141d0 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a80141d0 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x7f41a80141d0 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a4027060 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a800a4d0 con 0x7f41a4027060 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048da930 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a400c040 con 0x5628048da930 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048d4b70 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a80141d0 2024-02-15T23:29:49.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x7f41a80141d0 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048d4b70 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a4027060 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048da930 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a400c040 con 0x5628048da930 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.627+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048da930 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a80141d0 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x7f41a80141d0 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048da930 2024-02-15T23:29:49.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048da930 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048d4b70 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048d4b70 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a80141d0 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x7f41a80141d0 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048da930 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a4027060 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048d4b70 2024-02-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x5628048d4b70 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.631+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a80141d0 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x7f41a80141d0 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048da930 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a80141d0 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00d39c0 con 0x7f41a80141d0 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a4027060 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048da930 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a80141d0 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x5628048d4b70 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f41a00ed040 con 0x7f41a4027060 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d9580 con 0x5628048d4b70 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d9200 con 0x5628048d4b70 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d9e50 con 0x5628048d4b70 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 zone default found 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 4 Realm: () 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 zonegroup default 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.635+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048d9e50 con 0x7f41a80141d0 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048df260 con 0x5628048da930 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048df5c0 con 0x5628048da930 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 20 started sync module instance, tier type = 2024-02-15T23:29:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048deb40 con 0x7f41a4027060 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94729875089056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048deef0 con 0x7f41a4027060 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e0300 con 0x5628048d4b70 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.639+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94729875089056] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94729875093952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e0280 con 0x5628048d4b70 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e0cd0 con 0x5628048da930 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94729875097520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e1520 con 0x5628048da930 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e1ef0 con 0x7f41a4027060 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94729875093952] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94729875102192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e22a0 con 0x7f41a4027060 2024-02-15T23:29:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.643+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e2c50 con 0x5628048d4b70 2024-02-15T23:29:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.647+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94729875097520] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.647+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94729875102192] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.647+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.647+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94729875095008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e2770 con 0x5628048d4b70 2024-02-15T23:29:49.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.647+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e34a0 con 0x7f41a80141d0 2024-02-15T23:29:49.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.651+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94729875095008] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.651+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.651+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94729875099776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e3190 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.651+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e3990 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.651+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.651+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94729875108752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e3dd0 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.651+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e48a0 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.651+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94729875099776] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94729875108752] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94729875112832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e3830 con 0x7f41a80141d0 2024-02-15T23:29:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 20 add_watcher() i=0 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 20 add_watcher() i=1 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 20 add_watcher() i=2 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 20 add_watcher() i=3 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 20 add_watcher() i=4 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 20 add_watcher() i=5 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 20 add_watcher() i=6 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94729875112832] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 20 add_watcher() i=7 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e7890 con 0x5628048d4b70 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.655+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94729875107056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e4dd0 con 0x5628048d4b70 2024-02-15T23:29:49.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94729875107056] v31'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f40657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:49.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:49.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 5 note: GC not initialized 2024-02-15T23:29:49.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f3fdffff640 20 reqs_thread_entry: start 2024-02-15T23:29:49.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:49.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 20 Filter name: none 2024-02-15T23:29:49.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f3fddffb640 20 reqs_thread_entry: start 2024-02-15T23:29:49.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562804909200 con 0x5628048d4b70 2024-02-15T23:29:49.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:49.670 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:49.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f40657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.659+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94729875107056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048cee70 con 0x5628048d4b70 2024-02-15T23:29:49.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94729875107056] v31'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94729875089056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048e2cf0 con 0x7f41a4027060 2024-02-15T23:29:49.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94729875089056] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41b0ed1980 20 remove_watcher() i=0 2024-02-15T23:29:49.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41b0ed1980 2 removed watcher, disabling cache 2024-02-15T23:29:49.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94729875093952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048de6a0 con 0x5628048d4b70 2024-02-15T23:29:49.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94729875093952] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41b0ed1980 20 remove_watcher() i=1 2024-02-15T23:29:49.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.663+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94729875097520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048de6a0 con 0x5628048da930 2024-02-15T23:29:49.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.667+0000 7f41ae1eb640 1 -- 172.21.15.133:0/2018632590 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94729875097520] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a405f040 con 0x5628048da930 2024-02-15T23:29:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.667+0000 7f41b0ed1980 20 remove_watcher() i=2 2024-02-15T23:29:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.667+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94729875102192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048df9c0 con 0x7f41a4027060 2024-02-15T23:29:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.667+0000 7f41af1ed640 1 -- 172.21.15.133:0/2018632590 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94729875102192] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a803a040 con 0x7f41a4027060 2024-02-15T23:29:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.667+0000 7f41b0ed1980 20 remove_watcher() i=3 2024-02-15T23:29:49.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.667+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94729875095008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048df9c0 con 0x5628048d4b70 2024-02-15T23:29:49.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.671+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94729875095008] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x5628048d4b70 2024-02-15T23:29:49.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.671+0000 7f41b0ed1980 20 remove_watcher() i=4 2024-02-15T23:29:49.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.671+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94729875099776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048dfe60 con 0x7f41a80141d0 2024-02-15T23:29:49.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.671+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94729875099776] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.671+0000 7f41b0ed1980 20 remove_watcher() i=5 2024-02-15T23:29:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.671+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94729875108752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048dfe60 con 0x7f41a80141d0 2024-02-15T23:29:49.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94729875108752] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 20 remove_watcher() i=6 2024-02-15T23:29:49.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94729875112832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5628048dfe60 con 0x7f41a80141d0 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94729875112832] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41a00fd040 con 0x7f41a80141d0 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 20 remove_watcher() i=7 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41a80141d0 msgr2=0x7f41a8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41a80141d0 0x7f41a8015940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628048d4b70 msgr2=0x5628048d7010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628048d4b70 0x5628048d7010 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f41a4027060 msgr2=0x7f41a4027870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f41a4027060 0x7f41a4027870 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628048da930 msgr2=0x5628048dcd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5628048da930 0x5628048dcd40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 msgr2=0x7f4078036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 0x7f4078036770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41a8011010 tx=0x7f41a8020000 comp rx=0 tx=0).stop 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 msgr2=0x5628048c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41ae9ec640 1 -- 172.21.15.133:0/2018632590 reap_dead start 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c95e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41a403c040 tx=0x7f41a4048a20 comp rx=0 tx=0).stop 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 shutdown_connections 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2018632590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048c2730 0x5628048c95e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 >> 172.21.15.133:0/2018632590 conn(0x5628048bea70 msgr2=0x5628048bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 shutdown_connections 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2018632590 wait complete. 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2790997281 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4088034300 msgr2=0x7f40880367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2790997281 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4088034300 0x7f40880367c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5628048a5c20 tx=0x7f41a8005850 comp rx=0 tx=0).stop 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2790997281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048b5750 msgr2=0x5628048b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2790997281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048b5750 0x5628048b5b70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f41a400e620 tx=0x7f41a400e650 comp rx=0 tx=0).stop 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2790997281 shutdown_connections 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2790997281 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4088034300 0x7f40880367c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/2790997281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628048b5750 0x5628048b5b70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2790997281 >> 172.21.15.133:0/2790997281 conn(0x5628048aa560 msgr2=0x5628048ab070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2790997281 shutdown_connections 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.675+0000 7f41b0ed1980 1 -- 172.21.15.133:0/2790997281 wait complete. 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628047aba90 msgr2=0x5628048a4ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628047aba90 0x5628048a4ff0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40940342b0 msgr2=0x7f4094036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40940342b0 0x7f4094036770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c10 tx=0x7f41a40013c0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 msgr2=0x562804720ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x562804720ef0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f41a001bb20 tx=0x7f41a0018020 comp rx=0 tx=0).stop 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 shutdown_connections 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5628047aba90 0x5628048a4ff0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40940342b0 0x7f4094036770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 --2- 172.21.15.133:0/3507634654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5628047ab170 0x562804720ef0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 >> 172.21.15.133:0/3507634654 conn(0x5628047a6a40 msgr2=0x56280488fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 shutdown_connections 2024-02-15T23:29:49.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.679+0000 7f41b0ed1980 1 -- 172.21.15.133:0/3507634654 wait complete. 2024-02-15T23:29:49.695 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:49.695 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-15T23:29:49.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-15T23:29:49.696 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-15T23:29:49.769 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f2645415980 1 Processor -- start 2024-02-15T23:29:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f2645415980 1 -- start start 2024-02-15T23:29:49.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f2645415980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56089a924920 0x56089a926d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f2645415980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56089a86a4c0 con 0x56089a892080 2024-02-15T23:29:49.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f2645415980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x56089a831180 con 0x56089a924920 2024-02-15T23:29:49.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f264272f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56089a924920 0x56089a926d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f264272f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56089a924920 0x56089a926d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42082/0 (socket says 172.21.15.133:42082) 2024-02-15T23:29:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f264272f640 1 -- 172.21.15.133:0/3712897764 learned_addr learned my addr 172.21.15.133:0/3712897764 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f2642f30640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x56089a892080 0x56089a923200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39758/0 (socket says 172.21.15.133:39758) 2024-02-15T23:29:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f264272f640 1 -- 172.21.15.133:0/3712897764 >> v1:172.21.15.131:6789/0 conn(0x56089a892080 legacy=0x56089a923200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.763+0000 7f264272f640 1 -- 172.21.15.133:0/3712897764 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56089a928260 con 0x56089a924920 2024-02-15T23:29:49.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f264272f640 1 --2- 172.21.15.133:0/3712897764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a924920 0x56089a926d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f263800a5c0 tx=0x7f263801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f8fb3516888cd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2641f2e640 1 -- 172.21.15.133:0/3712897764 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26380aa470 con 0x56089a924920 2024-02-15T23:29:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2641f2e640 1 -- 172.21.15.133:0/3712897764 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26380aa5d0 con 0x56089a924920 2024-02-15T23:29:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2641f2e640 1 -- 172.21.15.133:0/3712897764 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26380aa890 con 0x56089a924920 2024-02-15T23:29:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2645415980 1 -- 172.21.15.133:0/3712897764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a924920 msgr2=0x56089a926d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2645415980 1 --2- 172.21.15.133:0/3712897764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a924920 0x56089a926d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f263800a5c0 tx=0x7f263801b340 comp rx=0 tx=0).stop 2024-02-15T23:29:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2645415980 1 -- 172.21.15.133:0/3712897764 shutdown_connections 2024-02-15T23:29:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2645415980 1 --2- 172.21.15.133:0/3712897764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a924920 0x56089a926d10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2645415980 1 -- 172.21.15.133:0/3712897764 >> 172.21.15.133:0/3712897764 conn(0x56089a9188e0 msgr2=0x56089a91ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2645415980 1 -- 172.21.15.133:0/3712897764 shutdown_connections 2024-02-15T23:29:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.767+0000 7f2645415980 1 -- 172.21.15.133:0/3712897764 wait complete. 2024-02-15T23:29:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2645415980 1 Processor -- start 2024-02-15T23:29:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2645415980 1 -- start start 2024-02-15T23:29:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2645415980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa0a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2645415980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56089a82e6b0 con 0x56089a892080 2024-02-15T23:29:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2642f30640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa0a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2642f30640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa0a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42098/0 (socket says 172.21.15.133:42098) 2024-02-15T23:29:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2642f30640 1 -- 172.21.15.133:0/4246911939 learned_addr learned my addr 172.21.15.133:0/4246911939 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2642f30640 1 -- 172.21.15.133:0/4246911939 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2638005df0 con 0x56089a892080 2024-02-15T23:29:49.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2642f30640 1 --2- 172.21.15.133:0/4246911939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa0a4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f263c006fb0 tx=0x7f263c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db524fb484ac9eb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2530e09640 1 -- 172.21.15.133:0/4246911939 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f263c013420 con 0x56089a892080 2024-02-15T23:29:49.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2530e09640 1 -- 172.21.15.133:0/4246911939 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c013580 con 0x56089a892080 2024-02-15T23:29:49.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.779+0000 7f2530e09640 1 -- 172.21.15.133:0/4246911939 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f263c013860 con 0x56089a892080 2024-02-15T23:29:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- 172.21.15.133:0/4246911939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 msgr2=0x56089aa0a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 --2- 172.21.15.133:0/4246911939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa0a4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f263c006fb0 tx=0x7f263c001940 comp rx=0 tx=0).stop 2024-02-15T23:29:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- 172.21.15.133:0/4246911939 shutdown_connections 2024-02-15T23:29:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 --2- 172.21.15.133:0/4246911939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa0a4b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- 172.21.15.133:0/4246911939 >> 172.21.15.133:0/4246911939 conn(0x56089a9188e0 msgr2=0x56089aa05ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- 172.21.15.133:0/4246911939 shutdown_connections 2024-02-15T23:29:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- 172.21.15.133:0/4246911939 wait complete. 2024-02-15T23:29:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 Processor -- start 2024-02-15T23:29:49.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- start start 2024-02-15T23:29:49.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa11550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56089a829e90 con 0x56089a892080 2024-02-15T23:29:49.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2642f30640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa11550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2642f30640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa11550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42108/0 (socket says 172.21.15.133:42108) 2024-02-15T23:29:49.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2642f30640 1 -- 172.21.15.133:0/1434408422 learned_addr learned my addr 172.21.15.133:0/1434408422 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2642f30640 1 -- 172.21.15.133:0/1434408422 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56089a86a4c0 con 0x56089a892080 2024-02-15T23:29:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2642f30640 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa11550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x56089aa0b260 tx=0x7f263c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f252f606640 1 -- 172.21.15.133:0/1434408422 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f263c0037a0 con 0x56089a892080 2024-02-15T23:29:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56089aa11a90 con 0x56089a892080 2024-02-15T23:29:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f252f606640 1 -- 172.21.15.133:0/1434408422 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c003900 con 0x56089a892080 2024-02-15T23:29:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f252f606640 1 -- 172.21.15.133:0/1434408422 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f263c003ba0 con 0x56089a892080 2024-02-15T23:29:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56089aa11ec0 con 0x56089a892080 2024-02-15T23:29:49.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.783+0000 7f252f606640 1 -- 172.21.15.133:0/1434408422 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f263c028460 con 0x56089a892080 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f252f606640 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25280342b0 0x7f2528036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f252f606640 1 -- 172.21.15.133:0/1434408422 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f263c049550 con 0x56089a892080 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f264272f640 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25280342b0 0x7f2528036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa16180 0x56089aa18570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa18ab0 con 0x56089aa16180 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2643731640 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa16180 0x56089aa18570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f264272f640 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25280342b0 0x7f2528036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26380ae000 tx=0x7f26380a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2643731640 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa16180 0x56089aa18570 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2643731640 1 -- 172.21.15.133:0/1434408422 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f26340083f0 con 0x56089aa16180 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa18ea0 con 0x56089aa16180 2024-02-15T23:29:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2643731640 1 -- 172.21.15.133:0/1434408422 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f26340083f0 con 0x56089aa16180 2024-02-15T23:29:49.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa1a750 con 0x56089aa16180 2024-02-15T23:29:49.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2643731640 1 -- 172.21.15.133:0/1434408422 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f26340083f0 con 0x56089aa16180 2024-02-15T23:29:49.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa19950 con 0x56089aa16180 2024-02-15T23:29:49.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2643731640 1 -- 172.21.15.133:0/1434408422 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f26340083f0 con 0x56089aa16180 2024-02-15T23:29:49.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa19d60 con 0x56089aa16180 2024-02-15T23:29:49.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2643731640 1 -- 172.21.15.133:0/1434408422 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2634012040 con 0x56089aa16180 2024-02-15T23:29:49.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 Processor -- start 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 -- start start 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa28d90 0x56089aa291b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f2645415980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56089a7c2f20 con 0x56089aa28d90 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f264272f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa28d90 0x56089aa291b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f264272f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa28d90 0x56089aa291b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42118/0 (socket says 172.21.15.133:42118) 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f264272f640 1 -- 172.21.15.133:0/2761888772 learned_addr learned my addr 172.21.15.133:0/2761888772 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.787+0000 7f264272f640 1 -- 172.21.15.133:0/2761888772 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56089aa296f0 con 0x56089aa28d90 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f264272f640 1 --2- 172.21.15.133:0/2761888772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa28d90 0x56089aa291b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2638018f70 tx=0x7f26380180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f252ce01640 1 -- 172.21.15.133:0/2761888772 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26380b3b90 con 0x56089aa28d90 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f2645415980 1 -- 172.21.15.133:0/2761888772 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56089aa298e0 con 0x56089aa28d90 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f252ce01640 1 -- 172.21.15.133:0/2761888772 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26380c3070 con 0x56089aa28d90 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f2645415980 1 -- 172.21.15.133:0/2761888772 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56089aa2a3d0 con 0x56089aa28d90 2024-02-15T23:29:49.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f252ce01640 1 -- 172.21.15.133:0/2761888772 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26380b3e20 con 0x56089aa28d90 2024-02-15T23:29:49.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f252ce01640 1 -- 172.21.15.133:0/2761888772 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f26380c5030 con 0x56089aa28d90 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f252ce01640 1 --2- 172.21.15.133:0/2761888772 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f251c0342b0 0x7f251c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f252ce01640 1 -- 172.21.15.133:0/2761888772 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f26380e6880 con 0x56089aa28d90 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f2643731640 1 --2- 172.21.15.133:0/2761888772 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f251c0342b0 0x7f251c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f2645415980 1 Processor -- start 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f2645415980 1 -- start start 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f2643731640 1 --2- 172.21.15.133:0/2761888772 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f251c0342b0 0x7f251c036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56089aa19390 tx=0x7f2634003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f2645415980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa361b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f2645415980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56089a7b6790 con 0x56089aa35d90 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f264272f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f264272f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa361b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42122/0 (socket says 172.21.15.133:42122) 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f264272f640 1 -- 172.21.15.133:0/1654541952 learned_addr learned my addr 172.21.15.133:0/1654541952 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f264272f640 1 -- 172.21.15.133:0/1654541952 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56089aa36780 con 0x56089aa35d90 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f264272f640 1 --2- 172.21.15.133:0/1654541952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa361b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f26380e4ca0 tx=0x7f26380bd4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644364d4f815d3a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f25267fc640 1 -- 172.21.15.133:0/1654541952 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26380bdb00 con 0x56089aa35d90 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f25267fc640 1 -- 172.21.15.133:0/1654541952 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26380bdc60 con 0x56089aa35d90 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.791+0000 7f25267fc640 1 -- 172.21.15.133:0/1654541952 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26380c8430 con 0x56089aa35d90 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- 172.21.15.133:0/1654541952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 msgr2=0x56089aa361b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 --2- 172.21.15.133:0/1654541952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa361b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f26380e4ca0 tx=0x7f26380bd4c0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- 172.21.15.133:0/1654541952 shutdown_connections 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 --2- 172.21.15.133:0/1654541952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa361b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- 172.21.15.133:0/1654541952 >> 172.21.15.133:0/1654541952 conn(0x56089aa32120 msgr2=0x56089aa30180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- 172.21.15.133:0/1654541952 shutdown_connections 2024-02-15T23:29:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- 172.21.15.133:0/1654541952 wait complete. 2024-02-15T23:29:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 Processor -- start 2024-02-15T23:29:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- start start 2024-02-15T23:29:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa3ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56089aa3d210 con 0x56089aa35d90 2024-02-15T23:29:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f264272f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa3ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f264272f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa3ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42132/0 (socket says 172.21.15.133:42132) 2024-02-15T23:29:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 learned_addr learned my addr 172.21.15.133:0/3085766386 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26380d6040 con 0x56089aa35d90 2024-02-15T23:29:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f264272f640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa3ccd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f26380bc7c0 tx=0x7f26380e4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2524ff9640 1 -- 172.21.15.133:0/3085766386 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26380e6d10 con 0x56089aa35d90 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2524ff9640 1 -- 172.21.15.133:0/3085766386 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26380ea070 con 0x56089aa35d90 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56089aa3d410 con 0x56089aa35d90 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2524ff9640 1 -- 172.21.15.133:0/3085766386 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26380c8430 con 0x56089aa35d90 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56089aa3d410 con 0x56089aa35d90 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2524ff9640 1 -- 172.21.15.133:0/3085766386 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f26380ec030 con 0x56089aa35d90 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2524ff9640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f250c0342b0 0x7f250c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2524ff9640 1 -- 172.21.15.133:0/3085766386 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f26380f0c90 con 0x56089aa35d90 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2643731640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f250c0342b0 0x7f250c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa47f40 0x56089aa4a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa4ab50 con 0x56089aa47f40 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.795+0000 7f2642f30640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa47f40 0x56089aa4a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2643731640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f250c0342b0 0x7f250c036770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2634008fd0 tx=0x7f263401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2642f30640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa47f40 0x56089aa4a400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f263c024020 con 0x56089aa47f40 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 realm 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa4af20 con 0x56089aa47f40 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f263c024020 con 0x56089aa47f40 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa4b7a0 con 0x56089aa47f40 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f263c024020 con 0x56089aa47f40 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa4bb00 con 0x56089aa47f40 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f263c024020 con 0x56089aa47f40 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa4c300 con 0x56089aa47f40 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f263c024020 con 0x56089aa47f40 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 20 searching for the correct realm 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56089aa4e190 0x56089aa50600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f264272f640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56089aa4e190 0x56089aa50600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f264272f640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56089aa4e190 0x56089aa50600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f264272f640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f26380fc040 0x7f2638006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f26380fc040 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2643731640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f26380fc040 0x7f2638006aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2643731640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f26380fc040 0x7f2638006aa0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263402c040 con 0x7f26380fc040 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2643731640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2634027940 0x7f26340333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.799+0000 7f2642f30640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2634027940 0x7f26340333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2634027940 0x7f26340333c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c024020 con 0x7f2634027940 2024-02-15T23:29:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa47f40 2024-02-15T23:29:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f263c03d080 con 0x56089aa47f40 2024-02-15T23:29:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa47f40 2024-02-15T23:29:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x56089aa47f40 2024-02-15T23:29:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x7f2634027940 2024-02-15T23:29:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x7f2634027940 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f26380fc040 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263402c040 con 0x7f26380fc040 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa47f40 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f263c03d080 con 0x56089aa47f40 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.803+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x7f2634027940 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa47f40 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x56089aa47f40 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f26380fc040 2024-02-15T23:29:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f263402c040 con 0x7f26380fc040 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x7f2634027940 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa47f40 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x56089aa47f40 2024-02-15T23:29:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa47f40 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f263c03d080 con 0x56089aa47f40 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x7f2634027940 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.807+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f26380fc040 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263402c040 con 0x7f26380fc040 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa47f40 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x56089aa47f40 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x7f2634027940 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c03d080 con 0x7f2634027940 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f26380fc040 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263402c040 con 0x7f26380fc040 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa4e190 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f2634027940 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x56089aa47f40 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa50cd0 con 0x7f26380fc040 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f263402c040 con 0x7f26380fc040 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2645415980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2645415980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2645415980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2645415980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2645415980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.811+0000 7f2645415980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa4cc00 con 0x56089aa47f40 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa4d450 con 0x56089aa47f40 2024-02-15T23:29:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa51110 con 0x56089aa47f40 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 zone default found 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 4 Realm: () 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 zonegroup default 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa51110 con 0x7f2634027940 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa52f90 con 0x56089aa4e190 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa532f0 con 0x56089aa4e190 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 started sync module instance, tier type = 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa52560 con 0x7f26380fc040 2024-02-15T23:29:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263403f040 con 0x7f26380fc040 2024-02-15T23:29:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594954242368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa52560 con 0x7f26380fc040 2024-02-15T23:29:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.815+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa53c60 con 0x56089aa47f40 2024-02-15T23:29:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.819+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594954242368] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263403f040 con 0x7f26380fc040 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.819+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.819+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594954246352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa52560 con 0x56089aa47f40 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.819+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa54620 con 0x56089aa4e190 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.819+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594954246352] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.819+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.819+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594954240192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa524e0 con 0x56089aa4e190 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.819+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa55310 con 0x7f26380fc040 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.823+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263403f040 con 0x7f26380fc040 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.823+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594954252192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa55b60 con 0x7f26380fc040 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.823+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa56540 con 0x56089aa47f40 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.823+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594954240192] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.823+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594954252192] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263403f040 con 0x7f26380fc040 2024-02-15T23:29:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.823+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.823+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594954250704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa556c0 con 0x56089aa47f40 2024-02-15T23:29:49.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.823+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa56dc0 con 0x7f2634027940 2024-02-15T23:29:49.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.827+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594954250704] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.827+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.827+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594954256480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa556c0 con 0x7f2634027940 2024-02-15T23:29:49.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.827+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa57250 con 0x7f2634027940 2024-02-15T23:29:49.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.827+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.827+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594954259792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa576b0 con 0x7f2634027940 2024-02-15T23:29:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.827+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa580a0 con 0x7f2634027940 2024-02-15T23:29:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.827+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594954256480] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594954259792] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594954263424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa57210 con 0x7f2634027940 2024-02-15T23:29:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 20 add_watcher() i=0 2024-02-15T23:29:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 20 add_watcher() i=1 2024-02-15T23:29:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 20 add_watcher() i=2 2024-02-15T23:29:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 20 add_watcher() i=3 2024-02-15T23:29:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 20 add_watcher() i=4 2024-02-15T23:29:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 20 add_watcher() i=5 2024-02-15T23:29:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 20 add_watcher() i=6 2024-02-15T23:29:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594954263424] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 20 add_watcher() i=7 2024-02-15T23:29:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa5b1a0 con 0x56089aa47f40 2024-02-15T23:29:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594954258160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa58610 con 0x56089aa47f40 2024-02-15T23:29:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.831+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594954258160] v31'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f24f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 5 note: GC not initialized 2024-02-15T23:29:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2473fff640 20 reqs_thread_entry: start 2024-02-15T23:29:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 20 Filter name: none 2024-02-15T23:29:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2471ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa7cee0 con 0x56089aa47f40 2024-02-15T23:29:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa7f2a0 con 0x7f26380fc040 2024-02-15T23:29:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f263403f040 con 0x7f26380fc040 2024-02-15T23:29:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa82960 con 0x56089aa47f40 2024-02-15T23:29:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v31'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94594954437728 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa7f740 con 0x56089aa47f40 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94594954250704 notify 133143986178 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f263c04d040 con 0x56089aa47f40 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f25267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94594954250704 notifier 4325 bl.length()=534 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f25267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f25267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(65 notify.4 [notify cookie 94594954437728 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f25267fc640 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2508003ea0 con 0x56089aa47f40 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== watch-notify(notify_complete (2) cookie 94594954437728 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56089aa11ec0 con 0x56089aa47f40 2024-02-15T23:29:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.849 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f24f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.835+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594954258160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa7be70 con 0x56089aa47f40 2024-02-15T23:29:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94594954258160] v31'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594954242368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa566f0 con 0x7f26380fc040 2024-02-15T23:29:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94594954242368] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263403f040 con 0x7f26380fc040 2024-02-15T23:29:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2645415980 20 remove_watcher() i=0 2024-02-15T23:29:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2645415980 2 removed watcher, disabling cache 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594954246352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa566f0 con 0x56089aa47f40 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94594954246352] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2645415980 20 remove_watcher() i=1 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.839+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594954240192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa566f0 con 0x56089aa4e190 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.843+0000 7f264272f640 1 -- 172.21.15.133:0/3085766386 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94594954240192] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26380e4db0 con 0x56089aa4e190 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.843+0000 7f2645415980 20 remove_watcher() i=2 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.843+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594954252192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa520c0 con 0x7f26380fc040 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.843+0000 7f2643731640 1 -- 172.21.15.133:0/3085766386 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94594954252192] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263403f040 con 0x7f26380fc040 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.843+0000 7f2645415980 20 remove_watcher() i=3 2024-02-15T23:29:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.843+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594954250704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa520c0 con 0x56089aa47f40 2024-02-15T23:29:49.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.847+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94594954250704] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x56089aa47f40 2024-02-15T23:29:49.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.847+0000 7f2645415980 20 remove_watcher() i=4 2024-02-15T23:29:49.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.847+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594954256480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa520c0 con 0x7f2634027940 2024-02-15T23:29:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.847+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94594954256480] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.847+0000 7f2645415980 20 remove_watcher() i=5 2024-02-15T23:29:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.847+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594954259792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa520c0 con 0x7f2634027940 2024-02-15T23:29:49.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94594954259792] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 20 remove_watcher() i=6 2024-02-15T23:29:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594954263424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56089aa520c0 con 0x7f2634027940 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94594954263424] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f263c058040 con 0x7f2634027940 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 20 remove_watcher() i=7 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2634027940 msgr2=0x7f26340333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2634027940 0x7f26340333c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa47f40 msgr2=0x56089aa4a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa47f40 0x56089aa4a400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f26380fc040 msgr2=0x7f2638006aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f26380fc040 0x7f2638006aa0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56089aa4e190 msgr2=0x56089aa50600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56089aa4e190 0x56089aa50600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f250c0342b0 msgr2=0x7f250c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f250c0342b0 0x7f250c036770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2634008fd0 tx=0x7f263401c070 comp rx=0 tx=0).stop 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 msgr2=0x56089aa3ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2642f30640 1 -- 172.21.15.133:0/3085766386 reap_dead start 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa3ccd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f26380bc7c0 tx=0x7f26380e4c00 comp rx=0 tx=0).stop 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 shutdown_connections 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/3085766386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa35d90 0x56089aa3ccd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 >> 172.21.15.133:0/3085766386 conn(0x56089aa32120 msgr2=0x56089aa2f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 shutdown_connections 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/3085766386 wait complete. 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/2761888772 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f251c0342b0 msgr2=0x7f251c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/2761888772 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f251c0342b0 0x7f251c036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56089aa19390 tx=0x7f2634003070 comp rx=0 tx=0).stop 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/2761888772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa28d90 msgr2=0x56089aa291b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/2761888772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa28d90 0x56089aa291b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2638018f70 tx=0x7f26380180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/2761888772 shutdown_connections 2024-02-15T23:29:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/2761888772 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f251c0342b0 0x7f251c036770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/2761888772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089aa28d90 0x56089aa291b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/2761888772 >> 172.21.15.133:0/2761888772 conn(0x56089aa1dba0 msgr2=0x56089aa1e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/2761888772 shutdown_connections 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/2761888772 wait complete. 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa16180 msgr2=0x56089aa18570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa16180 0x56089aa18570 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25280342b0 msgr2=0x7f2528036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25280342b0 0x7f2528036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26380ae000 tx=0x7f26380a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 msgr2=0x56089aa11550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa11550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x56089aa0b260 tx=0x7f263c000f50 comp rx=0 tx=0).stop 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 shutdown_connections 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56089aa16180 0x56089aa18570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25280342b0 0x7f2528036770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 --2- 172.21.15.133:0/1434408422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56089a892080 0x56089aa11550 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.851+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 >> 172.21.15.133:0/1434408422 conn(0x56089a9188e0 msgr2=0x56089aa049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.855+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 shutdown_connections 2024-02-15T23:29:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.855+0000 7f2645415980 1 -- 172.21.15.133:0/1434408422 wait complete. 2024-02-15T23:29:49.870 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:49.871 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:29:49.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:29:49.871 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:29:49.950 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:49.950 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:49.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fbd347980 1 Processor -- start 2024-02-15T23:29:49.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fbd347980 1 -- start start 2024-02-15T23:29:49.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fbd347980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x555f4feaa170 0x555f4feaa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fbd347980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555f4fdf64c0 con 0x555f4feaaa90 2024-02-15T23:29:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fbd347980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x555f4fdbd180 con 0x555f4feaa170 2024-02-15T23:29:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fbae62640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x555f4feaa170 0x555f4feaa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fba661640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x555f4feaaa90 0x555f4feab450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39768/0 (socket says 172.21.15.133:39768) 2024-02-15T23:29:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fba661640 1 -- 172.21.15.133:0/3277576010 learned_addr learned my addr 172.21.15.133:0/3277576010 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fbae62640 1 -- 172.21.15.133:0/3277576010 >> v1:172.21.15.131:6789/0 conn(0x555f4feaaa90 legacy=0x555f4feab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.943+0000 7f1fbae62640 1 -- 172.21.15.133:0/3277576010 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f4feabc80 con 0x555f4feaa170 2024-02-15T23:29:49.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fbae62640 1 --2- 172.21.15.133:0/3277576010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4feaa550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400a420 tx=0x7f1fa401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6b0bceb1fcc81a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fb9e60640 1 -- 172.21.15.133:0/3277576010 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fa40aa530 con 0x555f4feaa170 2024-02-15T23:29:49.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fb9e60640 1 -- 172.21.15.133:0/3277576010 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa40a6050 con 0x555f4feaa170 2024-02-15T23:29:49.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fb9e60640 1 -- 172.21.15.133:0/3277576010 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fa40aa800 con 0x555f4feaa170 2024-02-15T23:29:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fbd347980 1 -- 172.21.15.133:0/3277576010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 msgr2=0x555f4feaa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3277576010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4feaa550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400a420 tx=0x7f1fa401afd0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fbd347980 1 -- 172.21.15.133:0/3277576010 shutdown_connections 2024-02-15T23:29:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3277576010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4feaa550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fbd347980 1 -- 172.21.15.133:0/3277576010 >> 172.21.15.133:0/3277576010 conn(0x555f4fea5a40 msgr2=0x555f4fea7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fbd347980 1 -- 172.21.15.133:0/3277576010 shutdown_connections 2024-02-15T23:29:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.947+0000 7f1fbd347980 1 -- 172.21.15.133:0/3277576010 wait complete. 2024-02-15T23:29:49.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.959+0000 7f1fbd347980 1 Processor -- start 2024-02-15T23:29:49.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.959+0000 7f1fbd347980 1 -- start start 2024-02-15T23:29:49.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.959+0000 7f1fbd347980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff945d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.959+0000 7f1fbd347980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f4fdba6b0 con 0x555f4feaa170 2024-02-15T23:29:49.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.959+0000 7f1fbae62640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff945d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42150/0 (socket says 172.21.15.133:42150) 2024-02-15T23:29:49.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 -- 172.21.15.133:0/3839583696 learned_addr learned my addr 172.21.15.133:0/3839583696 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 -- 172.21.15.133:0/3839583696 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa400a100 con 0x555f4feaa170 2024-02-15T23:29:49.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 --2- 172.21.15.133:0/3839583696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff945d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40ad040 tx=0x7f1fa40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb6d4098f5be10e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1ea8e09640 1 -- 172.21.15.133:0/3839583696 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fa40aa6c0 con 0x555f4feaa170 2024-02-15T23:29:49.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1ea8e09640 1 -- 172.21.15.133:0/3839583696 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa40aa820 con 0x555f4feaa170 2024-02-15T23:29:49.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1ea8e09640 1 -- 172.21.15.133:0/3839583696 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fa40aaac0 con 0x555f4feaa170 2024-02-15T23:29:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 -- 172.21.15.133:0/3839583696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 msgr2=0x555f4ff945d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3839583696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff945d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40ad040 tx=0x7f1fa40033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 -- 172.21.15.133:0/3839583696 shutdown_connections 2024-02-15T23:29:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3839583696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff945d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 -- 172.21.15.133:0/3839583696 >> 172.21.15.133:0/3839583696 conn(0x555f4fea5a40 msgr2=0x555f4ff90160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 -- 172.21.15.133:0/3839583696 shutdown_connections 2024-02-15T23:29:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 -- 172.21.15.133:0/3839583696 wait complete. 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 Processor -- start 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 -- start start 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff9b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f4fdb5e90 con 0x555f4feaa170 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff9b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff9b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42160/0 (socket says 172.21.15.133:42160) 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 -- 172.21.15.133:0/3481481930 learned_addr learned my addr 172.21.15.133:0/3481481930 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 -- 172.21.15.133:0/3481481930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f4feabc80 con 0x555f4feaa170 2024-02-15T23:29:49.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbae62640 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff9b2a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4003430 tx=0x7f1fa4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1ea7606640 1 -- 172.21.15.133:0/3481481930 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fa40b6950 con 0x555f4feaa170 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f4ff9b7e0 con 0x555f4feaa170 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.963+0000 7f1ea7606640 1 -- 172.21.15.133:0/3481481930 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa40b6ab0 con 0x555f4feaa170 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1ea7606640 1 -- 172.21.15.133:0/3481481930 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fa40b6d50 con 0x555f4feaa170 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f4ff9bc90 con 0x555f4feaa170 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1ea7606640 1 -- 172.21.15.133:0/3481481930 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fa40c0450 con 0x555f4feaa170 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1ea7606640 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea00342b0 0x7f1ea0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1ea7606640 1 -- 172.21.15.133:0/3481481930 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1fa40e3fa0 con 0x555f4feaa170 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fba661640 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea00342b0 0x7f1ea0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4feaaa90 0x555f4ffa1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffa2400 con 0x555f4feaaa90 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbb663640 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4feaaa90 0x555f4ffa1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fba661640 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea00342b0 0x7f1ea0036770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1fac001da0 tx=0x7f1fac001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbb663640 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4feaaa90 0x555f4ffa1ec0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbb663640 1 -- 172.21.15.133:0/3481481930 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fb40083f0 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffa27a0 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbb663640 1 -- 172.21.15.133:0/3481481930 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1fb40083f0 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffa4050 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbb663640 1 -- 172.21.15.133:0/3481481930 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1fb40083f0 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffa3250 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbb663640 1 -- 172.21.15.133:0/3481481930 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fb40083f0 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffa3660 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbb663640 1 -- 172.21.15.133:0/3481481930 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1fb4012040 con 0x555f4feaaa90 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 Processor -- start 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.967+0000 7f1fbd347980 1 -- start start 2024-02-15T23:29:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbd347980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4ffb2730 0x555f4ffb2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbd347980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f4fd4ef20 con 0x555f4ffb2730 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fba661640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4ffb2730 0x555f4ffb2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fba661640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4ffb2730 0x555f4ffb2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42172/0 (socket says 172.21.15.133:42172) 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fba661640 1 -- 172.21.15.133:0/883506623 learned_addr learned my addr 172.21.15.133:0/883506623 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fba661640 1 -- 172.21.15.133:0/883506623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f4ffb3090 con 0x555f4ffb2730 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fba661640 1 --2- 172.21.15.133:0/883506623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4ffb2730 0x555f4ffb2b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00d660 tx=0x7f1fac00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1ea4e01640 1 -- 172.21.15.133:0/883506623 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fac020070 con 0x555f4ffb2730 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbd347980 1 -- 172.21.15.133:0/883506623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f4ffb32e0 con 0x555f4ffb2730 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1ea4e01640 1 -- 172.21.15.133:0/883506623 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac00c770 con 0x555f4ffb2730 2024-02-15T23:29:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbd347980 1 -- 172.21.15.133:0/883506623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f4ffb3e30 con 0x555f4ffb2730 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1ea4e01640 1 -- 172.21.15.133:0/883506623 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fac013040 con 0x555f4ffb2730 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1ea4e01640 1 -- 172.21.15.133:0/883506623 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fac00a040 con 0x555f4ffb2730 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1ea4e01640 1 --2- 172.21.15.133:0/883506623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e940342b0 0x7f1e94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1ea4e01640 1 -- 172.21.15.133:0/883506623 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1fac04b5d0 con 0x555f4ffb2730 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbb663640 1 --2- 172.21.15.133:0/883506623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e940342b0 0x7f1e94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbd347980 1 Processor -- start 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbd347980 1 -- start start 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbb663640 1 --2- 172.21.15.133:0/883506623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e940342b0 0x7f1e94036770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x555f4ffa2c90 tx=0x7f1fb4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbd347980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4fe20150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.971+0000 7f1fbd347980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f4fd42790 con 0x555f4fe1fd50 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4fe20150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4fe20150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42182/0 (socket says 172.21.15.133:42182) 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 -- 172.21.15.133:0/3721402018 learned_addr learned my addr 172.21.15.133:0/3721402018 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 -- 172.21.15.133:0/3721402018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f4fe1e580 con 0x555f4fe1fd50 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 --2- 172.21.15.133:0/3721402018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4fe20150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0499c0 tx=0x7f1fac019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d332baf2027dc06 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1e9e7fc640 1 -- 172.21.15.133:0/3721402018 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fac01aac0 con 0x555f4fe1fd50 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1e9e7fc640 1 -- 172.21.15.133:0/3721402018 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac040030 con 0x555f4fe1fd50 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1e9e7fc640 1 -- 172.21.15.133:0/3721402018 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fac01acc0 con 0x555f4fe1fd50 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- 172.21.15.133:0/3721402018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 msgr2=0x555f4fe20150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3721402018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4fe20150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0499c0 tx=0x7f1fac019f10 comp rx=0 tx=0).stop 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- 172.21.15.133:0/3721402018 shutdown_connections 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3721402018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4fe20150 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- 172.21.15.133:0/3721402018 >> 172.21.15.133:0/3721402018 conn(0x555f4ffbba90 msgr2=0x555f4ffb9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- 172.21.15.133:0/3721402018 shutdown_connections 2024-02-15T23:29:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- 172.21.15.133:0/3721402018 wait complete. 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 Processor -- start 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- start start 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4ffc8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f4ffc8da0 con 0x555f4fe1fd50 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4ffc8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4ffc8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42190/0 (socket says 172.21.15.133:42190) 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 learned_addr learned my addr 172.21.15.133:0/782536953 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f4ffb3e30 con 0x555f4fe1fd50 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fba661640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4ffc8860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0198a0 tx=0x7f1fac049950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1e9cff9640 1 -- 172.21.15.133:0/782536953 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fac049b00 con 0x555f4fe1fd50 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f4ffc8fa0 con 0x555f4fe1fd50 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1e9cff9640 1 -- 172.21.15.133:0/782536953 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac033070 con 0x555f4fe1fd50 2024-02-15T23:29:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1e9cff9640 1 -- 172.21.15.133:0/782536953 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fac049db0 con 0x555f4fe1fd50 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.975+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f4ffc93d0 con 0x555f4fe1fd50 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1e9cff9640 1 -- 172.21.15.133:0/782536953 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fac024720 con 0x555f4fe1fd50 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1e9cff9640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e840342b0 0x7f1e84036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1e9cff9640 1 -- 172.21.15.133:0/782536953 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1fac03ac90 con 0x555f4fe1fd50 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbb663640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e840342b0 0x7f1e84036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4ffd3dd0 0x555f4ffd6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd69c0 con 0x555f4ffd3dd0 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbae62640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4ffd3dd0 0x555f4ffd6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbb663640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e840342b0 0x7f1e84036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4008fd0 tx=0x7f1fb401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbae62640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4ffd3dd0 0x555f4ffd6270 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 realm 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd6d90 con 0x555f4ffd3dd0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd75e0 con 0x555f4ffd3dd0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd7940 con 0x555f4ffd3dd0 2024-02-15T23:29:49.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd7280 con 0x555f4ffd3dd0 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 20 searching for the correct realm 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x555f4ffd9b90 0x555f4ffdbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdc650 con 0x555f4ffd9b90 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fba661640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x555f4ffd9b90 0x555f4ffdbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fba661640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x555f4ffd9b90 0x555f4ffdbf80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fba661640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fac02f400 0x7f1fac04b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdc650 con 0x7f1fac02f400 2024-02-15T23:29:49.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.979+0000 7f1fbb663640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fac02f400 0x7f1fac04b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:49.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbb663640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fac02f400 0x7f1fac04b8e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb402c040 con 0x7f1fac02f400 2024-02-15T23:29:50.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbb663640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fb4027940 0x7f1fb40333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdc650 con 0x7f1fb4027940 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fb4027940 0x7f1fb40333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fb4027940 0x7f1fb40333c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdc650 con 0x555f4ffd3dd0 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdc650 con 0x555f4ffd3dd0 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fb4027940 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.983+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fb4027940 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fac02f400 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb402c040 con 0x7f1fac02f400 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd9b90 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd3dd0 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fb4027940 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd3dd0 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fac02f400 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1fb402c040 con 0x7f1fac02f400 2024-02-15T23:29:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd9b90 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd9b90 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fb4027940 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd9b90 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd9b90 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.987+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd3dd0 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd3dd0 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fb4027940 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd9b90 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fac02f400 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb402c040 con 0x7f1fac02f400 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd3dd0 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x555f4ffd3dd0 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fb4027940 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd9b90 2024-02-15T23:29:50.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fb4027940 2024-02-15T23:29:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fac02f400 2024-02-15T23:29:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb402c040 con 0x7f1fac02f400 2024-02-15T23:29:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.991+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd9b90 2024-02-15T23:29:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fb4027940 2024-02-15T23:29:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fa40c6070 con 0x7f1fb4027940 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x555f4ffd3dd0 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1fa40de040 con 0x7f1fac02f400 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb402c040 con 0x7f1fac02f400 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd87e0 con 0x555f4ffd3dd0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd8460 con 0x555f4ffd3dd0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd90b0 con 0x555f4ffd3dd0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 zone default found 2024-02-15T23:29:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 4 Realm: () 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 zonegroup default 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffd90b0 con 0x7f1fb4027940 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffde4c0 con 0x555f4ffd9b90 2024-02-15T23:29:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffde820 con 0x555f4ffd9b90 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 started sync module instance, tier type = 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.995+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffddda0 con 0x7f1fac02f400 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.999+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb403f040 con 0x7f1fac02f400 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.999+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93867852290304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffde150 con 0x7f1fac02f400 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.999+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdf550 con 0x555f4ffd3dd0 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.999+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93867852290304] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb403f040 con 0x7f1fac02f400 2024-02-15T23:29:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.999+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.999+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93867852295184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdf4d0 con 0x555f4ffd3dd0 2024-02-15T23:29:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:49.999+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdffa0 con 0x555f4ffd9b90 2024-02-15T23:29:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93867852298880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe07f0 con 0x555f4ffd9b90 2024-02-15T23:29:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe11c0 con 0x7f1fac02f400 2024-02-15T23:29:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93867852295184] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb403f040 con 0x7f1fac02f400 2024-02-15T23:29:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93867852303552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe1570 con 0x7f1fac02f400 2024-02-15T23:29:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe1ee0 con 0x555f4ffd3dd0 2024-02-15T23:29:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93867852298880] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93867852303552] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb403f040 con 0x7f1fac02f400 2024-02-15T23:29:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93867852296240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe1a40 con 0x555f4ffd3dd0 2024-02-15T23:29:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.003+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe2730 con 0x7f1fb4027940 2024-02-15T23:29:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.007+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93867852296240] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.007+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.007+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93867852301136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe2490 con 0x7f1fb4027940 2024-02-15T23:29:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.007+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe2c90 con 0x7f1fb4027940 2024-02-15T23:29:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.007+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93867852301136] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93867852308736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe2b00 con 0x7f1fb4027940 2024-02-15T23:29:50.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe35b0 con 0x7f1fb4027940 2024-02-15T23:29:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93867852312752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe3a50 con 0x7f1fb4027940 2024-02-15T23:29:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 20 add_watcher() i=0 2024-02-15T23:29:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 20 add_watcher() i=1 2024-02-15T23:29:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 20 add_watcher() i=2 2024-02-15T23:29:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 20 add_watcher() i=3 2024-02-15T23:29:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 20 add_watcher() i=4 2024-02-15T23:29:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 20 add_watcher() i=5 2024-02-15T23:29:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93867852308736] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.011+0000 7f1fbd347980 20 add_watcher() i=6 2024-02-15T23:29:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93867852312752] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 20 add_watcher() i=7 2024-02-15T23:29:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe25a0 con 0x555f4ffd3dd0 2024-02-15T23:29:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93867852309856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe3f30 con 0x555f4ffd3dd0 2024-02-15T23:29:50.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93867852309856] v31'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1e717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 5 note: GC not initialized 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1debfff640 20 reqs_thread_entry: start 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 20 Filter name: none 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1de9ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f500084b0 con 0x555f4ffd3dd0 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:50.026 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1e717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.015+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93867852309856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe9090 con 0x555f4ffd3dd0 2024-02-15T23:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93867852309856] v31'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93867852290304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe2560 con 0x7f1fac02f400 2024-02-15T23:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93867852290304] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb403f040 con 0x7f1fac02f400 2024-02-15T23:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbd347980 20 remove_watcher() i=0 2024-02-15T23:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbd347980 2 removed watcher, disabling cache 2024-02-15T23:29:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93867852295184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdd900 con 0x555f4ffd3dd0 2024-02-15T23:29:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93867852295184] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbd347980 20 remove_watcher() i=1 2024-02-15T23:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.019+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93867852298880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdd900 con 0x555f4ffd9b90 2024-02-15T23:29:50.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.023+0000 7f1fba661640 1 -- 172.21.15.133:0/782536953 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93867852298880] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fac022070 con 0x555f4ffd9b90 2024-02-15T23:29:50.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.023+0000 7f1fbd347980 20 remove_watcher() i=2 2024-02-15T23:29:50.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.023+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93867852303552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdec10 con 0x7f1fac02f400 2024-02-15T23:29:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.023+0000 7f1fbb663640 1 -- 172.21.15.133:0/782536953 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93867852303552] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb403f040 con 0x7f1fac02f400 2024-02-15T23:29:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.023+0000 7f1fbd347980 20 remove_watcher() i=3 2024-02-15T23:29:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.023+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93867852296240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdec10 con 0x555f4ffd3dd0 2024-02-15T23:29:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.027+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93867852296240] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x555f4ffd3dd0 2024-02-15T23:29:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.027+0000 7f1fbd347980 20 remove_watcher() i=4 2024-02-15T23:29:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.027+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93867852301136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffdf0b0 con 0x7f1fb4027940 2024-02-15T23:29:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.027+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93867852301136] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.027+0000 7f1fbd347980 20 remove_watcher() i=5 2024-02-15T23:29:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.027+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93867852308736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe0350 con 0x7f1fb4027940 2024-02-15T23:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93867852308736] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 20 remove_watcher() i=6 2024-02-15T23:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93867852312752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555f4ffe0350 con 0x7f1fb4027940 2024-02-15T23:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93867852312752] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fa40ee080 con 0x7f1fb4027940 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 20 remove_watcher() i=7 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fb4027940 msgr2=0x7f1fb40333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fb4027940 0x7f1fb40333c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4ffd3dd0 msgr2=0x555f4ffd6270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4ffd3dd0 0x555f4ffd6270 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fac02f400 msgr2=0x7f1fac04b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fac02f400 0x7f1fac04b8e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x555f4ffd9b90 msgr2=0x555f4ffdbf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x555f4ffd9b90 0x555f4ffdbf80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e840342b0 msgr2=0x7f1e84036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e840342b0 0x7f1e84036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4008fd0 tx=0x7f1fb401c070 comp rx=0 tx=0).stop 2024-02-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbae62640 1 -- 172.21.15.133:0/782536953 reap_dead start 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 msgr2=0x555f4ffc8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4ffc8860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0198a0 tx=0x7f1fac049950 comp rx=0 tx=0).stop 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 shutdown_connections 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/782536953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4fe1fd50 0x555f4ffc8860 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 >> 172.21.15.133:0/782536953 conn(0x555f4ffbba90 msgr2=0x555f4ffb90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 shutdown_connections 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/782536953 wait complete. 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/883506623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e940342b0 msgr2=0x7f1e94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/883506623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e940342b0 0x7f1e94036770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x555f4ffa2c90 tx=0x7f1fb4003070 comp rx=0 tx=0).stop 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/883506623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4ffb2730 msgr2=0x555f4ffb2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/883506623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4ffb2730 0x555f4ffb2b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00d660 tx=0x7f1fac00da60 comp rx=0 tx=0).stop 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/883506623 shutdown_connections 2024-02-15T23:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/883506623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e940342b0 0x7f1e94036770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/883506623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4ffb2730 0x555f4ffb2b50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/883506623 >> 172.21.15.133:0/883506623 conn(0x555f4ffa7540 msgr2=0x555f4ffa8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/883506623 shutdown_connections 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/883506623 wait complete. 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4feaaa90 msgr2=0x555f4ffa1ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4feaaa90 0x555f4ffa1ec0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea00342b0 msgr2=0x7f1ea0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea00342b0 0x7f1ea0036770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1fac001da0 tx=0x7f1fac001300 comp rx=0 tx=0).stop 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 msgr2=0x555f4ff9b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff9b2a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4003430 tx=0x7f1fa4019810 comp rx=0 tx=0).stop 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 shutdown_connections 2024-02-15T23:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x555f4feaaa90 0x555f4ffa1ec0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea00342b0 0x7f1ea0036770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 --2- 172.21.15.133:0/3481481930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f4feaa170 0x555f4ff9b2a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 >> 172.21.15.133:0/3481481930 conn(0x555f4fea5a40 msgr2=0x555f4ff8ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.031+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 shutdown_connections 2024-02-15T23:29:50.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.035+0000 7f1fbd347980 1 -- 172.21.15.133:0/3481481930 wait complete. 2024-02-15T23:29:50.051 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:50.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-15T23:29:50.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-15T23:29:50.051 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-02-15T23:29:50.126 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:50.126 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d9680980 1 Processor -- start 2024-02-15T23:29:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d9680980 1 -- start start 2024-02-15T23:29:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d9680980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5572eea58fe0 0x5572eea593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d9680980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5572ee9a6460 con 0x5572eea59900 2024-02-15T23:29:50.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d9680980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5572ee96d180 con 0x5572eea58fe0 2024-02-15T23:29:50.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d719b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5572eea58fe0 0x5572eea593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d699a640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5572eea59900 0x5572eea5a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39774/0 (socket says 172.21.15.133:39774) 2024-02-15T23:29:50.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d699a640 1 -- 172.21.15.133:0/1154165536 learned_addr learned my addr 172.21.15.133:0/1154165536 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:50.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d719b640 1 -- 172.21.15.133:0/1154165536 >> v1:172.21.15.131:6789/0 conn(0x5572eea59900 legacy=0x5572eea5a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.119+0000 7fc3d719b640 1 -- 172.21.15.133:0/1154165536 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572eea5aaf0 con 0x5572eea58fe0 2024-02-15T23:29:50.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d719b640 1 --2- 172.21.15.133:0/1154165536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eea593c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000a420 tx=0x7fc3d001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736fd70a99604730 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d6199640 1 -- 172.21.15.133:0/1154165536 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3d00aa530 con 0x5572eea58fe0 2024-02-15T23:29:50.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d6199640 1 -- 172.21.15.133:0/1154165536 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00a6050 con 0x5572eea58fe0 2024-02-15T23:29:50.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d6199640 1 -- 172.21.15.133:0/1154165536 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3d00aa800 con 0x5572eea58fe0 2024-02-15T23:29:50.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d9680980 1 -- 172.21.15.133:0/1154165536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 msgr2=0x5572eea593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d9680980 1 --2- 172.21.15.133:0/1154165536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eea593c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000a420 tx=0x7fc3d001afd0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d9680980 1 -- 172.21.15.133:0/1154165536 shutdown_connections 2024-02-15T23:29:50.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d9680980 1 --2- 172.21.15.133:0/1154165536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eea593c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d9680980 1 -- 172.21.15.133:0/1154165536 >> 172.21.15.133:0/1154165536 conn(0x5572eea548b0 msgr2=0x5572eea56cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d9680980 1 -- 172.21.15.133:0/1154165536 shutdown_connections 2024-02-15T23:29:50.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.123+0000 7fc3d9680980 1 -- 172.21.15.133:0/1154165536 wait complete. 2024-02-15T23:29:50.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d9680980 1 Processor -- start 2024-02-15T23:29:50.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d9680980 1 -- start start 2024-02-15T23:29:50.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d9680980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb44680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d9680980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572ee96a6b0 con 0x5572eea58fe0 2024-02-15T23:29:50.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d719b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb44680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d719b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb44680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42206/0 (socket says 172.21.15.133:42206) 2024-02-15T23:29:50.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d719b640 1 -- 172.21.15.133:0/776537377 learned_addr learned my addr 172.21.15.133:0/776537377 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d719b640 1 -- 172.21.15.133:0/776537377 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d000a100 con 0x5572eea58fe0 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc3d719b640 1 --2- 172.21.15.133:0/776537377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb44680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00ad040 tx=0x7fc3d00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc15b9b87c54ed8b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc2c560a640 1 -- 172.21.15.133:0/776537377 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3d00aa6c0 con 0x5572eea58fe0 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc2c560a640 1 -- 172.21.15.133:0/776537377 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00aa820 con 0x5572eea58fe0 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.135+0000 7fc2c560a640 1 -- 172.21.15.133:0/776537377 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3d00aaac0 con 0x5572eea58fe0 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- 172.21.15.133:0/776537377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 msgr2=0x5572eeb44680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 --2- 172.21.15.133:0/776537377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb44680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00ad040 tx=0x7fc3d00033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- 172.21.15.133:0/776537377 shutdown_connections 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 --2- 172.21.15.133:0/776537377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb44680 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- 172.21.15.133:0/776537377 >> 172.21.15.133:0/776537377 conn(0x5572eea548b0 msgr2=0x5572ee9ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- 172.21.15.133:0/776537377 shutdown_connections 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- 172.21.15.133:0/776537377 wait complete. 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 Processor -- start 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- start start 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb4b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572ee965e90 con 0x5572eea58fe0 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d719b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb4b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d719b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb4b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42222/0 (socket says 172.21.15.133:42222) 2024-02-15T23:29:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d719b640 1 -- 172.21.15.133:0/2933669853 learned_addr learned my addr 172.21.15.133:0/2933669853 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d719b640 1 -- 172.21.15.133:0/2933669853 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572eea5aaf0 con 0x5572eea58fe0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d719b640 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb4b400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0003430 tx=0x7fc3d0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc2c3e07640 1 -- 172.21.15.133:0/2933669853 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3d00b6950 con 0x5572eea58fe0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc2c3e07640 1 -- 172.21.15.133:0/2933669853 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00b6ab0 con 0x5572eea58fe0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572eeb4b940 con 0x5572eea58fe0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc2c3e07640 1 -- 172.21.15.133:0/2933669853 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3d00b6d50 con 0x5572eea58fe0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572eeb4bdd0 con 0x5572eea58fe0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc2c3e07640 1 -- 172.21.15.133:0/2933669853 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc3d00c0450 con 0x5572eea58fe0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc2c3e07640 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2bc0342b0 0x7fc2bc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc2c3e07640 1 -- 172.21.15.133:0/2933669853 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc3d00e3fa0 con 0x5572eea58fe0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d699a640 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2bc0342b0 0x7fc2bc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eea59900 0x5572eeb52090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.139+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb525d0 con 0x5572eea59900 2024-02-15T23:29:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d799c640 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eea59900 0x5572eeb52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d699a640 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2bc0342b0 0x7fc2bc036770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0000f70 tx=0x7fc3c00012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d799c640 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eea59900 0x5572eeb52090 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d799c640 1 -- 172.21.15.133:0/2933669853 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3c80083f0 con 0x5572eea59900 2024-02-15T23:29:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb52950 con 0x5572eea59900 2024-02-15T23:29:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d799c640 1 -- 172.21.15.133:0/2933669853 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc3c80083f0 con 0x5572eea59900 2024-02-15T23:29:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb54200 con 0x5572eea59900 2024-02-15T23:29:50.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d799c640 1 -- 172.21.15.133:0/2933669853 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc3c80083f0 con 0x5572eea59900 2024-02-15T23:29:50.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb53400 con 0x5572eea59900 2024-02-15T23:29:50.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d799c640 1 -- 172.21.15.133:0/2933669853 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc3c80083f0 con 0x5572eea59900 2024-02-15T23:29:50.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb53810 con 0x5572eea59900 2024-02-15T23:29:50.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d799c640 1 -- 172.21.15.133:0/2933669853 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc3c8012040 con 0x5572eea59900 2024-02-15T23:29:50.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 Processor -- start 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 -- start start 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb62910 0x5572eeb62d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572ee8fef20 con 0x5572eeb62910 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d699a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb62910 0x5572eeb62d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d699a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb62910 0x5572eeb62d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42224/0 (socket says 172.21.15.133:42224) 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d699a640 1 -- 172.21.15.133:0/334665866 learned_addr learned my addr 172.21.15.133:0/334665866 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d699a640 1 -- 172.21.15.133:0/334665866 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572eeb63270 con 0x5572eeb62910 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d699a640 1 --2- 172.21.15.133:0/334665866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb62910 0x5572eeb62d30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0001ee0 tx=0x7fc3c000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc2c1602640 1 -- 172.21.15.133:0/334665866 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3c0020070 con 0x5572eeb62910 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc2c1602640 1 -- 172.21.15.133:0/334665866 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000c770 con 0x5572eeb62910 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 -- 172.21.15.133:0/334665866 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572eeb634c0 con 0x5572eeb62910 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc2c1602640 1 -- 172.21.15.133:0/334665866 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3c0013040 con 0x5572eeb62910 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.143+0000 7fc3d9680980 1 -- 172.21.15.133:0/334665866 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572eeb64010 con 0x5572eeb62910 2024-02-15T23:29:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc2c1602640 1 -- 172.21.15.133:0/334665866 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc3c000a040 con 0x5572eeb62910 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc2c1602640 1 --2- 172.21.15.133:0/334665866 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2b0034300 0x7fc2b00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc2c1602640 1 -- 172.21.15.133:0/334665866 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc3c004b770 con 0x5572eeb62910 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d799c640 1 --2- 172.21.15.133:0/334665866 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2b0034300 0x7fc2b00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 Processor -- start 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- start start 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d799c640 1 --2- 172.21.15.133:0/334665866 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2b0034300 0x7fc2b00367c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5572eeb52e40 tx=0x7fc3c8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb40790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572ee8f2790 con 0x5572eeb40370 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d699a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb40790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d699a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb40790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42232/0 (socket says 172.21.15.133:42232) 2024-02-15T23:29:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d699a640 1 -- 172.21.15.133:0/3615805466 learned_addr learned my addr 172.21.15.133:0/3615805466 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d699a640 1 -- 172.21.15.133:0/3615805466 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572eeb3ebc0 con 0x5572eeb40370 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d699a640 1 --2- 172.21.15.133:0/3615805466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb40790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0049aa0 tx=0x7fc3c00198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5a84d0f822ae62 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc2baffd640 1 -- 172.21.15.133:0/3615805466 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3c0048070 con 0x5572eeb40370 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc2baffd640 1 -- 172.21.15.133:0/3615805466 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c003a2b0 con 0x5572eeb40370 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc2baffd640 1 -- 172.21.15.133:0/3615805466 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3c003a440 con 0x5572eeb40370 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- 172.21.15.133:0/3615805466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 msgr2=0x5572eeb40790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 --2- 172.21.15.133:0/3615805466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb40790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0049aa0 tx=0x7fc3c00198d0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- 172.21.15.133:0/3615805466 shutdown_connections 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 --2- 172.21.15.133:0/3615805466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb40790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- 172.21.15.133:0/3615805466 >> 172.21.15.133:0/3615805466 conn(0x5572eeb6bc20 msgr2=0x5572eeb69c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- 172.21.15.133:0/3615805466 shutdown_connections 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- 172.21.15.133:0/3615805466 wait complete. 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 Processor -- start 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- start start 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d9680980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572eeb78f00 con 0x5572eeb40370 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.147+0000 7fc3d699a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d699a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb789c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42236/0 (socket says 172.21.15.133:42236) 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 learned_addr learned my addr 172.21.15.133:0/4004361864 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572eeb64010 con 0x5572eeb40370 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d699a640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb789c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc3c003f040 tx=0x7fc3c0049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc2b97fa640 1 -- 172.21.15.133:0/4004361864 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3c004b2e0 con 0x5572eeb40370 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc2b97fa640 1 -- 172.21.15.133:0/4004361864 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c004b440 con 0x5572eeb40370 2024-02-15T23:29:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572eeb79100 con 0x5572eeb40370 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc2b97fa640 1 -- 172.21.15.133:0/4004361864 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3c0048070 con 0x5572eeb40370 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572eeb79590 con 0x5572eeb40370 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc2b97fa640 1 -- 172.21.15.133:0/4004361864 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc3c00481d0 con 0x5572eeb40370 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc2b97fa640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2a0034300 0x7fc2a00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc2b97fa640 1 -- 172.21.15.133:0/4004361864 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc3c0039cb0 con 0x5572eeb40370 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d799c640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2a0034300 0x7fc2a00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eeb83fa0 0x5572eeb86460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb86bb0 con 0x5572eeb83fa0 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d719b640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eeb83fa0 0x5572eeb86460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d799c640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2a0034300 0x7fc2a00367c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8008fd0 tx=0x7fc3c801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d719b640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eeb83fa0 0x5572eeb86460 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 20 realm 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb86f80 con 0x5572eeb83fa0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb87800 con 0x5572eeb83fa0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.151+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb87b60 con 0x5572eeb83fa0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d9680980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb88360 con 0x5572eeb83fa0 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d9680980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d9680980 20 searching for the correct realm 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572eeb8a1f0 0x5572eeb8c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d699a640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572eeb8a1f0 0x5572eeb8c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d699a640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572eeb8a1f0 0x5572eeb8c660 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d699a640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc3c0038070 0x7fc3c004ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c0038070 2024-02-15T23:29:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d799c640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc3c0038070 0x7fc3c004ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d799c640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc3c0038070 0x7fc3c004ba00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c802c040 con 0x7fc3c0038070 2024-02-15T23:29:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d799c640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc3c8027940 0x7fc3c80333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc3c8027940 0x7fc3c80333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc3c8027940 0x7fc3c80333c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00c6070 con 0x7fc3c8027940 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb83fa0 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb83fa0 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.155+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00c6070 con 0x7fc3c8027940 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00c6070 con 0x7fc3c8027940 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c0038070 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c802c040 con 0x7fc3c0038070 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb83fa0 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00c6070 con 0x7fc3c8027940 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb83fa0 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c0038070 2024-02-15T23:29:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc3c802c040 con 0x7fc3c0038070 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00c6070 con 0x7fc3c8027940 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.159+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb83fa0 2024-02-15T23:29:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb83fa0 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc3d00c6070 con 0x5572eeb83fa0 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c0038070 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c802c040 con 0x7fc3c0038070 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb83fa0 2024-02-15T23:29:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.163+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c0038070 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c802c040 con 0x7fc3c0038070 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c8027940 2024-02-15T23:29:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x5572eeb83fa0 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8cd30 con 0x7fc3c0038070 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3c802c040 con 0x7fc3c0038070 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb88c90 con 0x5572eeb83fa0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb894e0 con 0x5572eeb83fa0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb894e0 con 0x5572eeb83fa0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 zone default found 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 4 Realm: () 2024-02-15T23:29:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 zonegroup default 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb894e0 con 0x7fc3c8027940 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8ebd0 con 0x5572eeb8a1f0 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8ef30 con 0x5572eeb8a1f0 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 started sync module instance, tier type = 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.167+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8e4b0 con 0x7fc3c0038070 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.171+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c803f040 con 0x7fc3c0038070 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.171+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93952119726096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8e430 con 0x7fc3c0038070 2024-02-15T23:29:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.171+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8fc40 con 0x5572eeb83fa0 2024-02-15T23:29:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.171+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93952119726096] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c803f040 con 0x7fc3c0038070 2024-02-15T23:29:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.171+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.171+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93952119730944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8e430 con 0x5572eeb83fa0 2024-02-15T23:29:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.171+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb90330 con 0x5572eeb8a1f0 2024-02-15T23:29:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93952119733776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb90b80 con 0x5572eeb8a1f0 2024-02-15T23:29:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb91530 con 0x7fc3c0038070 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93952119730944] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c803f040 con 0x7fc3c0038070 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93952119732000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb91910 con 0x7fc3c0038070 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb92280 con 0x5572eeb83fa0 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93952119733776] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93952119732000] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c803f040 con 0x7fc3c0038070 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93952119738448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb91de0 con 0x5572eeb83fa0 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.175+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb92ad0 con 0x7fc3c8027940 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.179+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93952119738448] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.179+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.179+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93952119736032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb92800 con 0x7fc3c8027940 2024-02-15T23:29:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.179+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb93000 con 0x7fc3c8027940 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.179+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.179+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93952119744784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb93370 con 0x7fc3c8027940 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.179+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb93e40 con 0x7fc3c8027940 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.179+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93952119736032] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93952119748896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb93e00 con 0x7fc3c8027940 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 add_watcher() i=0 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 add_watcher() i=1 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 add_watcher() i=2 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 add_watcher() i=3 2024-02-15T23:29:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 add_watcher() i=4 2024-02-15T23:29:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 add_watcher() i=5 2024-02-15T23:29:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93952119744784] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 add_watcher() i=6 2024-02-15T23:29:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93952119748896] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 add_watcher() i=7 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb92e10 con 0x5572eeb83fa0 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93952119746000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb94290 con 0x5572eeb83fa0 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93952119746000] v31'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc28dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.183+0000 7fc3d9680980 5 note: GC not initialized 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc28cfe1640 20 reqs_thread_entry: start 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 20 Filter name: none 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc2067fc640 20 reqs_thread_entry: start 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eebb8cf0 con 0x5572eeb83fa0 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eebb9090 con 0x7fc3c8027940 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-15T23:29:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~461 in=461b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eebbe8b0 con 0x5572eeb83fa0 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~461] v31'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93952119923664 in=649b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eebbb550 con 0x5572eeb83fa0 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 93952119738448 notify 133143986179 ret 0) v3 ==== 679+0+0 (crc 0 0 0) 0x7fc3d00f6040 con 0x5572eeb83fa0 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc2baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 93952119738448 notifier 4339 bl.length()=637 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc2baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc2baffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc2baffd640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc29c003ea0 con 0x5572eeb83fa0 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(65 notify.4 [notify cookie 93952119923664 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 93952119923664 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5572eeb4bdd0 con 0x5572eeb83fa0 2024-02-15T23:29:50.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.187+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eebb9090 con 0x7fc3c8027940 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d9680980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d9680980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d9680980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93952119923664 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eebb9090 con 0x5572eeb8a1f0 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== watch-notify(notify (1) cookie 93952119733776 notify 133143986176 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x5572eeb79590 con 0x5572eeb8a1f0 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc2ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 93952119733776 notifier 4339 bl.length()=177 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc2ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc2ba7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(68 notify.2 [notify cookie 93952119923664 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc2ba7fc640 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc20c003400 con 0x5572eeb8a1f0 2024-02-15T23:29:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== watch-notify(notify_complete (2) cookie 93952119923664 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5572eeb79100 con 0x5572eeb8a1f0 2024-02-15T23:29:50.203 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc28dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93952119746000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb81540 con 0x5572eeb83fa0 2024-02-15T23:29:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93952119746000] v31'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.191+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93952119726096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb92dd0 con 0x7fc3c0038070 2024-02-15T23:29:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.195+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93952119726096] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c803f040 con 0x7fc3c0038070 2024-02-15T23:29:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.195+0000 7fc3d9680980 20 remove_watcher() i=0 2024-02-15T23:29:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.195+0000 7fc3d9680980 2 removed watcher, disabling cache 2024-02-15T23:29:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.195+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93952119730944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8e010 con 0x5572eeb83fa0 2024-02-15T23:29:50.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.195+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93952119730944] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.195+0000 7fc3d9680980 20 remove_watcher() i=1 2024-02-15T23:29:50.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.195+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93952119733776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8e010 con 0x5572eeb8a1f0 2024-02-15T23:29:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d699a640 1 -- 172.21.15.133:0/4004361864 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93952119733776] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c0022070 con 0x5572eeb8a1f0 2024-02-15T23:29:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d9680980 20 remove_watcher() i=2 2024-02-15T23:29:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93952119732000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8fe10 con 0x7fc3c0038070 2024-02-15T23:29:50.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d799c640 1 -- 172.21.15.133:0/4004361864 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93952119732000] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3c803f040 con 0x7fc3c0038070 2024-02-15T23:29:50.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d9680980 20 remove_watcher() i=3 2024-02-15T23:29:50.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93952119738448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8fe10 con 0x5572eeb83fa0 2024-02-15T23:29:50.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93952119738448] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x5572eeb83fa0 2024-02-15T23:29:50.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d9680980 20 remove_watcher() i=4 2024-02-15T23:29:50.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.199+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93952119736032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8fe10 con 0x7fc3c8027940 2024-02-15T23:29:50.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.203+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93952119736032] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.203+0000 7fc3d9680980 20 remove_watcher() i=5 2024-02-15T23:29:50.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.203+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93952119744784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb906e0 con 0x7fc3c8027940 2024-02-15T23:29:50.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.203+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93952119744784] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.203+0000 7fc3d9680980 20 remove_watcher() i=6 2024-02-15T23:29:50.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.203+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93952119748896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5572eeb8fe10 con 0x7fc3c8027940 2024-02-15T23:29:50.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93952119748896] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3d00ee040 con 0x7fc3c8027940 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 20 remove_watcher() i=7 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc3c8027940 msgr2=0x7fc3c80333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc3c8027940 0x7fc3c80333c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eeb83fa0 msgr2=0x5572eeb86460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eeb83fa0 0x5572eeb86460 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc3c0038070 msgr2=0x7fc3c004ba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc3c0038070 0x7fc3c004ba00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572eeb8a1f0 msgr2=0x5572eeb8c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572eeb8a1f0 0x5572eeb8c660 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2a0034300 msgr2=0x7fc2a00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2a0034300 0x7fc2a00367c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8008fd0 tx=0x7fc3c801c070 comp rx=0 tx=0).stop 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d719b640 1 -- 172.21.15.133:0/4004361864 reap_dead start 2024-02-15T23:29:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 msgr2=0x5572eeb789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb789c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc3c003f040 tx=0x7fc3c0049a30 comp rx=0 tx=0).stop 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 shutdown_connections 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/4004361864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb40370 0x5572eeb789c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 >> 172.21.15.133:0/4004361864 conn(0x5572eeb6bc20 msgr2=0x5572eeb69280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 shutdown_connections 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/4004361864 wait complete. 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/334665866 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2b0034300 msgr2=0x7fc2b00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/334665866 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2b0034300 0x7fc2b00367c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5572eeb52e40 tx=0x7fc3c8003070 comp rx=0 tx=0).stop 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/334665866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb62910 msgr2=0x5572eeb62d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/334665866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb62910 0x5572eeb62d30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0001ee0 tx=0x7fc3c000da30 comp rx=0 tx=0).stop 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/334665866 shutdown_connections 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/334665866 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2b0034300 0x7fc2b00367c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/334665866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eeb62910 0x5572eeb62d30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/334665866 >> 172.21.15.133:0/334665866 conn(0x5572eeb57720 msgr2=0x5572eeb58230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/334665866 shutdown_connections 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/334665866 wait complete. 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eea59900 msgr2=0x5572eeb52090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eea59900 0x5572eeb52090 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2bc0342b0 msgr2=0x7fc2bc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2bc0342b0 0x7fc2bc036770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0000f70 tx=0x7fc3c00012c0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 msgr2=0x5572eeb4b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb4b400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0003430 tx=0x7fc3d0019810 comp rx=0 tx=0).stop 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 shutdown_connections 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572eea59900 0x5572eeb52090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc2bc0342b0 0x7fc2bc036770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 --2- 172.21.15.133:0/2933669853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572eea58fe0 0x5572eeb4b400 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 >> 172.21.15.133:0/2933669853 conn(0x5572eea548b0 msgr2=0x5572eeb3dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 shutdown_connections 2024-02-15T23:29:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.207+0000 7fc3d9680980 1 -- 172.21.15.133:0/2933669853 wait complete. 2024-02-15T23:29:50.224 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:50.224 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:29:50.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:29:50.225 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:29:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.283+0000 7faff2b0e980 1 Processor -- start 2024-02-15T23:29:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7faff2b0e980 1 -- start start 2024-02-15T23:29:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7faff2b0e980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x560e50978350 0x560e50978730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7faff2b0e980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560e508c24c0 con 0x560e50978c70 2024-02-15T23:29:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7faff2b0e980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x560e50889180 con 0x560e50978350 2024-02-15T23:29:50.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7fafefe28640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x560e50978c70 0x560e50979620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39790/0 (socket says 172.21.15.133:39790) 2024-02-15T23:29:50.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7faff0629640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x560e50978350 0x560e50978730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7fafefe28640 1 -- 172.21.15.133:0/3001946690 learned_addr learned my addr 172.21.15.133:0/3001946690 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:50.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7fafef627640 1 -- 172.21.15.133:0/3001946690 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509666676 0 0) 0x560e508c24c0 con 0x560e50978c70 2024-02-15T23:29:50.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7fafef627640 1 -- 172.21.15.133:0/3001946690 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafdc001e20 con 0x560e50978c70 2024-02-15T23:29:50.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7faff0629640 1 -- 172.21.15.133:0/3001946690 >> v1:172.21.15.131:6789/0 conn(0x560e50978c70 legacy=0x560e50979620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7faff0629640 1 -- 172.21.15.133:0/3001946690 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e50979e50 con 0x560e50978350 2024-02-15T23:29:50.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7faff0629640 1 --2- 172.21.15.133:0/3001946690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50978730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fafe800a480 tx=0x7fafe801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0949c52f712d1e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7fafef627640 1 -- 172.21.15.133:0/3001946690 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafe80ab540 con 0x560e50978350 2024-02-15T23:29:50.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7fafef627640 1 -- 172.21.15.133:0/3001946690 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80ab6a0 con 0x560e50978350 2024-02-15T23:29:50.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.287+0000 7fafef627640 1 -- 172.21.15.133:0/3001946690 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafe80ab940 con 0x560e50978350 2024-02-15T23:29:50.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.291+0000 7faff2b0e980 1 -- 172.21.15.133:0/3001946690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 msgr2=0x560e50978730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.291+0000 7faff2b0e980 1 --2- 172.21.15.133:0/3001946690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50978730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fafe800a480 tx=0x7fafe801b280 comp rx=0 tx=0).stop 2024-02-15T23:29:50.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.291+0000 7faff2b0e980 1 -- 172.21.15.133:0/3001946690 shutdown_connections 2024-02-15T23:29:50.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.291+0000 7faff2b0e980 1 --2- 172.21.15.133:0/3001946690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50978730 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.291+0000 7faff2b0e980 1 -- 172.21.15.133:0/3001946690 >> 172.21.15.133:0/3001946690 conn(0x560e508eba40 msgr2=0x560e508ebe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.291+0000 7faff2b0e980 1 -- 172.21.15.133:0/3001946690 shutdown_connections 2024-02-15T23:29:50.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.291+0000 7faff2b0e980 1 -- 172.21.15.133:0/3001946690 wait complete. 2024-02-15T23:29:50.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 Processor -- start 2024-02-15T23:29:50.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 -- start start 2024-02-15T23:29:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a62670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e508866b0 con 0x560e50978350 2024-02-15T23:29:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff0629640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a62670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff0629640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a62670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42250/0 (socket says 172.21.15.133:42250) 2024-02-15T23:29:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff0629640 1 -- 172.21.15.133:0/1380719382 learned_addr learned my addr 172.21.15.133:0/1380719382 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff0629640 1 -- 172.21.15.133:0/1380719382 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8005d30 con 0x560e50978350 2024-02-15T23:29:50.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff0629640 1 --2- 172.21.15.133:0/1380719382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a62670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fafe8017e90 tx=0x7fafe8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6470072e5c37058 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faede60c640 1 -- 172.21.15.133:0/1380719382 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafe80ab940 con 0x560e50978350 2024-02-15T23:29:50.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faede60c640 1 -- 172.21.15.133:0/1380719382 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80abaa0 con 0x560e50978350 2024-02-15T23:29:50.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faede60c640 1 -- 172.21.15.133:0/1380719382 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafe80abd80 con 0x560e50978350 2024-02-15T23:29:50.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 -- 172.21.15.133:0/1380719382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 msgr2=0x560e50a62670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1380719382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a62670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fafe8017e90 tx=0x7fafe8003030 comp rx=0 tx=0).stop 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 -- 172.21.15.133:0/1380719382 shutdown_connections 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1380719382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a62670 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 -- 172.21.15.133:0/1380719382 >> 172.21.15.133:0/1380719382 conn(0x560e508eba40 msgr2=0x560e50a5e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 -- 172.21.15.133:0/1380719382 shutdown_connections 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 -- 172.21.15.133:0/1380719382 wait complete. 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 Processor -- start 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.303+0000 7faff2b0e980 1 -- start start 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff2b0e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a69320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff2b0e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e50881e90 con 0x560e50978350 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0629640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a69320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0629640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a69320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42264/0 (socket says 172.21.15.133:42264) 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0629640 1 -- 172.21.15.133:0/1554870700 learned_addr learned my addr 172.21.15.133:0/1554870700 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0629640 1 -- 172.21.15.133:0/1554870700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e50979e50 con 0x560e50978350 2024-02-15T23:29:50.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0629640 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a69320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fafe8000c10 tx=0x7fafe8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faedce09640 1 -- 172.21.15.133:0/1554870700 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafe80c4070 con 0x560e50978350 2024-02-15T23:29:50.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560e50a69860 con 0x560e50978350 2024-02-15T23:29:50.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e50a69c90 con 0x560e50978350 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faedce09640 1 -- 172.21.15.133:0/1554870700 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80bf620 con 0x560e50978350 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faedce09640 1 -- 172.21.15.133:0/1554870700 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafe80bf8c0 con 0x560e50978350 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faedce09640 1 -- 172.21.15.133:0/1554870700 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fafe80b2070 con 0x560e50978350 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faedce09640 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faed8034300 0x7faed80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faedce09640 1 -- 172.21.15.133:0/1554870700 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fafe80e3990 con 0x560e50978350 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7fafefe28640 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faed8034300 0x7faed80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50978c70 0x560e50a6ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50a704a0 con 0x560e50978c70 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0e2a640 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50978c70 0x560e50a6ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7fafefe28640 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faed8034300 0x7faed80367c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafd80012f0 tx=0x7fafd8001430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0e2a640 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50978c70 0x560e50a6ff60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0e2a640 1 -- 172.21.15.133:0/1554870700 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafe00083f0 con 0x560e50978c70 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50a70800 con 0x560e50978c70 2024-02-15T23:29:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff0e2a640 1 -- 172.21.15.133:0/1554870700 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fafe00083f0 con 0x560e50978c70 2024-02-15T23:29:50.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.307+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50a72060 con 0x560e50978c70 2024-02-15T23:29:50.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff0e2a640 1 -- 172.21.15.133:0/1554870700 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fafe00083f0 con 0x560e50978c70 2024-02-15T23:29:50.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50a71260 con 0x560e50978c70 2024-02-15T23:29:50.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff0e2a640 1 -- 172.21.15.133:0/1554870700 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fafe00083f0 con 0x560e50978c70 2024-02-15T23:29:50.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50a71670 con 0x560e50978c70 2024-02-15T23:29:50.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff0e2a640 1 -- 172.21.15.133:0/1554870700 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fafe00121d0 con 0x560e50978c70 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff2b0e980 1 Processor -- start 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff2b0e980 1 -- start start 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff2b0e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a806a0 0x560e50a80ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff2b0e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5081af20 con 0x560e50a806a0 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7fafefe28640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a806a0 0x560e50a80ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7fafefe28640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a806a0 0x560e50a80ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42270/0 (socket says 172.21.15.133:42270) 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7fafefe28640 1 -- 172.21.15.133:0/4248368813 learned_addr learned my addr 172.21.15.133:0/4248368813 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7fafefe28640 1 -- 172.21.15.133:0/4248368813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e50a81000 con 0x560e50a806a0 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7fafefe28640 1 --2- 172.21.15.133:0/4248368813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a806a0 0x560e50a80ac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fafd8004ef0 tx=0x7fafd8015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faed5ffb640 1 -- 172.21.15.133:0/4248368813 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafd801a070 con 0x560e50a806a0 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff2b0e980 1 -- 172.21.15.133:0/4248368813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560e50a81250 con 0x560e50a806a0 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faed5ffb640 1 -- 172.21.15.133:0/4248368813 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8011440 con 0x560e50a806a0 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faed5ffb640 1 -- 172.21.15.133:0/4248368813 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafd8011700 con 0x560e50a806a0 2024-02-15T23:29:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faff2b0e980 1 -- 172.21.15.133:0/4248368813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e50a81da0 con 0x560e50a806a0 2024-02-15T23:29:50.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.311+0000 7faed5ffb640 1 -- 172.21.15.133:0/4248368813 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fafd8011860 con 0x560e50a806a0 2024-02-15T23:29:50.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faed5ffb640 1 --2- 172.21.15.133:0/4248368813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec80342b0 0x7faec8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faed5ffb640 1 -- 172.21.15.133:0/4248368813 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fafd804aa30 con 0x560e50a806a0 2024-02-15T23:29:50.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff0e2a640 1 --2- 172.21.15.133:0/4248368813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec80342b0 0x7faec8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 Processor -- start 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- start start 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff0e2a640 1 --2- 172.21.15.133:0/4248368813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec80342b0 0x7faec8036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x560e50a70d00 tx=0x7fafe0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a8da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5080e790 con 0x560e50a8d620 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7fafefe28640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a8da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7fafefe28640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a8da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42282/0 (socket says 172.21.15.133:42282) 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7fafefe28640 1 -- 172.21.15.133:0/1418435956 learned_addr learned my addr 172.21.15.133:0/1418435956 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7fafefe28640 1 -- 172.21.15.133:0/1418435956 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e50a8e010 con 0x560e50a8d620 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7fafefe28640 1 --2- 172.21.15.133:0/1418435956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a8da40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fafd8048e20 tx=0x7fafd8013ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ea94800bcd258d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faecf7fe640 1 -- 172.21.15.133:0/1418435956 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafd8047070 con 0x560e50a8d620 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faecf7fe640 1 -- 172.21.15.133:0/1418435956 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd80135b0 con 0x560e50a8d620 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faecf7fe640 1 -- 172.21.15.133:0/1418435956 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafd801dd20 con 0x560e50a8d620 2024-02-15T23:29:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- 172.21.15.133:0/1418435956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 msgr2=0x560e50a8da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1418435956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a8da40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fafd8048e20 tx=0x7fafd8013ac0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- 172.21.15.133:0/1418435956 shutdown_connections 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1418435956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a8da40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- 172.21.15.133:0/1418435956 >> 172.21.15.133:0/1418435956 conn(0x560e50a899b0 msgr2=0x560e50a87a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- 172.21.15.133:0/1418435956 shutdown_connections 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- 172.21.15.133:0/1418435956 wait complete. 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 Processor -- start 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- start start 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a94510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7faff2b0e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e50a94a50 con 0x560e50a8d620 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7fafefe28640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a94510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7fafefe28640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a94510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42288/0 (socket says 172.21.15.133:42288) 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.315+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 learned_addr learned my addr 172.21.15.133:0/27419172 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e50a81da0 con 0x560e50a8d620 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7fafefe28640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a94510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fafd8006da0 tx=0x7fafd8048db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faecdffb640 1 -- 172.21.15.133:0/27419172 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafd802e040 con 0x560e50a8d620 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560e50a94c50 con 0x560e50a8d620 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faecdffb640 1 -- 172.21.15.133:0/27419172 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8011e40 con 0x560e50a8d620 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e50a950e0 con 0x560e50a8d620 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faecdffb640 1 -- 172.21.15.133:0/27419172 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafd801d530 con 0x560e50a8d620 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faecdffb640 1 -- 172.21.15.133:0/27419172 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fafd803ad50 con 0x560e50a8d620 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faecdffb640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec00342b0 0x7faec0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faecdffb640 1 -- 172.21.15.133:0/27419172 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fafd8005030 con 0x560e50a8d620 2024-02-15T23:29:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0e2a640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec00342b0 0x7faec0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50a9fac0 0x560e50aa1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa26d0 con 0x560e50a9fac0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0629640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50a9fac0 0x560e50aa1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0e2a640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec00342b0 0x7faec0036770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafe0008fd0 tx=0x7fafe001d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0629640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50a9fac0 0x560e50aa1f80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 realm 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa2aa0 con 0x560e50a9fac0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa32f0 con 0x560e50a9fac0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa3650 con 0x560e50a9fac0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa2f90 con 0x560e50a9fac0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 20 searching for the correct realm 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560e50aa58a0 0x560e50aa7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.319+0000 7fafefe28640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560e50aa58a0 0x560e50aa7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7fafefe28640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560e50aa58a0 0x560e50aa7cd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7fafefe28640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fafd80424c0 0x7fafd8037170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafd80424c0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0e2a640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fafd80424c0 0x7fafd8037170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0e2a640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fafd80424c0 0x7fafd8037170 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe002d040 con 0x7fafd80424c0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0e2a640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fafe0028940 0x7fafe0012420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fafe0028940 0x7fafe0012420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fafe0028940 0x7fafe0012420 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80da040 con 0x7fafe0028940 2024-02-15T23:29:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50a9fac0 2024-02-15T23:29:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50a9fac0 2024-02-15T23:29:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80da040 con 0x7fafe0028940 2024-02-15T23:29:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.323+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80da040 con 0x7fafe0028940 2024-02-15T23:29:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafd80424c0 2024-02-15T23:29:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe002d040 con 0x7fafd80424c0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50a9fac0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80da040 con 0x7fafe0028940 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50a9fac0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafd80424c0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fafe002d040 con 0x7fafd80424c0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80da040 con 0x7fafe0028940 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.327+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50a9fac0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50a9fac0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fafe80da040 con 0x560e50a9fac0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafd80424c0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe002d040 con 0x7fafd80424c0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50a9fac0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafd80424c0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe002d040 con 0x7fafd80424c0 2024-02-15T23:29:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50aa58a0 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.331+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafe0028940 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x560e50a9fac0 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa83a0 con 0x7fafd80424c0 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafe002d040 con 0x7fafd80424c0 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa44c0 con 0x560e50a9fac0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa4140 con 0x560e50a9fac0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa4d90 con 0x560e50a9fac0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 zone default found 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 4 Realm: () 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 zonegroup default 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa4d90 con 0x7fafe0028940 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aaa1c0 con 0x560e50aa58a0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aaa520 con 0x560e50aa58a0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 started sync module instance, tier type = 2024-02-15T23:29:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.335+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa9aa0 con 0x7fafd80424c0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.339+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe0040040 con 0x7fafd80424c0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.339+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94619482887680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aa9e50 con 0x7fafd80424c0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.339+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aab3a0 con 0x560e50a9fac0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.339+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94619482887680] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe0040040 con 0x7fafd80424c0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.339+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.339+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94619482894080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aab7c0 con 0x560e50a9fac0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.339+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aac000 con 0x560e50aa58a0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94619482894080] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94619482895408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aac3e0 con 0x560e50aa58a0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aacd50 con 0x7fafd80424c0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe0040040 con 0x7fafd80424c0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94619482900928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aad480 con 0x7fafd80424c0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aadf50 con 0x560e50a9fac0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94619482895408] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94619482900928] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe0040040 con 0x7fafd80424c0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.343+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94619482905136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aadf10 con 0x560e50a9fac0 2024-02-15T23:29:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.347+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aad050 con 0x7fafe0028940 2024-02-15T23:29:50.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.347+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94619482905136] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.347+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.347+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94619482906384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aae7d0 con 0x7fafe0028940 2024-02-15T23:29:50.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.347+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aaefd0 con 0x7fafe0028940 2024-02-15T23:29:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94619482909104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aaf450 con 0x7fafe0028940 2024-02-15T23:29:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aaff20 con 0x7fafe0028940 2024-02-15T23:29:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94619482906384] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94619482909104] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94619482913280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aaeeb0 con 0x7fafe0028940 2024-02-15T23:29:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 20 add_watcher() i=0 2024-02-15T23:29:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 20 add_watcher() i=1 2024-02-15T23:29:50.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 20 add_watcher() i=2 2024-02-15T23:29:50.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 20 add_watcher() i=3 2024-02-15T23:29:50.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 20 add_watcher() i=4 2024-02-15T23:29:50.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 20 add_watcher() i=5 2024-02-15T23:29:50.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.351+0000 7faff2b0e980 20 add_watcher() i=6 2024-02-15T23:29:50.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94619482913280] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 20 add_watcher() i=7 2024-02-15T23:29:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50ab2f10 con 0x560e50a9fac0 2024-02-15T23:29:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94619482907440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50ab0380 con 0x560e50a9fac0 2024-02-15T23:29:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94619482907440] v31'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faea67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 5 note: GC not initialized 2024-02-15T23:29:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faea57e2640 20 reqs_thread_entry: start 2024-02-15T23:29:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 20 Filter name: none 2024-02-15T23:29:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7fae16ffd640 20 reqs_thread_entry: start 2024-02-15T23:29:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.355+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50ad4890 con 0x560e50a9fac0 2024-02-15T23:29:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff2b0e980 20 rados_obj.operate() r=0 bl.length=461 2024-02-15T23:29:50.366 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faea67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94619482907440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50ab5480 con 0x560e50a9fac0 2024-02-15T23:29:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94619482907440] v31'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94619482887680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aae330 con 0x7fafd80424c0 2024-02-15T23:29:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94619482887680] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe0040040 con 0x7fafd80424c0 2024-02-15T23:29:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff2b0e980 20 remove_watcher() i=0 2024-02-15T23:29:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff2b0e980 2 removed watcher, disabling cache 2024-02-15T23:29:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.359+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94619482894080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aae330 con 0x560e50a9fac0 2024-02-15T23:29:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.363+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94619482894080] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.363+0000 7faff2b0e980 20 remove_watcher() i=1 2024-02-15T23:29:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.363+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94619482895408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aaaf00 con 0x560e50aa58a0 2024-02-15T23:29:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.363+0000 7fafefe28640 1 -- 172.21.15.133:0/27419172 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94619482895408] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafd804a750 con 0x560e50aa58a0 2024-02-15T23:29:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.363+0000 7faff2b0e980 20 remove_watcher() i=2 2024-02-15T23:29:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.363+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94619482900928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aae330 con 0x7fafd80424c0 2024-02-15T23:29:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.367+0000 7faff0e2a640 1 -- 172.21.15.133:0/27419172 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94619482900928] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe0040040 con 0x7fafd80424c0 2024-02-15T23:29:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.367+0000 7faff2b0e980 20 remove_watcher() i=3 2024-02-15T23:29:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.367+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94619482905136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aab430 con 0x560e50a9fac0 2024-02-15T23:29:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.367+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94619482905136] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x560e50a9fac0 2024-02-15T23:29:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.367+0000 7faff2b0e980 20 remove_watcher() i=4 2024-02-15T23:29:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.367+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94619482906384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aae330 con 0x7fafe0028940 2024-02-15T23:29:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.371+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94619482906384] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.371+0000 7faff2b0e980 20 remove_watcher() i=5 2024-02-15T23:29:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.371+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94619482909104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aab430 con 0x7fafe0028940 2024-02-15T23:29:50.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.371+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94619482909104] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.371+0000 7faff2b0e980 20 remove_watcher() i=6 2024-02-15T23:29:50.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.371+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94619482913280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560e50aab430 con 0x7fafe0028940 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.371+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94619482913280] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafe80fd040 con 0x7fafe0028940 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.371+0000 7faff2b0e980 20 remove_watcher() i=7 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fafe0028940 msgr2=0x7fafe0012420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fafe0028940 0x7fafe0012420 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50a9fac0 msgr2=0x560e50aa1f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50a9fac0 0x560e50aa1f80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fafd80424c0 msgr2=0x7fafd8037170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fafd80424c0 0x7fafd8037170 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560e50aa58a0 msgr2=0x560e50aa7cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560e50aa58a0 0x560e50aa7cd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec00342b0 msgr2=0x7faec0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec00342b0 0x7faec0036770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafe0008fd0 tx=0x7fafe001d070 comp rx=0 tx=0).stop 2024-02-15T23:29:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 msgr2=0x560e50a94510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff0629640 1 -- 172.21.15.133:0/27419172 reap_dead start 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a94510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fafd8006da0 tx=0x7fafd8048db0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 shutdown_connections 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/27419172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a8d620 0x560e50a94510 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 >> 172.21.15.133:0/27419172 conn(0x560e50a899b0 msgr2=0x560e50a87010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 shutdown_connections 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/27419172 wait complete. 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/4248368813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec80342b0 msgr2=0x7faec8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/4248368813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec80342b0 0x7faec8036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x560e50a70d00 tx=0x7fafe0003070 comp rx=0 tx=0).stop 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/4248368813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a806a0 msgr2=0x560e50a80ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/4248368813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a806a0 0x560e50a80ac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fafd8004ef0 tx=0x7fafd8015820 comp rx=0 tx=0).stop 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/4248368813 shutdown_connections 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/4248368813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faec80342b0 0x7faec8036770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/4248368813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50a806a0 0x560e50a80ac0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/4248368813 >> 172.21.15.133:0/4248368813 conn(0x560e50a754b0 msgr2=0x560e50a75fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/4248368813 shutdown_connections 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/4248368813 wait complete. 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50978c70 msgr2=0x560e50a6ff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50978c70 0x560e50a6ff60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faed8034300 msgr2=0x7faed80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faed8034300 0x7faed80367c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafd80012f0 tx=0x7fafd8001430 comp rx=0 tx=0).stop 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 msgr2=0x560e50a69320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a69320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fafe8000c10 tx=0x7fafe8018020 comp rx=0 tx=0).stop 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 shutdown_connections 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560e50978c70 0x560e50a6ff60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faed8034300 0x7faed80367c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 --2- 172.21.15.133:0/1554870700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e50978350 0x560e50a69320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 >> 172.21.15.133:0/1554870700 conn(0x560e508eba40 msgr2=0x560e50a5cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 shutdown_connections 2024-02-15T23:29:50.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.375+0000 7faff2b0e980 1 -- 172.21.15.133:0/1554870700 wait complete. 2024-02-15T23:29:50.392 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:50.392 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-15T23:29:50.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-15T23:29:50.392 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-02-15T23:29:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.455+0000 7ff4254fc980 1 Processor -- start 2024-02-15T23:29:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.455+0000 7ff4254fc980 1 -- start start 2024-02-15T23:29:50.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.455+0000 7ff4254fc980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x561b7ebf1360 0x561b7ebf1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.455+0000 7ff4254fc980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b7eb3b4d0 con 0x561b7ebf1c80 2024-02-15T23:29:50.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.455+0000 7ff4254fc980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b7eb02180 con 0x561b7ebf1360 2024-02-15T23:29:50.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.459+0000 7ff423017640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x561b7ebf1360 0x561b7ebf1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.459+0000 7ff423017640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x561b7ebf1360 0x561b7ebf1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42302/0 (socket says 172.21.15.133:42302) 2024-02-15T23:29:50.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.459+0000 7ff422816640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x561b7ebf1c80 0x561b7ebf2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39796/0 (socket says 172.21.15.133:39796) 2024-02-15T23:29:50.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.459+0000 7ff423017640 1 -- 172.21.15.133:0/2798718411 learned_addr learned my addr 172.21.15.133:0/2798718411 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.459+0000 7ff423017640 1 -- 172.21.15.133:0/2798718411 >> v1:172.21.15.131:6789/0 conn(0x561b7ebf1c80 legacy=0x561b7ebf2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.459+0000 7ff423017640 1 -- 172.21.15.133:0/2798718411 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b7ebf2e60 con 0x561b7ebf1360 2024-02-15T23:29:50.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff423017640 1 --2- 172.21.15.133:0/2798718411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ebf1740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff41400a5c0 tx=0x7ff41401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642266700c5e9b55 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff422015640 1 -- 172.21.15.133:0/2798718411 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4140aa470 con 0x561b7ebf1360 2024-02-15T23:29:50.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff422015640 1 -- 172.21.15.133:0/2798718411 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140aa5d0 con 0x561b7ebf1360 2024-02-15T23:29:50.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff422015640 1 -- 172.21.15.133:0/2798718411 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4140aa890 con 0x561b7ebf1360 2024-02-15T23:29:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff4254fc980 1 -- 172.21.15.133:0/2798718411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 msgr2=0x561b7ebf1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2798718411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ebf1740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff41400a5c0 tx=0x7ff41401b340 comp rx=0 tx=0).stop 2024-02-15T23:29:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff4254fc980 1 -- 172.21.15.133:0/2798718411 shutdown_connections 2024-02-15T23:29:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2798718411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ebf1740 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff4254fc980 1 -- 172.21.15.133:0/2798718411 >> 172.21.15.133:0/2798718411 conn(0x561b7eb64a50 msgr2=0x561b7eb64e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff4254fc980 1 -- 172.21.15.133:0/2798718411 shutdown_connections 2024-02-15T23:29:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.463+0000 7ff4254fc980 1 -- 172.21.15.133:0/2798718411 wait complete. 2024-02-15T23:29:50.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.475+0000 7ff4254fc980 1 Processor -- start 2024-02-15T23:29:50.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.475+0000 7ff4254fc980 1 -- start start 2024-02-15T23:29:50.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.475+0000 7ff4254fc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ecdb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.475+0000 7ff4254fc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7eaff6b0 con 0x561b7ebf1360 2024-02-15T23:29:50.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.475+0000 7ff423017640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ecdb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.475+0000 7ff423017640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ecdb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42316/0 (socket says 172.21.15.133:42316) 2024-02-15T23:29:50.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.475+0000 7ff423017640 1 -- 172.21.15.133:0/355657191 learned_addr learned my addr 172.21.15.133:0/355657191 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.475+0000 7ff423017640 1 -- 172.21.15.133:0/355657191 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414005df0 con 0x561b7ebf1360 2024-02-15T23:29:50.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff423017640 1 --2- 172.21.15.133:0/355657191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ecdb870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff4140ac040 tx=0x7ff414003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b96d9a68b31c8b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff31160a640 1 -- 172.21.15.133:0/355657191 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4140aa9b0 con 0x561b7ebf1360 2024-02-15T23:29:50.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff31160a640 1 -- 172.21.15.133:0/355657191 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140aab30 con 0x561b7ebf1360 2024-02-15T23:29:50.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff31160a640 1 -- 172.21.15.133:0/355657191 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4140aae10 con 0x561b7ebf1360 2024-02-15T23:29:50.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- 172.21.15.133:0/355657191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 msgr2=0x561b7ecdb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 --2- 172.21.15.133:0/355657191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ecdb870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff4140ac040 tx=0x7ff414003030 comp rx=0 tx=0).stop 2024-02-15T23:29:50.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- 172.21.15.133:0/355657191 shutdown_connections 2024-02-15T23:29:50.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 --2- 172.21.15.133:0/355657191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ecdb870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- 172.21.15.133:0/355657191 >> 172.21.15.133:0/355657191 conn(0x561b7eb64a50 msgr2=0x561b7ecd7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- 172.21.15.133:0/355657191 shutdown_connections 2024-02-15T23:29:50.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- 172.21.15.133:0/355657191 wait complete. 2024-02-15T23:29:50.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 Processor -- start 2024-02-15T23:29:50.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- start start 2024-02-15T23:29:50.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ece25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7eafae90 con 0x561b7ebf1360 2024-02-15T23:29:50.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff423017640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ece25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff423017640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ece25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42326/0 (socket says 172.21.15.133:42326) 2024-02-15T23:29:50.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff423017640 1 -- 172.21.15.133:0/2834543295 learned_addr learned my addr 172.21.15.133:0/2834543295 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff423017640 1 -- 172.21.15.133:0/2834543295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b7ebf2e60 con 0x561b7ebf1360 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff423017640 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ece25e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff41401b820 tx=0x7ff4140180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff30fe07640 1 -- 172.21.15.133:0/2834543295 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4140c6650 con 0x561b7ebf1360 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b7ece2b20 con 0x561b7ebf1360 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff30fe07640 1 -- 172.21.15.133:0/2834543295 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140c67b0 con 0x561b7ebf1360 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff30fe07640 1 -- 172.21.15.133:0/2834543295 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4140c6a90 con 0x561b7ebf1360 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.479+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b7ece2f50 con 0x561b7ebf1360 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff30fe07640 1 -- 172.21.15.133:0/2834543295 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff4140c6cc0 con 0x561b7ebf1360 2024-02-15T23:29:50.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff30fe07640 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff308034300 0x7ff3080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff30fe07640 1 -- 172.21.15.133:0/2834543295 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff4140e4e50 con 0x561b7ebf1360 2024-02-15T23:29:50.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff422816640 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff308034300 0x7ff3080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ebf1c80 0x561b7ece9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ece97b0 con 0x561b7ebf1c80 2024-02-15T23:29:50.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff423818640 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ebf1c80 0x561b7ece9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff422816640 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff308034300 0x7ff3080367c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff418000f70 tx=0x7ff418001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff423818640 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ebf1c80 0x561b7ece9270 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff423818640 1 -- 172.21.15.133:0/2834543295 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff41c00a4d0 con 0x561b7ebf1c80 2024-02-15T23:29:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ece9b30 con 0x561b7ebf1c80 2024-02-15T23:29:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff423818640 1 -- 172.21.15.133:0/2834543295 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff41c00a4d0 con 0x561b7ebf1c80 2024-02-15T23:29:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7eceb3e0 con 0x561b7ebf1c80 2024-02-15T23:29:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff423818640 1 -- 172.21.15.133:0/2834543295 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff41c00a4d0 con 0x561b7ebf1c80 2024-02-15T23:29:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ecea5e0 con 0x561b7ebf1c80 2024-02-15T23:29:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff423818640 1 -- 172.21.15.133:0/2834543295 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff41c00a4d0 con 0x561b7ebf1c80 2024-02-15T23:29:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ecea9f0 con 0x561b7ebf1c80 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff423818640 1 -- 172.21.15.133:0/2834543295 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff41c00a4d0 con 0x561b7ebf1c80 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 Processor -- start 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 -- start start 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ecf9af0 0x561b7ecf9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.483+0000 7ff4254fc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7ea93f20 con 0x561b7ecf9af0 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ecf9af0 0x561b7ecf9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ecf9af0 0x561b7ecf9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42340/0 (socket says 172.21.15.133:42340) 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 -- 172.21.15.133:0/344916346 learned_addr learned my addr 172.21.15.133:0/344916346 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 -- 172.21.15.133:0/344916346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b7ecfa450 con 0x561b7ecf9af0 2024-02-15T23:29:50.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 --2- 172.21.15.133:0/344916346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ecf9af0 0x561b7ecf9f10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff418001ee0 tx=0x7ff41800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff30d602640 1 -- 172.21.15.133:0/344916346 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff418007040 con 0x561b7ecf9af0 2024-02-15T23:29:50.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff4254fc980 1 -- 172.21.15.133:0/344916346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b7ecfa6a0 con 0x561b7ecf9af0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff30d602640 1 -- 172.21.15.133:0/344916346 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800d660 con 0x561b7ecf9af0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff30d602640 1 -- 172.21.15.133:0/344916346 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff41800d900 con 0x561b7ecf9af0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff4254fc980 1 -- 172.21.15.133:0/344916346 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b7ecfb1f0 con 0x561b7ecf9af0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff30d602640 1 -- 172.21.15.133:0/344916346 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff41801a070 con 0x561b7ecf9af0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff30d602640 1 --2- 172.21.15.133:0/344916346 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2fc0342b0 0x7ff2fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff30d602640 1 -- 172.21.15.133:0/344916346 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff418017050 con 0x561b7ecf9af0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff423818640 1 --2- 172.21.15.133:0/344916346 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2fc0342b0 0x7ff2fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff4254fc980 1 Processor -- start 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff4254fc980 1 -- start start 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff423818640 1 --2- 172.21.15.133:0/344916346 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2fc0342b0 0x7ff2fc036770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x561b7ecea020 tx=0x7ff41c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff4254fc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed06e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff4254fc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7ea87790 con 0x561b7ed06a70 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed06e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed06e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42350/0 (socket says 172.21.15.133:42350) 2024-02-15T23:29:50.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 -- 172.21.15.133:0/2515109334 learned_addr learned my addr 172.21.15.133:0/2515109334 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.487+0000 7ff422816640 1 -- 172.21.15.133:0/2515109334 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b7ed07420 con 0x561b7ed06a70 2024-02-15T23:29:50.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff422816640 1 --2- 172.21.15.133:0/2515109334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed06e50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff418027030 tx=0x7ff41800df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d15cac58f1cdf8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff306ffd640 1 -- 172.21.15.133:0/2515109334 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff418039440 con 0x561b7ed06a70 2024-02-15T23:29:50.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff306ffd640 1 -- 172.21.15.133:0/2515109334 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180395c0 con 0x561b7ed06a70 2024-02-15T23:29:50.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff306ffd640 1 -- 172.21.15.133:0/2515109334 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff41803ac80 con 0x561b7ed06a70 2024-02-15T23:29:50.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- 172.21.15.133:0/2515109334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 msgr2=0x561b7ed06e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2515109334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed06e50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff418027030 tx=0x7ff41800df20 comp rx=0 tx=0).stop 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- 172.21.15.133:0/2515109334 shutdown_connections 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2515109334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed06e50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- 172.21.15.133:0/2515109334 >> 172.21.15.133:0/2515109334 conn(0x561b7ed02db0 msgr2=0x561b7ed00e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- 172.21.15.133:0/2515109334 shutdown_connections 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- 172.21.15.133:0/2515109334 wait complete. 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 Processor -- start 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- start start 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed0d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7ed0de20 con 0x561b7ed06a70 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff422816640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed0d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff422816640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed0d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42358/0 (socket says 172.21.15.133:42358) 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 learned_addr learned my addr 172.21.15.133:0/871855761 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b7ecfb1f0 con 0x561b7ed06a70 2024-02-15T23:29:50.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff422816640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed0d8e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff41800eea0 tx=0x7ff418048b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff3057fa640 1 -- 172.21.15.133:0/871855761 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff41801a6f0 con 0x561b7ed06a70 2024-02-15T23:29:50.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b7ed0e020 con 0x561b7ed06a70 2024-02-15T23:29:50.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff3057fa640 1 -- 172.21.15.133:0/871855761 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41801a850 con 0x561b7ed06a70 2024-02-15T23:29:50.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b7ed0e450 con 0x561b7ed06a70 2024-02-15T23:29:50.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.491+0000 7ff3057fa640 1 -- 172.21.15.133:0/871855761 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff41804aa70 con 0x561b7ed06a70 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff3057fa640 1 -- 172.21.15.133:0/871855761 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff41804abd0 con 0x561b7ed06a70 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff3057fa640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2ec0342b0 0x7ff2ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff3057fa640 1 -- 172.21.15.133:0/871855761 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff418049170 con 0x561b7ed06a70 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423818640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2ec0342b0 0x7ff2ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ed18ea0 0x561b7ed1b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1ba90 con 0x561b7ed18ea0 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423017640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ed18ea0 0x561b7ed1b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423818640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2ec0342b0 0x7ff2ec036770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff41c011010 tx=0x7ff41c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423017640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ed18ea0 0x561b7ed1b340 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 realm 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1be80 con 0x561b7ed18ea0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1c6d0 con 0x561b7ed18ea0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1ca30 con 0x561b7ed18ea0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1d230 con 0x561b7ed18ea0 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 20 searching for the correct realm 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x561b7ed1f140 0x561b7ed215d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff422816640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x561b7ed1f140 0x561b7ed215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff422816640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x561b7ed1f140 0x561b7ed215d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff422816640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff418027060 0x7ff41803a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff418027060 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423818640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff418027060 0x7ff41803a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423818640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff418027060 0x7ff41803a470 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.495+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff41c00a4d0 con 0x7ff418027060 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423818640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff41c0141d0 0x7ff41c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff41c0141d0 0x7ff41c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff41c0141d0 0x7ff41c015940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140b0020 con 0x7ff41c0141d0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed18ea0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed18ea0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140b0020 con 0x7ff41c0141d0 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140b0020 con 0x7ff41c0141d0 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff418027060 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff41c00a4d0 con 0x7ff418027060 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.499+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed18ea0 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140b0020 con 0x7ff41c0141d0 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed18ea0 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff418027060 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140b0020 con 0x7ff41c0141d0 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed18ea0 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed18ea0 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff4140b0020 con 0x561b7ed18ea0 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.503+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff418027060 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed18ea0 2024-02-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff418027060 2024-02-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed1f140 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff41c0141d0 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.507+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x561b7ed18ea0 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed21c50 con 0x7ff418027060 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1db30 con 0x561b7ed18ea0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1e380 con 0x561b7ed18ea0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1e380 con 0x561b7ed18ea0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 zone default found 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 4 Realm: () 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 zonegroup default 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1e380 con 0x7ff41c0141d0 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed23a70 con 0x561b7ed1f140 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed23dd0 con 0x561b7ed1f140 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 started sync module instance, tier type = 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed1e190 con 0x7ff418027060 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94676091809456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed241c0 con 0x7ff418027060 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.511+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed249c0 con 0x561b7ed18ea0 2024-02-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.515+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94676091809456] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.515+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.515+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94676091814336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed24a80 con 0x561b7ed18ea0 2024-02-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.515+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed25280 con 0x561b7ed1f140 2024-02-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.515+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.515+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94676091816880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed25ad0 con 0x561b7ed1f140 2024-02-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.515+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed26480 con 0x7ff418027060 2024-02-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94676091814336] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94676091815392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed26830 con 0x7ff418027060 2024-02-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed271a0 con 0x561b7ed18ea0 2024-02-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94676091816880] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94676091815392] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94676091821984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed26d00 con 0x561b7ed18ea0 2024-02-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.519+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed27670 con 0x7ff41c0141d0 2024-02-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.523+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94676091821984] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.523+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.523+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94676091819568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed27670 con 0x7ff41c0141d0 2024-02-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.523+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed27ed0 con 0x7ff41c0141d0 2024-02-15T23:29:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.523+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.523+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94676091819568] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.523+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94676091827824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed28480 con 0x7ff41c0141d0 2024-02-15T23:29:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.523+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed271d0 con 0x7ff41c0141d0 2024-02-15T23:29:50.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94676091827824] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94676091830240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed28400 con 0x7ff41c0141d0 2024-02-15T23:29:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 20 add_watcher() i=0 2024-02-15T23:29:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 20 add_watcher() i=1 2024-02-15T23:29:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 20 add_watcher() i=2 2024-02-15T23:29:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 20 add_watcher() i=3 2024-02-15T23:29:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 20 add_watcher() i=4 2024-02-15T23:29:50.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 20 add_watcher() i=5 2024-02-15T23:29:50.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 20 add_watcher() i=6 2024-02-15T23:29:50.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94676091830240] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 20 add_watcher() i=7 2024-02-15T23:29:50.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:50.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed2be20 con 0x561b7ed18ea0 2024-02-15T23:29:50.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.527+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94676091832656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed29210 con 0x561b7ed18ea0 2024-02-15T23:29:50.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94676091832656] v31'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff2d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 5 note: GC not initialized 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff2d8fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 20 Filter name: none 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff2527fc640 20 reqs_thread_entry: start 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed4dbb0 con 0x561b7ed18ea0 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 20 rados_obj.operate() r=0 bl.length=461 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:50.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:50.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed536f0 con 0x561b7ed18ea0 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v31'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94676092007312 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed50410 con 0x561b7ed18ea0 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94676091821984 notify 133143986180 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7ff414103040 con 0x561b7ed18ea0 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94676091821984 notifier 4353 bl.length()=534 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff306ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff306ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff306ffd640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff2e8003ea0 con 0x561b7ed18ea0 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(64 notify.4 [notify cookie 94676092007312 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 94676092007312 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b7ece2f50 con 0x561b7ed18ea0 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.531+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 94676092007312 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed50410 con 0x561b7ed1f140 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== watch-notify(notify (1) cookie 94676091816880 notify 133143986177 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x561b7ed0e450 con 0x561b7ed1f140 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff3067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94676091816880 notifier 4353 bl.length()=170 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff3067fc640 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff2580032c0 con 0x561b7ed1f140 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(66 notify.2 [notify cookie 94676092007312 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== watch-notify(notify_complete (2) cookie 94676092007312 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b7ed0e020 con 0x561b7ed1f140 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed53390 con 0x7ff41c0141d0 2024-02-15T23:29:50.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v31'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.545 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:50.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff2d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.535+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94676091832656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed2e440 con 0x561b7ed18ea0 2024-02-15T23:29:50.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94676091832656] v31'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94676091809456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed2e440 con 0x7ff418027060 2024-02-15T23:29:50.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94676091809456] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff4254fc980 20 remove_watcher() i=0 2024-02-15T23:29:50.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff4254fc980 2 removed watcher, disabling cache 2024-02-15T23:29:50.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94676091814336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed22eb0 con 0x561b7ed18ea0 2024-02-15T23:29:50.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94676091814336] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff4254fc980 20 remove_watcher() i=1 2024-02-15T23:29:50.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.539+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94676091816880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed22eb0 con 0x561b7ed1f140 2024-02-15T23:29:50.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.543+0000 7ff422816640 1 -- 172.21.15.133:0/871855761 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94676091816880] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff418024900 con 0x561b7ed1f140 2024-02-15T23:29:50.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.543+0000 7ff4254fc980 20 remove_watcher() i=2 2024-02-15T23:29:50.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.543+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94676091815392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed24bb0 con 0x7ff418027060 2024-02-15T23:29:50.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.543+0000 7ff423818640 1 -- 172.21.15.133:0/871855761 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94676091815392] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff41c03a040 con 0x7ff418027060 2024-02-15T23:29:50.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.543+0000 7ff4254fc980 20 remove_watcher() i=3 2024-02-15T23:29:50.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.543+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94676091821984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed24660 con 0x561b7ed18ea0 2024-02-15T23:29:50.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.547+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94676091821984] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x561b7ed18ea0 2024-02-15T23:29:50.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.547+0000 7ff4254fc980 20 remove_watcher() i=4 2024-02-15T23:29:50.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.547+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94676091819568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed24660 con 0x7ff41c0141d0 2024-02-15T23:29:50.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.547+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94676091819568] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.547+0000 7ff4254fc980 20 remove_watcher() i=5 2024-02-15T23:29:50.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.547+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94676091827824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed24660 con 0x7ff41c0141d0 2024-02-15T23:29:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94676091827824] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 20 remove_watcher() i=6 2024-02-15T23:29:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94676091830240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b7ed24660 con 0x7ff41c0141d0 2024-02-15T23:29:50.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94676091830240] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4140fb040 con 0x7ff41c0141d0 2024-02-15T23:29:50.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 20 remove_watcher() i=7 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff41c0141d0 msgr2=0x7ff41c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff41c0141d0 0x7ff41c015940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ed18ea0 msgr2=0x561b7ed1b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ed18ea0 0x561b7ed1b340 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff418027060 msgr2=0x7ff41803a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff418027060 0x7ff41803a470 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x561b7ed1f140 msgr2=0x561b7ed215d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x561b7ed1f140 0x561b7ed215d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2ec0342b0 msgr2=0x7ff2ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2ec0342b0 0x7ff2ec036770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff41c011010 tx=0x7ff41c020000 comp rx=0 tx=0).stop 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 msgr2=0x561b7ed0d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed0d8e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff41800eea0 tx=0x7ff418048b70 comp rx=0 tx=0).stop 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff423017640 1 -- 172.21.15.133:0/871855761 reap_dead start 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 shutdown_connections 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/871855761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ed06a70 0x561b7ed0d8e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 >> 172.21.15.133:0/871855761 conn(0x561b7ed02db0 msgr2=0x561b7ed00410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 shutdown_connections 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/871855761 wait complete. 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/344916346 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2fc0342b0 msgr2=0x7ff2fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/344916346 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2fc0342b0 0x7ff2fc036770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x561b7ecea020 tx=0x7ff41c005850 comp rx=0 tx=0).stop 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/344916346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ecf9af0 msgr2=0x561b7ecf9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/344916346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ecf9af0 0x561b7ecf9f10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff418001ee0 tx=0x7ff41800ea10 comp rx=0 tx=0).stop 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/344916346 shutdown_connections 2024-02-15T23:29:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/344916346 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff2fc0342b0 0x7ff2fc036770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 --2- 172.21.15.133:0/344916346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ecf9af0 0x561b7ecf9f10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/344916346 >> 172.21.15.133:0/344916346 conn(0x561b7ecee900 msgr2=0x561b7ecef410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/344916346 shutdown_connections 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.551+0000 7ff4254fc980 1 -- 172.21.15.133:0/344916346 wait complete. 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ebf1c80 msgr2=0x561b7ece9270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ebf1c80 0x561b7ece9270 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff308034300 msgr2=0x7ff3080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff308034300 0x7ff3080367c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff418000f70 tx=0x7ff418001380 comp rx=0 tx=0).stop 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 msgr2=0x561b7ece25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ece25e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff41401b820 tx=0x7ff4140180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 shutdown_connections 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x561b7ebf1c80 0x561b7ece9270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff308034300 0x7ff3080367c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 --2- 172.21.15.133:0/2834543295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b7ebf1360 0x561b7ece25e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 >> 172.21.15.133:0/2834543295 conn(0x561b7eb64a50 msgr2=0x561b7ecd5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 shutdown_connections 2024-02-15T23:29:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.555+0000 7ff4254fc980 1 -- 172.21.15.133:0/2834543295 wait complete. 2024-02-15T23:29:50.571 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:50.571 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-15T23:29:50.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-15T23:29:50.571 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-02-15T23:29:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1f842980 1 Processor -- start 2024-02-15T23:29:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1f842980 1 -- start start 2024-02-15T23:29:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1f842980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ea38b31180 0x55ea38b31560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1f842980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ea38a7d4d0 con 0x55ea38b31aa0 2024-02-15T23:29:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1f842980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ea38a44180 con 0x55ea38b31180 2024-02-15T23:29:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1d35d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ea38b31180 0x55ea38b31560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1d35d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ea38b31180 0x55ea38b31560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42362/0 (socket says 172.21.15.133:42362) 2024-02-15T23:29:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1d35d640 1 -- 172.21.15.133:0/5213297 learned_addr learned my addr 172.21.15.133:0/5213297 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1d35d640 1 -- 172.21.15.133:0/5213297 >> v1:172.21.15.131:6789/0 conn(0x55ea38b31aa0 legacy=0x55ea38b32460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.639+0000 7f1a1d35d640 1 -- 172.21.15.133:0/5213297 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea38b32c90 con 0x55ea38b31180 2024-02-15T23:29:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a1d35d640 1 --2- 172.21.15.133:0/5213297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38b31560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000a5c0 tx=0x7f1a1001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1daad3cd009e19 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a17fff640 1 -- 172.21.15.133:0/5213297 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a100aa470 con 0x55ea38b31180 2024-02-15T23:29:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a17fff640 1 -- 172.21.15.133:0/5213297 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100aa5d0 con 0x55ea38b31180 2024-02-15T23:29:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a17fff640 1 -- 172.21.15.133:0/5213297 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a100aa890 con 0x55ea38b31180 2024-02-15T23:29:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a1f842980 1 -- 172.21.15.133:0/5213297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 msgr2=0x55ea38b31560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a1f842980 1 --2- 172.21.15.133:0/5213297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38b31560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000a5c0 tx=0x7f1a1001b340 comp rx=0 tx=0).stop 2024-02-15T23:29:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a1f842980 1 -- 172.21.15.133:0/5213297 shutdown_connections 2024-02-15T23:29:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a1f842980 1 --2- 172.21.15.133:0/5213297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38b31560 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a1f842980 1 -- 172.21.15.133:0/5213297 >> 172.21.15.133:0/5213297 conn(0x55ea38b2ca50 msgr2=0x55ea38b2ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a1f842980 1 -- 172.21.15.133:0/5213297 shutdown_connections 2024-02-15T23:29:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.643+0000 7f1a1f842980 1 -- 172.21.15.133:0/5213297 wait complete. 2024-02-15T23:29:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.655+0000 7f1a1f842980 1 Processor -- start 2024-02-15T23:29:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.655+0000 7f1a1f842980 1 -- start start 2024-02-15T23:29:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c1b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea38a416b0 con 0x55ea38b31180 2024-02-15T23:29:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c1b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c1b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42370/0 (socket says 172.21.15.133:42370) 2024-02-15T23:29:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2585093743 learned_addr learned my addr 172.21.15.133:0/2585093743 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2585093743 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10005df0 con 0x55ea38b31180 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 --2- 172.21.15.133:0/2585093743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c1b620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1a10018f70 tx=0x7f1a10003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48a61d46012793f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f190b606640 1 -- 172.21.15.133:0/2585093743 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a100aa9c0 con 0x55ea38b31180 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f190b606640 1 -- 172.21.15.133:0/2585093743 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100aab20 con 0x55ea38b31180 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f190b606640 1 -- 172.21.15.133:0/2585093743 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a100aadc0 con 0x55ea38b31180 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 -- 172.21.15.133:0/2585093743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 msgr2=0x55ea38c1b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2585093743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c1b620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1a10018f70 tx=0x7f1a10003030 comp rx=0 tx=0).stop 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 -- 172.21.15.133:0/2585093743 shutdown_connections 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2585093743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c1b620 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 -- 172.21.15.133:0/2585093743 >> 172.21.15.133:0/2585093743 conn(0x55ea38b2ca50 msgr2=0x55ea38c171b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 -- 172.21.15.133:0/2585093743 shutdown_connections 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 -- 172.21.15.133:0/2585093743 wait complete. 2024-02-15T23:29:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 Processor -- start 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 -- start start 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c22390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1f842980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea38a3ce90 con 0x55ea38b31180 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c22390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c22390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42384/0 (socket says 172.21.15.133:42384) 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2255389313 learned_addr learned my addr 172.21.15.133:0/2255389313 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2255389313 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea38b32c90 con 0x55ea38b31180 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.659+0000 7f1a1d35d640 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c22390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1a10000c10 tx=0x7f1a100180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1909e03640 1 -- 172.21.15.133:0/2255389313 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a100c6650 con 0x55ea38b31180 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ea38c228d0 con 0x55ea38b31180 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1909e03640 1 -- 172.21.15.133:0/2255389313 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100c67b0 con 0x55ea38b31180 2024-02-15T23:29:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1909e03640 1 -- 172.21.15.133:0/2255389313 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a100c6a50 con 0x55ea38b31180 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea38c22d20 con 0x55ea38b31180 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1909e03640 1 -- 172.21.15.133:0/2255389313 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a100c6bb0 con 0x55ea38b31180 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1909e03640 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1904034300 0x7f19040367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1909e03640 1 -- 172.21.15.133:0/2255389313 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1a100e4c00 con 0x55ea38b31180 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1cb5c640 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1904034300 0x7f19040367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38b31aa0 0x55ea38c29020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c29560 con 0x55ea38b31aa0 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38b31aa0 0x55ea38c29020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1cb5c640 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1904034300 0x7f19040367c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a08001e20 tx=0x7f1a080013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38b31aa0 0x55ea38c29020 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2255389313 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a1800a4d0 con 0x55ea38b31aa0 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c26770 con 0x55ea38b31aa0 2024-02-15T23:29:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2255389313 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a1800a4d0 con 0x55ea38b31aa0 2024-02-15T23:29:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c2b290 con 0x55ea38b31aa0 2024-02-15T23:29:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2255389313 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1a1800a4d0 con 0x55ea38b31aa0 2024-02-15T23:29:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c2a490 con 0x55ea38b31aa0 2024-02-15T23:29:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2255389313 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a1800a4d0 con 0x55ea38b31aa0 2024-02-15T23:29:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c2a8a0 con 0x55ea38b31aa0 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.663+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2255389313 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1a1800a4d0 con 0x55ea38b31aa0 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 Processor -- start 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 -- start start 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c39930 0x55ea38c39d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea389d5f20 con 0x55ea38c39930 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1cb5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c39930 0x55ea38c39d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1cb5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c39930 0x55ea38c39d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42392/0 (socket says 172.21.15.133:42392) 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2652920535 learned_addr learned my addr 172.21.15.133:0/2652920535 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2652920535 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea38c3a290 con 0x55ea38c39930 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1cb5c640 1 --2- 172.21.15.133:0/2652920535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c39930 0x55ea38c39d50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1a08001780 tx=0x7f1a0800f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1902ffd640 1 -- 172.21.15.133:0/2652920535 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a0800e580 con 0x55ea38c39930 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 -- 172.21.15.133:0/2652920535 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ea38c3a4e0 con 0x55ea38c39930 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1902ffd640 1 -- 172.21.15.133:0/2652920535 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0800e6e0 con 0x55ea38c39930 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1902ffd640 1 -- 172.21.15.133:0/2652920535 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a0800e980 con 0x55ea38c39930 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 -- 172.21.15.133:0/2652920535 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea38c3b030 con 0x55ea38c39930 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1902ffd640 1 -- 172.21.15.133:0/2652920535 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a0800eae0 con 0x55ea38c39930 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1902ffd640 1 --2- 172.21.15.133:0/2652920535 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18f40342b0 0x7f18f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1902ffd640 1 -- 172.21.15.133:0/2652920535 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1a08018040 con 0x55ea38c39930 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2652920535 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18f40342b0 0x7f18f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 Processor -- start 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 -- start start 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2652920535 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18f40342b0 0x7f18f4036770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55ea38c29ed0 tx=0x7f1a18005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c46d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.667+0000 7f1a1f842980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea389c9790 con 0x55ea38c46940 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c46d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c46d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42398/0 (socket says 172.21.15.133:42398) 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/3533736692 learned_addr learned my addr 172.21.15.133:0/3533736692 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/3533736692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea38c47330 con 0x55ea38c46940 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 --2- 172.21.15.133:0/3533736692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c46d60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1a080494f0 tx=0x7f1a0801aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65762a78cc196db server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1900ff9640 1 -- 172.21.15.133:0/3533736692 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a08040070 con 0x55ea38c46940 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1900ff9640 1 -- 172.21.15.133:0/3533736692 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08048130 con 0x55ea38c46940 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1900ff9640 1 -- 172.21.15.133:0/3533736692 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a08023d90 con 0x55ea38c46940 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- 172.21.15.133:0/3533736692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 msgr2=0x55ea38c46d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 --2- 172.21.15.133:0/3533736692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c46d60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1a080494f0 tx=0x7f1a0801aa60 comp rx=0 tx=0).stop 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- 172.21.15.133:0/3533736692 shutdown_connections 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 --2- 172.21.15.133:0/3533736692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c46d60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- 172.21.15.133:0/3533736692 >> 172.21.15.133:0/3533736692 conn(0x55ea38c42cd0 msgr2=0x55ea38c40d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- 172.21.15.133:0/3533736692 shutdown_connections 2024-02-15T23:29:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- 172.21.15.133:0/3533736692 wait complete. 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 Processor -- start 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- start start 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c4d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea38c4ddf0 con 0x55ea38c46940 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c4d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c4d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42408/0 (socket says 172.21.15.133:42408) 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 learned_addr learned my addr 172.21.15.133:0/2745381528 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea38c3b030 con 0x55ea38c46940 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1cb5c640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c4d8b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1a0801aef0 tx=0x7f1a08049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f18f2ffd640 1 -- 172.21.15.133:0/2745381528 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a08040040 con 0x55ea38c46940 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ea38c4dff0 con 0x55ea38c46940 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f18f2ffd640 1 -- 172.21.15.133:0/2745381528 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0801c410 con 0x55ea38c46940 2024-02-15T23:29:50.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea38c4e420 con 0x55ea38c46940 2024-02-15T23:29:50.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.671+0000 7f18f2ffd640 1 -- 172.21.15.133:0/2745381528 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a0801a440 con 0x55ea38c46940 2024-02-15T23:29:50.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f18f2ffd640 1 -- 172.21.15.133:0/2745381528 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a0803b050 con 0x55ea38c46940 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f18f2ffd640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18e8034260 0x7f18e8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f18f2ffd640 1 -- 172.21.15.133:0/2745381528 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1a08031cd0 con 0x55ea38c46940 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18e8034260 0x7f18e8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38c58cc0 0x55ea38c5b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5b8d0 con 0x55ea38c58cc0 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1d35d640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38c58cc0 0x55ea38c5b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18e8034260 0x7f18e8036720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a18011010 tx=0x7f1a18020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1d35d640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38c58cc0 0x55ea38c5b180 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 realm 2024-02-15T23:29:50.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5bca0 con 0x55ea38c58cc0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5c4f0 con 0x55ea38c58cc0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5c850 con 0x55ea38c58cc0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5d050 con 0x55ea38c58cc0 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 20 searching for the correct realm 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ea38c5ef10 0x55ea38c61390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c61a10 con 0x55ea38c5ef10 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1cb5c640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ea38c5ef10 0x55ea38c61390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1cb5c640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ea38c5ef10 0x55ea38c61390 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08036020 con 0x55ea38c5ef10 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1cb5c640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1a0801c030 0x7f1a08051440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.675+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c61a10 con 0x7f1a0801c030 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1a0801c030 0x7f1a08051440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1a0801c030 0x7f1a08051440 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a1800a4d0 con 0x7f1a0801c030 2024-02-15T23:29:50.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1db5e640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1a180141d0 0x7f1a18015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c61a10 con 0x7f1a180141d0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1a180141d0 0x7f1a18015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1a180141d0 0x7f1a18015940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a100cd070 con 0x7f1a180141d0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5d050 con 0x55ea38c58cc0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5d050 con 0x55ea38c58cc0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a180141d0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a100cd070 con 0x7f1a180141d0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a180141d0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a100cd070 con 0x7f1a180141d0 2024-02-15T23:29:50.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.679+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a0801c030 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a1800a4d0 con 0x7f1a0801c030 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c5ef10 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08036020 con 0x55ea38c5ef10 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c58cc0 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a180141d0 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a100cd070 con 0x7f1a180141d0 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c58cc0 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a0801c030 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c5ef10 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08036020 con 0x55ea38c5ef10 2024-02-15T23:29:50.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c5ef10 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08036020 con 0x55ea38c5ef10 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a180141d0 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a100cd070 con 0x7f1a180141d0 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c5ef10 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08036020 con 0x55ea38c5ef10 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c5ef10 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08036020 con 0x55ea38c5ef10 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c58cc0 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c58cc0 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1a100cd070 con 0x55ea38c58cc0 2024-02-15T23:29:50.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.683+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a180141d0 2024-02-15T23:29:50.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c5ef10 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08036020 con 0x55ea38c5ef10 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a0801c030 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c58cc0 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a180141d0 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c5ef10 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08065040 con 0x55ea38c5ef10 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a180141d0 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a0801c030 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c5ef10 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08065040 con 0x55ea38c5ef10 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.687+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a180141d0 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x55ea38c58cc0 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a100f1040 con 0x7f1a0801c030 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5d050 con 0x55ea38c58cc0 2024-02-15T23:29:50.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5d400 con 0x55ea38c58cc0 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5d7e0 con 0x55ea38c58cc0 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 zone default found 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 4 Realm: () 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:50.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 zonegroup default 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5dbd0 con 0x7f1a180141d0 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c5dbd0 con 0x55ea38c5ef10 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a08065040 con 0x55ea38c5ef10 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c63830 con 0x55ea38c5ef10 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a08065040 con 0x55ea38c5ef10 2024-02-15T23:29:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 started sync module instance, tier type = 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.691+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c62cc0 con 0x7f1a0801c030 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.695+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.695+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94464463218720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c63120 con 0x7f1a0801c030 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.695+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c64030 con 0x55ea38c58cc0 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.695+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94464463218720] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.695+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.695+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94464463219776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c64030 con 0x55ea38c58cc0 2024-02-15T23:29:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.695+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c649a0 con 0x55ea38c5ef10 2024-02-15T23:29:50.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a08065040 con 0x55ea38c5ef10 2024-02-15T23:29:50.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94464463226112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c651a0 con 0x55ea38c5ef10 2024-02-15T23:29:50.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c65b50 con 0x7f1a0801c030 2024-02-15T23:29:50.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94464463219776] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94464463223696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c65f00 con 0x7f1a0801c030 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c66870 con 0x55ea38c58cc0 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94464463226112] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a08065040 con 0x55ea38c5ef10 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94464463223696] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94464463230576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c663d0 con 0x55ea38c58cc0 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.699+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c670c0 con 0x7f1a180141d0 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.703+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94464463230576] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.703+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.703+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94464463228160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c66e20 con 0x7f1a180141d0 2024-02-15T23:29:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.703+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c67620 con 0x7f1a180141d0 2024-02-15T23:29:50.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.703+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.703+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94464463236912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c679b0 con 0x7f1a180141d0 2024-02-15T23:29:50.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.703+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c68480 con 0x7f1a180141d0 2024-02-15T23:29:50.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94464463228160] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94464463241056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c68440 con 0x7f1a180141d0 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 20 add_watcher() i=0 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 20 add_watcher() i=1 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 20 add_watcher() i=2 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 20 add_watcher() i=3 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 20 add_watcher() i=4 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 20 add_watcher() i=5 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94464463236912] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 20 add_watcher() i=6 2024-02-15T23:29:50.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94464463241056] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 20 add_watcher() i=7 2024-02-15T23:29:50.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:50.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c67450 con 0x55ea38c58cc0 2024-02-15T23:29:50.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.707+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94464463235456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c67410 con 0x55ea38c58cc0 2024-02-15T23:29:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94464463235456] v31'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f18d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 5 note: GC not initialized 2024-02-15T23:29:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f18d27e4640 20 reqs_thread_entry: start 2024-02-15T23:29:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 20 Filter name: none 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1843fff640 20 reqs_thread_entry: start 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c8d2e0 con 0x55ea38c58cc0 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c8d680 con 0x55ea38c58cc0 2024-02-15T23:29:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-02-15T23:29:50.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-15T23:29:50.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-02-15T23:29:50.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c92ee0 con 0x55ea38c58cc0 2024-02-15T23:29:50.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~515] v31'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:50.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:50.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94464463415744 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c8fb40 con 0x55ea38c58cc0 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== watch-notify(notify (1) cookie 94464463230576 notify 133143986181 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7f1a10109040 con 0x55ea38c58cc0 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1900ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94464463230576 notifier 4360 bl.length()=691 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1900ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1900ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(65 notify.4 [notify cookie 94464463415744 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1900ff9640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f18e0003ea0 con 0x55ea38c58cc0 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== watch-notify(notify_complete (2) cookie 94464463415744 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ea38c22d20 con 0x55ea38c58cc0 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.711+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c929c0 con 0x55ea38c58cc0 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1f842980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1f842980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1f842980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-15T23:29:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94464463415744 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c8fba0 con 0x7f1a0801c030 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== watch-notify(notify (1) cookie 94464463218720 notify 133143986178 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x7f1a180269c0 con 0x7f1a0801c030 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f18f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94464463218720 notifier 4360 bl.length()=166 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f18f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f18f3fff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f18f3fff640 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1850003400 con 0x7f1a0801c030 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(68 notify.0 [notify cookie 94464463415744 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== watch-notify(notify_complete (2) cookie 94464463415744 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1a18026c20 con 0x7f1a0801c030 2024-02-15T23:29:50.726 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"7MnBm6WdOfBU2Golhxp55gFZ7ZmyUxXqarnqgjYj","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:50.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f18d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94464463235456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c6db60 con 0x55ea38c58cc0 2024-02-15T23:29:50.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94464463235456] v31'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.715+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94464463218720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c66980 con 0x7f1a0801c030 2024-02-15T23:29:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.719+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94464463218720] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.719+0000 7f1a1f842980 20 remove_watcher() i=0 2024-02-15T23:29:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.719+0000 7f1a1f842980 2 removed watcher, disabling cache 2024-02-15T23:29:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.719+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94464463219776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c62820 con 0x55ea38c58cc0 2024-02-15T23:29:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.719+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94464463219776] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.719+0000 7f1a1f842980 20 remove_watcher() i=1 2024-02-15T23:29:50.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.719+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94464463226112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c62cc0 con 0x55ea38c5ef10 2024-02-15T23:29:50.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1cb5c640 1 -- 172.21.15.133:0/2745381528 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94464463226112] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a08065040 con 0x55ea38c5ef10 2024-02-15T23:29:50.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1f842980 20 remove_watcher() i=2 2024-02-15T23:29:50.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94464463223696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c64500 con 0x7f1a0801c030 2024-02-15T23:29:50.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1db5e640 1 -- 172.21.15.133:0/2745381528 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94464463223696] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a1803a040 con 0x7f1a0801c030 2024-02-15T23:29:50.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1f842980 20 remove_watcher() i=3 2024-02-15T23:29:50.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94464463230576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c64500 con 0x55ea38c58cc0 2024-02-15T23:29:50.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94464463230576] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x55ea38c58cc0 2024-02-15T23:29:50.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1f842980 20 remove_watcher() i=4 2024-02-15T23:29:50.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.723+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94464463228160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c65670 con 0x7f1a180141d0 2024-02-15T23:29:50.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.727+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94464463228160] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.727+0000 7f1a1f842980 20 remove_watcher() i=5 2024-02-15T23:29:50.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.727+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94464463236912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c64500 con 0x7f1a180141d0 2024-02-15T23:29:50.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.727+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94464463236912] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.727+0000 7f1a1f842980 20 remove_watcher() i=6 2024-02-15T23:29:50.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.727+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94464463241056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ea38c64d00 con 0x7f1a180141d0 2024-02-15T23:29:50.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94464463241056] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a10101040 con 0x7f1a180141d0 2024-02-15T23:29:50.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 20 remove_watcher() i=7 2024-02-15T23:29:50.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1a180141d0 msgr2=0x7f1a18015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1a180141d0 0x7f1a18015940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38c58cc0 msgr2=0x55ea38c5b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38c58cc0 0x55ea38c5b180 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1a0801c030 msgr2=0x7f1a08051440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1a0801c030 0x7f1a08051440 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ea38c5ef10 msgr2=0x55ea38c61390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ea38c5ef10 0x55ea38c61390 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18e8034260 msgr2=0x7f18e8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18e8034260 0x7f18e8036720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a18011010 tx=0x7f1a18020000 comp rx=0 tx=0).stop 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 msgr2=0x55ea38c4d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1d35d640 1 -- 172.21.15.133:0/2745381528 reap_dead start 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c4d8b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1a0801aef0 tx=0x7f1a08049450 comp rx=0 tx=0).stop 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 shutdown_connections 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2745381528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c46940 0x55ea38c4d8b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 >> 172.21.15.133:0/2745381528 conn(0x55ea38c42cd0 msgr2=0x55ea38c40330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 shutdown_connections 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2745381528 wait complete. 2024-02-15T23:29:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2652920535 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18f40342b0 msgr2=0x7f18f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2652920535 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18f40342b0 0x7f18f4036770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55ea38c29ed0 tx=0x7f1a18005850 comp rx=0 tx=0).stop 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2652920535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c39930 msgr2=0x55ea38c39d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2652920535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c39930 0x55ea38c39d50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1a08001780 tx=0x7f1a0800f7a0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2652920535 shutdown_connections 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2652920535 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f18f40342b0 0x7f18f4036770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2652920535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38c39930 0x55ea38c39d50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2652920535 >> 172.21.15.133:0/2652920535 conn(0x55ea38c2e740 msgr2=0x55ea38c2f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2652920535 shutdown_connections 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2652920535 wait complete. 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38b31aa0 msgr2=0x55ea38c29020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38b31aa0 0x55ea38c29020 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1904034300 msgr2=0x7f19040367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1904034300 0x7f19040367c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a08001e20 tx=0x7f1a080013a0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 msgr2=0x55ea38c22390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c22390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1a10000c10 tx=0x7f1a100180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 shutdown_connections 2024-02-15T23:29:50.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ea38b31aa0 0x55ea38c29020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1904034300 0x7f19040367c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 --2- 172.21.15.133:0/2255389313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea38b31180 0x55ea38c22390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 >> 172.21.15.133:0/2255389313 conn(0x55ea38b2ca50 msgr2=0x55ea38c15cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 shutdown_connections 2024-02-15T23:29:50.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.731+0000 7f1a1f842980 1 -- 172.21.15.133:0/2255389313 wait complete. 2024-02-15T23:29:50.749 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': '7MnBm6WdOfBU2Golhxp55gFZ7ZmyUxXqarnqgjYj', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:50.749 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-15T23:29:50.750 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-15T23:29:50.750 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-02-15T23:29:50.824 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:50.824 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.815+0000 7fec7adb5980 1 Processor -- start 2024-02-15T23:29:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.815+0000 7fec7adb5980 1 -- start start 2024-02-15T23:29:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.815+0000 7fec7adb5980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557c7f124110 0x557c7f1244f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.815+0000 7fec7adb5980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557c7f070460 con 0x557c7f124a30 2024-02-15T23:29:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.815+0000 7fec7adb5980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x557c7f037180 con 0x557c7f124110 2024-02-15T23:29:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.815+0000 7fec788d0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557c7f124110 0x557c7f1244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.815+0000 7fec788d0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557c7f124110 0x557c7f1244f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42422/0 (socket says 172.21.15.133:42422) 2024-02-15T23:29:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.815+0000 7fec788d0640 1 -- 172.21.15.133:0/3431861277 learned_addr learned my addr 172.21.15.133:0/3431861277 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec788d0640 1 -- 172.21.15.133:0/3431861277 >> v1:172.21.15.131:6789/0 conn(0x557c7f124a30 legacy=0x557c7f1253f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec788d0640 1 -- 172.21.15.133:0/3431861277 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7f125c20 con 0x557c7f124110 2024-02-15T23:29:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec788d0640 1 --2- 172.21.15.133:0/3431861277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f1244f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fec6800a4e0 tx=0x7fec6801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa6c085fabaa80a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec778ce640 1 -- 172.21.15.133:0/3431861277 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec680aa540 con 0x557c7f124110 2024-02-15T23:29:50.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec778ce640 1 -- 172.21.15.133:0/3431861277 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680a6070 con 0x557c7f124110 2024-02-15T23:29:50.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec778ce640 1 -- 172.21.15.133:0/3431861277 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec680aa850 con 0x557c7f124110 2024-02-15T23:29:50.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec7adb5980 1 -- 172.21.15.133:0/3431861277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 msgr2=0x557c7f1244f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec7adb5980 1 --2- 172.21.15.133:0/3431861277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f1244f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fec6800a4e0 tx=0x7fec6801b090 comp rx=0 tx=0).stop 2024-02-15T23:29:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec7adb5980 1 -- 172.21.15.133:0/3431861277 shutdown_connections 2024-02-15T23:29:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec7adb5980 1 --2- 172.21.15.133:0/3431861277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f1244f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec7adb5980 1 -- 172.21.15.133:0/3431861277 >> 172.21.15.133:0/3431861277 conn(0x557c7f11f9e0 msgr2=0x557c7f121e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec7adb5980 1 -- 172.21.15.133:0/3431861277 shutdown_connections 2024-02-15T23:29:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.819+0000 7fec7adb5980 1 -- 172.21.15.133:0/3431861277 wait complete. 2024-02-15T23:29:50.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.831+0000 7fec7adb5980 1 Processor -- start 2024-02-15T23:29:50.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.831+0000 7fec7adb5980 1 -- start start 2024-02-15T23:29:50.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f20e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7f0346b0 con 0x557c7f124110 2024-02-15T23:29:50.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f20e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f20e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42434/0 (socket says 172.21.15.133:42434) 2024-02-15T23:29:50.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 -- 172.21.15.133:0/1437583995 learned_addr learned my addr 172.21.15.133:0/1437583995 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 -- 172.21.15.133:0/1437583995 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6800a1c0 con 0x557c7f124110 2024-02-15T23:29:50.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 --2- 172.21.15.133:0/1437583995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f20e610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fec68017ca0 tx=0x7fec680033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f9a95eefd74f2d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7feb66e0d640 1 -- 172.21.15.133:0/1437583995 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec680aa780 con 0x557c7f124110 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7feb66e0d640 1 -- 172.21.15.133:0/1437583995 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680aa8e0 con 0x557c7f124110 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7feb66e0d640 1 -- 172.21.15.133:0/1437583995 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec680aab80 con 0x557c7f124110 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 -- 172.21.15.133:0/1437583995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 msgr2=0x557c7f20e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 --2- 172.21.15.133:0/1437583995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f20e610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fec68017ca0 tx=0x7fec680033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 -- 172.21.15.133:0/1437583995 shutdown_connections 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 --2- 172.21.15.133:0/1437583995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f20e610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 -- 172.21.15.133:0/1437583995 >> 172.21.15.133:0/1437583995 conn(0x557c7f11f9e0 msgr2=0x557c7f20a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 -- 172.21.15.133:0/1437583995 shutdown_connections 2024-02-15T23:29:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 -- 172.21.15.133:0/1437583995 wait complete. 2024-02-15T23:29:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 Processor -- start 2024-02-15T23:29:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 -- start start 2024-02-15T23:29:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f2153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec7adb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7f02fe90 con 0x557c7f124110 2024-02-15T23:29:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f2153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f2153c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42450/0 (socket says 172.21.15.133:42450) 2024-02-15T23:29:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 -- 172.21.15.133:0/226255383 learned_addr learned my addr 172.21.15.133:0/226255383 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 -- 172.21.15.133:0/226255383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7f125c20 con 0x557c7f124110 2024-02-15T23:29:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.835+0000 7fec788d0640 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f2153c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec6801aec0 tx=0x7fec68017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7feb6560a640 1 -- 172.21.15.133:0/226255383 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec680c4070 con 0x557c7f124110 2024-02-15T23:29:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c7f215900 con 0x557c7f124110 2024-02-15T23:29:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7feb6560a640 1 -- 172.21.15.133:0/226255383 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680b5650 con 0x557c7f124110 2024-02-15T23:29:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7feb6560a640 1 -- 172.21.15.133:0/226255383 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec680b5910 con 0x557c7f124110 2024-02-15T23:29:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c7f215d50 con 0x557c7f124110 2024-02-15T23:29:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7feb6560a640 1 -- 172.21.15.133:0/226255383 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fec680a8070 con 0x557c7f124110 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7feb6560a640 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb600342b0 0x7feb60036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7feb6560a640 1 -- 172.21.15.133:0/226255383 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fec680e3840 con 0x557c7f124110 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec780cf640 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb600342b0 0x7feb60036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec7adb5980 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f124a30 0x557c7f21c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f21c590 con 0x557c7f124a30 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec790d1640 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f124a30 0x557c7f21c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec780cf640 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb600342b0 0x7feb60036770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec6c001e20 tx=0x7fec6c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec790d1640 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f124a30 0x557c7f21c050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec790d1640 1 -- 172.21.15.133:0/226255383 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec700083f0 con 0x557c7f124a30 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f21c9a0 con 0x557c7f124a30 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec790d1640 1 -- 172.21.15.133:0/226255383 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fec700083f0 con 0x557c7f124a30 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f21e250 con 0x557c7f124a30 2024-02-15T23:29:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec790d1640 1 -- 172.21.15.133:0/226255383 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fec700083f0 con 0x557c7f124a30 2024-02-15T23:29:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f21d450 con 0x557c7f124a30 2024-02-15T23:29:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec790d1640 1 -- 172.21.15.133:0/226255383 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fec700083f0 con 0x557c7f124a30 2024-02-15T23:29:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f21d860 con 0x557c7f124a30 2024-02-15T23:29:50.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.839+0000 7fec790d1640 1 -- 172.21.15.133:0/226255383 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fec70012040 con 0x557c7f124a30 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 Processor -- start 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 -- start start 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f22c8f0 0x557c7f22cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7efc8f20 con 0x557c7f22c8f0 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec780cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f22c8f0 0x557c7f22cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec780cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f22c8f0 0x557c7f22cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42460/0 (socket says 172.21.15.133:42460) 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec780cf640 1 -- 172.21.15.133:0/771019037 learned_addr learned my addr 172.21.15.133:0/771019037 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec780cf640 1 -- 172.21.15.133:0/771019037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7f22d250 con 0x557c7f22c8f0 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec780cf640 1 --2- 172.21.15.133:0/771019037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f22c8f0 0x557c7f22cd10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fec6c001780 tx=0x7fec6c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7feb5e7fc640 1 -- 172.21.15.133:0/771019037 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c00e580 con 0x557c7f22c8f0 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 -- 172.21.15.133:0/771019037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c7f22d4a0 con 0x557c7f22c8f0 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7feb5e7fc640 1 -- 172.21.15.133:0/771019037 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c00e6e0 con 0x557c7f22c8f0 2024-02-15T23:29:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 -- 172.21.15.133:0/771019037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c7f22dff0 con 0x557c7f22c8f0 2024-02-15T23:29:50.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7feb5e7fc640 1 -- 172.21.15.133:0/771019037 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c00e980 con 0x557c7f22c8f0 2024-02-15T23:29:50.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7feb5e7fc640 1 -- 172.21.15.133:0/771019037 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fec6c00eae0 con 0x557c7f22c8f0 2024-02-15T23:29:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7feb5e7fc640 1 --2- 172.21.15.133:0/771019037 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb500342b0 0x7feb50036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7feb5e7fc640 1 -- 172.21.15.133:0/771019037 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fec6c018040 con 0x557c7f22c8f0 2024-02-15T23:29:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec790d1640 1 --2- 172.21.15.133:0/771019037 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb500342b0 0x7feb50036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 Processor -- start 2024-02-15T23:29:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 -- start start 2024-02-15T23:29:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec790d1640 1 --2- 172.21.15.133:0/771019037 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb500342b0 0x7feb50036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557c7f21ce90 tx=0x7fec70003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f239d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.843+0000 7fec7adb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7efbc790 con 0x557c7f239900 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f239d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f239d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42470/0 (socket says 172.21.15.133:42470) 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 -- 172.21.15.133:0/724254563 learned_addr learned my addr 172.21.15.133:0/724254563 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 -- 172.21.15.133:0/724254563 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7f23a2f0 con 0x557c7f239900 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 --2- 172.21.15.133:0/724254563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f239d20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0494f0 tx=0x7fec6c01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616dec1669972c8a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7feb4ffff640 1 -- 172.21.15.133:0/724254563 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c00ed90 con 0x557c7f239900 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7feb4ffff640 1 -- 172.21.15.133:0/724254563 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c01bbe0 con 0x557c7f239900 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7feb4ffff640 1 -- 172.21.15.133:0/724254563 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c023ec0 con 0x557c7f239900 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 -- 172.21.15.133:0/724254563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 msgr2=0x557c7f239d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 --2- 172.21.15.133:0/724254563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f239d20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0494f0 tx=0x7fec6c01aa60 comp rx=0 tx=0).stop 2024-02-15T23:29:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 -- 172.21.15.133:0/724254563 shutdown_connections 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 --2- 172.21.15.133:0/724254563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f239d20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 -- 172.21.15.133:0/724254563 >> 172.21.15.133:0/724254563 conn(0x557c7f235c90 msgr2=0x557c7f233cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 -- 172.21.15.133:0/724254563 shutdown_connections 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 -- 172.21.15.133:0/724254563 wait complete. 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 Processor -- start 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 -- start start 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f240870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7f240db0 con 0x557c7f239900 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f240870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f240870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42486/0 (socket says 172.21.15.133:42486) 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 learned_addr learned my addr 172.21.15.133:0/4103585168 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7f22dff0 con 0x557c7f239900 2024-02-15T23:29:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec780cf640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f240870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00fcc0 tx=0x7fec6c049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7feb4e7fc640 1 -- 172.21.15.133:0/4103585168 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c01c8c0 con 0x557c7f239900 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.847+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c7f240fb0 con 0x557c7f239900 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c7f241440 con 0x557c7f239900 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7feb4e7fc640 1 -- 172.21.15.133:0/4103585168 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c01a310 con 0x557c7f239900 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7feb4e7fc640 1 -- 172.21.15.133:0/4103585168 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c03b050 con 0x557c7f239900 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7feb4e7fc640 1 -- 172.21.15.133:0/4103585168 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fec6c024c60 con 0x557c7f239900 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7feb4e7fc640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb440342b0 0x7feb44036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7feb4e7fc640 1 -- 172.21.15.133:0/4103585168 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fec6c040020 con 0x557c7f239900 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec790d1640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb440342b0 0x7feb44036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f24bd30 0x557c7f24e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f24e920 con 0x557c7f24bd30 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec788d0640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f24bd30 0x557c7f24e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec790d1640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb440342b0 0x7feb44036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec70008fd0 tx=0x7fec7001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec788d0640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f24bd30 0x557c7f24e1d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec680d09f0 con 0x557c7f24bd30 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 realm 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f24ecf0 con 0x557c7f24bd30 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec680d09f0 con 0x557c7f24bd30 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f24f540 con 0x557c7f24bd30 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec680d09f0 con 0x557c7f24bd30 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f24f8a0 con 0x557c7f24bd30 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fec680d09f0 con 0x557c7f24bd30 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2500a0 con 0x557c7f24bd30 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fec680d09f0 con 0x557c7f24bd30 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 20 searching for the correct realm 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557c7f251f30 0x557c7f2543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec780cf640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557c7f251f30 0x557c7f2543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec780cf640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557c7f251f30 0x557c7f2543d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec780cf640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fec6c03a020 0x7fec6c04f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.851+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec6c03a020 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec790d1640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fec6c03a020 0x7fec6c04f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec790d1640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fec6c03a020 0x7fec6c04f410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec7002c040 con 0x7fec6c03a020 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec790d1640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fec70027940 0x7fec700333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fec70027940 0x7fec700333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fec70027940 0x7fec700333c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:50.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680d09f0 con 0x7fec70027940 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f24bd30 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fec680d09f0 con 0x557c7f24bd30 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f24bd30 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x557c7f24bd30 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x7fec70027940 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x7fec70027940 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.855+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec6c03a020 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec7002c040 con 0x7fec6c03a020 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f24bd30 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fec680de040 con 0x557c7f24bd30 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x7fec70027940 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f24bd30 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x557c7f24bd30 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec6c03a020 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fec7002c040 con 0x7fec6c03a020 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x7fec70027940 2024-02-15T23:29:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f24bd30 2024-02-15T23:29:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x557c7f24bd30 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.859+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f24bd30 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fec680de040 con 0x557c7f24bd30 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x7fec70027940 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec6c03a020 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec7002c040 con 0x7fec6c03a020 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f24bd30 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x557c7f24bd30 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x7fec70027940 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680de040 con 0x7fec70027940 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec6c03a020 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec7002c040 con 0x7fec6c03a020 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f251f30 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.863+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec70027940 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x557c7f24bd30 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f254a50 con 0x7fec6c03a020 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec7002c040 con 0x7fec6c03a020 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2509a0 con 0x557c7f24bd30 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2511f0 con 0x557c7f24bd30 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2511f0 con 0x557c7f24bd30 2024-02-15T23:29:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 zone default found 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 4 Realm: () 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 zonegroup default 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2511f0 con 0x7fec70027940 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2568c0 con 0x557c7f251f30 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f256c20 con 0x557c7f251f30 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 started sync module instance, tier type = 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.867+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2561a0 con 0x7fec6c03a020 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.871+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec7003f040 con 0x7fec6c03a020 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.871+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93993197460736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f256550 con 0x7fec6c03a020 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.871+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f257930 con 0x557c7f24bd30 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.871+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93993197460736] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec7003f040 con 0x7fec6c03a020 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.871+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.871+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93993197465584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2578b0 con 0x557c7f24bd30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.871+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f258380 con 0x557c7f251f30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93993197469280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f258bd0 con 0x557c7f251f30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f259580 con 0x7fec6c03a020 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93993197465584] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec7003f040 con 0x7fec6c03a020 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93993197466640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f259960 con 0x7fec6c03a020 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25a2d0 con 0x557c7f24bd30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93993197469280] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93993197466640] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec7003f040 con 0x7fec6c03a020 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93993197473952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f259e30 con 0x557c7f24bd30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.875+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25a6b0 con 0x7fec70027940 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.879+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93993197473952] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.879+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.879+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93993197471536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25a2d0 con 0x7fec70027940 2024-02-15T23:29:50.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.879+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25b070 con 0x7fec70027940 2024-02-15T23:29:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.879+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.879+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93993197480912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25b490 con 0x7fec70027940 2024-02-15T23:29:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.879+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25be60 con 0x7fec70027940 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.879+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93993197471536] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93993197480912] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93993197484384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25b030 con 0x7fec70027940 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec7adb5980 20 add_watcher() i=0 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec7adb5980 20 add_watcher() i=1 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec7adb5980 20 add_watcher() i=2 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec7adb5980 20 add_watcher() i=3 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec7adb5980 20 add_watcher() i=4 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec7adb5980 20 add_watcher() i=5 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.883+0000 7fec7adb5980 20 add_watcher() i=6 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93993197484384] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 20 add_watcher() i=7 2024-02-15T23:29:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25ef60 con 0x557c7f24bd30 2024-02-15T23:29:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93993197477424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f25c3d0 con 0x557c7f24bd30 2024-02-15T23:29:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93993197477424] v31'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7feb2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 5 note: GC not initialized 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7feb2dfe3640 20 reqs_thread_entry: start 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 20 Filter name: none 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fea9f7fe640 20 reqs_thread_entry: start 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f280cb0 con 0x557c7f24bd30 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.887+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2869f0 con 0x557c7f24bd30 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v31'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec7adb5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec7adb5980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec7adb5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93993197659280 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f282500 con 0x557c7f24bd30 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 93993197473952 notify 133143986182 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7fec680e7040 con 0x557c7f24bd30 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7feb4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 93993197473952 notifier 4367 bl.length()=691 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7feb4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7feb4ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(64 notify.4 [notify cookie 93993197659280 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7feb4ffff640 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7feb3c003ea0 con 0x557c7f24bd30 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 93993197659280 notify 133143986182 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557c7f215d50 con 0x557c7f24bd30 2024-02-15T23:29:50.902 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7feb2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93993197477424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f285560 con 0x557c7f24bd30 2024-02-15T23:29:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93993197477424] v31'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.891+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93993197460736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f259e30 con 0x7fec6c03a020 2024-02-15T23:29:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.895+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93993197460736] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec7003f040 con 0x7fec6c03a020 2024-02-15T23:29:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.895+0000 7fec7adb5980 20 remove_watcher() i=0 2024-02-15T23:29:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.895+0000 7fec7adb5980 2 removed watcher, disabling cache 2024-02-15T23:29:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.895+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93993197465584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f259e30 con 0x557c7f24bd30 2024-02-15T23:29:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.895+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93993197465584] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.895+0000 7fec7adb5980 20 remove_watcher() i=1 2024-02-15T23:29:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.895+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93993197469280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f256ff0 con 0x557c7f251f30 2024-02-15T23:29:50.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec780cf640 1 -- 172.21.15.133:0/4103585168 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93993197469280] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec6c04c070 con 0x557c7f251f30 2024-02-15T23:29:50.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec7adb5980 20 remove_watcher() i=2 2024-02-15T23:29:50.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93993197466640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f259e30 con 0x7fec6c03a020 2024-02-15T23:29:50.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec790d1640 1 -- 172.21.15.133:0/4103585168 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93993197466640] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec7003f040 con 0x7fec6c03a020 2024-02-15T23:29:50.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec7adb5980 20 remove_watcher() i=3 2024-02-15T23:29:50.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93993197473952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f259e30 con 0x557c7f24bd30 2024-02-15T23:29:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93993197473952] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x557c7f24bd30 2024-02-15T23:29:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec7adb5980 20 remove_watcher() i=4 2024-02-15T23:29:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.899+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93993197471536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2590a0 con 0x7fec70027940 2024-02-15T23:29:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.903+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93993197471536] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.903+0000 7fec7adb5980 20 remove_watcher() i=5 2024-02-15T23:29:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.903+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93993197480912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2590a0 con 0x7fec70027940 2024-02-15T23:29:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.903+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93993197480912] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.903+0000 7fec7adb5980 20 remove_watcher() i=6 2024-02-15T23:29:50.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.903+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93993197484384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557c7f2590a0 con 0x7fec70027940 2024-02-15T23:29:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93993197484384] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec680f2040 con 0x7fec70027940 2024-02-15T23:29:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 20 remove_watcher() i=7 2024-02-15T23:29:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fec70027940 msgr2=0x7fec700333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fec70027940 0x7fec700333c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f24bd30 msgr2=0x557c7f24e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f24bd30 0x557c7f24e1d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fec6c03a020 msgr2=0x7fec6c04f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fec6c03a020 0x7fec6c04f410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557c7f251f30 msgr2=0x557c7f2543d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557c7f251f30 0x557c7f2543d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb440342b0 msgr2=0x7feb44036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb440342b0 0x7feb44036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec70008fd0 tx=0x7fec7001c070 comp rx=0 tx=0).stop 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec788d0640 1 -- 172.21.15.133:0/4103585168 reap_dead start 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 msgr2=0x557c7f240870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f240870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00fcc0 tx=0x7fec6c049450 comp rx=0 tx=0).stop 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 shutdown_connections 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/4103585168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f239900 0x557c7f240870 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 >> 172.21.15.133:0/4103585168 conn(0x557c7f235c90 msgr2=0x557c7f2332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 shutdown_connections 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/4103585168 wait complete. 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/771019037 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb500342b0 msgr2=0x7feb50036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/771019037 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb500342b0 0x7feb50036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557c7f21ce90 tx=0x7fec70003070 comp rx=0 tx=0).stop 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/771019037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f22c8f0 msgr2=0x557c7f22cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/771019037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f22c8f0 0x557c7f22cd10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fec6c001780 tx=0x7fec6c00f7a0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/771019037 shutdown_connections 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/771019037 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb500342b0 0x7feb50036770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/771019037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f22c8f0 0x557c7f22cd10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/771019037 >> 172.21.15.133:0/771019037 conn(0x557c7f221700 msgr2=0x557c7f222210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/771019037 shutdown_connections 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/771019037 wait complete. 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f124a30 msgr2=0x557c7f21c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f124a30 0x557c7f21c050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb600342b0 msgr2=0x7feb60036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb600342b0 0x7feb60036770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec6c001e20 tx=0x7fec6c0013a0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 msgr2=0x557c7f2153c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f2153c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec6801aec0 tx=0x7fec68017e30 comp rx=0 tx=0).stop 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 shutdown_connections 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557c7f124a30 0x557c7f21c050 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feb600342b0 0x7feb60036770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 --2- 172.21.15.133:0/226255383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c7f124110 0x557c7f2153c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 >> 172.21.15.133:0/226255383 conn(0x557c7f11f9e0 msgr2=0x557c7f208cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 shutdown_connections 2024-02-15T23:29:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.907+0000 7fec7adb5980 1 -- 172.21.15.133:0/226255383 wait complete. 2024-02-15T23:29:50.926 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:50.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:29:50.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:29:50.927 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:29:51.001 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:51.001 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2ebc3980 1 Processor -- start 2024-02-15T23:29:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2ebc3980 1 -- start start 2024-02-15T23:29:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2ebc3980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5612b27ce850 0x5612b27d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2ebc3980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5612b27144c0 con 0x5612b27ca350 2024-02-15T23:29:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2ebc3980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5612b26db180 con 0x5612b27ce850 2024-02-15T23:29:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2bedd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5612b27ce850 0x5612b27d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2bedd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5612b27ce850 0x5612b27d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42498/0 (socket says 172.21.15.133:42498) 2024-02-15T23:29:51.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2bedd640 1 -- 172.21.15.133:0/1605572518 learned_addr learned my addr 172.21.15.133:0/1605572518 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2bedd640 1 -- 172.21.15.133:0/1605572518 >> v1:172.21.15.131:6789/0 conn(0x5612b27ca350 legacy=0x5612b27ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2bedd640 1 -- 172.21.15.133:0/1605572518 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612b27d2190 con 0x5612b27ce850 2024-02-15T23:29:51.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/1605572518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ce850 0x5612b27d0c40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000a5c0 tx=0x7f3d2001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ad9e43922d0358 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2b6dc640 1 -- 172.21.15.133:0/1605572518 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d200aa470 con 0x5612b27ce850 2024-02-15T23:29:51.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2b6dc640 1 -- 172.21.15.133:0/1605572518 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200aa5d0 con 0x5612b27ce850 2024-02-15T23:29:51.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.995+0000 7f3d2b6dc640 1 -- 172.21.15.133:0/1605572518 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d200aa890 con 0x5612b27ce850 2024-02-15T23:29:51.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.999+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/1605572518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ce850 msgr2=0x5612b27d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.999+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/1605572518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ce850 0x5612b27d0c40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000a5c0 tx=0x7f3d2001b340 comp rx=0 tx=0).stop 2024-02-15T23:29:51.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.999+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/1605572518 shutdown_connections 2024-02-15T23:29:51.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.999+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/1605572518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ce850 0x5612b27d0c40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.999+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/1605572518 >> 172.21.15.133:0/1605572518 conn(0x5612b273da40 msgr2=0x5612b273de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.999+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/1605572518 shutdown_connections 2024-02-15T23:29:51.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:50.999+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/1605572518 wait complete. 2024-02-15T23:29:51.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2ebc3980 1 Processor -- start 2024-02-15T23:29:51.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2ebc3980 1 -- start start 2024-02-15T23:29:51.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2ebc3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2ebc3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b26d86b0 con 0x5612b27ca350 2024-02-15T23:29:51.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2c6de640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2c6de640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42510/0 (socket says 172.21.15.133:42510) 2024-02-15T23:29:51.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2c6de640 1 -- 172.21.15.133:0/2560672978 learned_addr learned my addr 172.21.15.133:0/2560672978 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2c6de640 1 -- 172.21.15.133:0/2560672978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d20005df0 con 0x5612b27ca350 2024-02-15T23:29:51.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3d2c6de640 1 --2- 172.21.15.133:0/2560672978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28b4250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c001d10 tx=0x7f3d1c00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25e01ac0a0b3a0d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3c1a60c640 1 -- 172.21.15.133:0/2560672978 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1c014070 con 0x5612b27ca350 2024-02-15T23:29:51.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3c1a60c640 1 -- 172.21.15.133:0/2560672978 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00f560 con 0x5612b27ca350 2024-02-15T23:29:51.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.011+0000 7f3c1a60c640 1 -- 172.21.15.133:0/2560672978 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1c00f840 con 0x5612b27ca350 2024-02-15T23:29:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2560672978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 msgr2=0x5612b28b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2560672978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28b4250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c001d10 tx=0x7f3d1c00b5c0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2560672978 shutdown_connections 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2560672978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28b4250 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2560672978 >> 172.21.15.133:0/2560672978 conn(0x5612b273da40 msgr2=0x5612b28afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2560672978 shutdown_connections 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2560672978 wait complete. 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 Processor -- start 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- start start 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28bb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b26d3e90 con 0x5612b27ca350 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2c6de640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28bb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2c6de640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28bb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42514/0 (socket says 172.21.15.133:42514) 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2c6de640 1 -- 172.21.15.133:0/2290494439 learned_addr learned my addr 172.21.15.133:0/2290494439 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2c6de640 1 -- 172.21.15.133:0/2290494439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612b27144c0 con 0x5612b27ca350 2024-02-15T23:29:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2c6de640 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28bb0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5612b28b50e0 tx=0x7f3d1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3c18e09640 1 -- 172.21.15.133:0/2290494439 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1c014050 con 0x5612b27ca350 2024-02-15T23:29:51.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612b28bb600 con 0x5612b27ca350 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3c18e09640 1 -- 172.21.15.133:0/2290494439 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c001520 con 0x5612b27ca350 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612b28bbab0 con 0x5612b27ca350 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3c18e09640 1 -- 172.21.15.133:0/2290494439 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1c01bab0 con 0x5612b27ca350 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3c18e09640 1 -- 172.21.15.133:0/2290494439 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d1c022020 con 0x5612b27ca350 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3c18e09640 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c140342b0 0x7f3c14036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.015+0000 7f3c18e09640 1 -- 172.21.15.133:0/2290494439 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d1c049100 con 0x5612b27ca350 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c140342b0 0x7f3c14036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b27ce850 0x5612b28c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28c2270 con 0x5612b27ce850 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b27ce850 0x5612b28c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c140342b0 0x7f3c14036770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ae000 tx=0x7f3d200a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b27ce850 0x5612b28c1d30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2cedf640 1 -- 172.21.15.133:0/2290494439 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5612b27ce850 2024-02-15T23:29:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28bf450 con 0x5612b27ce850 2024-02-15T23:29:51.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2cedf640 1 -- 172.21.15.133:0/2290494439 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5612b27ce850 2024-02-15T23:29:51.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28c3ff0 con 0x5612b27ce850 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2cedf640 1 -- 172.21.15.133:0/2290494439 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5612b27ce850 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28c31f0 con 0x5612b27ce850 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2cedf640 1 -- 172.21.15.133:0/2290494439 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5612b27ce850 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28c3600 con 0x5612b27ce850 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2cedf640 1 -- 172.21.15.133:0/2290494439 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5612b27ce850 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 Processor -- start 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 -- start start 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28d2670 0x5612b28d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2ebc3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b266cf20 con 0x5612b28d2670 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2bedd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28d2670 0x5612b28d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2bedd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28d2670 0x5612b28d2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42524/0 (socket says 172.21.15.133:42524) 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2bedd640 1 -- 172.21.15.133:0/595474949 learned_addr learned my addr 172.21.15.133:0/595474949 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2bedd640 1 -- 172.21.15.133:0/595474949 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612b28d2fd0 con 0x5612b28d2670 2024-02-15T23:29:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.019+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/595474949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28d2670 0x5612b28d2a90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ac040 tx=0x7f3d200180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c11ffb640 1 -- 172.21.15.133:0/595474949 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d200b3cd0 con 0x5612b28d2670 2024-02-15T23:29:51.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c11ffb640 1 -- 172.21.15.133:0/595474949 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200c3070 con 0x5612b28d2670 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c11ffb640 1 -- 172.21.15.133:0/595474949 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d200c8430 con 0x5612b28d2670 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/595474949 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612b28d31c0 con 0x5612b28d2670 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/595474949 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612b28d3cb0 con 0x5612b28d2670 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c11ffb640 1 -- 172.21.15.133:0/595474949 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d200c5030 con 0x5612b28d2670 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c11ffb640 1 --2- 172.21.15.133:0/595474949 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c040342b0 0x7f3c04036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c11ffb640 1 -- 172.21.15.133:0/595474949 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d200e6850 con 0x5612b28d2670 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/595474949 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c040342b0 0x7f3c04036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2ebc3980 1 Processor -- start 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2ebc3980 1 -- start start 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/595474949 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c040342b0 0x7f3c04036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5612b28c2c30 tx=0x7f3d24005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2ebc3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28dfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2ebc3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b2660790 con 0x5612b28df6a0 2024-02-15T23:29:51.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2bedd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28dfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2bedd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28dfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42536/0 (socket says 172.21.15.133:42536) 2024-02-15T23:29:51.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2bedd640 1 -- 172.21.15.133:0/2293815411 learned_addr learned my addr 172.21.15.133:0/2293815411 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2bedd640 1 -- 172.21.15.133:0/2293815411 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612b28e0070 con 0x5612b28df6a0 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/2293815411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28dfaa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3d200befd0 tx=0x7f3d200bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbbf34991d54a9f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c037fe640 1 -- 172.21.15.133:0/2293815411 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d200d6040 con 0x5612b28df6a0 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c037fe640 1 -- 172.21.15.133:0/2293815411 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200d1e10 con 0x5612b28df6a0 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.023+0000 7f3c037fe640 1 -- 172.21.15.133:0/2293815411 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d200c7c50 con 0x5612b28df6a0 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2293815411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 msgr2=0x5612b28dfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2293815411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28dfaa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3d200befd0 tx=0x7f3d200bd450 comp rx=0 tx=0).stop 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2293815411 shutdown_connections 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2293815411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28dfaa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2293815411 >> 172.21.15.133:0/2293815411 conn(0x5612b28db9e0 msgr2=0x5612b28d9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2293815411 shutdown_connections 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2293815411 wait complete. 2024-02-15T23:29:51.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 Processor -- start 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- start start 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28e65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b28e6af0 con 0x5612b28df6a0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2bedd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28e65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2bedd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28e65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42538/0 (socket says 172.21.15.133:42538) 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 learned_addr learned my addr 172.21.15.133:0/977805340 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612b28d3cb0 con 0x5612b28df6a0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28e65b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3d200dd040 tx=0x7f3d200e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3c01ffb640 1 -- 172.21.15.133:0/977805340 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d200d6040 con 0x5612b28df6a0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612b28e6cf0 con 0x5612b28df6a0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612b28e6cf0 con 0x5612b28df6a0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3c01ffb640 1 -- 172.21.15.133:0/977805340 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200c7e20 con 0x5612b28df6a0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3c01ffb640 1 -- 172.21.15.133:0/977805340 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d200e6c60 con 0x5612b28df6a0 2024-02-15T23:29:51.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3c01ffb640 1 -- 172.21.15.133:0/977805340 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d200bdbe0 con 0x5612b28df6a0 2024-02-15T23:29:51.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3c01ffb640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bf4034300 0x7f3bf40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3c01ffb640 1 -- 172.21.15.133:0/977805340 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d200c10e0 con 0x5612b28df6a0 2024-02-15T23:29:51.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bf4034300 0x7f3bf40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b28f17c0 0x5612b28f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f43b0 con 0x5612b28f17c0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2c6de640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b28f17c0 0x5612b28f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.027+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bf4034300 0x7f3bf40367c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d24011010 tx=0x7f3d24020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2c6de640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b28f17c0 0x5612b28f3c60 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 realm 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f47d0 con 0x5612b28f17c0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f5020 con 0x5612b28f17c0 2024-02-15T23:29:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f5380 con 0x5612b28f17c0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 20 searching for the correct realm 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5612b28f75d0 0x5612b28f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fa0d0 con 0x5612b28f75d0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5612b28f75d0 0x5612b28f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5612b28f75d0 0x5612b28f9a00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2bedd640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3d20009040 0x7f3d200d5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fa0d0 con 0x7f3d20009040 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3d20009040 0x7f3d200d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3d20009040 0x7f3d200d5890 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x7f3d20009040 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2cedf640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3d240141d0 0x7f3d24015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fa0d0 con 0x7f3d240141d0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2c6de640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3d240141d0 0x7f3d24015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.031+0000 7f3d2c6de640 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3d240141d0 0x7f3d24015940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d240141d0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d240141d0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d20009040 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x7f3d20009040 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f75d0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d240141d0 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d20009040 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f75d0 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f75d0 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.035+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d240141d0 2024-02-15T23:29:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f75d0 2024-02-15T23:29:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f75d0 2024-02-15T23:29:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d240141d0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f75d0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d20009040 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d240141d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f75d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.039+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d240141d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d20009040 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f75d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d240141d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x5612b28f17c0 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f4cc0 con 0x7f3d20009040 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f60b0 con 0x5612b28f17c0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f6460 con 0x5612b28f17c0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f6460 con 0x5612b28f17c0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 zone default found 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 4 Realm: () 2024-02-15T23:29:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 zonegroup default 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f5d00 con 0x7f3d240141d0 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28f6d30 con 0x5612b28f75d0 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fbef0 con 0x5612b28f75d0 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 started sync module instance, tier type = 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.043+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fb7d0 con 0x7f3d20009040 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.047+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.047+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94638305162032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fbb80 con 0x7f3d20009040 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.047+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fcc00 con 0x5612b28f17c0 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.047+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94638305162032] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.047+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.047+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94638305166016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fcb80 con 0x5612b28f17c0 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.047+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fd630 con 0x5612b28f75d0 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94638305166016] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94638305167072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fcb00 con 0x5612b28f75d0 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fe350 con 0x7f3d20009040 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94638305173472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28feba0 con 0x7f3d20009040 2024-02-15T23:29:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28ff580 con 0x5612b28f17c0 2024-02-15T23:29:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94638305167072] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.051+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94638305173472] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.055+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.055+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94638305171984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fe700 con 0x5612b28f17c0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.055+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28ffe00 con 0x7f3d240141d0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.055+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94638305171984] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.055+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.055+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94638305177760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fe700 con 0x7f3d240141d0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.055+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b29002e0 con 0x7f3d240141d0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.055+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94638305177760] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94638305181152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b29002a0 con 0x7f3d240141d0 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b2900c90 con 0x7f3d240141d0 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94638305183600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b29010f0 con 0x7f3d240141d0 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 20 add_watcher() i=0 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 20 add_watcher() i=1 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 20 add_watcher() i=2 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 20 add_watcher() i=3 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 20 add_watcher() i=4 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 20 add_watcher() i=5 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94638305181152] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.059+0000 7f3d2ebc3980 20 add_watcher() i=6 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94638305183600] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 20 add_watcher() i=7 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28ff7a0 con 0x5612b28f17c0 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94638305184848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28ff7a0 con 0x5612b28f17c0 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94638305184848] v31'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3be27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 5 note: GC not initialized 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3be17e2640 20 reqs_thread_entry: start 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 20 Filter name: none 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3b52ffd640 20 reqs_thread_entry: start 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b2925b50 con 0x5612b28f17c0 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.063+0000 7f3d2ebc3980 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T23:29:51.075 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.067+0000 7f3be27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.067+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94638305184848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b2906770 con 0x5612b28f17c0 2024-02-15T23:29:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.067+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94638305184848] v31'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.067+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94638305162032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b2900c50 con 0x7f3d20009040 2024-02-15T23:29:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.067+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94638305162032] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.067+0000 7f3d2ebc3980 20 remove_watcher() i=0 2024-02-15T23:29:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.067+0000 7f3d2ebc3980 2 removed watcher, disabling cache 2024-02-15T23:29:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.067+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94638305166016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fb330 con 0x5612b28f17c0 2024-02-15T23:29:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94638305166016] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2ebc3980 20 remove_watcher() i=1 2024-02-15T23:29:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94638305167072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fb330 con 0x5612b28f75d0 2024-02-15T23:29:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2bedd640 1 -- 172.21.15.133:0/977805340 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94638305167072] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d200ed070 con 0x5612b28f75d0 2024-02-15T23:29:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2ebc3980 20 remove_watcher() i=2 2024-02-15T23:29:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94638305173472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fc760 con 0x7f3d20009040 2024-02-15T23:29:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2cedf640 1 -- 172.21.15.133:0/977805340 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94638305173472] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2403a040 con 0x7f3d20009040 2024-02-15T23:29:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2ebc3980 20 remove_watcher() i=3 2024-02-15T23:29:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.071+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94638305171984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fc760 con 0x5612b28f17c0 2024-02-15T23:29:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.075+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94638305171984] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x5612b28f17c0 2024-02-15T23:29:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.075+0000 7f3d2ebc3980 20 remove_watcher() i=4 2024-02-15T23:29:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.075+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94638305177760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fc760 con 0x7f3d240141d0 2024-02-15T23:29:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.075+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94638305177760] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.075+0000 7f3d2ebc3980 20 remove_watcher() i=5 2024-02-15T23:29:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.075+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94638305181152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28fc760 con 0x7f3d240141d0 2024-02-15T23:29:51.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94638305181152] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 20 remove_watcher() i=6 2024-02-15T23:29:51.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94638305183600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5612b28ffde0 con 0x7f3d240141d0 2024-02-15T23:29:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94638305183600] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c016070 con 0x7f3d240141d0 2024-02-15T23:29:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 20 remove_watcher() i=7 2024-02-15T23:29:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3d240141d0 msgr2=0x7f3d24015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3d240141d0 0x7f3d24015940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b28f17c0 msgr2=0x5612b28f3c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b28f17c0 0x5612b28f3c60 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3d20009040 msgr2=0x7f3d200d5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3d20009040 0x7f3d200d5890 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5612b28f75d0 msgr2=0x5612b28f9a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5612b28f75d0 0x5612b28f9a00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bf4034300 msgr2=0x7f3bf40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bf4034300 0x7f3bf40367c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d24011010 tx=0x7f3d24020000 comp rx=0 tx=0).stop 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 msgr2=0x5612b28e65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28e65b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3d200dd040 tx=0x7f3d200e4b90 comp rx=0 tx=0).stop 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2c6de640 1 -- 172.21.15.133:0/977805340 reap_dead start 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 shutdown_connections 2024-02-15T23:29:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/977805340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28df6a0 0x5612b28e65b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 >> 172.21.15.133:0/977805340 conn(0x5612b28db9e0 msgr2=0x5612b28d9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 shutdown_connections 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.079+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/977805340 wait complete. 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/595474949 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c040342b0 msgr2=0x7f3c04036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/595474949 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c040342b0 0x7f3c04036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5612b28c2c30 tx=0x7f3d24005850 comp rx=0 tx=0).stop 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/595474949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28d2670 msgr2=0x5612b28d2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/595474949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28d2670 0x5612b28d2a90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ac040 tx=0x7f3d200180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/595474949 shutdown_connections 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/595474949 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c040342b0 0x7f3c04036770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/595474949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b28d2670 0x5612b28d2a90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/595474949 >> 172.21.15.133:0/595474949 conn(0x5612b28c7480 msgr2=0x5612b28c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/595474949 shutdown_connections 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/595474949 wait complete. 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b27ce850 msgr2=0x5612b28c1d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b27ce850 0x5612b28c1d30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c140342b0 msgr2=0x7f3c14036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c140342b0 0x7f3c14036770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ae000 tx=0x7f3d200a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 msgr2=0x5612b28bb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28bb0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5612b28b50e0 tx=0x7f3d1c000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 shutdown_connections 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5612b27ce850 0x5612b28c1d30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3c140342b0 0x7f3c14036770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 --2- 172.21.15.133:0/2290494439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612b27ca350 0x5612b28bb0c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 >> 172.21.15.133:0/2290494439 conn(0x5612b273da40 msgr2=0x5612b28ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 shutdown_connections 2024-02-15T23:29:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.083+0000 7f3d2ebc3980 1 -- 172.21.15.133:0/2290494439 wait complete. 2024-02-15T23:29:51.100 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:51.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:29:51.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:29:51.100 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:29:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cda3d980 1 Processor -- start 2024-02-15T23:29:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cda3d980 1 -- start start 2024-02-15T23:29:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cda3d980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5621e397c850 0x5621e397ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cda3d980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5621e38c24c0 con 0x5621e3978350 2024-02-15T23:29:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cda3d980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5621e3889180 con 0x5621e397c850 2024-02-15T23:29:51.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cad57640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5621e397c850 0x5621e397ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cad57640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5621e397c850 0x5621e397ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42554/0 (socket says 172.21.15.133:42554) 2024-02-15T23:29:51.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cad57640 1 -- 172.21.15.133:0/2087606955 learned_addr learned my addr 172.21.15.133:0/2087606955 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cad57640 1 -- 172.21.15.133:0/2087606955 >> v1:172.21.15.131:6789/0 conn(0x5621e3978350 legacy=0x5621e3978730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cad57640 1 -- 172.21.15.133:0/2087606955 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621e3980190 con 0x5621e397c850 2024-02-15T23:29:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89cad57640 1 --2- 172.21.15.133:0/2087606955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e397c850 0x5621e397ec40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f89c000a5c0 tx=0x7f89c001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ead9c46b554c32 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89ca556640 1 -- 172.21.15.133:0/2087606955 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89c00aa470 con 0x5621e397c850 2024-02-15T23:29:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89ca556640 1 -- 172.21.15.133:0/2087606955 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00aa5d0 con 0x5621e397c850 2024-02-15T23:29:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.163+0000 7f89ca556640 1 -- 172.21.15.133:0/2087606955 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89c00aa890 con 0x5621e397c850 2024-02-15T23:29:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.167+0000 7f89cda3d980 1 -- 172.21.15.133:0/2087606955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e397c850 msgr2=0x5621e397ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.167+0000 7f89cda3d980 1 --2- 172.21.15.133:0/2087606955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e397c850 0x5621e397ec40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f89c000a5c0 tx=0x7f89c001b340 comp rx=0 tx=0).stop 2024-02-15T23:29:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.167+0000 7f89cda3d980 1 -- 172.21.15.133:0/2087606955 shutdown_connections 2024-02-15T23:29:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.167+0000 7f89cda3d980 1 --2- 172.21.15.133:0/2087606955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e397c850 0x5621e397ec40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.167+0000 7f89cda3d980 1 -- 172.21.15.133:0/2087606955 >> 172.21.15.133:0/2087606955 conn(0x5621e38eba40 msgr2=0x5621e38ebe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.167+0000 7f89cda3d980 1 -- 172.21.15.133:0/2087606955 shutdown_connections 2024-02-15T23:29:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.167+0000 7f89cda3d980 1 -- 172.21.15.133:0/2087606955 wait complete. 2024-02-15T23:29:51.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 Processor -- start 2024-02-15T23:29:51.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 -- start start 2024-02-15T23:29:51.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a62250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e38866b0 con 0x5621e3978350 2024-02-15T23:29:51.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cb558640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a62250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cb558640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a62250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42558/0 (socket says 172.21.15.133:42558) 2024-02-15T23:29:51.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cb558640 1 -- 172.21.15.133:0/678036400 learned_addr learned my addr 172.21.15.133:0/678036400 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cb558640 1 -- 172.21.15.133:0/678036400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0005df0 con 0x5621e3978350 2024-02-15T23:29:51.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cb558640 1 --2- 172.21.15.133:0/678036400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a62250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89bc001d10 tx=0x7f89bc00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc37d9ea3cab6faa server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f88b960a640 1 -- 172.21.15.133:0/678036400 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89bc014070 con 0x5621e3978350 2024-02-15T23:29:51.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f88b960a640 1 -- 172.21.15.133:0/678036400 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc00f560 con 0x5621e3978350 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f88b960a640 1 -- 172.21.15.133:0/678036400 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89bc00f840 con 0x5621e3978350 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 -- 172.21.15.133:0/678036400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 msgr2=0x5621e3a62250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 --2- 172.21.15.133:0/678036400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a62250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89bc001d10 tx=0x7f89bc00b5c0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 -- 172.21.15.133:0/678036400 shutdown_connections 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 --2- 172.21.15.133:0/678036400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a62250 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 -- 172.21.15.133:0/678036400 >> 172.21.15.133:0/678036400 conn(0x5621e38eba40 msgr2=0x5621e3a5dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 -- 172.21.15.133:0/678036400 shutdown_connections 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 -- 172.21.15.133:0/678036400 wait complete. 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.179+0000 7f89cda3d980 1 Processor -- start 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cda3d980 1 -- start start 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cda3d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cda3d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e3881e90 con 0x5621e3978350 2024-02-15T23:29:51.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cb558640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cb558640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42562/0 (socket says 172.21.15.133:42562) 2024-02-15T23:29:51.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cb558640 1 -- 172.21.15.133:0/784304332 learned_addr learned my addr 172.21.15.133:0/784304332 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cb558640 1 -- 172.21.15.133:0/784304332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621e38c24c0 con 0x5621e3978350 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cb558640 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a690c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5621e3a630e0 tx=0x7f89bc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f88b7e07640 1 -- 172.21.15.133:0/784304332 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89bc014050 con 0x5621e3978350 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621e3a69600 con 0x5621e3978350 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f88b7e07640 1 -- 172.21.15.133:0/784304332 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc001520 con 0x5621e3978350 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f88b7e07640 1 -- 172.21.15.133:0/784304332 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89bc01bad0 con 0x5621e3978350 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621e3a69ab0 con 0x5621e3978350 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f88b7e07640 1 -- 172.21.15.133:0/784304332 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f89bc022020 con 0x5621e3978350 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f88b7e07640 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88b00342b0 0x7f88b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f88b7e07640 1 -- 172.21.15.133:0/784304332 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f89bc048d20 con 0x5621e3978350 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cad57640 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88b00342b0 0x7f88b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cda3d980 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e397c850 0x5621e3a6fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3a70270 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cbd59640 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e397c850 0x5621e3a6fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cad57640 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88b00342b0 0x7f88b0036770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89c00ae000 tx=0x7f89c00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cbd59640 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e397c850 0x5621e3a6fd30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cbd59640 1 -- 172.21.15.133:0/784304332 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f89c400a4d0 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.183+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3a6d440 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cbd59640 1 -- 172.21.15.133:0/784304332 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f89c400a4d0 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3a71f70 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cbd59640 1 -- 172.21.15.133:0/784304332 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f89c400a4d0 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3a71170 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cbd59640 1 -- 172.21.15.133:0/784304332 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f89c400a4d0 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3a71580 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cbd59640 1 -- 172.21.15.133:0/784304332 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f89c400a4d0 con 0x5621e397c850 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 Processor -- start 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 -- start start 2024-02-15T23:29:51.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a80610 0x5621e3a80a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e381af20 con 0x5621e3a80610 2024-02-15T23:29:51.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cad57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a80610 0x5621e3a80a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cad57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a80610 0x5621e3a80a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42578/0 (socket says 172.21.15.133:42578) 2024-02-15T23:29:51.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cad57640 1 -- 172.21.15.133:0/1980762509 learned_addr learned my addr 172.21.15.133:0/1980762509 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cad57640 1 -- 172.21.15.133:0/1980762509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621e3a80f70 con 0x5621e3a80610 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cad57640 1 --2- 172.21.15.133:0/1980762509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a80610 0x5621e3a80a30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f89c00ac040 tx=0x7f89c00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f88b5602640 1 -- 172.21.15.133:0/1980762509 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89c00b3cd0 con 0x5621e3a80610 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f88b5602640 1 -- 172.21.15.133:0/1980762509 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00c3070 con 0x5621e3a80610 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 -- 172.21.15.133:0/1980762509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621e3a81160 con 0x5621e3a80610 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f88b5602640 1 -- 172.21.15.133:0/1980762509 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89c00c8430 con 0x5621e3a80610 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.187+0000 7f89cda3d980 1 -- 172.21.15.133:0/1980762509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621e3a81c50 con 0x5621e3a80610 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f88b5602640 1 -- 172.21.15.133:0/1980762509 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f89c00c5030 con 0x5621e3a80610 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f88b5602640 1 --2- 172.21.15.133:0/1980762509 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88a40342b0 0x7f88a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f88b5602640 1 -- 172.21.15.133:0/1980762509 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f89c00e67d0 con 0x5621e3a80610 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cbd59640 1 --2- 172.21.15.133:0/1980762509 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88a40342b0 0x7f88a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 Processor -- start 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- start start 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cbd59640 1 --2- 172.21.15.133:0/1980762509 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88a40342b0 0x7f88a4036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5621e3a70bb0 tx=0x7f89c4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a8da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e380e790 con 0x5621e3a8d620 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cad57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a8da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cad57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a8da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42586/0 (socket says 172.21.15.133:42586) 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cad57640 1 -- 172.21.15.133:0/1058986165 learned_addr learned my addr 172.21.15.133:0/1058986165 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cad57640 1 -- 172.21.15.133:0/1058986165 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621e3a8dff0 con 0x5621e3a8d620 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cad57640 1 --2- 172.21.15.133:0/1058986165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a8da20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89c00befd0 tx=0x7f89c00bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990f51c7954922b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f88aeffd640 1 -- 172.21.15.133:0/1058986165 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89c00d6040 con 0x5621e3a8d620 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f88aeffd640 1 -- 172.21.15.133:0/1058986165 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00c7c50 con 0x5621e3a8d620 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f88aeffd640 1 -- 172.21.15.133:0/1058986165 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89c00c7590 con 0x5621e3a8d620 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- 172.21.15.133:0/1058986165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 msgr2=0x5621e3a8da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 --2- 172.21.15.133:0/1058986165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a8da20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89c00befd0 tx=0x7f89c00bd450 comp rx=0 tx=0).stop 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- 172.21.15.133:0/1058986165 shutdown_connections 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 --2- 172.21.15.133:0/1058986165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a8da20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- 172.21.15.133:0/1058986165 >> 172.21.15.133:0/1058986165 conn(0x5621e3a89960 msgr2=0x5621e3a879c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- 172.21.15.133:0/1058986165 shutdown_connections 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- 172.21.15.133:0/1058986165 wait complete. 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 Processor -- start 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- start start 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a94500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cda3d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e3a94a40 con 0x5621e3a8d620 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cad57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a94500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cad57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a94500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42602/0 (socket says 172.21.15.133:42602) 2024-02-15T23:29:51.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.191+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 learned_addr learned my addr 172.21.15.133:0/4018533950 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621e3a81c50 con 0x5621e3a8d620 2024-02-15T23:29:51.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cad57640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a94500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f89c00de040 tx=0x7f89c00e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f88ad7fa640 1 -- 172.21.15.133:0/4018533950 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89c00e6e70 con 0x5621e3a8d620 2024-02-15T23:29:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621e3a94c40 con 0x5621e3a8d620 2024-02-15T23:29:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621e3a94c40 con 0x5621e3a8d620 2024-02-15T23:29:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f88ad7fa640 1 -- 172.21.15.133:0/4018533950 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00ea070 con 0x5621e3a8d620 2024-02-15T23:29:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f88ad7fa640 1 -- 172.21.15.133:0/4018533950 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89c00bdb00 con 0x5621e3a8d620 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f88ad7fa640 1 -- 172.21.15.133:0/4018533950 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f89c00e2050 con 0x5621e3a8d620 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f88ad7fa640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88940342b0 0x7f8894036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f88ad7fa640 1 -- 172.21.15.133:0/4018533950 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f89c00ec070 con 0x5621e3a8d620 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cbd59640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88940342b0 0x7f8894036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e3a9f820 0x5621e3aa1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2410 con 0x5621e3a9f820 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cb558640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e3a9f820 0x5621e3aa1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cbd59640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88940342b0 0x7f8894036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f89c4011010 tx=0x7f89c4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cb558640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e3a9f820 0x5621e3aa1cc0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f89bc016070 con 0x5621e3a9f820 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 realm 2024-02-15T23:29:51.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa27e0 con 0x5621e3a9f820 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f89bc016070 con 0x5621e3a9f820 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa3030 con 0x5621e3a9f820 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f89bc016070 con 0x5621e3a9f820 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa3390 con 0x5621e3a9f820 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f89bc016070 con 0x5621e3a9f820 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f89bc016070 con 0x5621e3a9f820 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.195+0000 7f89cda3d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cda3d980 20 searching for the correct realm 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cda3d980 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5621e3aa55e0 0x5621e3aa7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa80e0 con 0x5621e3aa55e0 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cad57640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5621e3aa55e0 0x5621e3aa7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cad57640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5621e3aa55e0 0x5621e3aa7a10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c00b0020 con 0x5621e3aa55e0 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cad57640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f89c00db070 0x7f89c0006620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa80e0 con 0x7f89c00db070 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cbd59640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f89c00db070 0x7f89c0006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cbd59640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f89c00db070 0x7f89c0006620 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c400a4d0 con 0x7f89c00db070 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cbd59640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f89c40141d0 0x7f89c4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa80e0 con 0x7f89c40141d0 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cb558640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f89c40141d0 0x7f89c4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cb558640 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f89c40141d0 0x7f89c4015940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc016070 con 0x7f89c40141d0 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f89bc016070 con 0x5621e3a9f820 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.199+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c40141d0 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c40141d0 2024-02-15T23:29:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c00db070 2024-02-15T23:29:51.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c400a4d0 con 0x7f89c00db070 2024-02-15T23:29:51.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3aa55e0 2024-02-15T23:29:51.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c40141d0 2024-02-15T23:29:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c00db070 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3aa55e0 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3aa55e0 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.203+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c40141d0 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3aa55e0 2024-02-15T23:29:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3aa55e0 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c40141d0 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3aa55e0 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c00db070 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c40141d0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3aa55e0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.207+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c40141d0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c00db070 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3aa55e0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c40141d0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x5621e3a9f820 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa2cd0 con 0x7f89c00db070 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa40c0 con 0x5621e3a9f820 2024-02-15T23:29:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa4470 con 0x5621e3a9f820 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa4470 con 0x5621e3a9f820 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 zone default found 2024-02-15T23:29:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 4 Realm: () 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 zonegroup default 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa3d10 con 0x7f89c40141d0 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa4d40 con 0x5621e3aa55e0 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.211+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa9f00 con 0x5621e3aa55e0 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cda3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cda3d980 20 started sync module instance, tier type = 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cda3d980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa97e0 con 0x7f89c00db070 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94703553516352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa9b90 con 0x7f89c00db070 2024-02-15T23:29:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaac10 con 0x5621e3a9f820 2024-02-15T23:29:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94703553516352] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94703553520336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaab90 con 0x5621e3a9f820 2024-02-15T23:29:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.215+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aab5f0 con 0x5621e3aa55e0 2024-02-15T23:29:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94703553523984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aabe70 con 0x5621e3aa55e0 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aac860 con 0x7f89c00db070 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94703553520336] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94703553528640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aacc10 con 0x7f89c00db070 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aad580 con 0x5621e3a9f820 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94703553523984] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.219+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94703553528640] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.223+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.223+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94703553521392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aad0e0 con 0x5621e3a9f820 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.223+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aada50 con 0x7f89c40141d0 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.223+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94703553521392] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.223+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.223+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94703553526224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aada50 con 0x7f89c40141d0 2024-02-15T23:29:51.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.223+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aae3c0 con 0x7f89c40141d0 2024-02-15T23:29:51.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.223+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94703553526224] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94703553533904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aae3c0 con 0x7f89c40141d0 2024-02-15T23:29:51.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaed30 con 0x7f89c40141d0 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94703553533904] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94703553535776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaed30 con 0x7f89c40141d0 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 20 add_watcher() i=0 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 20 add_watcher() i=1 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 20 add_watcher() i=2 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 20 add_watcher() i=3 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 20 add_watcher() i=4 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 20 add_watcher() i=5 2024-02-15T23:29:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.227+0000 7f89cda3d980 20 add_watcher() i=6 2024-02-15T23:29:51.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94703553535776] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 20 add_watcher() i=7 2024-02-15T23:29:51.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:51.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3ab2150 con 0x5621e3a9f820 2024-02-15T23:29:51.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94703553538656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaf630 con 0x5621e3a9f820 2024-02-15T23:29:51.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94703553538656] v31'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f88827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 5 note: GC not initialized 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f88817e2640 20 reqs_thread_entry: start 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 20 Filter name: none 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f887a7fc640 20 reqs_thread_entry: start 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3ad3be0 con 0x5621e3a9f820 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T23:29:51.242 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:51.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f88827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.231+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94703553538656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3a99d80 con 0x5621e3a9f820 2024-02-15T23:29:51.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.235+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94703553538656] v31'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.235+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94703553516352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaea30 con 0x7f89c00db070 2024-02-15T23:29:51.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.235+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94703553516352] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.235+0000 7f89cda3d980 20 remove_watcher() i=0 2024-02-15T23:29:51.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.235+0000 7f89cda3d980 2 removed watcher, disabling cache 2024-02-15T23:29:51.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.235+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94703553520336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa9340 con 0x5621e3a9f820 2024-02-15T23:29:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94703553520336] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cda3d980 20 remove_watcher() i=1 2024-02-15T23:29:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94703553523984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aa9340 con 0x5621e3aa55e0 2024-02-15T23:29:51.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cad57640 1 -- 172.21.15.133:0/4018533950 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94703553523984] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c0103040 con 0x5621e3aa55e0 2024-02-15T23:29:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cda3d980 20 remove_watcher() i=2 2024-02-15T23:29:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94703553528640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaa2d0 con 0x7f89c00db070 2024-02-15T23:29:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cbd59640 1 -- 172.21.15.133:0/4018533950 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94703553528640] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89c403a040 con 0x7f89c00db070 2024-02-15T23:29:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cda3d980 20 remove_watcher() i=3 2024-02-15T23:29:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.239+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94703553521392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaa2d0 con 0x5621e3a9f820 2024-02-15T23:29:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.243+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94703553521392] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x5621e3a9f820 2024-02-15T23:29:51.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.243+0000 7f89cda3d980 20 remove_watcher() i=4 2024-02-15T23:29:51.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.243+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94703553526224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaa770 con 0x7f89c40141d0 2024-02-15T23:29:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.243+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94703553526224] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.243+0000 7f89cda3d980 20 remove_watcher() i=5 2024-02-15T23:29:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.243+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94703553533904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaa770 con 0x7f89c40141d0 2024-02-15T23:29:51.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94703553533904] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 20 remove_watcher() i=6 2024-02-15T23:29:51.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94703553535776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621e3aaa770 con 0x7f89c40141d0 2024-02-15T23:29:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94703553535776] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f89bc03c040 con 0x7f89c40141d0 2024-02-15T23:29:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 20 remove_watcher() i=7 2024-02-15T23:29:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f89c40141d0 msgr2=0x7f89c4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f89c40141d0 0x7f89c4015940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e3a9f820 msgr2=0x5621e3aa1cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e3a9f820 0x5621e3aa1cc0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f89c00db070 msgr2=0x7f89c0006620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f89c00db070 0x7f89c0006620 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5621e3aa55e0 msgr2=0x5621e3aa7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5621e3aa55e0 0x5621e3aa7a10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88940342b0 msgr2=0x7f8894036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88940342b0 0x7f8894036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f89c4011010 tx=0x7f89c4020000 comp rx=0 tx=0).stop 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 msgr2=0x5621e3a94500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/4018533950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a8d620 0x5621e3a94500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f89c00de040 tx=0x7f89c00e4b90 comp rx=0 tx=0).stop 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cb558640 1 -- 172.21.15.133:0/4018533950 reap_dead start 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 shutdown_connections 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 >> 172.21.15.133:0/4018533950 conn(0x5621e3a89960 msgr2=0x5621e3a86fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 shutdown_connections 2024-02-15T23:29:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/4018533950 wait complete. 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/1980762509 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88a40342b0 msgr2=0x7f88a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/1980762509 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88a40342b0 0x7f88a4036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5621e3a70bb0 tx=0x7f89c4005850 comp rx=0 tx=0).stop 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/1980762509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a80610 msgr2=0x5621e3a80a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/1980762509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a80610 0x5621e3a80a30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f89c00ac040 tx=0x7f89c00180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/1980762509 shutdown_connections 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/1980762509 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88a40342b0 0x7f88a4036770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/1980762509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3a80610 0x5621e3a80a30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/1980762509 >> 172.21.15.133:0/1980762509 conn(0x5621e3a75420 msgr2=0x5621e3a75f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/1980762509 shutdown_connections 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/1980762509 wait complete. 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e397c850 msgr2=0x5621e3a6fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e397c850 0x5621e3a6fd30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88b00342b0 msgr2=0x7f88b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88b00342b0 0x7f88b0036770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89c00ae000 tx=0x7f89c00a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 msgr2=0x5621e3a690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.247+0000 7f89cda3d980 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a690c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5621e3a630e0 tx=0x7f89bc000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.251+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 shutdown_connections 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.251+0000 7f89cda3d980 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5621e397c850 0x5621e3a6fd30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.251+0000 7f89cda3d980 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f88b00342b0 0x7f88b0036770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.251+0000 7f89cda3d980 1 --2- 172.21.15.133:0/784304332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621e3978350 0x5621e3a690c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.251+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 >> 172.21.15.133:0/784304332 conn(0x5621e38eba40 msgr2=0x5621e3a5c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.251+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 shutdown_connections 2024-02-15T23:29:51.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.251+0000 7f89cda3d980 1 -- 172.21.15.133:0/784304332 wait complete. 2024-02-15T23:29:51.267 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:51.267 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-15T23:29:51.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-15T23:29:51.267 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-02-15T23:29:51.343 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:51.343 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:51.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb6c42980 1 Processor -- start 2024-02-15T23:29:51.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb6c42980 1 -- start start 2024-02-15T23:29:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb6c42980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55d0a3b08110 0x55d0a3b084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb6c42980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d0a3a54460 con 0x55d0a3b08a30 2024-02-15T23:29:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb6c42980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d0a3a1b180 con 0x55d0a3b08110 2024-02-15T23:29:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb475d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55d0a3b08110 0x55d0a3b084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb475d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55d0a3b08110 0x55d0a3b084f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42610/0 (socket says 172.21.15.133:42610) 2024-02-15T23:29:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb475d640 1 -- 172.21.15.133:0/1179750778 learned_addr learned my addr 172.21.15.133:0/1179750778 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb475d640 1 -- 172.21.15.133:0/1179750778 >> v1:172.21.15.131:6789/0 conn(0x55d0a3b08a30 legacy=0x55d0a3b093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.335+0000 7fccb475d640 1 -- 172.21.15.133:0/1179750778 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a3b09c20 con 0x55d0a3b08110 2024-02-15T23:29:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb475d640 1 --2- 172.21.15.133:0/1179750778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3b084f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcca400a5c0 tx=0x7fcca401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e42aafb5cc47fe4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb375b640 1 -- 172.21.15.133:0/1179750778 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca40aa470 con 0x55d0a3b08110 2024-02-15T23:29:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb375b640 1 -- 172.21.15.133:0/1179750778 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca40aa5d0 con 0x55d0a3b08110 2024-02-15T23:29:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb375b640 1 -- 172.21.15.133:0/1179750778 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca40aa890 con 0x55d0a3b08110 2024-02-15T23:29:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb6c42980 1 -- 172.21.15.133:0/1179750778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 msgr2=0x55d0a3b084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb6c42980 1 --2- 172.21.15.133:0/1179750778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3b084f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcca400a5c0 tx=0x7fcca401b340 comp rx=0 tx=0).stop 2024-02-15T23:29:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb6c42980 1 -- 172.21.15.133:0/1179750778 shutdown_connections 2024-02-15T23:29:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb6c42980 1 --2- 172.21.15.133:0/1179750778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3b084f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb6c42980 1 -- 172.21.15.133:0/1179750778 >> 172.21.15.133:0/1179750778 conn(0x55d0a3b039e0 msgr2=0x55d0a3b05e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb6c42980 1 -- 172.21.15.133:0/1179750778 shutdown_connections 2024-02-15T23:29:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.339+0000 7fccb6c42980 1 -- 172.21.15.133:0/1179750778 wait complete. 2024-02-15T23:29:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 Processor -- start 2024-02-15T23:29:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- start start 2024-02-15T23:29:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a3a186b0 con 0x55d0a3b08110 2024-02-15T23:29:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb475d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb475d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42624/0 (socket says 172.21.15.133:42624) 2024-02-15T23:29:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb475d640 1 -- 172.21.15.133:0/3025530828 learned_addr learned my addr 172.21.15.133:0/3025530828 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb475d640 1 -- 172.21.15.133:0/3025530828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4005df0 con 0x55d0a3b08110 2024-02-15T23:29:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb475d640 1 --2- 172.21.15.133:0/3025530828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf0410 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ac040 tx=0x7fcca4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238611f7dff7589 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fcba260c640 1 -- 172.21.15.133:0/3025530828 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca40aa9b0 con 0x55d0a3b08110 2024-02-15T23:29:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fcba260c640 1 -- 172.21.15.133:0/3025530828 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca40aab30 con 0x55d0a3b08110 2024-02-15T23:29:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fcba260c640 1 -- 172.21.15.133:0/3025530828 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca40aae10 con 0x55d0a3b08110 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- 172.21.15.133:0/3025530828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 msgr2=0x55d0a3bf0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 --2- 172.21.15.133:0/3025530828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf0410 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ac040 tx=0x7fcca4003030 comp rx=0 tx=0).stop 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- 172.21.15.133:0/3025530828 shutdown_connections 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 --2- 172.21.15.133:0/3025530828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf0410 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- 172.21.15.133:0/3025530828 >> 172.21.15.133:0/3025530828 conn(0x55d0a3b039e0 msgr2=0x55d0a3bebfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- 172.21.15.133:0/3025530828 shutdown_connections 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- 172.21.15.133:0/3025530828 wait complete. 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 Processor -- start 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- start start 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb6c42980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a3a13e90 con 0x55d0a3b08110 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb475d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.355+0000 7fccb475d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42626/0 (socket says 172.21.15.133:42626) 2024-02-15T23:29:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb475d640 1 -- 172.21.15.133:0/26329229 learned_addr learned my addr 172.21.15.133:0/26329229 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb475d640 1 -- 172.21.15.133:0/26329229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a3b09c20 con 0x55d0a3b08110 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb475d640 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf7270 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcca401b820 tx=0x7fcca40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fcba0e09640 1 -- 172.21.15.133:0/26329229 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca40c6650 con 0x55d0a3b08110 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d0a3bf77b0 con 0x55d0a3b08110 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fcba0e09640 1 -- 172.21.15.133:0/26329229 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca40c67b0 con 0x55d0a3b08110 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fcba0e09640 1 -- 172.21.15.133:0/26329229 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca40c6a90 con 0x55d0a3b08110 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0a3bf7c60 con 0x55d0a3b08110 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fcba0e09640 1 -- 172.21.15.133:0/26329229 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcca40c6cc0 con 0x55d0a3b08110 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fcba0e09640 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb9c0342b0 0x7fcb9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fcba0e09640 1 -- 172.21.15.133:0/26329229 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcca40e4e50 con 0x55d0a3b08110 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb3f5c640 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb9c0342b0 0x7fcb9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb6c42980 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3b08a30 0x55d0a3bfde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3bfe3b0 con 0x55d0a3b08a30 2024-02-15T23:29:51.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3b08a30 0x55d0a3bfde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb3f5c640 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb9c0342b0 0x7fcb9c036770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f70 tx=0x7fcc9c001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3b08a30 0x55d0a3bfde70 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb4f5e640 1 -- 172.21.15.133:0/26329229 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fccac00a4d0 con 0x55d0a3b08a30 2024-02-15T23:29:51.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3bfe7c0 con 0x55d0a3b08a30 2024-02-15T23:29:51.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb4f5e640 1 -- 172.21.15.133:0/26329229 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fccac00a4d0 con 0x55d0a3b08a30 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c00070 con 0x55d0a3b08a30 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.359+0000 7fccb4f5e640 1 -- 172.21.15.133:0/26329229 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fccac00a4d0 con 0x55d0a3b08a30 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3bff1b0 con 0x55d0a3b08a30 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb4f5e640 1 -- 172.21.15.133:0/26329229 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fccac00a4d0 con 0x55d0a3b08a30 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3bff5c0 con 0x55d0a3b08a30 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb4f5e640 1 -- 172.21.15.133:0/26329229 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fccac00a4d0 con 0x55d0a3b08a30 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb6c42980 1 Processor -- start 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb6c42980 1 -- start start 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb6c42980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c0e730 0x55d0a3c0eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb6c42980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a39acf20 con 0x55d0a3c0e730 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb3f5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c0e730 0x55d0a3c0eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb3f5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c0e730 0x55d0a3c0eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42628/0 (socket says 172.21.15.133:42628) 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb3f5c640 1 -- 172.21.15.133:0/3878541207 learned_addr learned my addr 172.21.15.133:0/3878541207 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb3f5c640 1 -- 172.21.15.133:0/3878541207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a3c0f090 con 0x55d0a3c0e730 2024-02-15T23:29:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb3f5c640 1 --2- 172.21.15.133:0/3878541207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c0e730 0x55d0a3c0eb50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00f3d0 tx=0x7fcc9c00f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fcb99ffb640 1 -- 172.21.15.133:0/3878541207 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c00e6b0 con 0x55d0a3c0e730 2024-02-15T23:29:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb6c42980 1 -- 172.21.15.133:0/3878541207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d0a3c0f2e0 con 0x55d0a3c0e730 2024-02-15T23:29:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fcb99ffb640 1 -- 172.21.15.133:0/3878541207 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c00e810 con 0x55d0a3c0e730 2024-02-15T23:29:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fcb99ffb640 1 -- 172.21.15.133:0/3878541207 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c00ead0 con 0x55d0a3c0e730 2024-02-15T23:29:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb6c42980 1 -- 172.21.15.133:0/3878541207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0a3c0fe30 con 0x55d0a3c0e730 2024-02-15T23:29:51.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fcb99ffb640 1 -- 172.21.15.133:0/3878541207 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcc9c00ec80 con 0x55d0a3c0e730 2024-02-15T23:29:51.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fcb99ffb640 1 --2- 172.21.15.133:0/3878541207 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb8c0342b0 0x7fcb8c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fcb99ffb640 1 -- 172.21.15.133:0/3878541207 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcc9c018040 con 0x55d0a3c0e730 2024-02-15T23:29:51.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.363+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/3878541207 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb8c0342b0 0x7fcb8c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 Processor -- start 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- start start 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/3878541207 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb8c0342b0 0x7fcb8c036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55d0a3bfebf0 tx=0x7fccac005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c1bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a39a0790 con 0x55d0a3c1b730 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c1bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c1bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42638/0 (socket says 172.21.15.133:42638) 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 -- 172.21.15.133:0/2876611856 learned_addr learned my addr 172.21.15.133:0/2876611856 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 -- 172.21.15.133:0/2876611856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a3c1c100 con 0x55d0a3c1b730 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 --2- 172.21.15.133:0/2876611856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c1bb30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c001690 tx=0x7fcc9c01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c299557cb714c396 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fcb937fe640 1 -- 172.21.15.133:0/2876611856 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c0432b0 con 0x55d0a3c1b730 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fcb937fe640 1 -- 172.21.15.133:0/2876611856 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c023d90 con 0x55d0a3c1b730 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fcb937fe640 1 -- 172.21.15.133:0/2876611856 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c03b140 con 0x55d0a3c1b730 2024-02-15T23:29:51.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- 172.21.15.133:0/2876611856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 msgr2=0x55d0a3c1bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 --2- 172.21.15.133:0/2876611856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c1bb30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c001690 tx=0x7fcc9c01aa60 comp rx=0 tx=0).stop 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- 172.21.15.133:0/2876611856 shutdown_connections 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 --2- 172.21.15.133:0/2876611856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c1bb30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- 172.21.15.133:0/2876611856 >> 172.21.15.133:0/2876611856 conn(0x55d0a3c17a70 msgr2=0x55d0a3c15ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- 172.21.15.133:0/2876611856 shutdown_connections 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- 172.21.15.133:0/2876611856 wait complete. 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 Processor -- start 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- start start 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb6c42980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a3c22b10 con 0x55d0a3c1b730 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42644/0 (socket says 172.21.15.133:42644) 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 learned_addr learned my addr 172.21.15.133:0/4185129300 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a3c0fe30 con 0x55d0a3c1b730 2024-02-15T23:29:51.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.367+0000 7fccb3f5c640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c225d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c01ab30 tx=0x7fcc9c0494c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fcb91ffb640 1 -- 172.21.15.133:0/4185129300 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c01a440 con 0x55d0a3c1b730 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d0a3c22d10 con 0x55d0a3c1b730 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0a3c22d10 con 0x55d0a3c1b730 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fcb91ffb640 1 -- 172.21.15.133:0/4185129300 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c024c60 con 0x55d0a3c1b730 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fcb91ffb640 1 -- 172.21.15.133:0/4185129300 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c023530 con 0x55d0a3c1b730 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fcb91ffb640 1 -- 172.21.15.133:0/4185129300 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcc9c042040 con 0x55d0a3c1b730 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fcb91ffb640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb840342b0 0x7fcb84036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fcb91ffb640 1 -- 172.21.15.133:0/4185129300 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcc9c04fc70 con 0x55d0a3c1b730 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb840342b0 0x7fcb84036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3c2d8d0 0x55d0a3c2fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c304e0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb475d640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3c2d8d0 0x55d0a3c2fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb840342b0 0x7fcb84036770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fccac011010 tx=0x7fccac020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb475d640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3c2d8d0 0x55d0a3c2fd90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 realm 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c308d0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c31120 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c31480 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c31c80 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 20 searching for the correct realm 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d0a3c33b10 0x55d0a3c35fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb3f5c640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d0a3c33b10 0x55d0a3c35fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.371+0000 7fccb3f5c640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d0a3c33b10 0x55d0a3c35fb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb3f5c640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc9c01c030 0x7fcc9c04d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fcc9c01c030 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc9c01c030 0x7fcc9c04d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc9c01c030 0x7fcc9c04d820 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac00a4d0 con 0x7fcc9c01c030 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb4f5e640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fccac0141d0 0x7fccac015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fccac0141d0 0x7fccac015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fccac0141d0 0x7fccac015940 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40b0020 con 0x7fccac0141d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40b0020 con 0x7fccac0141d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.375+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40b0020 con 0x7fccac0141d0 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fcc9c01c030 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac00a4d0 con 0x7fcc9c01c030 2024-02-15T23:29:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40b0020 con 0x7fccac0141d0 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fcc9c01c030 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40b0020 con 0x7fccac0141d0 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.379+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcca40b0020 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fcc9c01c030 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fcc9c01c030 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c33b10 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.383+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fccac0141d0 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c36630 con 0x7fcc9c01c030 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c325b0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c32e00 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c32e00 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 zone default found 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 4 Realm: () 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 zonegroup default 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c32e00 con 0x7fccac0141d0 2024-02-15T23:29:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c38450 con 0x55d0a3c33b10 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c387b0 con 0x55d0a3c33b10 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcc9c034020 con 0x55d0a3c33b10 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 started sync module instance, tier type = 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.387+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c37d30 con 0x7fcc9c01c030 2024-02-15T23:29:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.391+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.391+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94354589055120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c37cb0 con 0x7fcc9c01c030 2024-02-15T23:29:51.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.391+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c394e0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.391+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94354589055120] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.391+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.391+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94354589060000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c37cb0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.391+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c39b80 con 0x55d0a3c33b10 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94354589060000] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc9c066040 con 0x55d0a3c33b10 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94354589062784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c39f30 con 0x55d0a3c33b10 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3a8a0 con 0x7fcc9c01c030 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94354589066544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3b0f0 con 0x7fcc9c01c030 2024-02-15T23:29:51.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3bae0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94354589062784] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc9c066040 con 0x55d0a3c33b10 2024-02-15T23:29:51.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.395+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94354589066544] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.399+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.399+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94354589070784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3ac50 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.399+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3c330 con 0x7fccac0141d0 2024-02-15T23:29:51.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.399+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.399+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94354589072608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3c5a0 con 0x7fccac0141d0 2024-02-15T23:29:51.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.399+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3cda0 con 0x7fccac0141d0 2024-02-15T23:29:51.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.399+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94354589070784] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.399+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94354589072608] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94354589073664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3c9c0 con 0x7fccac0141d0 2024-02-15T23:29:51.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3d1c0 con 0x7fccac0141d0 2024-02-15T23:29:51.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94354589076176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3d590 con 0x7fccac0141d0 2024-02-15T23:29:51.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 20 add_watcher() i=0 2024-02-15T23:29:51.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 20 add_watcher() i=1 2024-02-15T23:29:51.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 20 add_watcher() i=2 2024-02-15T23:29:51.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 20 add_watcher() i=3 2024-02-15T23:29:51.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 20 add_watcher() i=4 2024-02-15T23:29:51.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 20 add_watcher() i=5 2024-02-15T23:29:51.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94354589073664] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.403+0000 7fccb6c42980 20 add_watcher() i=6 2024-02-15T23:29:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94354589076176] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 add_watcher() i=7 2024-02-15T23:29:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3c570 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94354589074752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c3dac0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94354589074752] v31'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fcb6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 5 note: GC not initialized 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fcb697e2640 20 reqs_thread_entry: start 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 Filter name: none 2024-02-15T23:29:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fcadaffd640 20 reqs_thread_entry: start 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c624d0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c62d10 con 0x7fcc9c01c030 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-02-15T23:29:51.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-15T23:29:51.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-02-15T23:29:51.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~624 in=624b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c68590 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~624] v31'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.407+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94354589253648 in=812b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67120 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94354589070784 notify 133143986183 ret 0) v3 ==== 842+0+0 (crc 0 0 0) 0x7fcca4103040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fcb937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94354589070784 notifier 4388 bl.length()=800 2024-02-15T23:29:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fcb937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fcb937fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(65 notify.4 [notify cookie 94354589253648 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fcb937fe640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcb78003ea0 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 94354589253648 notify 133143986183 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d0a3bf7c60 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67510 con 0x7fcc9c01c030 2024-02-15T23:29:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb6c42980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb6c42980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb6c42980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94354589253648 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67510 con 0x7fcc9c01c030 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== watch-notify(notify (1) cookie 94354589055120 notify 133143986179 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x7fccac026bc0 con 0x7fcc9c01c030 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fcb92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94354589055120 notifier 4388 bl.length()=166 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fcb92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fcb92ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fcb92ffd640 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcae8003400 con 0x7fcc9c01c030 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(68 notify.0 [notify cookie 94354589253648 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.411+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== watch-notify(notify_complete (2) cookie 94354589253648 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fccac026e20 con 0x7fcc9c01c030 2024-02-15T23:29:51.423 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.415+0000 7fcb6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.415+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94354589074752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67510 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.415+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94354589074752] v31'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.415+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94354589055120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67510 con 0x7fcc9c01c030 2024-02-15T23:29:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.415+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94354589055120] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.415+0000 7fccb6c42980 20 remove_watcher() i=0 2024-02-15T23:29:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.415+0000 7fccb6c42980 2 removed watcher, disabling cache 2024-02-15T23:29:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.415+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94354589060000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67510 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94354589060000] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb6c42980 20 remove_watcher() i=1 2024-02-15T23:29:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94354589062784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67510 con 0x55d0a3c33b10 2024-02-15T23:29:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb3f5c640 1 -- 172.21.15.133:0/4185129300 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94354589062784] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc9c066040 con 0x55d0a3c33b10 2024-02-15T23:29:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb6c42980 20 remove_watcher() i=2 2024-02-15T23:29:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94354589066544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67120 con 0x7fcc9c01c030 2024-02-15T23:29:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb4f5e640 1 -- 172.21.15.133:0/4185129300 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94354589066544] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fccac03a040 con 0x7fcc9c01c030 2024-02-15T23:29:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb6c42980 20 remove_watcher() i=3 2024-02-15T23:29:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.419+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94354589070784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67120 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.423+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94354589070784] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x55d0a3c2d8d0 2024-02-15T23:29:51.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.423+0000 7fccb6c42980 20 remove_watcher() i=4 2024-02-15T23:29:51.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.423+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94354589072608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67120 con 0x7fccac0141d0 2024-02-15T23:29:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.423+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94354589072608] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.423+0000 7fccb6c42980 20 remove_watcher() i=5 2024-02-15T23:29:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.423+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94354589073664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67120 con 0x7fccac0141d0 2024-02-15T23:29:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.427+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94354589073664] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.427+0000 7fccb6c42980 20 remove_watcher() i=6 2024-02-15T23:29:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.427+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94354589076176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d0a3c67120 con 0x7fccac0141d0 2024-02-15T23:29:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.427+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94354589076176] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcca40fb040 con 0x7fccac0141d0 2024-02-15T23:29:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.427+0000 7fccb6c42980 20 remove_watcher() i=7 2024-02-15T23:29:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fccac0141d0 msgr2=0x7fccac015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fccac0141d0 0x7fccac015940 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3c2d8d0 msgr2=0x55d0a3c2fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3c2d8d0 0x55d0a3c2fd90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc9c01c030 msgr2=0x7fcc9c04d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc9c01c030 0x7fcc9c04d820 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d0a3c33b10 msgr2=0x55d0a3c35fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d0a3c33b10 0x55d0a3c35fb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb840342b0 msgr2=0x7fcb84036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb840342b0 0x7fcb84036770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fccac011010 tx=0x7fccac020000 comp rx=0 tx=0).stop 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb475d640 1 -- 172.21.15.133:0/4185129300 reap_dead start 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 msgr2=0x55d0a3c225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c225d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c01ab30 tx=0x7fcc9c0494c0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 shutdown_connections 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/4185129300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c1b730 0x55d0a3c225d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 >> 172.21.15.133:0/4185129300 conn(0x55d0a3c17a70 msgr2=0x55d0a3c150d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 shutdown_connections 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/4185129300 wait complete. 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/3878541207 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb8c0342b0 msgr2=0x7fcb8c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/3878541207 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb8c0342b0 0x7fcb8c036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55d0a3bfebf0 tx=0x7fccac005850 comp rx=0 tx=0).stop 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/3878541207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c0e730 msgr2=0x55d0a3c0eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/3878541207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c0e730 0x55d0a3c0eb50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00f3d0 tx=0x7fcc9c00f7d0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/3878541207 shutdown_connections 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/3878541207 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb8c0342b0 0x7fcb8c036770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/3878541207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3c0e730 0x55d0a3c0eb50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/3878541207 >> 172.21.15.133:0/3878541207 conn(0x55d0a3c03540 msgr2=0x55d0a3c04050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/3878541207 shutdown_connections 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/3878541207 wait complete. 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3b08a30 msgr2=0x55d0a3bfde70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3b08a30 0x55d0a3bfde70 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb9c0342b0 msgr2=0x7fcb9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb9c0342b0 0x7fcb9c036770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f70 tx=0x7fcc9c001420 comp rx=0 tx=0).stop 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 msgr2=0x55d0a3bf7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf7270 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcca401b820 tx=0x7fcca40180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 shutdown_connections 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d0a3b08a30 0x55d0a3bfde70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb9c0342b0 0x7fcb9c036770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 --2- 172.21.15.133:0/26329229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0a3b08110 0x55d0a3bf7270 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 >> 172.21.15.133:0/26329229 conn(0x55d0a3b039e0 msgr2=0x55d0a3beaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 shutdown_connections 2024-02-15T23:29:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.431+0000 7fccb6c42980 1 -- 172.21.15.133:0/26329229 wait complete. 2024-02-15T23:29:51.448 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:51.448 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:29:51.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:29:51.448 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:29:51.522 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:51.522 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:51.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c4ae2980 1 Processor -- start 2024-02-15T23:29:51.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c4ae2980 1 -- start start 2024-02-15T23:29:51.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c4ae2980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5593a832d0c0 0x5593a83be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c4ae2980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5593a83054c0 con 0x5593a83be700 2024-02-15T23:29:51.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c4ae2980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5593a82cc180 con 0x5593a832d0c0 2024-02-15T23:29:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c25fd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5593a832d0c0 0x5593a83be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c25fd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5593a832d0c0 0x5593a83be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42652/0 (socket says 172.21.15.133:42652) 2024-02-15T23:29:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c1dfc640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5593a83be700 0x5593a83c0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39836/0 (socket says 172.21.15.133:39836) 2024-02-15T23:29:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c25fd640 1 -- 172.21.15.133:0/2049321034 learned_addr learned my addr 172.21.15.133:0/2049321034 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c25fd640 1 -- 172.21.15.133:0/2049321034 >> v1:172.21.15.131:6789/0 conn(0x5593a83be700 legacy=0x5593a83c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.515+0000 7f88c25fd640 1 -- 172.21.15.133:0/2049321034 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593a83c3220 con 0x5593a832d0c0 2024-02-15T23:29:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c25fd640 1 --2- 172.21.15.133:0/2049321034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a83be1c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88b400a5c0 tx=0x7f88b401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d85a6562cc22181 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c15fb640 1 -- 172.21.15.133:0/2049321034 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b40aa470 con 0x5593a832d0c0 2024-02-15T23:29:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c15fb640 1 -- 172.21.15.133:0/2049321034 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40aa5d0 con 0x5593a832d0c0 2024-02-15T23:29:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c15fb640 1 -- 172.21.15.133:0/2049321034 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b40aa890 con 0x5593a832d0c0 2024-02-15T23:29:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2049321034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 msgr2=0x5593a83be1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/2049321034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a83be1c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88b400a5c0 tx=0x7f88b401b340 comp rx=0 tx=0).stop 2024-02-15T23:29:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2049321034 shutdown_connections 2024-02-15T23:29:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/2049321034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a83be1c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2049321034 >> 172.21.15.133:0/2049321034 conn(0x5593a83b38e0 msgr2=0x5593a83b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2049321034 shutdown_connections 2024-02-15T23:29:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.519+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2049321034 wait complete. 2024-02-15T23:29:51.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.531+0000 7f88c4ae2980 1 Processor -- start 2024-02-15T23:29:51.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.531+0000 7f88c4ae2980 1 -- start start 2024-02-15T23:29:51.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.531+0000 7f88c4ae2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.531+0000 7f88c4ae2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593a82c96b0 con 0x5593a832d0c0 2024-02-15T23:29:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.531+0000 7f88c25fd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.531+0000 7f88c25fd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84a52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42660/0 (socket says 172.21.15.133:42660) 2024-02-15T23:29:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.531+0000 7f88c25fd640 1 -- 172.21.15.133:0/1809359798 learned_addr learned my addr 172.21.15.133:0/1809359798 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.531+0000 7f88c25fd640 1 -- 172.21.15.133:0/1809359798 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4005df0 con 0x5593a832d0c0 2024-02-15T23:29:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c25fd640 1 --2- 172.21.15.133:0/1809359798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84a52a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f88b4018f70 tx=0x7f88b4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da3b4ba56ce0d77 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f87b0608640 1 -- 172.21.15.133:0/1809359798 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b40aa9c0 con 0x5593a832d0c0 2024-02-15T23:29:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f87b0608640 1 -- 172.21.15.133:0/1809359798 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40aab20 con 0x5593a832d0c0 2024-02-15T23:29:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f87b0608640 1 -- 172.21.15.133:0/1809359798 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b40aadc0 con 0x5593a832d0c0 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- 172.21.15.133:0/1809359798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 msgr2=0x5593a84a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/1809359798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84a52a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f88b4018f70 tx=0x7f88b4003030 comp rx=0 tx=0).stop 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- 172.21.15.133:0/1809359798 shutdown_connections 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/1809359798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84a52a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- 172.21.15.133:0/1809359798 >> 172.21.15.133:0/1809359798 conn(0x5593a83b38e0 msgr2=0x5593a84a0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- 172.21.15.133:0/1809359798 shutdown_connections 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- 172.21.15.133:0/1809359798 wait complete. 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 Processor -- start 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- start start 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593a82c4e90 con 0x5593a832d0c0 2024-02-15T23:29:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c25fd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c25fd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84abf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42670/0 (socket says 172.21.15.133:42670) 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c25fd640 1 -- 172.21.15.133:0/720974442 learned_addr learned my addr 172.21.15.133:0/720974442 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c25fd640 1 -- 172.21.15.133:0/720974442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593a83c3220 con 0x5593a832d0c0 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c25fd640 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84abf80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f88b4018f70 tx=0x7f88b40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f87aee05640 1 -- 172.21.15.133:0/720974442 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b40cb070 con 0x5593a832d0c0 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5593a84ac4c0 con 0x5593a832d0c0 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f87aee05640 1 -- 172.21.15.133:0/720974442 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40bd810 con 0x5593a832d0c0 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f87aee05640 1 -- 172.21.15.133:0/720974442 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b40bdab0 con 0x5593a832d0c0 2024-02-15T23:29:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.535+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593a84ac890 con 0x5593a832d0c0 2024-02-15T23:29:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f87aee05640 1 -- 172.21.15.133:0/720974442 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f88b40bdc10 con 0x5593a832d0c0 2024-02-15T23:29:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f87aee05640 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f87a80342b0 0x7f87a8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f87aee05640 1 -- 172.21.15.133:0/720974442 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f88b40e4a00 con 0x5593a832d0c0 2024-02-15T23:29:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c1dfc640 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f87a80342b0 0x7f87a8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a83be700 0x5593a84b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84b3150 con 0x5593a83be700 2024-02-15T23:29:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a83be700 0x5593a84b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c1dfc640 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f87a80342b0 0x7f87a8036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f88b8001e50 tx=0x7f88b80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a83be700 0x5593a84b2c10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c2dfe640 1 -- 172.21.15.133:0/720974442 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88bc00a4d0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84b34f0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c2dfe640 1 -- 172.21.15.133:0/720974442 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f88bc00a4d0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84b4da0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c2dfe640 1 -- 172.21.15.133:0/720974442 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f88bc00a4d0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84b3fa0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c2dfe640 1 -- 172.21.15.133:0/720974442 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f88bc00a4d0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84b43b0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c2dfe640 1 -- 172.21.15.133:0/720974442 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f88bc00a4d0 con 0x5593a83be700 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 Processor -- start 2024-02-15T23:29:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 -- start start 2024-02-15T23:29:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84c3480 0x5593a84c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c4ae2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593a825df20 con 0x5593a84c3480 2024-02-15T23:29:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c1dfc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84c3480 0x5593a84c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c1dfc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84c3480 0x5593a84c38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42676/0 (socket says 172.21.15.133:42676) 2024-02-15T23:29:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c1dfc640 1 -- 172.21.15.133:0/2641696425 learned_addr learned my addr 172.21.15.133:0/2641696425 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.539+0000 7f88c1dfc640 1 -- 172.21.15.133:0/2641696425 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593a84c3de0 con 0x5593a84c3480 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c1dfc640 1 --2- 172.21.15.133:0/2641696425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84c3480 0x5593a84c38a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f88b800e640 tx=0x7f88b800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f87a7fff640 1 -- 172.21.15.133:0/2641696425 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b8007040 con 0x5593a84c3480 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f87a7fff640 1 -- 172.21.15.133:0/2641696425 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b800d660 con 0x5593a84c3480 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f87a7fff640 1 -- 172.21.15.133:0/2641696425 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b800d920 con 0x5593a84c3480 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2641696425 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5593a84c4030 con 0x5593a84c3480 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2641696425 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593a84c4b80 con 0x5593a84c3480 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f87a7fff640 1 -- 172.21.15.133:0/2641696425 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f88b801a070 con 0x5593a84c3480 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f87a7fff640 1 --2- 172.21.15.133:0/2641696425 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f879c034300 0x7f879c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f87a7fff640 1 -- 172.21.15.133:0/2641696425 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f88b8017050 con 0x5593a84c3480 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/2641696425 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f879c034300 0x7f879c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c4ae2980 1 Processor -- start 2024-02-15T23:29:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c4ae2980 1 -- start start 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/2641696425 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f879c034300 0x7f879c0367c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5593a84b39e0 tx=0x7f88bc005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c4ae2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c4ae2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593a8251790 con 0x5593a84d0400 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c1dfc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c1dfc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42684/0 (socket says 172.21.15.133:42684) 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3812036716 learned_addr learned my addr 172.21.15.133:0/3812036716 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3812036716 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593a84d0dd0 con 0x5593a84d0400 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.543+0000 7f88c1dfc640 1 --2- 172.21.15.133:0/3812036716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d0800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f88b8048c10 tx=0x7f88b8024800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62448bd17b5e4c1a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f87a5ffb640 1 -- 172.21.15.133:0/3812036716 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b8046030 con 0x5593a84d0400 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f87a5ffb640 1 -- 172.21.15.133:0/3812036716 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8025360 con 0x5593a84d0400 2024-02-15T23:29:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f87a5ffb640 1 -- 172.21.15.133:0/3812036716 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b8039440 con 0x5593a84d0400 2024-02-15T23:29:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3812036716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 msgr2=0x5593a84d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3812036716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d0800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f88b8048c10 tx=0x7f88b8024800 comp rx=0 tx=0).stop 2024-02-15T23:29:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3812036716 shutdown_connections 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3812036716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d0800 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3812036716 >> 172.21.15.133:0/3812036716 conn(0x5593a84cc740 msgr2=0x5593a84ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3812036716 shutdown_connections 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3812036716 wait complete. 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 Processor -- start 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- start start 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593a84d7750 con 0x5593a84d0400 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c1dfc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c1dfc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42694/0 (socket says 172.21.15.133:42694) 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 learned_addr learned my addr 172.21.15.133:0/3604329137 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593a84c4b80 con 0x5593a84d0400 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c1dfc640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d7210 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f88b8025770 tx=0x7f88b8048ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f8793fff640 1 -- 172.21.15.133:0/3604329137 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b8046030 con 0x5593a84d0400 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5593a84d7950 con 0x5593a84d0400 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f8793fff640 1 -- 172.21.15.133:0/3604329137 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b803ce60 con 0x5593a84d0400 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593a84d7de0 con 0x5593a84d0400 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f8793fff640 1 -- 172.21.15.133:0/3604329137 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b8041070 con 0x5593a84d0400 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.547+0000 7f8793fff640 1 -- 172.21.15.133:0/3604329137 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f88b8048d50 con 0x5593a84d0400 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f8793fff640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f878c0342b0 0x7f878c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f8793fff640 1 -- 172.21.15.133:0/3604329137 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f88b8047070 con 0x5593a84d0400 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f878c0342b0 0x7f878c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a84e27e0 0x5593a84e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e53d0 con 0x5593a84e27e0 2024-02-15T23:29:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c25fd640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a84e27e0 0x5593a84e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f878c0342b0 0x7f878c036770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88bc011010 tx=0x7f88bc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c25fd640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a84e27e0 0x5593a84e4c80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 realm 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e57f0 con 0x5593a84e27e0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e6040 con 0x5593a84e27e0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e63a0 con 0x5593a84e27e0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e5ce0 con 0x5593a84e27e0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 20 searching for the correct realm 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593a84e85f0 0x5593a84eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c1dfc640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593a84e85f0 0x5593a84eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c1dfc640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593a84e85f0 0x5593a84eaa00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8042970 con 0x5593a84e85f0 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c1dfc640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88b8031020 0x7f88b80473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88b8031020 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88b8031020 0x7f88b80473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88b8031020 0x7f88b80473d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88bc00a4d0 con 0x7f88b8031020 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c2dfe640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f88bc0141d0 0x7f88bc015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.551+0000 7f88c25fd640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f88bc0141d0 0x7f88bc015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f88bc0141d0 0x7f88bc015940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b40cd070 con 0x7f88bc0141d0 2024-02-15T23:29:51.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e27e0 2024-02-15T23:29:51.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e27e0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b40cd070 con 0x7f88bc0141d0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b40cd070 con 0x7f88bc0141d0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88b8031020 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88bc00a4d0 con 0x7f88b8031020 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8042970 con 0x5593a84e85f0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e27e0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.555+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b40cd070 con 0x7f88bc0141d0 2024-02-15T23:29:51.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e27e0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88b8031020 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8042970 con 0x5593a84e85f0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8042970 con 0x5593a84e85f0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b40cd070 con 0x7f88bc0141d0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8042970 con 0x5593a84e85f0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8042970 con 0x5593a84e85f0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e27e0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e27e0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f88b40cd070 con 0x5593a84e27e0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8042970 con 0x5593a84e85f0 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.559+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88b8031020 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e27e0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8060040 con 0x5593a84e85f0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88b8031020 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e85f0 2024-02-15T23:29:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b8060040 con 0x5593a84e85f0 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88bc0141d0 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x5593a84e27e0 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eb0d0 con 0x7f88b8031020 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:51.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e7240 con 0x5593a84e27e0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e6ec0 con 0x5593a84e27e0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.563+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e7b10 con 0x5593a84e27e0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 zone default found 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 4 Realm: () 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:51.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 zonegroup default 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84e7b10 con 0x7f88bc0141d0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ecef0 con 0x5593a84e85f0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f88b8060040 con 0x5593a84e85f0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ed280 con 0x5593a84e85f0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f88b8060040 con 0x5593a84e85f0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 started sync module instance, tier type = 2024-02-15T23:29:51.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:51.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ec7d0 con 0x7f88b8031020 2024-02-15T23:29:51.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94092672287536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ecb80 con 0x7f88b8031020 2024-02-15T23:29:51.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84edfe0 con 0x5593a84e27e0 2024-02-15T23:29:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.567+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94092672287536] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94092672292512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84edfc0 con 0x5593a84e27e0 2024-02-15T23:29:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eea80 con 0x5593a84e85f0 2024-02-15T23:29:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94092672292512] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b8060040 con 0x5593a84e85f0 2024-02-15T23:29:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94092672296256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84eee30 con 0x5593a84e85f0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ef7a0 con 0x7f88b8031020 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94092672300048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84efed0 con 0x7f88b8031020 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.571+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f09a0 con 0x5593a84e27e0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.575+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94092672296256] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b8060040 con 0x5593a84e85f0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.575+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94092672300048] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.575+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.575+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94092672304256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f0960 con 0x5593a84e27e0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.575+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84efaa0 con 0x7f88bc0141d0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.575+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94092672304256] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.575+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.575+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94092672293568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f11a0 con 0x7f88bc0141d0 2024-02-15T23:29:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.579+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f1a20 con 0x7f88bc0141d0 2024-02-15T23:29:51.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.579+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.579+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94092672307616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f20c0 con 0x7f88bc0141d0 2024-02-15T23:29:51.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.579+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f2a30 con 0x7f88bc0141d0 2024-02-15T23:29:51.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.579+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94092672293568] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.579+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94092672307616] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94092672310304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f2040 con 0x7f88bc0141d0 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 add_watcher() i=0 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 add_watcher() i=1 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 add_watcher() i=2 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 add_watcher() i=3 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 add_watcher() i=4 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 add_watcher() i=5 2024-02-15T23:29:51.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 add_watcher() i=6 2024-02-15T23:29:51.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94092672310304] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 add_watcher() i=7 2024-02-15T23:29:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f5a60 con 0x5593a84e27e0 2024-02-15T23:29:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94092672312720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84f2e50 con 0x5593a84e27e0 2024-02-15T23:29:51.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94092672312720] v31'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f87797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:51.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:51.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 5 note: GC not initialized 2024-02-15T23:29:51.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f87737fe640 20 reqs_thread_entry: start 2024-02-15T23:29:51.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:51.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 Filter name: none 2024-02-15T23:29:51.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f87717fa640 20 reqs_thread_entry: start 2024-02-15T23:29:51.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.583+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a8517250 con 0x5593a84e27e0 2024-02-15T23:29:51.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c4ae2980 20 rados_obj.operate() r=0 bl.length=624 2024-02-15T23:29:51.595 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f87797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94092672312720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a8516400 con 0x5593a84e27e0 2024-02-15T23:29:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94092672312720] v31'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94092672287536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a8516400 con 0x7f88b8031020 2024-02-15T23:29:51.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94092672287536] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c4ae2980 20 remove_watcher() i=0 2024-02-15T23:29:51.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c4ae2980 2 removed watcher, disabling cache 2024-02-15T23:29:51.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.587+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94092672292512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ec330 con 0x5593a84e27e0 2024-02-15T23:29:51.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94092672292512] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c4ae2980 20 remove_watcher() i=1 2024-02-15T23:29:51.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94092672296256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ec330 con 0x5593a84e85f0 2024-02-15T23:29:51.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c1dfc640 1 -- 172.21.15.133:0/3604329137 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94092672296256] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b8060040 con 0x5593a84e85f0 2024-02-15T23:29:51.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c4ae2980 20 remove_watcher() i=2 2024-02-15T23:29:51.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94092672300048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ee540 con 0x7f88b8031020 2024-02-15T23:29:51.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c2dfe640 1 -- 172.21.15.133:0/3604329137 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94092672300048] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88bc03a040 con 0x7f88b8031020 2024-02-15T23:29:51.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c4ae2980 20 remove_watcher() i=3 2024-02-15T23:29:51.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.591+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94092672304256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ed6a0 con 0x5593a84e27e0 2024-02-15T23:29:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.595+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94092672304256] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x5593a84e27e0 2024-02-15T23:29:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.595+0000 7f88c4ae2980 20 remove_watcher() i=4 2024-02-15T23:29:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.595+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94092672293568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ed6a0 con 0x7f88bc0141d0 2024-02-15T23:29:51.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.595+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94092672293568] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.595+0000 7f88c4ae2980 20 remove_watcher() i=5 2024-02-15T23:29:51.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.595+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94092672307616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ed6a0 con 0x7f88bc0141d0 2024-02-15T23:29:51.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94092672307616] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 20 remove_watcher() i=6 2024-02-15T23:29:51.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94092672310304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593a84ed6a0 con 0x7f88bc0141d0 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94092672310304] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88b4100040 con 0x7f88bc0141d0 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 20 remove_watcher() i=7 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f88bc0141d0 msgr2=0x7f88bc015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f88bc0141d0 0x7f88bc015940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a84e27e0 msgr2=0x5593a84e4c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a84e27e0 0x5593a84e4c80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88b8031020 msgr2=0x7f88b80473d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88b8031020 0x7f88b80473d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593a84e85f0 msgr2=0x5593a84eaa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5593a84e85f0 0x5593a84eaa00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f878c0342b0 msgr2=0x7f878c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f878c0342b0 0x7f878c036770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88bc011010 tx=0x7f88bc020000 comp rx=0 tx=0).stop 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 msgr2=0x5593a84d7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c25fd640 1 -- 172.21.15.133:0/3604329137 reap_dead start 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.599+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d7210 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f88b8025770 tx=0x7f88b8048ba0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 shutdown_connections 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/3604329137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84d0400 0x5593a84d7210 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 >> 172.21.15.133:0/3604329137 conn(0x5593a84cc740 msgr2=0x5593a84c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 shutdown_connections 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/3604329137 wait complete. 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2641696425 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f879c034300 msgr2=0x7f879c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/2641696425 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f879c034300 0x7f879c0367c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5593a84b39e0 tx=0x7f88bc005850 comp rx=0 tx=0).stop 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2641696425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84c3480 msgr2=0x5593a84c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/2641696425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84c3480 0x5593a84c38a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f88b800e640 tx=0x7f88b800ea40 comp rx=0 tx=0).stop 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2641696425 shutdown_connections 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/2641696425 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f879c034300 0x7f879c0367c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/2641696425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a84c3480 0x5593a84c38a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2641696425 >> 172.21.15.133:0/2641696425 conn(0x5593a84b8290 msgr2=0x5593a84b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2641696425 shutdown_connections 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/2641696425 wait complete. 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a83be700 msgr2=0x5593a84b2c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a83be700 0x5593a84b2c10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f87a80342b0 msgr2=0x7f87a8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f87a80342b0 0x7f87a8036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f88b8001e50 tx=0x7f88b80013b0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 msgr2=0x5593a84abf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84abf80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f88b4018f70 tx=0x7f88b40180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 shutdown_connections 2024-02-15T23:29:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5593a83be700 0x5593a84b2c10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f87a80342b0 0x7f87a8036770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 --2- 172.21.15.133:0/720974442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593a832d0c0 0x5593a84abf80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 >> 172.21.15.133:0/720974442 conn(0x5593a83b38e0 msgr2=0x5593a849f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 shutdown_connections 2024-02-15T23:29:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.603+0000 7f88c4ae2980 1 -- 172.21.15.133:0/720974442 wait complete. 2024-02-15T23:29:51.620 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:51.620 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-15T23:29:51.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-15T23:29:51.621 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-02-15T23:29:51.690 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:51.690 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f5436980 1 Processor -- start 2024-02-15T23:29:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f5436980 1 -- start start 2024-02-15T23:29:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f5436980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5582c508c8d0 0x5582c511d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f5436980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5582c50644d0 con 0x5582c511d780 2024-02-15T23:29:51.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f5436980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5582c502b180 con 0x5582c508c8d0 2024-02-15T23:29:51.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f2f51640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5582c508c8d0 0x5582c511d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f2f51640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5582c508c8d0 0x5582c511d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42708/0 (socket says 172.21.15.133:42708) 2024-02-15T23:29:51.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f2f51640 1 -- 172.21.15.133:0/110115726 learned_addr learned my addr 172.21.15.133:0/110115726 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f2f51640 1 -- 172.21.15.133:0/110115726 >> v1:172.21.15.131:6789/0 conn(0x5582c511d780 legacy=0x5582c511fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.683+0000 7f55f2f51640 1 -- 172.21.15.133:0/110115726 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c5118c60 con 0x5582c508c8d0 2024-02-15T23:29:51.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f2f51640 1 --2- 172.21.15.133:0/110115726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c508c8d0 0x5582c511d240 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f55e400a5c0 tx=0x7f55e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d77d4169647c9b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f1f4f640 1 -- 172.21.15.133:0/110115726 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e40aa470 con 0x5582c508c8d0 2024-02-15T23:29:51.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f1f4f640 1 -- 172.21.15.133:0/110115726 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e40aa5d0 con 0x5582c508c8d0 2024-02-15T23:29:51.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f1f4f640 1 -- 172.21.15.133:0/110115726 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e40aa890 con 0x5582c508c8d0 2024-02-15T23:29:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f5436980 1 -- 172.21.15.133:0/110115726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c508c8d0 msgr2=0x5582c511d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f5436980 1 --2- 172.21.15.133:0/110115726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c508c8d0 0x5582c511d240 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f55e400a5c0 tx=0x7f55e401b340 comp rx=0 tx=0).stop 2024-02-15T23:29:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f5436980 1 -- 172.21.15.133:0/110115726 shutdown_connections 2024-02-15T23:29:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f5436980 1 --2- 172.21.15.133:0/110115726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c508c8d0 0x5582c511d240 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f5436980 1 -- 172.21.15.133:0/110115726 >> 172.21.15.133:0/110115726 conn(0x5582c5112920 msgr2=0x5582c5114d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f5436980 1 -- 172.21.15.133:0/110115726 shutdown_connections 2024-02-15T23:29:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.687+0000 7f55f5436980 1 -- 172.21.15.133:0/110115726 wait complete. 2024-02-15T23:29:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f5436980 1 Processor -- start 2024-02-15T23:29:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f5436980 1 -- start start 2024-02-15T23:29:51.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f5436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c5204430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f5436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c50286b0 con 0x5582c511d780 2024-02-15T23:29:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f2f51640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c5204430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f2f51640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c5204430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42722/0 (socket says 172.21.15.133:42722) 2024-02-15T23:29:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f2f51640 1 -- 172.21.15.133:0/3961985768 learned_addr learned my addr 172.21.15.133:0/3961985768 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f2f51640 1 -- 172.21.15.133:0/3961985768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4005df0 con 0x5582c511d780 2024-02-15T23:29:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.699+0000 7f55f2f51640 1 --2- 172.21.15.133:0/3961985768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c5204430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f55e401b380 tx=0x7f55e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadb53707f1c2100 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f54e0e09640 1 -- 172.21.15.133:0/3961985768 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e40aa8f0 con 0x5582c511d780 2024-02-15T23:29:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f54e0e09640 1 -- 172.21.15.133:0/3961985768 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e40aaa50 con 0x5582c511d780 2024-02-15T23:29:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f54e0e09640 1 -- 172.21.15.133:0/3961985768 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e40aad10 con 0x5582c511d780 2024-02-15T23:29:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- 172.21.15.133:0/3961985768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 msgr2=0x5582c5204430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 --2- 172.21.15.133:0/3961985768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c5204430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f55e401b380 tx=0x7f55e4003030 comp rx=0 tx=0).stop 2024-02-15T23:29:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- 172.21.15.133:0/3961985768 shutdown_connections 2024-02-15T23:29:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 --2- 172.21.15.133:0/3961985768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c5204430 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- 172.21.15.133:0/3961985768 >> 172.21.15.133:0/3961985768 conn(0x5582c5112920 msgr2=0x5582c51fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- 172.21.15.133:0/3961985768 shutdown_connections 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- 172.21.15.133:0/3961985768 wait complete. 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 Processor -- start 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- start start 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c520b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c5023e90 con 0x5582c511d780 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f2f51640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c520b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f2f51640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c520b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42732/0 (socket says 172.21.15.133:42732) 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f2f51640 1 -- 172.21.15.133:0/1443304461 learned_addr learned my addr 172.21.15.133:0/1443304461 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f2f51640 1 -- 172.21.15.133:0/1443304461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c5118c60 con 0x5582c511d780 2024-02-15T23:29:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f2f51640 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c520b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f55e401bbe0 tx=0x7f55e40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f54df606640 1 -- 172.21.15.133:0/1443304461 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e40c67c0 con 0x5582c511d780 2024-02-15T23:29:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f54df606640 1 -- 172.21.15.133:0/1443304461 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e40c6920 con 0x5582c511d780 2024-02-15T23:29:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582c520b5e0 con 0x5582c511d780 2024-02-15T23:29:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f54df606640 1 -- 172.21.15.133:0/1443304461 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e40c6be0 con 0x5582c511d780 2024-02-15T23:29:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.703+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582c520ba30 con 0x5582c511d780 2024-02-15T23:29:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f54df606640 1 -- 172.21.15.133:0/1443304461 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f55e40c6d40 con 0x5582c511d780 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f54df606640 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54d8034300 0x7f54d80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f54df606640 1 -- 172.21.15.133:0/1443304461 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f55e40e4dd0 con 0x5582c511d780 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f2750640 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54d8034300 0x7f54d80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c520fd00 0x5582c52120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5212630 con 0x5582c520fd00 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f3752640 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c520fd00 0x5582c52120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f2750640 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54d8034300 0x7f54d80367c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55e8000f70 tx=0x7f55e8001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f3752640 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c520fd00 0x5582c52120f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f3752640 1 -- 172.21.15.133:0/1443304461 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5582c520fd00 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5212a60 con 0x5582c520fd00 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f3752640 1 -- 172.21.15.133:0/1443304461 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5582c520fd00 2024-02-15T23:29:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5214310 con 0x5582c520fd00 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f3752640 1 -- 172.21.15.133:0/1443304461 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5582c520fd00 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5213510 con 0x5582c520fd00 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f3752640 1 -- 172.21.15.133:0/1443304461 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5582c520fd00 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5213920 con 0x5582c520fd00 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f3752640 1 -- 172.21.15.133:0/1443304461 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5582c520fd00 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 Processor -- start 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 -- start start 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52229b0 0x5582c5222dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f5436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c4fbcf20 con 0x5582c52229b0 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f2750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52229b0 0x5582c5222dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f2750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52229b0 0x5582c5222dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42748/0 (socket says 172.21.15.133:42748) 2024-02-15T23:29:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.707+0000 7f55f2750640 1 -- 172.21.15.133:0/1076763685 learned_addr learned my addr 172.21.15.133:0/1076763685 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f2750640 1 -- 172.21.15.133:0/1076763685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c5223310 con 0x5582c52229b0 2024-02-15T23:29:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f2750640 1 --2- 172.21.15.133:0/1076763685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52229b0 0x5582c5222dd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55e800f3d0 tx=0x7f55e800f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54dce01640 1 -- 172.21.15.133:0/1076763685 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e800e6b0 con 0x5582c52229b0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f5436980 1 -- 172.21.15.133:0/1076763685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582c5223560 con 0x5582c52229b0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54dce01640 1 -- 172.21.15.133:0/1076763685 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800e810 con 0x5582c52229b0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54dce01640 1 -- 172.21.15.133:0/1076763685 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e800ead0 con 0x5582c52229b0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f5436980 1 -- 172.21.15.133:0/1076763685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582c52240b0 con 0x5582c52229b0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54dce01640 1 -- 172.21.15.133:0/1076763685 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f55e800ec80 con 0x5582c52229b0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54dce01640 1 --2- 172.21.15.133:0/1076763685 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54cc0342b0 0x7f54cc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54dce01640 1 -- 172.21.15.133:0/1076763685 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f55e8018040 con 0x5582c52229b0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f3752640 1 --2- 172.21.15.133:0/1076763685 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54cc0342b0 0x7f54cc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f5436980 1 Processor -- start 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f5436980 1 -- start start 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f3752640 1 --2- 172.21.15.133:0/1076763685 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54cc0342b0 0x7f54cc036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5582c5212f50 tx=0x7f55ec005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f5436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c522fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f5436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c4fb0790 con 0x5582c522f9c0 2024-02-15T23:29:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f2750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c522fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f2750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c522fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42762/0 (socket says 172.21.15.133:42762) 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f2750640 1 -- 172.21.15.133:0/2812059139 learned_addr learned my addr 172.21.15.133:0/2812059139 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f2750640 1 -- 172.21.15.133:0/2812059139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c52303b0 con 0x5582c522f9c0 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f55f2750640 1 --2- 172.21.15.133:0/2812059139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c522fde0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f55e8001690 tx=0x7f55e8023f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64c95464289b699 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54d67fc640 1 -- 172.21.15.133:0/2812059139 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e803b160 con 0x5582c522f9c0 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54d67fc640 1 -- 172.21.15.133:0/2812059139 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e803b2c0 con 0x5582c522f9c0 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.711+0000 7f54d67fc640 1 -- 172.21.15.133:0/2812059139 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e801ca60 con 0x5582c522f9c0 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- 172.21.15.133:0/2812059139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 msgr2=0x5582c522fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 --2- 172.21.15.133:0/2812059139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c522fde0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f55e8001690 tx=0x7f55e8023f60 comp rx=0 tx=0).stop 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- 172.21.15.133:0/2812059139 shutdown_connections 2024-02-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 --2- 172.21.15.133:0/2812059139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c522fde0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- 172.21.15.133:0/2812059139 >> 172.21.15.133:0/2812059139 conn(0x5582c522bd50 msgr2=0x5582c5229db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- 172.21.15.133:0/2812059139 shutdown_connections 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- 172.21.15.133:0/2812059139 wait complete. 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 Processor -- start 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- start start 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c52368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c5236e30 con 0x5582c522f9c0 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f2750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c52368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f2750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c52368f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42772/0 (socket says 172.21.15.133:42772) 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 learned_addr learned my addr 172.21.15.133:0/1049618626 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c52240b0 con 0x5582c522f9c0 2024-02-15T23:29:51.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f2750640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c52368f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f55e801a480 tx=0x7f55e80494e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f54d4ff9640 1 -- 172.21.15.133:0/1049618626 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e8023510 con 0x5582c522f9c0 2024-02-15T23:29:51.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582c5237030 con 0x5582c522f9c0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f54d4ff9640 1 -- 172.21.15.133:0/1049618626 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e8023670 con 0x5582c522f9c0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f54d4ff9640 1 -- 172.21.15.133:0/1049618626 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e8023910 con 0x5582c522f9c0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582c5237460 con 0x5582c522f9c0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f54d4ff9640 1 -- 172.21.15.133:0/1049618626 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f55e80383c0 con 0x5582c522f9c0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.715+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f54d4ff9640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54bc0342b0 0x7f54bc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f54d4ff9640 1 -- 172.21.15.133:0/1049618626 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f55e8030cc0 con 0x5582c522f9c0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f3752640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54bc0342b0 0x7f54bc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c5241f10 0x5582c52443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5244b20 con 0x5582c5241f10 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2f51640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c5241f10 0x5582c52443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f3752640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54bc0342b0 0x7f54bc036770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55ec011010 tx=0x7f55ec020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2f51640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c5241f10 0x5582c52443d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 realm 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5244ef0 con 0x5582c5241f10 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5245740 con 0x5582c5241f10 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5245aa0 con 0x5582c5241f10 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c52462a0 con 0x5582c5241f10 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 20 searching for the correct realm 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5582c52481f0 0x5582c524a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2750640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5582c52481f0 0x5582c524a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2750640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5582c52481f0 0x5582c524a620 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2750640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f55e801c030 0x7f55e801e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55e801c030 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f3752640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f55e801c030 0x7f55e801e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f3752640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f55e801c030 0x7f55e801e0c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55e801c030 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f3752640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f55ec0141d0 0x7f55ec015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.719+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f55ec0141d0 0x7f55ec015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f55ec0141d0 0x7f55ec015940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x7f55ec0141d0 2024-02-15T23:29:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c5241f10 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c5241f10 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x7f55ec0141d0 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x7f55ec0141d0 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55e801c030 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55e801c030 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c5241f10 2024-02-15T23:29:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.723+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x7f55ec0141d0 2024-02-15T23:29:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c5241f10 2024-02-15T23:29:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55e801c030 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x7f55ec0141d0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c5241f10 2024-02-15T23:29:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c5241f10 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x7f55ec0141d0 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.727+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55e801c030 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c5241f10 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x5582c5241f10 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x7f55ec0141d0 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40cd020 con 0x7f55ec0141d0 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55e801c030 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c52481f0 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55ec0141d0 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x5582c5241f10 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524aca0 con 0x7f55e801c030 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5246c90 con 0x5582c5241f10 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c52474e0 con 0x5582c5241f10 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c52474e0 con 0x5582c5241f10 2024-02-15T23:29:51.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 zone default found 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 4 Realm: () 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 zonegroup default 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.731+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c52474e0 con 0x7f55ec0141d0 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524cb10 con 0x5582c52481f0 2024-02-15T23:29:51.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524ce70 con 0x5582c52481f0 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 20 started sync module instance, tier type = 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524c3f0 con 0x7f55e801c030 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94020141629264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524c370 con 0x7f55e801c030 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524db60 con 0x5582c5241f10 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94020141629264] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94020141634080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524c370 con 0x5582c5241f10 2024-02-15T23:29:51.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.735+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524e200 con 0x5582c52481f0 2024-02-15T23:29:51.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94020141636864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524ea50 con 0x5582c52481f0 2024-02-15T23:29:51.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524f420 con 0x7f55e801c030 2024-02-15T23:29:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94020141634080] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94020141641504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524f7d0 con 0x7f55e801c030 2024-02-15T23:29:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5250140 con 0x5582c5241f10 2024-02-15T23:29:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94020141636864] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.739+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94020141641504] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.743+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.743+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94020141635136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524fca0 con 0x5582c5241f10 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.743+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5250990 con 0x7f55ec0141d0 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.743+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.743+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94020141646368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5250ae0 con 0x7f55ec0141d0 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.743+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5251450 con 0x7f55ec0141d0 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.743+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94020141635136] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94020141646368] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94020141639088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5250fb0 con 0x7f55ec0141d0 2024-02-15T23:29:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c52517b0 con 0x7f55ec0141d0 2024-02-15T23:29:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94020141639088] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94020141649840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5251870 con 0x7f55ec0141d0 2024-02-15T23:29:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 20 add_watcher() i=0 2024-02-15T23:29:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 20 add_watcher() i=1 2024-02-15T23:29:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 20 add_watcher() i=2 2024-02-15T23:29:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 20 add_watcher() i=3 2024-02-15T23:29:51.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 20 add_watcher() i=4 2024-02-15T23:29:51.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 20 add_watcher() i=5 2024-02-15T23:29:51.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.747+0000 7f55f5436980 20 add_watcher() i=6 2024-02-15T23:29:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94020141649840] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 20 add_watcher() i=7 2024-02-15T23:29:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5254b90 con 0x5582c5241f10 2024-02-15T23:29:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94020141651264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5251e00 con 0x5582c5241f10 2024-02-15T23:29:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94020141651264] v31'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f54a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 5 note: GC not initialized 2024-02-15T23:29:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f5423fff640 20 reqs_thread_entry: start 2024-02-15T23:29:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 20 Filter name: none 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f5421ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5276b10 con 0x5582c5241f10 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 20 rados_obj.operate() r=0 bl.length=624 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:51.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.751+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~541 in=541b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c527ccc0 con 0x5582c5241f10 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~541] v31'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f5436980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f5436980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f5436980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94020141827968 in=729b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5278740 con 0x5582c5241f10 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94020141635136 notify 133143986184 ret 0) v3 ==== 759+0+0 (crc 0 0 0) 0x7f55e40f0040 con 0x5582c5241f10 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f54d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94020141635136 notifier 4402 bl.length()=717 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f54d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f54d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(64 notify.4 [notify cookie 94020141827968 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f54d67fc640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f54b8003ea0 con 0x5582c5241f10 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 94020141827968 notify 133143986184 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5582c520ba30 con 0x5582c5241f10 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f5436980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94020141827968 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5278740 con 0x7f55e801c030 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== watch-notify(notify (1) cookie 94020141629264 notify 133143986180 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7f55ec0269c0 con 0x7f55e801c030 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f54d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94020141629264 notifier 4402 bl.length()=159 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f54d67fc640 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f54b8004200 con 0x7f55e801c030 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(66 notify.0 [notify cookie 94020141827968 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== watch-notify(notify_complete (2) cookie 94020141827968 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f55ec026c20 con 0x7f55e801c030 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5278740 con 0x5582c5241f10 2024-02-15T23:29:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.755+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(68 foo:foo1 [delete] v31'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.768 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.759+0000 7f54a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.759+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94020141651264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c527b3c0 con 0x5582c5241f10 2024-02-15T23:29:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.759+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94020141651264] v31'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.759+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94020141629264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5251540 con 0x7f55e801c030 2024-02-15T23:29:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.759+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94020141629264] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.759+0000 7f55f5436980 20 remove_watcher() i=0 2024-02-15T23:29:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.759+0000 7f55f5436980 2 removed watcher, disabling cache 2024-02-15T23:29:51.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.759+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94020141634080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5246c90 con 0x5582c5241f10 2024-02-15T23:29:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94020141634080] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f5436980 20 remove_watcher() i=1 2024-02-15T23:29:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94020141636864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5246c90 con 0x5582c52481f0 2024-02-15T23:29:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f2750640 1 -- 172.21.15.133:0/1049618626 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94020141636864] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e8035020 con 0x5582c52481f0 2024-02-15T23:29:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f5436980 20 remove_watcher() i=2 2024-02-15T23:29:51.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94020141641504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5251540 con 0x7f55e801c030 2024-02-15T23:29:51.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f3752640 1 -- 172.21.15.133:0/1049618626 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94020141641504] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55ec03a040 con 0x7f55e801c030 2024-02-15T23:29:51.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f5436980 20 remove_watcher() i=3 2024-02-15T23:29:51.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.763+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94020141635136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c524d220 con 0x5582c5241f10 2024-02-15T23:29:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.767+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94020141635136] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x5582c5241f10 2024-02-15T23:29:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.767+0000 7f55f5436980 20 remove_watcher() i=4 2024-02-15T23:29:51.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.767+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94020141646368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5251540 con 0x7f55ec0141d0 2024-02-15T23:29:51.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.767+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94020141646368] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.767+0000 7f55f5436980 20 remove_watcher() i=5 2024-02-15T23:29:51.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.767+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94020141639088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5250220 con 0x7f55ec0141d0 2024-02-15T23:29:51.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94020141639088] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 20 remove_watcher() i=6 2024-02-15T23:29:51.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94020141649840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5582c5251540 con 0x7f55ec0141d0 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94020141649840] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55e40fb040 con 0x7f55ec0141d0 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 20 remove_watcher() i=7 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f55ec0141d0 msgr2=0x7f55ec015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f55ec0141d0 0x7f55ec015940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c5241f10 msgr2=0x5582c52443d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c5241f10 0x5582c52443d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f55e801c030 msgr2=0x7f55e801e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f55e801c030 0x7f55e801e0c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5582c52481f0 msgr2=0x5582c524a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5582c52481f0 0x5582c524a620 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54bc0342b0 msgr2=0x7f54bc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54bc0342b0 0x7f54bc036770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55ec011010 tx=0x7f55ec020000 comp rx=0 tx=0).stop 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 msgr2=0x5582c52368f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f2f51640 1 -- 172.21.15.133:0/1049618626 reap_dead start 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c52368f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f55e801a480 tx=0x7f55e80494e0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 shutdown_connections 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1049618626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c522f9c0 0x5582c52368f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 >> 172.21.15.133:0/1049618626 conn(0x5582c522bd50 msgr2=0x5582c52293b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 shutdown_connections 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1049618626 wait complete. 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1076763685 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54cc0342b0 msgr2=0x7f54cc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1076763685 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54cc0342b0 0x7f54cc036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5582c5212f50 tx=0x7f55ec005850 comp rx=0 tx=0).stop 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1076763685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52229b0 msgr2=0x5582c5222dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1076763685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52229b0 0x5582c5222dd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55e800f3d0 tx=0x7f55e800f7d0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1076763685 shutdown_connections 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1076763685 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54cc0342b0 0x7f54cc036770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1076763685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52229b0 0x5582c5222dd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1076763685 >> 172.21.15.133:0/1076763685 conn(0x5582c52177c0 msgr2=0x5582c52182d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1076763685 shutdown_connections 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1076763685 wait complete. 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c520fd00 msgr2=0x5582c52120f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.771+0000 7f55f5436980 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c520fd00 0x5582c52120f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54d8034300 msgr2=0x7f54d80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54d8034300 0x7f54d80367c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55e8000f70 tx=0x7f55e8001420 comp rx=0 tx=0).stop 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 msgr2=0x5582c520b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c520b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f55e401bbe0 tx=0x7f55e40180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 shutdown_connections 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5582c520fd00 0x5582c52120f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f54d8034300 0x7f54d80367c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 --2- 172.21.15.133:0/1443304461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c511d780 0x5582c520b0a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 >> 172.21.15.133:0/1443304461 conn(0x5582c5112920 msgr2=0x5582c51fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 shutdown_connections 2024-02-15T23:29:51.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.775+0000 7f55f5436980 1 -- 172.21.15.133:0/1443304461 wait complete. 2024-02-15T23:29:51.791 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:51.791 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-15T23:29:51.791 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-15T23:29:51.791 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-02-15T23:29:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266ddbe980 1 Processor -- start 2024-02-15T23:29:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266ddbe980 1 -- start start 2024-02-15T23:29:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266ddbe980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609636178c0 0x5609636a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266ddbe980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5609635ef4c0 con 0x5609636a6370 2024-02-15T23:29:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266ddbe980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5609635b6180 con 0x5609636178c0 2024-02-15T23:29:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266b8d9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609636178c0 0x5609636a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266b8d9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609636178c0 0x5609636a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42780/0 (socket says 172.21.15.133:42780) 2024-02-15T23:29:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266b8d9640 1 -- 172.21.15.133:0/3060114522 learned_addr learned my addr 172.21.15.133:0/3060114522 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266b0d8640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5609636a6370 0x5609636a8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39858/0 (socket says 172.21.15.133:39858) 2024-02-15T23:29:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266b8d9640 1 -- 172.21.15.133:0/3060114522 >> v1:172.21.15.131:6789/0 conn(0x5609636a6370 legacy=0x5609636a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266b8d9640 1 -- 172.21.15.133:0/3060114522 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609636aaec0 con 0x5609636178c0 2024-02-15T23:29:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266b8d9640 1 --2- 172.21.15.133:0/3060114522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a5e30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f266400a4e0 tx=0x7f266401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f26d57040735a29 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.855+0000 7f266a8d7640 1 -- 172.21.15.133:0/3060114522 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26640aa540 con 0x5609636178c0 2024-02-15T23:29:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266a8d7640 1 -- 172.21.15.133:0/3060114522 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26640a6070 con 0x5609636178c0 2024-02-15T23:29:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266a8d7640 1 -- 172.21.15.133:0/3060114522 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26640aa850 con 0x5609636178c0 2024-02-15T23:29:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266ddbe980 1 -- 172.21.15.133:0/3060114522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 msgr2=0x5609636a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266ddbe980 1 --2- 172.21.15.133:0/3060114522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a5e30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f266400a4e0 tx=0x7f266401b090 comp rx=0 tx=0).stop 2024-02-15T23:29:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266ddbe980 1 -- 172.21.15.133:0/3060114522 shutdown_connections 2024-02-15T23:29:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266ddbe980 1 --2- 172.21.15.133:0/3060114522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a5e30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266ddbe980 1 -- 172.21.15.133:0/3060114522 >> 172.21.15.133:0/3060114522 conn(0x56096369d910 msgr2=0x56096369fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266ddbe980 1 -- 172.21.15.133:0/3060114522 shutdown_connections 2024-02-15T23:29:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.859+0000 7f266ddbe980 1 -- 172.21.15.133:0/3060114522 wait complete. 2024-02-15T23:29:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266ddbe980 1 Processor -- start 2024-02-15T23:29:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266ddbe980 1 -- start start 2024-02-15T23:29:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266ddbe980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266ddbe980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609635b36b0 con 0x5609636178c0 2024-02-15T23:29:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266b8d9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266b8d9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42786/0 (socket says 172.21.15.133:42786) 2024-02-15T23:29:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266b8d9640 1 -- 172.21.15.133:0/2325067937 learned_addr learned my addr 172.21.15.133:0/2325067937 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266b8d9640 1 -- 172.21.15.133:0/2325067937 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266400a1c0 con 0x5609636178c0 2024-02-15T23:29:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f266b8d9640 1 --2- 172.21.15.133:0/2325067937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a3590 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2664017ca0 tx=0x7f26640033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321a90db93cee8a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f2559e0b640 1 -- 172.21.15.133:0/2325067937 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26640aa780 con 0x5609636178c0 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f2559e0b640 1 -- 172.21.15.133:0/2325067937 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26640aa8e0 con 0x5609636178c0 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.871+0000 7f2559e0b640 1 -- 172.21.15.133:0/2325067937 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26640aab80 con 0x5609636178c0 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- 172.21.15.133:0/2325067937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 msgr2=0x5609636a3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 --2- 172.21.15.133:0/2325067937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a3590 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2664017ca0 tx=0x7f26640033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- 172.21.15.133:0/2325067937 shutdown_connections 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 --2- 172.21.15.133:0/2325067937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x5609636a3590 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- 172.21.15.133:0/2325067937 >> 172.21.15.133:0/2325067937 conn(0x56096369d910 msgr2=0x560963788c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- 172.21.15.133:0/2325067937 shutdown_connections 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- 172.21.15.133:0/2325067937 wait complete. 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 Processor -- start 2024-02-15T23:29:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- start start 2024-02-15T23:29:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x560963796030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609635aee90 con 0x5609636178c0 2024-02-15T23:29:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266b8d9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x560963796030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266b8d9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x560963796030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42802/0 (socket says 172.21.15.133:42802) 2024-02-15T23:29:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266b8d9640 1 -- 172.21.15.133:0/324303478 learned_addr learned my addr 172.21.15.133:0/324303478 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266b8d9640 1 -- 172.21.15.133:0/324303478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609636aaec0 con 0x5609636178c0 2024-02-15T23:29:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266b8d9640 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x560963796030 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2664017ca0 tx=0x7f2664017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f2553fff640 1 -- 172.21.15.133:0/324303478 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26640c4070 con 0x5609636178c0 2024-02-15T23:29:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f2553fff640 1 -- 172.21.15.133:0/324303478 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664005150 con 0x5609636178c0 2024-02-15T23:29:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560963796570 con 0x5609636178c0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f2553fff640 1 -- 172.21.15.133:0/324303478 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2664005410 con 0x5609636178c0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609637969a0 con 0x5609636178c0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f2553fff640 1 -- 172.21.15.133:0/324303478 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f26640a8070 con 0x5609636178c0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f2553fff640 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25540342b0 0x7f2554036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.875+0000 7f2553fff640 1 -- 172.21.15.133:0/324303478 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f26640e32c0 con 0x5609636178c0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266b0d8640 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25540342b0 0x7f2554036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609636a6370 0x56096379cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56096379d1b0 con 0x5609636a6370 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266c0da640 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609636a6370 0x56096379cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266b0d8640 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25540342b0 0x7f2554036770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2660001e50 tx=0x7f26600013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266c0da640 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609636a6370 0x56096379cc70 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266c0da640 1 -- 172.21.15.133:0/324303478 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f265c0083f0 con 0x5609636a6370 2024-02-15T23:29:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56096379d530 con 0x5609636a6370 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266c0da640 1 -- 172.21.15.133:0/324303478 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f265c0083f0 con 0x5609636a6370 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56096379ede0 con 0x5609636a6370 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266c0da640 1 -- 172.21.15.133:0/324303478 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f265c0083f0 con 0x5609636a6370 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56096379dfe0 con 0x5609636a6370 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266c0da640 1 -- 172.21.15.133:0/324303478 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f265c0083f0 con 0x5609636a6370 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56096379e3f0 con 0x5609636a6370 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266c0da640 1 -- 172.21.15.133:0/324303478 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f265c012040 con 0x5609636a6370 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 Processor -- start 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 -- start start 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ad4f0 0x5609637ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266ddbe980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560963547f20 con 0x5609637ad4f0 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266b0d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ad4f0 0x5609637ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266b0d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ad4f0 0x5609637ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42816/0 (socket says 172.21.15.133:42816) 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266b0d8640 1 -- 172.21.15.133:0/2588003977 learned_addr learned my addr 172.21.15.133:0/2588003977 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266b0d8640 1 -- 172.21.15.133:0/2588003977 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609637ade50 con 0x5609637ad4f0 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.879+0000 7f266b0d8640 1 --2- 172.21.15.133:0/2588003977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ad4f0 0x5609637ad910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f266000e640 tx=0x7f266000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f25517fa640 1 -- 172.21.15.133:0/2588003977 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2660007040 con 0x5609637ad4f0 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 -- 172.21.15.133:0/2588003977 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609637ae0a0 con 0x5609637ad4f0 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f25517fa640 1 -- 172.21.15.133:0/2588003977 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266000d660 con 0x5609637ad4f0 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f25517fa640 1 -- 172.21.15.133:0/2588003977 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f266000d920 con 0x5609637ad4f0 2024-02-15T23:29:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 -- 172.21.15.133:0/2588003977 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609637aebf0 con 0x5609637ad4f0 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f25517fa640 1 -- 172.21.15.133:0/2588003977 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f266001a070 con 0x5609637ad4f0 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f25517fa640 1 --2- 172.21.15.133:0/2588003977 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25440342b0 0x7f2544036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f25517fa640 1 -- 172.21.15.133:0/2588003977 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2660017050 con 0x5609637ad4f0 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266c0da640 1 --2- 172.21.15.133:0/2588003977 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25440342b0 0x7f2544036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 Processor -- start 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 -- start start 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266c0da640 1 --2- 172.21.15.133:0/2588003977 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25440342b0 0x7f2544036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x56096379da20 tx=0x7f265c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637ba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096353b790 con 0x5609637ba4c0 2024-02-15T23:29:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266b0d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637ba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266b0d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637ba8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42822/0 (socket says 172.21.15.133:42822) 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266b0d8640 1 -- 172.21.15.133:0/734521015 learned_addr learned my addr 172.21.15.133:0/734521015 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266b0d8640 1 -- 172.21.15.133:0/734521015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609637bae70 con 0x5609637ba4c0 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266b0d8640 1 --2- 172.21.15.133:0/734521015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637ba8a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f266000ff70 tx=0x7f266001ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9a20458d129d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f254affd640 1 -- 172.21.15.133:0/734521015 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2660025360 con 0x5609637ba4c0 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f254affd640 1 -- 172.21.15.133:0/734521015 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266000de00 con 0x5609637ba4c0 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f254affd640 1 -- 172.21.15.133:0/734521015 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f266003ad00 con 0x5609637ba4c0 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 -- 172.21.15.133:0/734521015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 msgr2=0x5609637ba8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 --2- 172.21.15.133:0/734521015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637ba8a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f266000ff70 tx=0x7f266001ae40 comp rx=0 tx=0).stop 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 -- 172.21.15.133:0/734521015 shutdown_connections 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 --2- 172.21.15.133:0/734521015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637ba8a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.883+0000 7f266ddbe980 1 -- 172.21.15.133:0/734521015 >> 172.21.15.133:0/734521015 conn(0x5609637b6800 msgr2=0x5609637b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 -- 172.21.15.133:0/734521015 shutdown_connections 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 -- 172.21.15.133:0/734521015 wait complete. 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 Processor -- start 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 -- start start 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609637c18a0 con 0x5609637ba4c0 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266b0d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266b0d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637c1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42836/0 (socket says 172.21.15.133:42836) 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 learned_addr learned my addr 172.21.15.133:0/1969667786 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609637aebf0 con 0x5609637ba4c0 2024-02-15T23:29:51.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266b0d8640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637c1360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f266000eed0 tx=0x7f2660048c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f25497fa640 1 -- 172.21.15.133:0/1969667786 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2660025360 con 0x5609637ba4c0 2024-02-15T23:29:51.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609637c1aa0 con 0x5609637ba4c0 2024-02-15T23:29:51.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609637c1f30 con 0x5609637ba4c0 2024-02-15T23:29:51.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f25497fa640 1 -- 172.21.15.133:0/1969667786 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26600246d0 con 0x5609637ba4c0 2024-02-15T23:29:51.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f25497fa640 1 -- 172.21.15.133:0/1969667786 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2660024d40 con 0x5609637ba4c0 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f25497fa640 1 -- 172.21.15.133:0/1969667786 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f266004aa30 con 0x5609637ba4c0 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f25497fa640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25340342b0 0x7f2534036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f25497fa640 1 -- 172.21.15.133:0/1969667786 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2660010070 con 0x5609637ba4c0 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266c0da640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25340342b0 0x7f2534036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609637cc980 0x5609637cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637cf560 con 0x5609637cc980 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266b8d9640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609637cc980 0x5609637cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266c0da640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25340342b0 0x7f2534036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f265c008fd0 tx=0x7f265c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.887+0000 7f266b8d9640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609637cc980 0x5609637cee10 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 realm 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637cf930 con 0x5609637cc980 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d0180 con 0x5609637cc980 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d04e0 con 0x5609637cc980 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d0ce0 con 0x5609637cc980 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 20 searching for the correct realm 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609637d2c30 0x5609637d5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b0d8640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609637d2c30 0x5609637d5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b0d8640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609637d2c30 0x5609637d5060 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b0d8640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2660027060 0x7f266001b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f2660027060 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266c0da640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2660027060 0x7f266001b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266c0da640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2660027060 0x7f266001b740 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f265c02c040 con 0x7f2660027060 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266c0da640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f265c027940 0x7f265c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b8d9640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f265c027940 0x7f265c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.891+0000 7f266b8d9640 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f265c027940 0x7f265c0333c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637cc980 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637cc980 2024-02-15T23:29:51.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f2660027060 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f265c02c040 con 0x7f2660027060 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637cc980 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.895+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637cc980 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f2660027060 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f265c02c040 con 0x7f2660027060 2024-02-15T23:29:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637cc980 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637cc980 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f2660027060 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f265c02c040 con 0x7f2660027060 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637cc980 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.899+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f2660027060 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f265c02c040 con 0x7f2660027060 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637d2c30 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f265c027940 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x5609637cc980 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d56e0 con 0x7f2660027060 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f265c02c040 con 0x7f2660027060 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:51.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d16d0 con 0x5609637cc980 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d1f20 con 0x5609637cc980 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:51.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.903+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d1f20 con 0x5609637cc980 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 zone default found 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 4 Realm: () 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 zonegroup default 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d1f20 con 0x7f265c027940 2024-02-15T23:29:51.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d7550 con 0x5609637d2c30 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d78b0 con 0x5609637d2c30 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 started sync module instance, tier type = 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d6e30 con 0x7f2660027060 2024-02-15T23:29:51.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f265c03f040 con 0x7f2660027060 2024-02-15T23:29:51.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94598323857808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d71e0 con 0x7f2660027060 2024-02-15T23:29:51.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d85c0 con 0x5609637cc980 2024-02-15T23:29:51.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.907+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94598323857808] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f265c03f040 con 0x7f2660027060 2024-02-15T23:29:51.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.911+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.911+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94598323862656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d8540 con 0x5609637cc980 2024-02-15T23:29:51.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.911+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d9010 con 0x5609637d2c30 2024-02-15T23:29:51.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.911+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94598323862656] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.911+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.911+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94598323863712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d84c0 con 0x5609637d2c30 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.911+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d9d00 con 0x7f2660027060 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.915+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f265c03f040 con 0x7f2660027060 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.915+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94598323870064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637da550 con 0x7f2660027060 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.915+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637daf40 con 0x5609637cc980 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.915+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94598323863712] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.915+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94598323870064] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f265c03f040 con 0x7f2660027060 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.915+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.915+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94598323874336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637da0b0 con 0x5609637cc980 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.915+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637db790 con 0x7f265c027940 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.919+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94598323874336] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.919+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.919+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94598323868608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637da0b0 con 0x7f265c027940 2024-02-15T23:29:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.919+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dbc60 con 0x7f265c027940 2024-02-15T23:29:51.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.919+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.919+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94598323877696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dc0c0 con 0x7f265c027940 2024-02-15T23:29:51.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.919+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dcad0 con 0x7f265c027940 2024-02-15T23:29:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.919+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94598323868608] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94598323876144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dca90 con 0x7f265c027940 2024-02-15T23:29:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 add_watcher() i=0 2024-02-15T23:29:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 add_watcher() i=1 2024-02-15T23:29:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 add_watcher() i=2 2024-02-15T23:29:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 add_watcher() i=3 2024-02-15T23:29:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 add_watcher() i=4 2024-02-15T23:29:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 add_watcher() i=5 2024-02-15T23:29:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94598323877696] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 add_watcher() i=6 2024-02-15T23:29:51.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94598323876144] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 add_watcher() i=7 2024-02-15T23:29:51.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:51.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dbc20 con 0x5609637cc980 2024-02-15T23:29:51.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94598323881456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dbc20 con 0x5609637cc980 2024-02-15T23:29:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94598323881456] v31'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f2521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.923+0000 7f266ddbe980 5 note: GC not initialized 2024-02-15T23:29:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f2520fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 20 Filter name: none 2024-02-15T23:29:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f249a7fc640 20 reqs_thread_entry: start 2024-02-15T23:29:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 20 rados->read ofs=0 len=0 2024-02-15T23:29:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560963801910 con 0x5609637cc980 2024-02-15T23:29:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~541 out=541b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+664 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 20 rados_obj.operate() r=0 bl.length=541 2024-02-15T23:29:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609638077c0 con 0x5609637cc980 2024-02-15T23:29:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v31'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94598324056640 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560963806310 con 0x5609637cc980 2024-02-15T23:29:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94598323874336 notify 133143986185 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x5609637969a0 con 0x5609637cc980 2024-02-15T23:29:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f254affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94598323874336 notifier 4409 bl.length()=691 2024-02-15T23:29:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f254affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f254affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f254affd640 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2530003ea0 con 0x5609637cc980 2024-02-15T23:29:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(64 notify.4 [notify cookie 94598324056640 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 94598324056640 notify 133143986185 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560963796570 con 0x5609637cc980 2024-02-15T23:29:51.938 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:51.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.927+0000 7f2521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:51.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94598323881456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560963805e70 con 0x5609637cc980 2024-02-15T23:29:51.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94598323881456] v31'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94598323857808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dc5f0 con 0x7f2660027060 2024-02-15T23:29:51.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94598323857808] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f265c03f040 con 0x7f2660027060 2024-02-15T23:29:51.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266ddbe980 20 remove_watcher() i=0 2024-02-15T23:29:51.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266ddbe980 2 removed watcher, disabling cache 2024-02-15T23:29:51.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94598323862656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dc5f0 con 0x5609637cc980 2024-02-15T23:29:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94598323862656] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266ddbe980 20 remove_watcher() i=1 2024-02-15T23:29:51.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.931+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94598323863712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d7c80 con 0x5609637d2c30 2024-02-15T23:29:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.935+0000 7f266b0d8640 1 -- 172.21.15.133:0/1969667786 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94598323863712] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f266002d040 con 0x5609637d2c30 2024-02-15T23:29:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.935+0000 7f266ddbe980 20 remove_watcher() i=2 2024-02-15T23:29:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.935+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94598323870064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dc5f0 con 0x7f2660027060 2024-02-15T23:29:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.935+0000 7f266c0da640 1 -- 172.21.15.133:0/1969667786 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94598323870064] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f265c03f040 con 0x7f2660027060 2024-02-15T23:29:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.935+0000 7f266ddbe980 20 remove_watcher() i=3 2024-02-15T23:29:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.935+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94598323874336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dc5f0 con 0x5609637cc980 2024-02-15T23:29:51.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.939+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94598323874336] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x5609637cc980 2024-02-15T23:29:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.939+0000 7f266ddbe980 20 remove_watcher() i=4 2024-02-15T23:29:51.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.939+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94598323868608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637daa20 con 0x7f265c027940 2024-02-15T23:29:51.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.939+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94598323868608] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.939+0000 7f266ddbe980 20 remove_watcher() i=5 2024-02-15T23:29:51.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.939+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94598323877696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637dc5f0 con 0x7f265c027940 2024-02-15T23:29:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94598323877696] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 20 remove_watcher() i=6 2024-02-15T23:29:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94598323876144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609637d93c0 con 0x7f265c027940 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94598323876144] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f26640a9a20 con 0x7f265c027940 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 20 remove_watcher() i=7 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f265c027940 msgr2=0x7f265c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f265c027940 0x7f265c0333c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609637cc980 msgr2=0x5609637cee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609637cc980 0x5609637cee10 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2660027060 msgr2=0x7f266001b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2660027060 0x7f266001b740 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609637d2c30 msgr2=0x5609637d5060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609637d2c30 0x5609637d5060 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.943+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25340342b0 msgr2=0x7f2534036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25340342b0 0x7f2534036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f265c008fd0 tx=0x7f265c01c070 comp rx=0 tx=0).stop 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 msgr2=0x5609637c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266b8d9640 1 -- 172.21.15.133:0/1969667786 reap_dead start 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637c1360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f266000eed0 tx=0x7f2660048c10 comp rx=0 tx=0).stop 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 shutdown_connections 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/1969667786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ba4c0 0x5609637c1360 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 >> 172.21.15.133:0/1969667786 conn(0x5609637b6800 msgr2=0x5609637b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 shutdown_connections 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/1969667786 wait complete. 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/2588003977 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25440342b0 msgr2=0x7f2544036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/2588003977 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25440342b0 0x7f2544036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x56096379da20 tx=0x7f265c003070 comp rx=0 tx=0).stop 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/2588003977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ad4f0 msgr2=0x5609637ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/2588003977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ad4f0 0x5609637ad910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f266000e640 tx=0x7f266000ea40 comp rx=0 tx=0).stop 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/2588003977 shutdown_connections 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/2588003977 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25440342b0 0x7f2544036770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/2588003977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609637ad4f0 0x5609637ad910 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/2588003977 >> 172.21.15.133:0/2588003977 conn(0x5609637a2300 msgr2=0x5609637a2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/2588003977 shutdown_connections 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/2588003977 wait complete. 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609636a6370 msgr2=0x56096379cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609636a6370 0x56096379cc70 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25540342b0 msgr2=0x7f2554036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25540342b0 0x7f2554036770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2660001e50 tx=0x7f26600013b0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 msgr2=0x560963796030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x560963796030 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2664017ca0 tx=0x7f2664017e30 comp rx=0 tx=0).stop 2024-02-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 shutdown_connections 2024-02-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609636a6370 0x56096379cc70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f25540342b0 0x7f2554036770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 --2- 172.21.15.133:0/324303478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609636178c0 0x560963796030 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 >> 172.21.15.133:0/324303478 conn(0x56096369d910 msgr2=0x5609636a1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 shutdown_connections 2024-02-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:51.947+0000 7f266ddbe980 1 -- 172.21.15.133:0/324303478 wait complete. 2024-02-15T23:29:51.964 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:51.964 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-15T23:29:51.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-15T23:29:51.964 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-02-15T23:29:52.035 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:52.035 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f880a99c980 1 Processor -- start 2024-02-15T23:29:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f880a99c980 1 -- start start 2024-02-15T23:29:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f880a99c980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5632e86244f0 0x5632e86268e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f880a99c980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5632e856d460 con 0x5632e861ffe0 2024-02-15T23:29:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f880a99c980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5632e8534180 con 0x5632e86244f0 2024-02-15T23:29:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f8807cb6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5632e86244f0 0x5632e86268e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f88084b7640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5632e861ffe0 0x5632e86203c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39874/0 (socket says 172.21.15.133:39874) 2024-02-15T23:29:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f88084b7640 1 -- 172.21.15.133:0/3201406721 learned_addr learned my addr 172.21.15.133:0/3201406721 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f88074b5640 1 -- 172.21.15.133:0/3201406721 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849663829 0 0) 0x5632e856d460 con 0x5632e861ffe0 2024-02-15T23:29:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f88074b5640 1 -- 172.21.15.133:0/3201406721 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e8001e20 con 0x5632e861ffe0 2024-02-15T23:29:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f8807cb6640 1 -- 172.21.15.133:0/3201406721 >> v1:172.21.15.131:6789/0 conn(0x5632e861ffe0 legacy=0x5632e86203c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.027+0000 7f8807cb6640 1 -- 172.21.15.133:0/3201406721 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632e8627e30 con 0x5632e86244f0 2024-02-15T23:29:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f8807cb6640 1 --2- 172.21.15.133:0/3201406721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e86244f0 0x5632e86268e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f880000a420 tx=0x7f880001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2509a9d4a6b37e37 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f88074b5640 1 -- 172.21.15.133:0/3201406721 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88000aa530 con 0x5632e86244f0 2024-02-15T23:29:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f88074b5640 1 -- 172.21.15.133:0/3201406721 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000a6050 con 0x5632e86244f0 2024-02-15T23:29:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f88074b5640 1 -- 172.21.15.133:0/3201406721 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88000aa800 con 0x5632e86244f0 2024-02-15T23:29:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f880a99c980 1 -- 172.21.15.133:0/3201406721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e86244f0 msgr2=0x5632e86268e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f880a99c980 1 --2- 172.21.15.133:0/3201406721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e86244f0 0x5632e86268e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f880000a420 tx=0x7f880001afd0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f880a99c980 1 -- 172.21.15.133:0/3201406721 shutdown_connections 2024-02-15T23:29:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f880a99c980 1 --2- 172.21.15.133:0/3201406721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e86244f0 0x5632e86268e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f880a99c980 1 -- 172.21.15.133:0/3201406721 >> 172.21.15.133:0/3201406721 conn(0x5632e861b8b0 msgr2=0x5632e861dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f880a99c980 1 -- 172.21.15.133:0/3201406721 shutdown_connections 2024-02-15T23:29:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.031+0000 7f880a99c980 1 -- 172.21.15.133:0/3201406721 wait complete. 2024-02-15T23:29:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.043+0000 7f880a99c980 1 Processor -- start 2024-02-15T23:29:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- start start 2024-02-15T23:29:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8594fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632e85316b0 con 0x5632e861ffe0 2024-02-15T23:29:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f88084b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8594fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f88084b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8594fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42846/0 (socket says 172.21.15.133:42846) 2024-02-15T23:29:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f88084b7640 1 -- 172.21.15.133:0/3930436724 learned_addr learned my addr 172.21.15.133:0/3930436724 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f88084b7640 1 -- 172.21.15.133:0/3930436724 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880000a100 con 0x5632e861ffe0 2024-02-15T23:29:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f88084b7640 1 --2- 172.21.15.133:0/3930436724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8594fc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f87f8001c30 tx=0x7f87f800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1e773a63d32beb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f86f561a640 1 -- 172.21.15.133:0/3930436724 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f800e690 con 0x5632e861ffe0 2024-02-15T23:29:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f86f561a640 1 -- 172.21.15.133:0/3930436724 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f800e7f0 con 0x5632e861ffe0 2024-02-15T23:29:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f86f561a640 1 -- 172.21.15.133:0/3930436724 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f800eb50 con 0x5632e861ffe0 2024-02-15T23:29:52.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- 172.21.15.133:0/3930436724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 msgr2=0x5632e8594fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 --2- 172.21.15.133:0/3930436724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8594fc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f87f8001c30 tx=0x7f87f800b6d0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- 172.21.15.133:0/3930436724 shutdown_connections 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 --2- 172.21.15.133:0/3930436724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8594fc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- 172.21.15.133:0/3930436724 >> 172.21.15.133:0/3930436724 conn(0x5632e861b8b0 msgr2=0x5632e87058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- 172.21.15.133:0/3930436724 shutdown_connections 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- 172.21.15.133:0/3930436724 wait complete. 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 Processor -- start 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- start start 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8713fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f880a99c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632e852ce90 con 0x5632e861ffe0 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f88084b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8713fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f88084b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8713fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42850/0 (socket says 172.21.15.133:42850) 2024-02-15T23:29:52.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.047+0000 7f88084b7640 1 -- 172.21.15.133:0/1598889269 learned_addr learned my addr 172.21.15.133:0/1598889269 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f88084b7640 1 -- 172.21.15.133:0/1598889269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8001e20 con 0x5632e861ffe0 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f88084b7640 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8713fe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f87f800b710 tx=0x7f87f8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f86f3e17640 1 -- 172.21.15.133:0/1598889269 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f801f070 con 0x5632e861ffe0 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f86f3e17640 1 -- 172.21.15.133:0/1598889269 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f801a2e0 con 0x5632e861ffe0 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5632e8714520 con 0x5632e861ffe0 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f86f3e17640 1 -- 172.21.15.133:0/1598889269 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f801a820 con 0x5632e861ffe0 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632e8714970 con 0x5632e861ffe0 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f86f3e17640 1 -- 172.21.15.133:0/1598889269 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f87f800a040 con 0x5632e861ffe0 2024-02-15T23:29:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f86f3e17640 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86ec0342b0 0x7f86ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f86f3e17640 1 -- 172.21.15.133:0/1598889269 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f87f8049810 con 0x5632e861ffe0 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f8807cb6640 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86ec0342b0 0x7f86ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f880a99c980 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e86244f0 0x5632e871ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e871b0d0 con 0x5632e86244f0 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f8808cb8640 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e86244f0 0x5632e871ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f8807cb6640 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86ec0342b0 0x7f86ec036770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f88000ac000 tx=0x7f88000a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f8808cb8640 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e86244f0 0x5632e871ab90 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f8808cb8640 1 -- 172.21.15.133:0/1598889269 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f00083f0 con 0x5632e86244f0 2024-02-15T23:29:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87182b0 con 0x5632e86244f0 2024-02-15T23:29:52.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f8808cb8640 1 -- 172.21.15.133:0/1598889269 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f87f00083f0 con 0x5632e86244f0 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.051+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e871ce00 con 0x5632e86244f0 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f8808cb8640 1 -- 172.21.15.133:0/1598889269 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f87f00083f0 con 0x5632e86244f0 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e871c000 con 0x5632e86244f0 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f8808cb8640 1 -- 172.21.15.133:0/1598889269 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f87f00083f0 con 0x5632e86244f0 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e871c410 con 0x5632e86244f0 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f8808cb8640 1 -- 172.21.15.133:0/1598889269 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f87f0012040 con 0x5632e86244f0 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f880a99c980 1 Processor -- start 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f880a99c980 1 -- start start 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f880a99c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e872b480 0x5632e872b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f880a99c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632e84c5f20 con 0x5632e872b480 2024-02-15T23:29:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f8807cb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e872b480 0x5632e872b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f8807cb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e872b480 0x5632e872b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42856/0 (socket says 172.21.15.133:42856) 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f8807cb6640 1 -- 172.21.15.133:0/4177430384 learned_addr learned my addr 172.21.15.133:0/4177430384 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f8807cb6640 1 -- 172.21.15.133:0/4177430384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632e872bde0 con 0x5632e872b480 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f8807cb6640 1 --2- 172.21.15.133:0/4177430384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e872b480 0x5632e872b8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8800096ac0 tx=0x7f8800017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f86f1612640 1 -- 172.21.15.133:0/4177430384 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88000bb070 con 0x5632e872b480 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f880a99c980 1 -- 172.21.15.133:0/4177430384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5632e872bfd0 con 0x5632e872b480 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f86f1612640 1 -- 172.21.15.133:0/4177430384 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000b6830 con 0x5632e872b480 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f86f1612640 1 -- 172.21.15.133:0/4177430384 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88000b6ad0 con 0x5632e872b480 2024-02-15T23:29:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f880a99c980 1 -- 172.21.15.133:0/4177430384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632e872cac0 con 0x5632e872b480 2024-02-15T23:29:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.055+0000 7f86f1612640 1 -- 172.21.15.133:0/4177430384 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f88000bf070 con 0x5632e872b480 2024-02-15T23:29:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f86f1612640 1 --2- 172.21.15.133:0/4177430384 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86e00342b0 0x7f86e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f86f1612640 1 -- 172.21.15.133:0/4177430384 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f88000e4ec0 con 0x5632e872b480 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8808cb8640 1 --2- 172.21.15.133:0/4177430384 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86e00342b0 0x7f86e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 Processor -- start 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- start start 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8808cb8640 1 --2- 172.21.15.133:0/4177430384 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86e00342b0 0x7f86e0036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5632e871ba40 tx=0x7f87f0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e87388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632e84b9790 con 0x5632e8738480 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e87388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e87388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42860/0 (socket says 172.21.15.133:42860) 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 -- 172.21.15.133:0/4209935796 learned_addr learned my addr 172.21.15.133:0/4209935796 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 -- 172.21.15.133:0/4209935796 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632e8738e70 con 0x5632e8738480 2024-02-15T23:29:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 --2- 172.21.15.133:0/4209935796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e87388a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f88000c1fd0 tx=0x7f88000b3770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f87017df2cbb37a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f86eaffd640 1 -- 172.21.15.133:0/4209935796 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88000c1690 con 0x5632e8738480 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f86eaffd640 1 -- 172.21.15.133:0/4209935796 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000ca3b0 con 0x5632e8738480 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f86eaffd640 1 -- 172.21.15.133:0/4209935796 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88000ca650 con 0x5632e8738480 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- 172.21.15.133:0/4209935796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 msgr2=0x5632e87388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 --2- 172.21.15.133:0/4209935796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e87388a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f88000c1fd0 tx=0x7f88000b3770 comp rx=0 tx=0).stop 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- 172.21.15.133:0/4209935796 shutdown_connections 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 --2- 172.21.15.133:0/4209935796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e87388a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- 172.21.15.133:0/4209935796 >> 172.21.15.133:0/4209935796 conn(0x5632e8734810 msgr2=0x5632e8732870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- 172.21.15.133:0/4209935796 shutdown_connections 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- 172.21.15.133:0/4209935796 wait complete. 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 Processor -- start 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- start start 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e873f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f880a99c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632e873f8f0 con 0x5632e8738480 2024-02-15T23:29:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e873f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e873f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42868/0 (socket says 172.21.15.133:42868) 2024-02-15T23:29:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 learned_addr learned my addr 172.21.15.133:0/2770614062 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.059+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632e872cac0 con 0x5632e8738480 2024-02-15T23:29:52.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f8807cb6640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e873f3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f88000b37b0 tx=0x7f88000e3280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f86e97fa640 1 -- 172.21.15.133:0/2770614062 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88000caa60 con 0x5632e8738480 2024-02-15T23:29:52.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5632e873faf0 con 0x5632e8738480 2024-02-15T23:29:52.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f86e97fa640 1 -- 172.21.15.133:0/2770614062 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000cb440 con 0x5632e8738480 2024-02-15T23:29:52.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632e873fec0 con 0x5632e8738480 2024-02-15T23:29:52.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f86e97fa640 1 -- 172.21.15.133:0/2770614062 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88000cb6e0 con 0x5632e8738480 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f86e97fa640 1 -- 172.21.15.133:0/2770614062 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f88000de040 con 0x5632e8738480 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f86e97fa640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86d0034300 0x7f86d00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f86e97fa640 1 -- 172.21.15.133:0/2770614062 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f88000b80c0 con 0x5632e8738480 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f8808cb8640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86d0034300 0x7f86d00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e874a960 0x5632e874ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e874d570 con 0x5632e874a960 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f88084b7640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e874a960 0x5632e874ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f8808cb8640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86d0034300 0x7f86d00367c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f87f0008fd0 tx=0x7f87f001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f88084b7640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e874a960 0x5632e874ce20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 realm 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e874d940 con 0x5632e874a960 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e874e1c0 con 0x5632e874a960 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e874e520 con 0x5632e874a960 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e874ed20 con 0x5632e874a960 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 20 searching for the correct realm 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5632e8750bb0 0x5632e8753020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.063+0000 7f8807cb6640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5632e8750bb0 0x5632e8753020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8807cb6640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5632e8750bb0 0x5632e8753020 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8807cb6640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88000cb060 0x7f88000f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f88000cb060 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8808cb8640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88000cb060 0x7f88000f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8808cb8640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88000cb060 0x7f88000f2860 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f002c040 con 0x7f88000cb060 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8808cb8640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f87f0027940 0x7f87f00333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f88084b7640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f87f0027940 0x7f87f00333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f88084b7640 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f87f0027940 0x7f87f00333c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8014070 con 0x7f87f0027940 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e874a960 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e874a960 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.067+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8014070 con 0x7f87f0027940 2024-02-15T23:29:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8014070 con 0x7f87f0027940 2024-02-15T23:29:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f88000cb060 2024-02-15T23:29:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f002c040 con 0x7f88000cb060 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e874a960 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8014070 con 0x7f87f0027940 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e874a960 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f88000cb060 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f87f002c040 con 0x7f88000cb060 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8014070 con 0x7f87f0027940 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.071+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e874a960 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e874a960 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f87f8014070 con 0x5632e874a960 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f88000cb060 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f002c040 con 0x7f88000cb060 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e874a960 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.075+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f88000cb060 2024-02-15T23:29:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f002c040 con 0x7f88000cb060 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e8750bb0 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f87f0027940 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x5632e874a960 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87536f0 con 0x7f88000cb060 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f002c040 con 0x7f88000cb060 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e874f620 con 0x5632e874a960 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e874fe70 con 0x5632e874a960 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8753b30 con 0x5632e874a960 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 zone default found 2024-02-15T23:29:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 4 Realm: () 2024-02-15T23:29:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 zonegroup default 2024-02-15T23:29:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8753b30 con 0x7f87f0027940 2024-02-15T23:29:52.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87559b0 con 0x5632e8750bb0 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8755d10 con 0x5632e8750bb0 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 started sync module instance, tier type = 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.079+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8754f80 con 0x7f88000cb060 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.083+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.083+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94776648356704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8754f80 con 0x7f88000cb060 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.083+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8756680 con 0x5632e874a960 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.083+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94776648356704] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.083+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.083+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94776648360688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8754f80 con 0x5632e874a960 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.083+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8757040 con 0x5632e8750bb0 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94776648362912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8757890 con 0x5632e8750bb0 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8758240 con 0x7f88000cb060 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94776648360688] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94776648354528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87585f0 con 0x7f88000cb060 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8758f60 con 0x5632e874a960 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94776648362912] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94776648354528] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94776648367456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8758ac0 con 0x5632e874a960 2024-02-15T23:29:52.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.087+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87597b0 con 0x7f87f0027940 2024-02-15T23:29:52.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.091+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94776648367456] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.091+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.091+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94776648365040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8758ac0 con 0x7f87f0027940 2024-02-15T23:29:52.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.091+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8759c50 con 0x7f87f0027940 2024-02-15T23:29:52.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.091+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94776648365040] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.091+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.091+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94776648374064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8759c10 con 0x7f87f0027940 2024-02-15T23:29:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.091+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e875a580 con 0x7f87f0027940 2024-02-15T23:29:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94776648374064] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94776648372336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e875a580 con 0x7f87f0027940 2024-02-15T23:29:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f880a99c980 20 add_watcher() i=0 2024-02-15T23:29:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f880a99c980 20 add_watcher() i=1 2024-02-15T23:29:52.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f880a99c980 20 add_watcher() i=2 2024-02-15T23:29:52.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f880a99c980 20 add_watcher() i=3 2024-02-15T23:29:52.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f880a99c980 20 add_watcher() i=4 2024-02-15T23:29:52.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f880a99c980 20 add_watcher() i=5 2024-02-15T23:29:52.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.095+0000 7f880a99c980 20 add_watcher() i=6 2024-02-15T23:29:52.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94776648372336] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 20 add_watcher() i=7 2024-02-15T23:29:52.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:52.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e875d970 con 0x5632e874a960 2024-02-15T23:29:52.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94776648377008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e875ae80 con 0x5632e874a960 2024-02-15T23:29:52.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94776648377008] v31'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f86be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:52.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:52.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 5 note: GC not initialized 2024-02-15T23:29:52.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f86bd7e2640 20 reqs_thread_entry: start 2024-02-15T23:29:52.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:52.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 20 Filter name: none 2024-02-15T23:29:52.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f86b67fc640 20 reqs_thread_entry: start 2024-02-15T23:29:52.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:52.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e877f8c0 con 0x5632e874a960 2024-02-15T23:29:52.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T23:29:52.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:52.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:52.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:52.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.099+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8785600 con 0x5632e874a960 2024-02-15T23:29:52.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v31'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f880a99c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:52.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f880a99c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f880a99c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94776648552640 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8781110 con 0x5632e874a960 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94776648367456 notify 133143986186 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f87f8061040 con 0x5632e874a960 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f86eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94776648367456 notifier 4416 bl.length()=534 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f86eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f86eaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f86eaffd640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f86cc003ea0 con 0x5632e874a960 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(64 notify.4 [notify cookie 94776648552640 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 94776648552640 notify 133143986186 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5632e8714970 con 0x5632e874a960 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f880a99c980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94776648552640 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8781110 con 0x7f88000cb060 2024-02-15T23:29:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== watch-notify(notify (1) cookie 94776648356704 notify 133143986181 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7f87f001aa80 con 0x7f88000cb060 2024-02-15T23:29:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f86ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94776648356704 notifier 4416 bl.length()=159 2024-02-15T23:29:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f86ea7fc640 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f86300032c0 con 0x7f88000cb060 2024-02-15T23:29:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(66 notify.0 [notify cookie 94776648552640 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== watch-notify(notify_complete (2) cookie 94776648552640 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f87f001ac10 con 0x7f88000cb060 2024-02-15T23:29:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.103+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87850c0 con 0x7f88000cb060 2024-02-15T23:29:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(68 foo:foo2 [delete] v31'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.115 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:52.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f86be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94776648377008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e87841d0 con 0x5632e874a960 2024-02-15T23:29:52.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94776648377008] v31'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94776648356704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8783d30 con 0x7f88000cb060 2024-02-15T23:29:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94776648356704] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f880a99c980 20 remove_watcher() i=0 2024-02-15T23:29:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f880a99c980 2 removed watcher, disabling cache 2024-02-15T23:29:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.107+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94776648360688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8755360 con 0x5632e874a960 2024-02-15T23:29:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.111+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94776648360688] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.111+0000 7f880a99c980 20 remove_watcher() i=1 2024-02-15T23:29:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.111+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94776648362912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8755360 con 0x5632e8750bb0 2024-02-15T23:29:52.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.111+0000 7f8807cb6640 1 -- 172.21.15.133:0/2770614062 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94776648362912] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88000ef070 con 0x5632e8750bb0 2024-02-15T23:29:52.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.111+0000 7f880a99c980 20 remove_watcher() i=2 2024-02-15T23:29:52.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.111+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94776648354528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8756ba0 con 0x7f88000cb060 2024-02-15T23:29:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.115+0000 7f8808cb8640 1 -- 172.21.15.133:0/2770614062 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94776648354528] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f003f040 con 0x7f88000cb060 2024-02-15T23:29:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.115+0000 7f880a99c980 20 remove_watcher() i=3 2024-02-15T23:29:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.115+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94776648367456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8754ae0 con 0x5632e874a960 2024-02-15T23:29:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.115+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94776648367456] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x5632e874a960 2024-02-15T23:29:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.115+0000 7f880a99c980 20 remove_watcher() i=4 2024-02-15T23:29:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.115+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94776648365040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8756ba0 con 0x7f87f0027940 2024-02-15T23:29:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.119+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94776648365040] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.119+0000 7f880a99c980 20 remove_watcher() i=5 2024-02-15T23:29:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.119+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94776648374064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8754ae0 con 0x7f87f0027940 2024-02-15T23:29:52.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.119+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94776648374064] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.119+0000 7f880a99c980 20 remove_watcher() i=6 2024-02-15T23:29:52.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.119+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94776648372336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5632e8756ba0 con 0x7f87f0027940 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94776648372336] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f8059040 con 0x7f87f0027940 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 20 remove_watcher() i=7 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f87f0027940 msgr2=0x7f87f00333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f87f0027940 0x7f87f00333c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e874a960 msgr2=0x5632e874ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e874a960 0x5632e874ce20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88000cb060 msgr2=0x7f88000f2860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f88000cb060 0x7f88000f2860 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5632e8750bb0 msgr2=0x5632e8753020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5632e8750bb0 0x5632e8753020 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86d0034300 msgr2=0x7f86d00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86d0034300 0x7f86d00367c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f87f0008fd0 tx=0x7f87f001c070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 msgr2=0x5632e873f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f88084b7640 1 -- 172.21.15.133:0/2770614062 reap_dead start 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e873f3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f88000b37b0 tx=0x7f88000e3280 comp rx=0 tx=0).stop 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 shutdown_connections 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/2770614062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e8738480 0x5632e873f3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 >> 172.21.15.133:0/2770614062 conn(0x5632e8734810 msgr2=0x5632e8731e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 shutdown_connections 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/2770614062 wait complete. 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/4177430384 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86e00342b0 msgr2=0x7f86e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/4177430384 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86e00342b0 0x7f86e0036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5632e871ba40 tx=0x7f87f0003070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/4177430384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e872b480 msgr2=0x5632e872b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/4177430384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e872b480 0x5632e872b8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8800096ac0 tx=0x7f8800017d70 comp rx=0 tx=0).stop 2024-02-15T23:29:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/4177430384 shutdown_connections 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/4177430384 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86e00342b0 0x7f86e0036770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/4177430384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e872b480 0x5632e872b8a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/4177430384 >> 172.21.15.133:0/4177430384 conn(0x5632e8720290 msgr2=0x5632e8720da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/4177430384 shutdown_connections 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/4177430384 wait complete. 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e86244f0 msgr2=0x5632e871ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e86244f0 0x5632e871ab90 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86ec0342b0 msgr2=0x7f86ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86ec0342b0 0x7f86ec036770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f88000ac000 tx=0x7f88000a5000 comp rx=0 tx=0).stop 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 msgr2=0x5632e8713fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8713fe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f87f800b710 tx=0x7f87f8000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 shutdown_connections 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5632e86244f0 0x5632e871ab90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f86ec0342b0 0x7f86ec036770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 --2- 172.21.15.133:0/1598889269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5632e861ffe0 0x5632e8713fe0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 >> 172.21.15.133:0/1598889269 conn(0x5632e861b8b0 msgr2=0x5632e87043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 shutdown_connections 2024-02-15T23:29:52.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.123+0000 7f880a99c980 1 -- 172.21.15.133:0/1598889269 wait complete. 2024-02-15T23:29:52.141 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:52.141 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-15T23:29:52.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-15T23:29:52.141 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-15T23:29:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f927a1ee980 1 Processor -- start 2024-02-15T23:29:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f927a1ee980 1 -- start start 2024-02-15T23:29:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f927a1ee980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609951036a0 0x560995197140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f927a1ee980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5609950da4c0 con 0x5609951049e0 2024-02-15T23:29:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f927a1ee980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5609950a1180 con 0x5609951036a0 2024-02-15T23:29:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f9277508640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609951036a0 0x560995197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f9277d09640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5609951049e0 0x560995102f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39878/0 (socket says 172.21.15.133:39878) 2024-02-15T23:29:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f9277508640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609951036a0 0x560995197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42884/0 (socket says 172.21.15.133:42884) 2024-02-15T23:29:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f9277d09640 1 -- 172.21.15.133:0/3669945191 learned_addr learned my addr 172.21.15.133:0/3669945191 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f9277508640 1 -- 172.21.15.133:0/3669945191 >> v1:172.21.15.131:6789/0 conn(0x5609951049e0 legacy=0x560995102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.207+0000 7f9277508640 1 -- 172.21.15.133:0/3669945191 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560995103ab0 con 0x5609951036a0 2024-02-15T23:29:52.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f9277508640 1 --2- 172.21.15.133:0/3669945191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x560995197140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f927000a420 tx=0x7f927001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c475534f538edbd7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f9276d07640 1 -- 172.21.15.133:0/3669945191 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92700a3dc0 con 0x5609951036a0 2024-02-15T23:29:52.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f9276d07640 1 -- 172.21.15.133:0/3669945191 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92700ab440 con 0x5609951036a0 2024-02-15T23:29:52.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f9276d07640 1 -- 172.21.15.133:0/3669945191 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92700ab720 con 0x5609951036a0 2024-02-15T23:29:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f927a1ee980 1 -- 172.21.15.133:0/3669945191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 msgr2=0x560995197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3669945191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x560995197140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f927000a420 tx=0x7f927001afd0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f927a1ee980 1 -- 172.21.15.133:0/3669945191 shutdown_connections 2024-02-15T23:29:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3669945191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x560995197140 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f927a1ee980 1 -- 172.21.15.133:0/3669945191 >> 172.21.15.133:0/3669945191 conn(0x560995189a00 msgr2=0x56099518be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f927a1ee980 1 -- 172.21.15.133:0/3669945191 shutdown_connections 2024-02-15T23:29:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.211+0000 7f927a1ee980 1 -- 172.21.15.133:0/3669945191 wait complete. 2024-02-15T23:29:52.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.223+0000 7f927a1ee980 1 Processor -- start 2024-02-15T23:29:52.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.223+0000 7f927a1ee980 1 -- start start 2024-02-15T23:29:52.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x56099527a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099509e6b0 con 0x5609951036a0 2024-02-15T23:29:52.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x56099527a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x56099527a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42894/0 (socket says 172.21.15.133:42894) 2024-02-15T23:29:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 -- 172.21.15.133:0/321237620 learned_addr learned my addr 172.21.15.133:0/321237620 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 -- 172.21.15.133:0/321237620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927000a100 con 0x5609951036a0 2024-02-15T23:29:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 --2- 172.21.15.133:0/321237620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x56099527a580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f926c001c90 tx=0x7f926c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6844354d0b26beb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9165e0b640 1 -- 172.21.15.133:0/321237620 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f926c00e690 con 0x5609951036a0 2024-02-15T23:29:52.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9165e0b640 1 -- 172.21.15.133:0/321237620 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c00e7f0 con 0x5609951036a0 2024-02-15T23:29:52.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9165e0b640 1 -- 172.21.15.133:0/321237620 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f926c00eaf0 con 0x5609951036a0 2024-02-15T23:29:52.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 -- 172.21.15.133:0/321237620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 msgr2=0x56099527a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 --2- 172.21.15.133:0/321237620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x56099527a580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f926c001c90 tx=0x7f926c00b6d0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 -- 172.21.15.133:0/321237620 shutdown_connections 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 --2- 172.21.15.133:0/321237620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x56099527a580 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 -- 172.21.15.133:0/321237620 >> 172.21.15.133:0/321237620 conn(0x560995189a00 msgr2=0x560995276110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 -- 172.21.15.133:0/321237620 shutdown_connections 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 -- 172.21.15.133:0/321237620 wait complete. 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 Processor -- start 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 -- start start 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x5609952813d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f927a1ee980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560995099e90 con 0x5609951036a0 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x5609952813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x5609952813d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42908/0 (socket says 172.21.15.133:42908) 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 -- 172.21.15.133:0/1300645663 learned_addr learned my addr 172.21.15.133:0/1300645663 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.227+0000 7f9277d09640 1 -- 172.21.15.133:0/1300645663 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609950da4c0 con 0x5609951036a0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f9277d09640 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x5609952813d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f926c001ee0 tx=0x7f926c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f915ffff640 1 -- 172.21.15.133:0/1300645663 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f926c01f070 con 0x5609951036a0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f915ffff640 1 -- 172.21.15.133:0/1300645663 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c01a4d0 con 0x5609951036a0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560995281910 con 0x5609951036a0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f915ffff640 1 -- 172.21.15.133:0/1300645663 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f926c01a770 con 0x5609951036a0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560995281d60 con 0x5609951036a0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f915ffff640 1 -- 172.21.15.133:0/1300645663 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f926c00a040 con 0x5609951036a0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f915ffff640 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91600342b0 0x7f9160036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f915ffff640 1 -- 172.21.15.133:0/1300645663 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f926c049840 con 0x5609951036a0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f9277508640 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91600342b0 0x7f9160036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609951049e0 0x560995288020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560995288560 con 0x5609951049e0 2024-02-15T23:29:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927850a640 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609951049e0 0x560995288020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f9277508640 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91600342b0 0x7f9160036770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f92700ad000 tx=0x7f92700a5070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927850a640 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609951049e0 0x560995288020 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927850a640 1 -- 172.21.15.133:0/1300645663 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92680083f0 con 0x5609951049e0 2024-02-15T23:29:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560995285720 con 0x5609951049e0 2024-02-15T23:29:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927850a640 1 -- 172.21.15.133:0/1300645663 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f92680083f0 con 0x5609951049e0 2024-02-15T23:29:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099528a260 con 0x5609951049e0 2024-02-15T23:29:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927850a640 1 -- 172.21.15.133:0/1300645663 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f92680083f0 con 0x5609951049e0 2024-02-15T23:29:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560995289460 con 0x5609951049e0 2024-02-15T23:29:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927850a640 1 -- 172.21.15.133:0/1300645663 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f92680083f0 con 0x5609951049e0 2024-02-15T23:29:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.231+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560995289870 con 0x5609951049e0 2024-02-15T23:29:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927850a640 1 -- 172.21.15.133:0/1300645663 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9268012040 con 0x5609951049e0 2024-02-15T23:29:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927a1ee980 1 Processor -- start 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927a1ee980 1 -- start start 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927a1ee980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952989d0 0x560995298df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927a1ee980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560995032f20 con 0x5609952989d0 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f9277508640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952989d0 0x560995298df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f9277508640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952989d0 0x560995298df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42916/0 (socket says 172.21.15.133:42916) 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f9277508640 1 -- 172.21.15.133:0/1447861613 learned_addr learned my addr 172.21.15.133:0/1447861613 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f9277508640 1 -- 172.21.15.133:0/1447861613 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560995299330 con 0x5609952989d0 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f9277508640 1 --2- 172.21.15.133:0/1447861613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952989d0 0x560995298df0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f927001b540 tx=0x7f9270017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f915d7fa640 1 -- 172.21.15.133:0/1447861613 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92700bc070 con 0x5609952989d0 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927a1ee980 1 -- 172.21.15.133:0/1447861613 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560995299520 con 0x5609952989d0 2024-02-15T23:29:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927a1ee980 1 -- 172.21.15.133:0/1447861613 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56099529a010 con 0x5609952989d0 2024-02-15T23:29:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f915d7fa640 1 -- 172.21.15.133:0/1447861613 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92700b7920 con 0x5609952989d0 2024-02-15T23:29:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f915d7fa640 1 -- 172.21.15.133:0/1447861613 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92700b7bc0 con 0x5609952989d0 2024-02-15T23:29:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f915d7fa640 1 -- 172.21.15.133:0/1447861613 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f92700c0070 con 0x5609952989d0 2024-02-15T23:29:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f915d7fa640 1 --2- 172.21.15.133:0/1447861613 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91500342b0 0x7f9150036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f915d7fa640 1 -- 172.21.15.133:0/1447861613 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f92700e53c0 con 0x5609952989d0 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927850a640 1 --2- 172.21.15.133:0/1447861613 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91500342b0 0x7f9150036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927a1ee980 1 Processor -- start 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.235+0000 7f927a1ee980 1 -- start start 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560995026790 con 0x5609952a5a80 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927850a640 1 --2- 172.21.15.133:0/1447861613 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91500342b0 0x7f9150036770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x560995288de0 tx=0x7f9268003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952a5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42922/0 (socket says 172.21.15.133:42922) 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 -- 172.21.15.133:0/13338018 learned_addr learned my addr 172.21.15.133:0/13338018 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 -- 172.21.15.133:0/13338018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609952a6430 con 0x5609952a5a80 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 --2- 172.21.15.133:0/13338018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952a5e60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92700b6040 tx=0x7f92700b7e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b314e3cf74b285c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9156ffd640 1 -- 172.21.15.133:0/13338018 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92700e2260 con 0x5609952a5a80 2024-02-15T23:29:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9156ffd640 1 -- 172.21.15.133:0/13338018 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92700e23c0 con 0x5609952a5a80 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9156ffd640 1 -- 172.21.15.133:0/13338018 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92700e51a0 con 0x5609952a5a80 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- 172.21.15.133:0/13338018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 msgr2=0x5609952a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 --2- 172.21.15.133:0/13338018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952a5e60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92700b6040 tx=0x7f92700b7e90 comp rx=0 tx=0).stop 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- 172.21.15.133:0/13338018 shutdown_connections 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 --2- 172.21.15.133:0/13338018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952a5e60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- 172.21.15.133:0/13338018 >> 172.21.15.133:0/13338018 conn(0x5609952a1dc0 msgr2=0x56099529fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- 172.21.15.133:0/13338018 shutdown_connections 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- 172.21.15.133:0/13338018 wait complete. 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 Processor -- start 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- start start 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609952ace60 con 0x5609952a5a80 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952ac920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42934/0 (socket says 172.21.15.133:42934) 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 learned_addr learned my addr 172.21.15.133:0/3156041937 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56099529a010 con 0x5609952a5a80 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f9277508640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952ac920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f92700b6040 tx=0x7f92700e36c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f91557fa640 1 -- 172.21.15.133:0/3156041937 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92700b48e0 con 0x5609952a5a80 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609952ad060 con 0x5609952a5a80 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609952ad490 con 0x5609952a5a80 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f91557fa640 1 -- 172.21.15.133:0/3156041937 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92700b5cf0 con 0x5609952a5a80 2024-02-15T23:29:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.239+0000 7f91557fa640 1 -- 172.21.15.133:0/3156041937 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92700caba0 con 0x5609952a5a80 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f91557fa640 1 -- 172.21.15.133:0/3156041937 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f92700b2070 con 0x5609952a5a80 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f91557fa640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91400342b0 0x7f9140036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f91557fa640 1 -- 172.21.15.133:0/3156041937 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f92700ba0c0 con 0x5609952a5a80 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927850a640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91400342b0 0x7f9140036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609952b7ce0 0x5609952ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952ba8f0 con 0x5609952b7ce0 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277d09640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609952b7ce0 0x5609952ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927850a640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91400342b0 0x7f9140036770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9268008fd0 tx=0x7f926801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277d09640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609952b7ce0 0x5609952ba1a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 realm 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952bacc0 con 0x5609952b7ce0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952bb510 con 0x5609952b7ce0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952bb870 con 0x5609952b7ce0 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952bb1b0 con 0x5609952b7ce0 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 20 searching for the correct realm 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609952bdac0 0x5609952bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277508640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609952bdac0 0x5609952bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277508640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609952bdac0 0x5609952bfef0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277508640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f92700ee020 0x7f92700e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f92700ee020 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.243+0000 7f927850a640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f92700ee020 0x7f92700e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f927850a640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f92700ee020 0x7f92700e57f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926802c040 con 0x7f92700ee020 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f927850a640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9268027940 0x7f92680333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9268027940 0x7f92680333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9268027940 0x7f92680333c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x7f9268027940 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952b7ce0 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952b7ce0 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x7f9268027940 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x7f9268027940 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f92700ee020 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926802c040 con 0x7f92700ee020 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.247+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952b7ce0 2024-02-15T23:29:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x7f9268027940 2024-02-15T23:29:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952b7ce0 2024-02-15T23:29:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f92700ee020 2024-02-15T23:29:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f926802c040 con 0x7f92700ee020 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x7f9268027940 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952b7ce0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952b7ce0 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.251+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x7f9268027940 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f92700ee020 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926802c040 con 0x7f92700ee020 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952b7ce0 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x5609952b7ce0 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x7f9268027940 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c014070 con 0x7f9268027940 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f92700ee020 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926802c040 con 0x7f92700ee020 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952bdac0 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.255+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f9268027940 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x5609952b7ce0 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c05c0 con 0x7f92700ee020 2024-02-15T23:29:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f926802c040 con 0x7f92700ee020 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952bc740 con 0x5609952b7ce0 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952bc3c0 con 0x5609952b7ce0 2024-02-15T23:29:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952bd010 con 0x5609952b7ce0 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 zone default found 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 4 Realm: () 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 zonegroup default 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952bd010 con 0x7f9268027940 2024-02-15T23:29:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c23e0 con 0x5609952bdac0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c2740 con 0x5609952bdac0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 started sync module instance, tier type = 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.259+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c1cc0 con 0x7f92700ee020 2024-02-15T23:29:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.263+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926803f040 con 0x7f92700ee020 2024-02-15T23:29:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.263+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599157389344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c2070 con 0x7f92700ee020 2024-02-15T23:29:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.263+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c3450 con 0x5609952b7ce0 2024-02-15T23:29:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.263+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599157389344] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926803f040 con 0x7f92700ee020 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.263+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.263+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599157394192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c3410 con 0x5609952b7ce0 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.263+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c3ed0 con 0x5609952bdac0 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599157397904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c4720 con 0x5609952bdac0 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c5110 con 0x7f92700ee020 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599157394192] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926803f040 con 0x7f92700ee020 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599157402608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c54c0 con 0x7f92700ee020 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c5e30 con 0x5609952b7ce0 2024-02-15T23:29:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599157397904] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599157402608] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926803f040 con 0x7f92700ee020 2024-02-15T23:29:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599157395248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c5990 con 0x5609952b7ce0 2024-02-15T23:29:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.267+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c6680 con 0x7f9268027940 2024-02-15T23:29:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.271+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.271+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599157395248] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.271+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599157400192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c63b0 con 0x7f9268027940 2024-02-15T23:29:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.271+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c6bb0 con 0x7f9268027940 2024-02-15T23:29:52.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.271+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599157400192] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.271+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.271+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599157407776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c69a0 con 0x7f9268027940 2024-02-15T23:29:52.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.271+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c7470 con 0x7f9268027940 2024-02-15T23:29:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599157407776] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599157411664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c7430 con 0x7f9268027940 2024-02-15T23:29:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f927a1ee980 20 add_watcher() i=0 2024-02-15T23:29:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f927a1ee980 20 add_watcher() i=1 2024-02-15T23:29:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f927a1ee980 20 add_watcher() i=2 2024-02-15T23:29:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f927a1ee980 20 add_watcher() i=3 2024-02-15T23:29:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f927a1ee980 20 add_watcher() i=4 2024-02-15T23:29:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f927a1ee980 20 add_watcher() i=5 2024-02-15T23:29:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.275+0000 7f927a1ee980 20 add_watcher() i=6 2024-02-15T23:29:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599157411664] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 20 add_watcher() i=7 2024-02-15T23:29:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952ca8e0 con 0x5609952b7ce0 2024-02-15T23:29:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599157408832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c7e20 con 0x5609952b7ce0 2024-02-15T23:29:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599157408832] v31'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f912dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 5 note: GC not initialized 2024-02-15T23:29:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f912cfe1640 20 reqs_thread_entry: start 2024-02-15T23:29:52.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:52.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 20 Filter name: none 2024-02-15T23:29:52.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f90a67fc640 20 reqs_thread_entry: start 2024-02-15T23:29:52.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952ec340 con 0x5609952b7ce0 2024-02-15T23:29:52.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:52.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952ec340 con 0x7f92700ee020 2024-02-15T23:29:52.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f926803f040 con 0x7f92700ee020 2024-02-15T23:29:52.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.279+0000 7f912dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599157408832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952ec300 con 0x5609952b7ce0 2024-02-15T23:29:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94599157408832] v31'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599157389344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952ec300 con 0x7f92700ee020 2024-02-15T23:29:52.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94599157389344] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926803f040 con 0x7f92700ee020 2024-02-15T23:29:52.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f927a1ee980 20 remove_watcher() i=0 2024-02-15T23:29:52.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f927a1ee980 2 removed watcher, disabling cache 2024-02-15T23:29:52.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599157394192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c1820 con 0x5609952b7ce0 2024-02-15T23:29:52.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94599157394192] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f927a1ee980 20 remove_watcher() i=1 2024-02-15T23:29:52.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.283+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599157397904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c1820 con 0x5609952bdac0 2024-02-15T23:29:52.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.287+0000 7f9277508640 1 -- 172.21.15.133:0/3156041937 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94599157397904] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92700eb070 con 0x5609952bdac0 2024-02-15T23:29:52.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.287+0000 7f927a1ee980 20 remove_watcher() i=2 2024-02-15T23:29:52.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.287+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599157402608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c3990 con 0x7f92700ee020 2024-02-15T23:29:52.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.287+0000 7f927850a640 1 -- 172.21.15.133:0/3156041937 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94599157402608] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926803f040 con 0x7f92700ee020 2024-02-15T23:29:52.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.287+0000 7f927a1ee980 20 remove_watcher() i=3 2024-02-15T23:29:52.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.287+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599157395248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c4bf0 con 0x5609952b7ce0 2024-02-15T23:29:52.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.291+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94599157395248] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x5609952b7ce0 2024-02-15T23:29:52.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.291+0000 7f927a1ee980 20 remove_watcher() i=4 2024-02-15T23:29:52.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.291+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599157400192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c4bf0 con 0x7f9268027940 2024-02-15T23:29:52.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.291+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94599157400192] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.291+0000 7f927a1ee980 20 remove_watcher() i=5 2024-02-15T23:29:52.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.291+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599157407776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c4280 con 0x7f9268027940 2024-02-15T23:29:52.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94599157407776] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 20 remove_watcher() i=6 2024-02-15T23:29:52.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599157411664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609952c4bf0 con 0x7f9268027940 2024-02-15T23:29:52.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94599157411664] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f926c058040 con 0x7f9268027940 2024-02-15T23:29:52.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 20 remove_watcher() i=7 2024-02-15T23:29:52.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9268027940 msgr2=0x7f92680333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f9268027940 0x7f92680333c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609952b7ce0 msgr2=0x5609952ba1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609952b7ce0 0x5609952ba1a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f92700ee020 msgr2=0x7f92700e57f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f92700ee020 0x7f92700e57f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609952bdac0 msgr2=0x5609952bfef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609952bdac0 0x5609952bfef0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91400342b0 msgr2=0x7f9140036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91400342b0 0x7f9140036770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9268008fd0 tx=0x7f926801c070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 msgr2=0x5609952ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/3156041937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952a5a80 0x5609952ac920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f92700b6040 tx=0x7f92700e36c0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f9277d09640 1 -- 172.21.15.133:0/3156041937 reap_dead start 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 shutdown_connections 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 >> 172.21.15.133:0/3156041937 conn(0x5609952a1dc0 msgr2=0x56099529f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 shutdown_connections 2024-02-15T23:29:52.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/3156041937 wait complete. 2024-02-15T23:29:52.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/1447861613 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91500342b0 msgr2=0x7f9150036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1447861613 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91500342b0 0x7f9150036770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x560995288de0 tx=0x7f9268003070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/1447861613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952989d0 msgr2=0x560995298df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1447861613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952989d0 0x560995298df0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f927001b540 tx=0x7f9270017d70 comp rx=0 tx=0).stop 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/1447861613 shutdown_connections 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1447861613 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91500342b0 0x7f9150036770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1447861613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609952989d0 0x560995298df0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/1447861613 >> 172.21.15.133:0/1447861613 conn(0x56099528d7e0 msgr2=0x56099528e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/1447861613 shutdown_connections 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.295+0000 7f927a1ee980 1 -- 172.21.15.133:0/1447861613 wait complete. 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609951049e0 msgr2=0x560995288020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609951049e0 0x560995288020 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91600342b0 msgr2=0x7f9160036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91600342b0 0x7f9160036770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f92700ad000 tx=0x7f92700a5070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 msgr2=0x5609952813d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x5609952813d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f926c001ee0 tx=0x7f926c000ee0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 shutdown_connections 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609951049e0 0x560995288020 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f91600342b0 0x7f9160036770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 --2- 172.21.15.133:0/1300645663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609951036a0 0x5609952813d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 >> 172.21.15.133:0/1300645663 conn(0x560995189a00 msgr2=0x560995274c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 shutdown_connections 2024-02-15T23:29:52.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.299+0000 7f927a1ee980 1 -- 172.21.15.133:0/1300645663 wait complete. 2024-02-15T23:29:52.315 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-02-15T23:29:52.315 DEBUG:tasks.util.rgw: json result: [] 2024-02-15T23:29:52.315 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-15T23:29:52.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-15T23:29:52.315 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-15T23:29:52.389 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:52.389 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:52.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6dc04980 1 Processor -- start 2024-02-15T23:29:52.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6dc04980 1 -- start start 2024-02-15T23:29:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6dc04980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55d3ac4d3640 0x55d3ac4d5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6dc04980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d3ac41b4c0 con 0x55d3ac4cf130 2024-02-15T23:29:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6dc04980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d3ac3e2180 con 0x55d3ac4d3640 2024-02-15T23:29:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6af1e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55d3ac4d3640 0x55d3ac4d5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6b71f640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55d3ac4cf130 0x55d3ac4cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39886/0 (socket says 172.21.15.133:39886) 2024-02-15T23:29:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6b71f640 1 -- 172.21.15.133:0/2370774931 learned_addr learned my addr 172.21.15.133:0/2370774931 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6af1e640 1 -- 172.21.15.133:0/2370774931 >> v1:172.21.15.131:6789/0 conn(0x55d3ac4cf130 legacy=0x55d3ac4cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6af1e640 1 -- 172.21.15.133:0/2370774931 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3ac4d6f80 con 0x55d3ac4d3640 2024-02-15T23:29:52.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/2370774931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4d3640 0x55d3ac4d5a30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000a480 tx=0x7fdb6001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16a3f3bc7151095 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.383+0000 7fdb6a71d640 1 -- 172.21.15.133:0/2370774931 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb600ab540 con 0x55d3ac4d3640 2024-02-15T23:29:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6a71d640 1 -- 172.21.15.133:0/2370774931 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb600ab6a0 con 0x55d3ac4d3640 2024-02-15T23:29:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6a71d640 1 -- 172.21.15.133:0/2370774931 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb600ab960 con 0x55d3ac4d3640 2024-02-15T23:29:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6dc04980 1 -- 172.21.15.133:0/2370774931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4d3640 msgr2=0x55d3ac4d5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/2370774931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4d3640 0x55d3ac4d5a30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000a480 tx=0x7fdb6001b280 comp rx=0 tx=0).stop 2024-02-15T23:29:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6dc04980 1 -- 172.21.15.133:0/2370774931 shutdown_connections 2024-02-15T23:29:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/2370774931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4d3640 0x55d3ac4d5a30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6dc04980 1 -- 172.21.15.133:0/2370774931 >> 172.21.15.133:0/2370774931 conn(0x55d3ac4caa00 msgr2=0x55d3ac4cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6dc04980 1 -- 172.21.15.133:0/2370774931 shutdown_connections 2024-02-15T23:29:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.387+0000 7fdb6dc04980 1 -- 172.21.15.133:0/2370774931 wait complete. 2024-02-15T23:29:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.399+0000 7fdb6dc04980 1 Processor -- start 2024-02-15T23:29:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.399+0000 7fdb6dc04980 1 -- start start 2024-02-15T23:29:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.399+0000 7fdb6dc04980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac445790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.399+0000 7fdb6dc04980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ac3df6b0 con 0x55d3ac4cf130 2024-02-15T23:29:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.399+0000 7fdb6b71f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac445790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.399+0000 7fdb6b71f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac445790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42950/0 (socket says 172.21.15.133:42950) 2024-02-15T23:29:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.399+0000 7fdb6b71f640 1 -- 172.21.15.133:0/646232408 learned_addr learned my addr 172.21.15.133:0/646232408 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.399+0000 7fdb6b71f640 1 -- 172.21.15.133:0/646232408 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60005d30 con 0x55d3ac4cf130 2024-02-15T23:29:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6b71f640 1 --2- 172.21.15.133:0/646232408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac445790 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdb64006fb0 tx=0x7fdb64001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7483a79c0cd506da server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fda5960a640 1 -- 172.21.15.133:0/646232408 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb64004530 con 0x55d3ac4cf130 2024-02-15T23:29:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fda5960a640 1 -- 172.21.15.133:0/646232408 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64004690 con 0x55d3ac4cf130 2024-02-15T23:29:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fda5960a640 1 -- 172.21.15.133:0/646232408 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb640049b0 con 0x55d3ac4cf130 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- 172.21.15.133:0/646232408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 msgr2=0x55d3ac445790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/646232408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac445790 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdb64006fb0 tx=0x7fdb64001940 comp rx=0 tx=0).stop 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- 172.21.15.133:0/646232408 shutdown_connections 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/646232408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac445790 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- 172.21.15.133:0/646232408 >> 172.21.15.133:0/646232408 conn(0x55d3ac4caa00 msgr2=0x55d3ac5b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- 172.21.15.133:0/646232408 shutdown_connections 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- 172.21.15.133:0/646232408 wait complete. 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 Processor -- start 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- start start 2024-02-15T23:29:52.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac5c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ac3dae90 con 0x55d3ac4cf130 2024-02-15T23:29:52.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6b71f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac5c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6b71f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac5c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42958/0 (socket says 172.21.15.133:42958) 2024-02-15T23:29:52.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6b71f640 1 -- 172.21.15.133:0/1159148065 learned_addr learned my addr 172.21.15.133:0/1159148065 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6b71f640 1 -- 172.21.15.133:0/1159148065 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3ac41b4c0 con 0x55d3ac4cf130 2024-02-15T23:29:52.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6b71f640 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac5c22a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55d3ac444fc0 tx=0x7fdb64000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fda57e07640 1 -- 172.21.15.133:0/1159148065 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb64013760 con 0x55d3ac4cf130 2024-02-15T23:29:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d3ac5c27e0 con 0x55d3ac4cf130 2024-02-15T23:29:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fda57e07640 1 -- 172.21.15.133:0/1159148065 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb640138c0 con 0x55d3ac4cf130 2024-02-15T23:29:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3ac5c2c30 con 0x55d3ac4cf130 2024-02-15T23:29:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.403+0000 7fda57e07640 1 -- 172.21.15.133:0/1159148065 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb64013b60 con 0x55d3ac4cf130 2024-02-15T23:29:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fda57e07640 1 -- 172.21.15.133:0/1159148065 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdb64013cc0 con 0x55d3ac4cf130 2024-02-15T23:29:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fda57e07640 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda500342b0 0x7fda50036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fda57e07640 1 -- 172.21.15.133:0/1159148065 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fdb64049550 con 0x55d3ac4cf130 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda500342b0 0x7fda50036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5c6f20 0x55d3ac5c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5c9850 con 0x55d3ac5c6f20 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5c6f20 0x55d3ac5c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda500342b0 0x7fda50036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb600ad000 tx=0x7fdb600a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5c6f20 0x55d3ac5c9310 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6bf20640 1 -- 172.21.15.133:0/1159148065 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb5c0083f0 con 0x55d3ac5c6f20 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5c9c40 con 0x55d3ac5c6f20 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6bf20640 1 -- 172.21.15.133:0/1159148065 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdb5c0083f0 con 0x55d3ac5c6f20 2024-02-15T23:29:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5cb4f0 con 0x55d3ac5c6f20 2024-02-15T23:29:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6bf20640 1 -- 172.21.15.133:0/1159148065 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fdb5c0083f0 con 0x55d3ac5c6f20 2024-02-15T23:29:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5ca6f0 con 0x55d3ac5c6f20 2024-02-15T23:29:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6bf20640 1 -- 172.21.15.133:0/1159148065 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdb5c0083f0 con 0x55d3ac5c6f20 2024-02-15T23:29:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5cab00 con 0x55d3ac5c6f20 2024-02-15T23:29:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6bf20640 1 -- 172.21.15.133:0/1159148065 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdb5c012040 con 0x55d3ac5c6f20 2024-02-15T23:29:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 Processor -- start 2024-02-15T23:29:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 -- start start 2024-02-15T23:29:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5d9b30 0x55d3ac5d9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6dc04980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ac373f20 con 0x55d3ac5d9b30 2024-02-15T23:29:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6af1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5d9b30 0x55d3ac5d9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6af1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5d9b30 0x55d3ac5d9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42970/0 (socket says 172.21.15.133:42970) 2024-02-15T23:29:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.407+0000 7fdb6af1e640 1 -- 172.21.15.133:0/1320409694 learned_addr learned my addr 172.21.15.133:0/1320409694 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6af1e640 1 -- 172.21.15.133:0/1320409694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3ac5da490 con 0x55d3ac5d9b30 2024-02-15T23:29:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/1320409694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5d9b30 0x55d3ac5d9f50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdb600ae040 tx=0x7fdb60018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fda55602640 1 -- 172.21.15.133:0/1320409694 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb600be880 con 0x55d3ac5d9b30 2024-02-15T23:29:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1320409694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d3ac5da680 con 0x55d3ac5d9b30 2024-02-15T23:29:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fda55602640 1 -- 172.21.15.133:0/1320409694 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb600be9e0 con 0x55d3ac5d9b30 2024-02-15T23:29:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fda55602640 1 -- 172.21.15.133:0/1320409694 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb600beca0 con 0x55d3ac5d9b30 2024-02-15T23:29:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1320409694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3ac5db1d0 con 0x55d3ac5d9b30 2024-02-15T23:29:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fda55602640 1 -- 172.21.15.133:0/1320409694 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdb600bd3e0 con 0x55d3ac5d9b30 2024-02-15T23:29:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fda55602640 1 --2- 172.21.15.133:0/1320409694 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda440342b0 0x7fda44036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fda55602640 1 -- 172.21.15.133:0/1320409694 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fdb600e6270 con 0x55d3ac5d9b30 2024-02-15T23:29:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/1320409694 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda440342b0 0x7fda44036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6dc04980 1 Processor -- start 2024-02-15T23:29:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6dc04980 1 -- start start 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/1320409694 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda440342b0 0x7fda44036770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55d3ac5ca130 tx=0x7fdb5c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6dc04980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6dc04980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ac367790 con 0x55d3ac5e6b40 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6af1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6af1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5e6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42982/0 (socket says 172.21.15.133:42982) 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6af1e640 1 -- 172.21.15.133:0/1281951840 learned_addr learned my addr 172.21.15.133:0/1281951840 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.411+0000 7fdb6af1e640 1 -- 172.21.15.133:0/1281951840 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3ac5e7530 con 0x55d3ac5e6b40 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/1281951840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5e6f60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdb60006990 tx=0x7fdb600bcd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d907bef932fa4fbb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fda4effd640 1 -- 172.21.15.133:0/1281951840 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb600b4d80 con 0x55d3ac5e6b40 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fda4effd640 1 -- 172.21.15.133:0/1281951840 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb600e47a0 con 0x55d3ac5e6b40 2024-02-15T23:29:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fda4effd640 1 -- 172.21.15.133:0/1281951840 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb600e4a40 con 0x55d3ac5e6b40 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1281951840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 msgr2=0x55d3ac5e6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1281951840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5e6f60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdb60006990 tx=0x7fdb600bcd50 comp rx=0 tx=0).stop 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1281951840 shutdown_connections 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1281951840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5e6f60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1281951840 >> 172.21.15.133:0/1281951840 conn(0x55d3ac5e2ed0 msgr2=0x55d3ac5e0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1281951840 shutdown_connections 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1281951840 wait complete. 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 Processor -- start 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- start start 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5edb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ac5ee040 con 0x55d3ac5e6b40 2024-02-15T23:29:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6af1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6af1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5edb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:42998/0 (socket says 172.21.15.133:42998) 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 learned_addr learned my addr 172.21.15.133:0/786565464 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3ac5db1d0 con 0x55d3ac5e6b40 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5edb00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdb60006990 tx=0x7fdb600e45f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fda4d7fa640 1 -- 172.21.15.133:0/786565464 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb600e4e80 con 0x55d3ac5e6b40 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d3ac5ee240 con 0x55d3ac5e6b40 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3ac5ee670 con 0x55d3ac5e6b40 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fda4d7fa640 1 -- 172.21.15.133:0/786565464 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb600e0040 con 0x55d3ac5e6b40 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.415+0000 7fda4d7fa640 1 -- 172.21.15.133:0/786565464 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb600b4830 con 0x55d3ac5e6b40 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fda4d7fa640 1 -- 172.21.15.133:0/786565464 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdb600bc360 con 0x55d3ac5e6b40 2024-02-15T23:29:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fda4d7fa640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda34034300 0x7fda340367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fda4d7fa640 1 -- 172.21.15.133:0/786565464 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fdb600f0c60 con 0x55d3ac5e6b40 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda34034300 0x7fda340367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5f9030 0x55d3ac5fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fbc40 con 0x55d3ac5f9030 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6b71f640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5f9030 0x55d3ac5fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda34034300 0x7fda340367c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c008fd0 tx=0x7fdb5c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6b71f640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5f9030 0x55d3ac5fb4f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 realm 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fc010 con 0x55d3ac5f9030 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fc860 con 0x55d3ac5f9030 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fcbc0 con 0x55d3ac5f9030 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fc500 con 0x55d3ac5f9030 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 20 searching for the correct realm 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d3ac5fee10 0x55d3ac601240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d3ac5fee10 0x55d3ac601240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d3ac5fee10 0x55d3ac601240 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6af1e640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdb600f8040 0x7fdb600aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb600f8040 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdb600f8040 0x7fdb600aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdb600f8040 0x7fdb600aea40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb5c02c040 con 0x7fdb600f8040 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6bf20640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdb5c027940 0x7fdb5c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.419+0000 7fdb6b71f640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdb5c027940 0x7fdb5c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdb5c027940 0x7fdb5c0333c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5f9030 2024-02-15T23:29:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5f9030 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb600f8040 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb5c02c040 con 0x7fdb600f8040 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5f9030 2024-02-15T23:29:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.423+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5f9030 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb600f8040 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdb5c02c040 con 0x7fdb600f8040 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5f9030 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5f9030 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.427+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb600f8040 2024-02-15T23:29:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb5c02c040 con 0x7fdb600f8040 2024-02-15T23:29:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5f9030 2024-02-15T23:29:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb600f8040 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb5c02c040 con 0x7fdb600f8040 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5fee10 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb5c027940 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x55d3ac5f9030 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac601910 con 0x7fdb600f8040 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb5c02c040 con 0x7fdb600f8040 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fda60 con 0x55d3ac5f9030 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fd6e0 con 0x55d3ac5f9030 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.431+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fe330 con 0x55d3ac5f9030 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 zone default found 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 4 Realm: () 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 zonegroup default 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac5fe330 con 0x7fdb5c027940 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac603730 con 0x55d3ac5fee10 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac603a90 con 0x55d3ac5fee10 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 started sync module instance, tier type = 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:52.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac603010 con 0x7fdb600f8040 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb5c03f040 con 0x7fdb600f8040 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94367618444144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac6033c0 con 0x7fdb600f8040 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac6047a0 con 0x55d3ac5f9030 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.435+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94367618444144] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb5c03f040 con 0x7fdb600f8040 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94367618448992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac604780 con 0x55d3ac5f9030 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac605240 con 0x55d3ac5fee10 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94367618448992] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94367618452736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac6055f0 con 0x55d3ac5fee10 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac605f60 con 0x7fdb600f8040 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb5c03f040 con 0x7fdb600f8040 2024-02-15T23:29:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94367618456560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac6067b0 con 0x7fdb600f8040 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.439+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac6071d0 con 0x55d3ac5f9030 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.443+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94367618452736] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.443+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.443+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94367618460848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac607190 con 0x55d3ac5f9030 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.443+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac607b90 con 0x7fdb5c027940 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.443+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94367618456560] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb5c03f040 con 0x7fdb600f8040 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.447+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.447+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94367618458384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac607b90 con 0x7fdb5c027940 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.447+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac608550 con 0x7fdb5c027940 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.447+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94367618460848] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.447+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94367618458384] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.447+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.447+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94367618463472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac607b10 con 0x7fdb5c027940 2024-02-15T23:29:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.447+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac6089f0 con 0x7fdb5c027940 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94367618467152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac608e10 con 0x7fdb5c027940 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 20 add_watcher() i=0 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 20 add_watcher() i=1 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 20 add_watcher() i=2 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 20 add_watcher() i=3 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 20 add_watcher() i=4 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 20 add_watcher() i=5 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94367618463472] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 20 add_watcher() i=6 2024-02-15T23:29:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94367618467152] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 20 add_watcher() i=7 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac608e10 con 0x55d3ac5f9030 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94367618468208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac608d90 con 0x55d3ac5f9030 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.451+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94367618468208] v31'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fda21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 5 note: GC not initialized 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fda20fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 20 Filter name: none 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fd99a7fc640 20 reqs_thread_entry: start 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac62d8a0 con 0x55d3ac5f9030 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac62ec50 con 0x7fdb600f8040 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fdb5c03f040 con 0x7fdb600f8040 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fda21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94367618468208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac62d860 con 0x55d3ac5f9030 2024-02-15T23:29:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94367618468208] v31'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94367618444144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac62d860 con 0x7fdb600f8040 2024-02-15T23:29:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94367618444144] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb5c03f040 con 0x7fdb600f8040 2024-02-15T23:29:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.455+0000 7fdb6dc04980 20 remove_watcher() i=0 2024-02-15T23:29:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.459+0000 7fdb6dc04980 2 removed watcher, disabling cache 2024-02-15T23:29:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.459+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94367618448992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac602b70 con 0x55d3ac5f9030 2024-02-15T23:29:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.459+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94367618448992] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.459+0000 7fdb6dc04980 20 remove_watcher() i=1 2024-02-15T23:29:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.459+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94367618452736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac603e60 con 0x55d3ac5fee10 2024-02-15T23:29:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.459+0000 7fdb6af1e640 1 -- 172.21.15.133:0/786565464 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94367618452736] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb600ec070 con 0x55d3ac5fee10 2024-02-15T23:29:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.463+0000 7fdb6dc04980 20 remove_watcher() i=2 2024-02-15T23:29:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.463+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94367618456560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac602b70 con 0x7fdb600f8040 2024-02-15T23:29:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.463+0000 7fdb6bf20640 1 -- 172.21.15.133:0/786565464 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94367618456560] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb5c03f040 con 0x7fdb600f8040 2024-02-15T23:29:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.463+0000 7fdb6dc04980 20 remove_watcher() i=3 2024-02-15T23:29:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.463+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94367618460848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac602b70 con 0x55d3ac5f9030 2024-02-15T23:29:52.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.463+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94367618460848] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x55d3ac5f9030 2024-02-15T23:29:52.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.463+0000 7fdb6dc04980 20 remove_watcher() i=4 2024-02-15T23:29:52.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.463+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94367618458384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac602b70 con 0x7fdb5c027940 2024-02-15T23:29:52.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.467+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94367618458384] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.467+0000 7fdb6dc04980 20 remove_watcher() i=5 2024-02-15T23:29:52.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.467+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94367618463472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac606310 con 0x7fdb5c027940 2024-02-15T23:29:52.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.467+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94367618463472] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.467+0000 7fdb6dc04980 20 remove_watcher() i=6 2024-02-15T23:29:52.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.467+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94367618467152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d3ac606310 con 0x7fdb5c027940 2024-02-15T23:29:52.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94367618467152] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb64024020 con 0x7fdb5c027940 2024-02-15T23:29:52.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 20 remove_watcher() i=7 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdb5c027940 msgr2=0x7fdb5c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdb5c027940 0x7fdb5c0333c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5f9030 msgr2=0x55d3ac5fb4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5f9030 0x55d3ac5fb4f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdb600f8040 msgr2=0x7fdb600aea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdb600f8040 0x7fdb600aea40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d3ac5fee10 msgr2=0x55d3ac601240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d3ac5fee10 0x55d3ac601240 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda34034300 msgr2=0x7fda340367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda34034300 0x7fda340367c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c008fd0 tx=0x7fdb5c01c070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6b71f640 1 -- 172.21.15.133:0/786565464 reap_dead start 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 msgr2=0x55d3ac5edb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5edb00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdb60006990 tx=0x7fdb600e45f0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 shutdown_connections 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/786565464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5e6b40 0x55d3ac5edb00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 >> 172.21.15.133:0/786565464 conn(0x55d3ac5e2ed0 msgr2=0x55d3ac5e0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 shutdown_connections 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/786565464 wait complete. 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1320409694 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda440342b0 msgr2=0x7fda44036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1320409694 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda440342b0 0x7fda44036770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55d3ac5ca130 tx=0x7fdb5c003070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1320409694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5d9b30 msgr2=0x55d3ac5d9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1320409694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5d9b30 0x55d3ac5d9f50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdb600ae040 tx=0x7fdb60018020 comp rx=0 tx=0).stop 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1320409694 shutdown_connections 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1320409694 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda440342b0 0x7fda44036770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1320409694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac5d9b30 0x55d3ac5d9f50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1320409694 >> 172.21.15.133:0/1320409694 conn(0x55d3ac5ce940 msgr2=0x55d3ac5cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1320409694 shutdown_connections 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1320409694 wait complete. 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5c6f20 msgr2=0x55d3ac5c9310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5c6f20 0x55d3ac5c9310 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda500342b0 msgr2=0x7fda50036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda500342b0 0x7fda50036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb600ad000 tx=0x7fdb600a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 msgr2=0x55d3ac5c22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac5c22a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55d3ac444fc0 tx=0x7fdb64000f50 comp rx=0 tx=0).stop 2024-02-15T23:29:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 shutdown_connections 2024-02-15T23:29:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d3ac5c6f20 0x55d3ac5c9310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fda500342b0 0x7fda50036770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 --2- 172.21.15.133:0/1159148065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3ac4cf130 0x55d3ac5c22a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 >> 172.21.15.133:0/1159148065 conn(0x55d3ac4caa00 msgr2=0x55d3ac444120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 shutdown_connections 2024-02-15T23:29:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.471+0000 7fdb6dc04980 1 -- 172.21.15.133:0/1159148065 wait complete. 2024-02-15T23:29:52.489 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-02-15T23:29:52.489 DEBUG:tasks.util.rgw: json result: [] 2024-02-15T23:29:52.512 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:52.512 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-15T23:29:52.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-15T23:29:52.513 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-15T23:29:52.562 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:52.562 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:52.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f634941d980 1 Processor -- start 2024-02-15T23:29:52.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f634941d980 1 -- start start 2024-02-15T23:29:52.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f634941d980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55a09ce4f640 0x55a09ce51a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f634941d980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a09cd974c0 con 0x55a09ce4b130 2024-02-15T23:29:52.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f634941d980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a09cd5e180 con 0x55a09ce4f640 2024-02-15T23:29:52.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f6346737640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55a09ce4f640 0x55a09ce51a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f6346f38640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55a09ce4b130 0x55a09ce4b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39896/0 (socket says 172.21.15.133:39896) 2024-02-15T23:29:52.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f6346f38640 1 -- 172.21.15.133:0/2663403026 learned_addr learned my addr 172.21.15.133:0/2663403026 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:52.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f6346737640 1 -- 172.21.15.133:0/2663403026 >> v1:172.21.15.131:6789/0 conn(0x55a09ce4b130 legacy=0x55a09ce4b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f6346737640 1 -- 172.21.15.133:0/2663403026 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09ce52f80 con 0x55a09ce4f640 2024-02-15T23:29:52.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.555+0000 7f6345f36640 1 -- 172.21.15.133:0/2663403026 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125110716 0 0) 0x55a09cd974c0 con 0x55a09ce4b130 2024-02-15T23:29:52.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f6346737640 1 --2- 172.21.15.133:0/2663403026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09ce51a30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f633c00a480 tx=0x7f633c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca89340cc17a27f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f6345f36640 1 -- 172.21.15.133:0/2663403026 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c0ab540 con 0x55a09ce4f640 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f6345f36640 1 -- 172.21.15.133:0/2663403026 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0ab6a0 con 0x55a09ce4f640 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f6345f36640 1 -- 172.21.15.133:0/2663403026 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c0ab960 con 0x55a09ce4f640 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f634941d980 1 -- 172.21.15.133:0/2663403026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 msgr2=0x55a09ce51a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f634941d980 1 --2- 172.21.15.133:0/2663403026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09ce51a30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f633c00a480 tx=0x7f633c01b280 comp rx=0 tx=0).stop 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f634941d980 1 -- 172.21.15.133:0/2663403026 shutdown_connections 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f634941d980 1 --2- 172.21.15.133:0/2663403026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09ce51a30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f634941d980 1 -- 172.21.15.133:0/2663403026 >> 172.21.15.133:0/2663403026 conn(0x55a09ce46a00 msgr2=0x55a09ce48e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f634941d980 1 -- 172.21.15.133:0/2663403026 shutdown_connections 2024-02-15T23:29:52.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.559+0000 7f634941d980 1 -- 172.21.15.133:0/2663403026 wait complete. 2024-02-15T23:29:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.571+0000 7f634941d980 1 Processor -- start 2024-02-15T23:29:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.571+0000 7f634941d980 1 -- start start 2024-02-15T23:29:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.571+0000 7f634941d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4b130 0x55a09cf34e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.571+0000 7f634941d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09cd5b6b0 con 0x55a09ce4b130 2024-02-15T23:29:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.571+0000 7f6346f38640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4b130 0x55a09cf34e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.571+0000 7f6346f38640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4b130 0x55a09cf34e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43014/0 (socket says 172.21.15.133:43014) 2024-02-15T23:29:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.571+0000 7f6346f38640 1 -- 172.21.15.133:0/2185025856 learned_addr learned my addr 172.21.15.133:0/2185025856 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.571+0000 7f6346f38640 1 -- 172.21.15.133:0/2185025856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c005d30 con 0x55a09ce4b130 2024-02-15T23:29:52.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6346f38640 1 --2- 172.21.15.133:0/2185025856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4b130 0x55a09cf34e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f63400016c0 tx=0x7f6340001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2147559f2125d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6234e09640 1 -- 172.21.15.133:0/2185025856 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6340003460 con 0x55a09ce4b130 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6234e09640 1 -- 172.21.15.133:0/2185025856 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63400035c0 con 0x55a09ce4b130 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6234e09640 1 -- 172.21.15.133:0/2185025856 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63400038a0 con 0x55a09ce4b130 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- 172.21.15.133:0/2185025856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4b130 msgr2=0x55a09cf34e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 --2- 172.21.15.133:0/2185025856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4b130 0x55a09cf34e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f63400016c0 tx=0x7f6340001b80 comp rx=0 tx=0).stop 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- 172.21.15.133:0/2185025856 shutdown_connections 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 --2- 172.21.15.133:0/2185025856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4b130 0x55a09cf34e10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- 172.21.15.133:0/2185025856 >> 172.21.15.133:0/2185025856 conn(0x55a09ce46a00 msgr2=0x55a09cf309a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- 172.21.15.133:0/2185025856 shutdown_connections 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- 172.21.15.133:0/2185025856 wait complete. 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 Processor -- start 2024-02-15T23:29:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- start start 2024-02-15T23:29:52.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09cf3bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09cd56e90 con 0x55a09ce4f640 2024-02-15T23:29:52.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6346f38640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09cf3bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6346f38640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09cf3bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43030/0 (socket says 172.21.15.133:43030) 2024-02-15T23:29:52.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6346f38640 1 -- 172.21.15.133:0/797371533 learned_addr learned my addr 172.21.15.133:0/797371533 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6346f38640 1 -- 172.21.15.133:0/797371533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6340006cf0 con 0x55a09ce4f640 2024-02-15T23:29:52.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6346f38640 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09cf3bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f63400012f0 tx=0x7f6340001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6233606640 1 -- 172.21.15.133:0/797371533 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6340013630 con 0x55a09ce4f640 2024-02-15T23:29:52.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6233606640 1 -- 172.21.15.133:0/797371533 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340013790 con 0x55a09ce4f640 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f6233606640 1 -- 172.21.15.133:0/797371533 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6340013a30 con 0x55a09ce4f640 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a09cf3c470 con 0x55a09ce4f640 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.575+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a09cf3c920 con 0x55a09ce4f640 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6233606640 1 -- 172.21.15.133:0/797371533 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6340013c60 con 0x55a09ce4f640 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6233606640 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f622c0342b0 0x7f622c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6233606640 1 -- 172.21.15.133:0/797371533 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6340049520 con 0x55a09ce4f640 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6346737640 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f622c0342b0 0x7f622c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf40bc0 0x55a09cf42fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf434f0 con 0x55a09cf40bc0 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6347739640 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf40bc0 0x55a09cf42fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6346737640 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f622c0342b0 0x7f622c036770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f633c0ad000 tx=0x7f633c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6347739640 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf40bc0 0x55a09cf42fb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6347739640 1 -- 172.21.15.133:0/797371533 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55a09cf40bc0 2024-02-15T23:29:52.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf402f0 con 0x55a09cf40bc0 2024-02-15T23:29:52.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6347739640 1 -- 172.21.15.133:0/797371533 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f63380083f0 con 0x55a09cf40bc0 2024-02-15T23:29:52.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf45220 con 0x55a09cf40bc0 2024-02-15T23:29:52.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6347739640 1 -- 172.21.15.133:0/797371533 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f63380083f0 con 0x55a09cf40bc0 2024-02-15T23:29:52.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf44420 con 0x55a09cf40bc0 2024-02-15T23:29:52.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6347739640 1 -- 172.21.15.133:0/797371533 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f63380083f0 con 0x55a09cf40bc0 2024-02-15T23:29:52.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf44830 con 0x55a09cf40bc0 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6347739640 1 -- 172.21.15.133:0/797371533 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f63380121d0 con 0x55a09cf40bc0 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 Processor -- start 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 -- start start 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cf53840 0x55a09cf53c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f634941d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09cceff20 con 0x55a09cf53840 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.579+0000 7f6346737640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cf53840 0x55a09cf53c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6346737640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cf53840 0x55a09cf53c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43034/0 (socket says 172.21.15.133:43034) 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6346737640 1 -- 172.21.15.133:0/743044918 learned_addr learned my addr 172.21.15.133:0/743044918 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6346737640 1 -- 172.21.15.133:0/743044918 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09cf541a0 con 0x55a09cf53840 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6346737640 1 --2- 172.21.15.133:0/743044918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cf53840 0x55a09cf53c60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c10 tx=0x7f633c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6230e01640 1 -- 172.21.15.133:0/743044918 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c0b71a0 con 0x55a09cf53840 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6230e01640 1 -- 172.21.15.133:0/743044918 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0bc040 con 0x55a09cf53840 2024-02-15T23:29:52.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6230e01640 1 -- 172.21.15.133:0/743044918 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c0aa820 con 0x55a09cf53840 2024-02-15T23:29:52.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f634941d980 1 -- 172.21.15.133:0/743044918 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a09cf54390 con 0x55a09cf53840 2024-02-15T23:29:52.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f634941d980 1 -- 172.21.15.133:0/743044918 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a09cf54e80 con 0x55a09cf53840 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6230e01640 1 -- 172.21.15.133:0/743044918 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f633c0aa980 con 0x55a09cf53840 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6230e01640 1 --2- 172.21.15.133:0/743044918 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6220034300 0x7f62200367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6230e01640 1 -- 172.21.15.133:0/743044918 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f633c0e5dc0 con 0x55a09cf53840 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6347739640 1 --2- 172.21.15.133:0/743044918 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6220034300 0x7f62200367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f634941d980 1 Processor -- start 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f634941d980 1 -- start start 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6347739640 1 --2- 172.21.15.133:0/743044918 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6220034300 0x7f62200367c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55a09cf43ec0 tx=0x7f6338003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f634941d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cdc19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f634941d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09cce3790 con 0x55a09cdc15e0 2024-02-15T23:29:52.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6346737640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cdc19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6346737640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cdc19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43050/0 (socket says 172.21.15.133:43050) 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.583+0000 7f6346737640 1 -- 172.21.15.133:0/2976099455 learned_addr learned my addr 172.21.15.133:0/2976099455 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6346737640 1 -- 172.21.15.133:0/2976099455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09cdbfe10 con 0x55a09cdc15e0 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6346737640 1 --2- 172.21.15.133:0/2976099455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cdc19e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f633c0c8e70 tx=0x7f633c0b4ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5612b7c275ad3ad server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f622a7fc640 1 -- 172.21.15.133:0/2976099455 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c0b5410 con 0x55a09cdc15e0 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f622a7fc640 1 -- 172.21.15.133:0/2976099455 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0b5570 con 0x55a09cdc15e0 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f622a7fc640 1 -- 172.21.15.133:0/2976099455 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c0b4370 con 0x55a09cdc15e0 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- 172.21.15.133:0/2976099455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 msgr2=0x55a09cdc19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 --2- 172.21.15.133:0/2976099455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cdc19e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f633c0c8e70 tx=0x7f633c0b4ac0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- 172.21.15.133:0/2976099455 shutdown_connections 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 --2- 172.21.15.133:0/2976099455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cdc19e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- 172.21.15.133:0/2976099455 >> 172.21.15.133:0/2976099455 conn(0x55a09cf5cbf0 msgr2=0x55a09cf5ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- 172.21.15.133:0/2976099455 shutdown_connections 2024-02-15T23:29:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- 172.21.15.133:0/2976099455 wait complete. 2024-02-15T23:29:52.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 Processor -- start 2024-02-15T23:29:52.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- start start 2024-02-15T23:29:52.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cf699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09cf69f20 con 0x55a09cdc15e0 2024-02-15T23:29:52.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6346737640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cf699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6346737640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cf699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43062/0 (socket says 172.21.15.133:43062) 2024-02-15T23:29:52.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 learned_addr learned my addr 172.21.15.133:0/3948530843 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09cf54e80 con 0x55a09cdc15e0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6346737640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cf699e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f633c0c8e10 tx=0x7f633c0e4140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6228ff9640 1 -- 172.21.15.133:0/3948530843 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c0e3070 con 0x55a09cdc15e0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a09cf6a120 con 0x55a09cdc15e0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a09cf6a550 con 0x55a09cdc15e0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6228ff9640 1 -- 172.21.15.133:0/3948530843 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0c9c20 con 0x55a09cdc15e0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.587+0000 7f6228ff9640 1 -- 172.21.15.133:0/3948530843 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c0b5410 con 0x55a09cdc15e0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6228ff9640 1 -- 172.21.15.133:0/3948530843 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f633c0ea070 con 0x55a09cdc15e0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6228ff9640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f62100342b0 0x7f6210036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6228ff9640 1 -- 172.21.15.133:0/3948530843 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f633c0e00a0 con 0x55a09cdc15e0 2024-02-15T23:29:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6347739640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f62100342b0 0x7f6210036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf74df0 0x55a09cf772b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf77a00 con 0x55a09cf74df0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346f38640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf74df0 0x55a09cf772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6347739640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f62100342b0 0x7f6210036770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6338008fd0 tx=0x7f633801d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346f38640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf74df0 0x55a09cf772b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6340024020 con 0x55a09cf74df0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 realm 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf77dd0 con 0x55a09cf74df0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6340024020 con 0x55a09cf74df0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf78620 con 0x55a09cf74df0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6340024020 con 0x55a09cf74df0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf78980 con 0x55a09cf74df0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6340024020 con 0x55a09cf74df0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf782c0 con 0x55a09cf74df0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6340024020 con 0x55a09cf74df0 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:52.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 20 searching for the correct realm 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a09cf7abd0 0x55a09cf7cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346737640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a09cf7abd0 0x55a09cf7cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346737640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a09cf7abd0 0x55a09cf7cfc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346737640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f633c0ab030 0x7f633c0dd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f633c0ab030 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6347739640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f633c0ab030 0x7f633c0dd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.591+0000 7f6347739640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f633c0ab030 0x7f633c0dd400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633802d040 con 0x7f633c0ab030 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6347739640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6338028940 0x7f6338012420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6338028940 0x7f6338012420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6338028940 0x7f6338012420 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6340024020 con 0x7f6338028940 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf74df0 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf74df0 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f633c0ab030 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633802d040 con 0x7f633c0ab030 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.595+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf74df0 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf74df0 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f633c0ab030 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f633802d040 con 0x7f633c0ab030 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf74df0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf74df0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.599+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f633c0ab030 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633802d040 con 0x7f633c0ab030 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf74df0 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f633c0ab030 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633802d040 con 0x7f633c0ab030 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf7abd0 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f6338028940 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.603+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x55a09cf74df0 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7d690 con 0x7f633c0ab030 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f633802d040 con 0x7f633c0ab030 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf797f0 con 0x55a09cf74df0 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf79470 con 0x55a09cf74df0 2024-02-15T23:29:52.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7a180 con 0x55a09cf74df0 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 zone default found 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 4 Realm: () 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 zonegroup default 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7dad0 con 0x7f6338028940 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7f950 con 0x55a09cf7abd0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7fcb0 con 0x55a09cf7abd0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 started sync module instance, tier type = 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7ef20 con 0x7f633c0ab030 2024-02-15T23:29:52.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6338040040 con 0x7f633c0ab030 2024-02-15T23:29:52.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94148316621472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf80010 con 0x7f633c0ab030 2024-02-15T23:29:52.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.607+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf80a00 con 0x55a09cf74df0 2024-02-15T23:29:52.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.611+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94148316621472] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6338040040 con 0x7f633c0ab030 2024-02-15T23:29:52.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.611+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.611+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94148316628192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf809c0 con 0x55a09cf74df0 2024-02-15T23:29:52.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.611+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf813e0 con 0x55a09cf7abd0 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.611+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.611+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94148316630816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf81c30 con 0x55a09cf7abd0 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.611+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf825e0 con 0x7f633c0ab030 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.611+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94148316628192] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.615+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6338040040 con 0x7f633c0ab030 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.615+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94148316623744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf82990 con 0x7f633c0ab030 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.615+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf83300 con 0x55a09cf74df0 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.615+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94148316630816] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.615+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94148316623744] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6338040040 con 0x7f633c0ab030 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.615+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.615+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94148316635392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf82e60 con 0x55a09cf74df0 2024-02-15T23:29:52.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.615+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf836e0 con 0x7f6338028940 2024-02-15T23:29:52.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.619+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94148316635392] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.619+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.619+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94148316632976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf83300 con 0x7f6338028940 2024-02-15T23:29:52.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.619+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf840a0 con 0x7f6338028940 2024-02-15T23:29:52.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.619+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94148316632976] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.619+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.619+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94148316639088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf840a0 con 0x7f6338028940 2024-02-15T23:29:52.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.619+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf84a10 con 0x7f6338028940 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94148316639088] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94148316642784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf84a10 con 0x7f6338028940 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 20 add_watcher() i=0 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 20 add_watcher() i=1 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 20 add_watcher() i=2 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 20 add_watcher() i=3 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 20 add_watcher() i=4 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 20 add_watcher() i=5 2024-02-15T23:29:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 20 add_watcher() i=6 2024-02-15T23:29:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94148316642784] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 20 add_watcher() i=7 2024-02-15T23:29:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf87e30 con 0x55a09cf74df0 2024-02-15T23:29:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.623+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94148316645184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf85270 con 0x55a09cf74df0 2024-02-15T23:29:52.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94148316645184] v31'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f61fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:52.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:52.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 5 note: GC not initialized 2024-02-15T23:29:52.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f6177fff640 20 reqs_thread_entry: start 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 20 Filter name: none 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f6175ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cfa9880 con 0x55a09cf74df0 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cfa9880 con 0x7f633c0ab030 2024-02-15T23:29:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f6338040040 con 0x7f633c0ab030 2024-02-15T23:29:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f61fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94148316645184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf89fc0 con 0x55a09cf74df0 2024-02-15T23:29:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94148316645184] v31'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.627+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94148316621472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf84710 con 0x7f633c0ab030 2024-02-15T23:29:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.631+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94148316621472] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6338040040 con 0x7f633c0ab030 2024-02-15T23:29:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.631+0000 7f634941d980 20 remove_watcher() i=0 2024-02-15T23:29:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.631+0000 7f634941d980 2 removed watcher, disabling cache 2024-02-15T23:29:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.631+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94148316628192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7eaa0 con 0x55a09cf74df0 2024-02-15T23:29:52.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.631+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94148316628192] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.631+0000 7f634941d980 20 remove_watcher() i=1 2024-02-15T23:29:52.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.631+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94148316630816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf7eaa0 con 0x55a09cf7abd0 2024-02-15T23:29:52.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f6346737640 1 -- 172.21.15.133:0/3948530843 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94148316630816] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f633c0e9030 con 0x55a09cf7abd0 2024-02-15T23:29:52.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f634941d980 20 remove_watcher() i=2 2024-02-15T23:29:52.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94148316623744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf80f20 con 0x7f633c0ab030 2024-02-15T23:29:52.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f6347739640 1 -- 172.21.15.133:0/3948530843 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94148316623744] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6338040040 con 0x7f633c0ab030 2024-02-15T23:29:52.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f634941d980 20 remove_watcher() i=3 2024-02-15T23:29:52.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94148316635392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf80f20 con 0x55a09cf74df0 2024-02-15T23:29:52.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94148316635392] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x55a09cf74df0 2024-02-15T23:29:52.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f634941d980 20 remove_watcher() i=4 2024-02-15T23:29:52.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.635+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94148316632976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf82100 con 0x7f6338028940 2024-02-15T23:29:52.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.639+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94148316632976] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.639+0000 7f634941d980 20 remove_watcher() i=5 2024-02-15T23:29:52.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.639+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94148316639088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf80f20 con 0x7f6338028940 2024-02-15T23:29:52.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.639+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94148316639088] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 20 remove_watcher() i=6 2024-02-15T23:29:52.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94148316642784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a09cf82100 con 0x7f6338028940 2024-02-15T23:29:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94148316642784] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634003d080 con 0x7f6338028940 2024-02-15T23:29:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 20 remove_watcher() i=7 2024-02-15T23:29:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6338028940 msgr2=0x7f6338012420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f6338028940 0x7f6338012420 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf74df0 msgr2=0x55a09cf772b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf74df0 0x55a09cf772b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f633c0ab030 msgr2=0x7f633c0dd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f633c0ab030 0x7f633c0dd400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a09cf7abd0 msgr2=0x55a09cf7cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a09cf7abd0 0x55a09cf7cfc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f62100342b0 msgr2=0x7f6210036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f62100342b0 0x7f6210036770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6338008fd0 tx=0x7f633801d070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 msgr2=0x55a09cf699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f6346f38640 1 -- 172.21.15.133:0/3948530843 reap_dead start 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cf699e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f633c0c8e10 tx=0x7f633c0e4140 comp rx=0 tx=0).stop 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 shutdown_connections 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/3948530843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cdc15e0 0x55a09cf699e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 >> 172.21.15.133:0/3948530843 conn(0x55a09cf5cbf0 msgr2=0x55a09cf5a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 shutdown_connections 2024-02-15T23:29:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/3948530843 wait complete. 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/743044918 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6220034300 msgr2=0x7f62200367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/743044918 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6220034300 0x7f62200367c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55a09cf43ec0 tx=0x7f6338003070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/743044918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cf53840 msgr2=0x55a09cf53c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/743044918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cf53840 0x55a09cf53c60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c10 tx=0x7f633c018020 comp rx=0 tx=0).stop 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/743044918 shutdown_connections 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/743044918 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6220034300 0x7f62200367c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/743044918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09cf53840 0x55a09cf53c60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/743044918 >> 172.21.15.133:0/743044918 conn(0x55a09cf48650 msgr2=0x55a09cf49160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/743044918 shutdown_connections 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/743044918 wait complete. 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf40bc0 msgr2=0x55a09cf42fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf40bc0 0x55a09cf42fb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f622c0342b0 msgr2=0x7f622c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f622c0342b0 0x7f622c036770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f633c0ad000 tx=0x7f633c0a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 msgr2=0x55a09cf3bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09cf3bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f63400012f0 tx=0x7f6340001260 comp rx=0 tx=0).stop 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 shutdown_connections 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a09cf40bc0 0x55a09cf42fb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f622c0342b0 0x7f622c036770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 --2- 172.21.15.133:0/797371533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ce4f640 0x55a09cf3bf30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 >> 172.21.15.133:0/797371533 conn(0x55a09ce46a00 msgr2=0x55a09cf2f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 shutdown_connections 2024-02-15T23:29:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.643+0000 7f634941d980 1 -- 172.21.15.133:0/797371533 wait complete. 2024-02-15T23:29:52.662 INFO:teuthology.orchestra.run.smithi133.stdout:["myfoo"] 2024-02-15T23:29:52.662 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-15T23:29:52.666 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:52.667 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-15T23:29:52.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-15T23:29:52.667 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-15T23:29:52.735 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:52.735 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:52.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b9527d980 1 Processor -- start 2024-02-15T23:29:52.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b9527d980 1 -- start start 2024-02-15T23:29:52.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b9527d980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x563b9e7bc340 0x563b9e7bc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b9527d980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563b9e7064b0 con 0x563b9e7bcc60 2024-02-15T23:29:52.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b9527d980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x563b9e6cd180 con 0x563b9e7bc340 2024-02-15T23:29:52.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b92d98640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x563b9e7bc340 0x563b9e7bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b92597640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x563b9e7bcc60 0x563b9e7bd610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39904/0 (socket says 172.21.15.133:39904) 2024-02-15T23:29:52.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b92597640 1 -- 172.21.15.133:0/1876867939 learned_addr learned my addr 172.21.15.133:0/1876867939 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:52.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b92d98640 1 -- 172.21.15.133:0/1876867939 >> v1:172.21.15.131:6789/0 conn(0x563b9e7bcc60 legacy=0x563b9e7bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.727+0000 7f2b92d98640 1 -- 172.21.15.133:0/1876867939 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b9e7bde40 con 0x563b9e7bc340 2024-02-15T23:29:52.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b92d98640 1 --2- 172.21.15.133:0/1876867939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e7bc720 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400a420 tx=0x7f2b8401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ace52f3542f905 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b91d96640 1 -- 172.21.15.133:0/1876867939 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b840aa530 con 0x563b9e7bc340 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b91d96640 1 -- 172.21.15.133:0/1876867939 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840a6050 con 0x563b9e7bc340 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b91d96640 1 -- 172.21.15.133:0/1876867939 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b840aa800 con 0x563b9e7bc340 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b9527d980 1 -- 172.21.15.133:0/1876867939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 msgr2=0x563b9e7bc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1876867939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e7bc720 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400a420 tx=0x7f2b8401afd0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b9527d980 1 -- 172.21.15.133:0/1876867939 shutdown_connections 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1876867939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e7bc720 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b9527d980 1 -- 172.21.15.133:0/1876867939 >> 172.21.15.133:0/1876867939 conn(0x563b9e72fa30 msgr2=0x563b9e72fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b9527d980 1 -- 172.21.15.133:0/1876867939 shutdown_connections 2024-02-15T23:29:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.731+0000 7f2b9527d980 1 -- 172.21.15.133:0/1876867939 wait complete. 2024-02-15T23:29:52.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b9527d980 1 Processor -- start 2024-02-15T23:29:52.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b9527d980 1 -- start start 2024-02-15T23:29:52.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b9527d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e8a6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b9527d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b9e6ca6b0 con 0x563b9e7bc340 2024-02-15T23:29:52.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b92d98640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e8a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b92d98640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e8a6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43076/0 (socket says 172.21.15.133:43076) 2024-02-15T23:29:52.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b92d98640 1 -- 172.21.15.133:0/2549381912 learned_addr learned my addr 172.21.15.133:0/2549381912 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b92d98640 1 -- 172.21.15.133:0/2549381912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8400a100 con 0x563b9e7bc340 2024-02-15T23:29:52.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.747+0000 7f2b92d98640 1 --2- 172.21.15.133:0/2549381912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e8a6820 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2b840ad040 tx=0x7f2b840033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cb42d5cdf85323 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2a80e09640 1 -- 172.21.15.133:0/2549381912 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b840aa6c0 con 0x563b9e7bc340 2024-02-15T23:29:52.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2a80e09640 1 -- 172.21.15.133:0/2549381912 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840aa820 con 0x563b9e7bc340 2024-02-15T23:29:52.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2a80e09640 1 -- 172.21.15.133:0/2549381912 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b840aaac0 con 0x563b9e7bc340 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 -- 172.21.15.133:0/2549381912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 msgr2=0x563b9e8a6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2549381912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e8a6820 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2b840ad040 tx=0x7f2b840033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 -- 172.21.15.133:0/2549381912 shutdown_connections 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2549381912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bc340 0x563b9e8a6820 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 -- 172.21.15.133:0/2549381912 >> 172.21.15.133:0/2549381912 conn(0x563b9e72fa30 msgr2=0x563b9e8a23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 -- 172.21.15.133:0/2549381912 shutdown_connections 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 -- 172.21.15.133:0/2549381912 wait complete. 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 Processor -- start 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 -- start start 2024-02-15T23:29:52.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bcc60 0x563b9e8ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b9527d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b9e6c5e90 con 0x563b9e7bcc60 2024-02-15T23:29:52.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b92d98640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bcc60 0x563b9e8ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b92d98640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bcc60 0x563b9e8ad790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43090/0 (socket says 172.21.15.133:43090) 2024-02-15T23:29:52.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b92d98640 1 -- 172.21.15.133:0/1510306579 learned_addr learned my addr 172.21.15.133:0/1510306579 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.751+0000 7f2b92d98640 1 -- 172.21.15.133:0/1510306579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b9e7bde40 con 0x563b9e7bcc60 2024-02-15T23:29:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b92d98640 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bcc60 0x563b9e8ad790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2b84003430 tx=0x7f2b84019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2a7f606640 1 -- 172.21.15.133:0/1510306579 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b840b6810 con 0x563b9e7bcc60 2024-02-15T23:29:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b9e8adcd0 con 0x563b9e7bcc60 2024-02-15T23:29:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2a7f606640 1 -- 172.21.15.133:0/1510306579 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840b6970 con 0x563b9e7bcc60 2024-02-15T23:29:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2a7f606640 1 -- 172.21.15.133:0/1510306579 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b840b6c10 con 0x563b9e7bcc60 2024-02-15T23:29:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b9e8ae160 con 0x563b9e7bcc60 2024-02-15T23:29:52.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2a7f606640 1 -- 172.21.15.133:0/1510306579 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b840c0450 con 0x563b9e7bcc60 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2a7f606640 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a780342b0 0x7f2a78036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2a7f606640 1 -- 172.21.15.133:0/1510306579 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b840e3d10 con 0x563b9e7bcc60 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b92597640 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a780342b0 0x7f2a78036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8b2410 0x563b9e8b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8b4d40 con 0x563b9e8b2410 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b93599640 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8b2410 0x563b9e8b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b92597640 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a780342b0 0x7f2a78036770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2b88000f70 tx=0x7f2b880012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b93599640 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8b2410 0x563b9e8b4800 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b93599640 1 -- 172.21.15.133:0/1510306579 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b8c0083f0 con 0x563b9e8b2410 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8b50a0 con 0x563b9e8b2410 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b93599640 1 -- 172.21.15.133:0/1510306579 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b8c0083f0 con 0x563b9e8b2410 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8b6900 con 0x563b9e8b2410 2024-02-15T23:29:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b93599640 1 -- 172.21.15.133:0/1510306579 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2b8c0083f0 con 0x563b9e8b2410 2024-02-15T23:29:52.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8b5b00 con 0x563b9e8b2410 2024-02-15T23:29:52.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b93599640 1 -- 172.21.15.133:0/1510306579 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b8c0083f0 con 0x563b9e8b2410 2024-02-15T23:29:52.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.755+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8b5f10 con 0x563b9e8b2410 2024-02-15T23:29:52.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b93599640 1 -- 172.21.15.133:0/1510306579 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2b8c012040 con 0x563b9e8b2410 2024-02-15T23:29:52.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b9527d980 1 Processor -- start 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b9527d980 1 -- start start 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b9527d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8c4fe0 0x563b9e8c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b9527d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b9e65ef20 con 0x563b9e8c4fe0 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b92597640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8c4fe0 0x563b9e8c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b92597640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8c4fe0 0x563b9e8c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43094/0 (socket says 172.21.15.133:43094) 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b92597640 1 -- 172.21.15.133:0/3613184581 learned_addr learned my addr 172.21.15.133:0/3613184581 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b92597640 1 -- 172.21.15.133:0/3613184581 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b9e8c5940 con 0x563b9e8c4fe0 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b92597640 1 --2- 172.21.15.133:0/3613184581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8c4fe0 0x563b9e8c5400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2b88001ee0 tx=0x7f2b8800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2a7ce01640 1 -- 172.21.15.133:0/3613184581 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b88020070 con 0x563b9e8c4fe0 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b9527d980 1 -- 172.21.15.133:0/3613184581 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b9e8c5b90 con 0x563b9e8c4fe0 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2a7ce01640 1 -- 172.21.15.133:0/3613184581 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8800c770 con 0x563b9e8c4fe0 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2a7ce01640 1 -- 172.21.15.133:0/3613184581 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b88013040 con 0x563b9e8c4fe0 2024-02-15T23:29:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b9527d980 1 -- 172.21.15.133:0/3613184581 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b9e8c66e0 con 0x563b9e8c4fe0 2024-02-15T23:29:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2a7ce01640 1 -- 172.21.15.133:0/3613184581 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b8800a040 con 0x563b9e8c4fe0 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2a7ce01640 1 --2- 172.21.15.133:0/3613184581 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a6c0342b0 0x7f2a6c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2a7ce01640 1 -- 172.21.15.133:0/3613184581 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b8804b6b0 con 0x563b9e8c4fe0 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b93599640 1 --2- 172.21.15.133:0/3613184581 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a6c0342b0 0x7f2a6c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b9527d980 1 Processor -- start 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.759+0000 7f2b93599640 1 --2- 172.21.15.133:0/3613184581 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a6c0342b0 0x7f2a6c036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x563b9e8b5540 tx=0x7f2b8c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- start start 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b9e652790 con 0x563b9e8d1f60 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43108/0 (socket says 172.21.15.133:43108) 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 -- 172.21.15.133:0/3122891867 learned_addr learned my addr 172.21.15.133:0/3122891867 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 -- 172.21.15.133:0/3122891867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b9e8d2950 con 0x563b9e8d1f60 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 --2- 172.21.15.133:0/3122891867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d2380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2b88019ef0 tx=0x7f2b8801b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd10ea500ece6005 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2a767fc640 1 -- 172.21.15.133:0/3122891867 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b88048070 con 0x563b9e8d1f60 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2a767fc640 1 -- 172.21.15.133:0/3122891867 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8801b420 con 0x563b9e8d1f60 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2a767fc640 1 -- 172.21.15.133:0/3122891867 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b88025c60 con 0x563b9e8d1f60 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- 172.21.15.133:0/3122891867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 msgr2=0x563b9e8d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 --2- 172.21.15.133:0/3122891867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d2380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2b88019ef0 tx=0x7f2b8801b940 comp rx=0 tx=0).stop 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- 172.21.15.133:0/3122891867 shutdown_connections 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 --2- 172.21.15.133:0/3122891867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d2380 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- 172.21.15.133:0/3122891867 >> 172.21.15.133:0/3122891867 conn(0x563b9e8ce2f0 msgr2=0x563b9e8cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- 172.21.15.133:0/3122891867 shutdown_connections 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- 172.21.15.133:0/3122891867 wait complete. 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 Processor -- start 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- start start 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b9e8d9390 con 0x563b9e8d1f60 2024-02-15T23:29:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43120/0 (socket says 172.21.15.133:43120) 2024-02-15T23:29:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 learned_addr learned my addr 172.21.15.133:0/2218619712 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:52.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b9e8c66e0 con 0x563b9e8d1f60 2024-02-15T23:29:52.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b92597640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d8e50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2b880199a0 tx=0x7f2b88049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2a74ff9640 1 -- 172.21.15.133:0/2218619712 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8801b590 con 0x563b9e8d1f60 2024-02-15T23:29:52.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.763+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b9e8d9590 con 0x563b9e8d1f60 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2a74ff9640 1 -- 172.21.15.133:0/2218619712 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8804ba10 con 0x563b9e8d1f60 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2a74ff9640 1 -- 172.21.15.133:0/2218619712 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8804bcb0 con 0x563b9e8d1f60 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b9e8d9a20 con 0x563b9e8d1f60 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2a74ff9640 1 -- 172.21.15.133:0/2218619712 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b8803b9d0 con 0x563b9e8d1f60 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2a74ff9640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a5c034260 0x7f2a5c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2a74ff9640 1 -- 172.21.15.133:0/2218619712 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b88039c60 con 0x563b9e8d1f60 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b93599640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a5c034260 0x7f2a5c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8e4430 0x563b9e8e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e7020 con 0x563b9e8e4430 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92d98640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8e4430 0x563b9e8e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b93599640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a5c034260 0x7f2a5c036720 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c008fd0 tx=0x7f2b8c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92d98640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8e4430 0x563b9e8e68d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 realm 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e73f0 con 0x563b9e8e4430 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e7c40 con 0x563b9e8e4430 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e7fa0 con 0x563b9e8e4430 2024-02-15T23:29:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e78e0 con 0x563b9e8e4430 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 20 searching for the correct realm 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563b9e8ea1f0 0x563b9e8ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92597640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563b9e8ea1f0 0x563b9e8ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.767+0000 7f2b92597640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563b9e8ea1f0 0x563b9e8ec5e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92597640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2b88038020 0x7f2b8802e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b93599640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2b88038020 0x7f2b8802e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b93599640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2b88038020 0x7f2b8802e840 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c02c040 con 0x7f2b88038020 2024-02-15T23:29:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b93599640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2b8c027940 0x7f2b8c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2b8c027940 0x7f2b8c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2b8c027940 0x7f2b8c0333c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.771+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c02c040 con 0x7f2b88038020 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2b8c02c040 con 0x7f2b88038020 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.775+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c02c040 con 0x7f2b88038020 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c02c040 con 0x7f2b88038020 2024-02-15T23:29:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.779+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c02c040 con 0x7f2b88038020 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e8e70 con 0x563b9e8e4430 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e8af0 con 0x563b9e8e4430 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e9800 con 0x563b9e8e4430 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 zone default found 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 4 Realm: () 2024-02-15T23:29:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 zonegroup default 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8ed0f0 con 0x7f2b8c027940 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eee80 con 0x563b9e8ea1f0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8ef1e0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 started sync module instance, tier type = 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.783+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8ee760 con 0x7f2b88038020 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.787+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.787+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94814063223488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eeb10 con 0x7f2b88038020 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.787+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8efef0 con 0x563b9e8e4430 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.787+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94814063223488] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.787+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.787+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94814063228336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8efef0 con 0x563b9e8e4430 2024-02-15T23:29:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.787+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f09c0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94814063232160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f1210 con 0x563b9e8ea1f0 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f1bc0 con 0x7f2b88038020 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94814063228336] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94814063229392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f1fa0 con 0x7f2b88038020 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f2910 con 0x563b9e8e4430 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94814063232160] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94814063229392] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94814063236832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f2470 con 0x563b9e8e4430 2024-02-15T23:29:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.791+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f3190 con 0x7f2b8c027940 2024-02-15T23:29:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.795+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94814063236832] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.795+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.795+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94814063234416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f2470 con 0x7f2b8c027940 2024-02-15T23:29:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.795+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f35e0 con 0x7f2b8c027940 2024-02-15T23:29:52.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94814063234416] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94814063243488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f35a0 con 0x7f2b8c027940 2024-02-15T23:29:52.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f3fd0 con 0x7f2b8c027940 2024-02-15T23:29:52.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94814063243488] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94814063241712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f3fd0 con 0x7f2b8c027940 2024-02-15T23:29:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 20 add_watcher() i=0 2024-02-15T23:29:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 20 add_watcher() i=1 2024-02-15T23:29:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 20 add_watcher() i=2 2024-02-15T23:29:52.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 20 add_watcher() i=3 2024-02-15T23:29:52.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 20 add_watcher() i=4 2024-02-15T23:29:52.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 20 add_watcher() i=5 2024-02-15T23:29:52.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.799+0000 7f2b9527d980 20 add_watcher() i=6 2024-02-15T23:29:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94814063241712] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 20 add_watcher() i=7 2024-02-15T23:29:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f7420 con 0x563b9e8e4430 2024-02-15T23:29:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94814063246592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f4930 con 0x563b9e8e4430 2024-02-15T23:29:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94814063246592] v31'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2a497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 5 note: GC not initialized 2024-02-15T23:29:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f29c3fff640 20 reqs_thread_entry: start 2024-02-15T23:29:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 20 Filter name: none 2024-02-15T23:29:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f29c1ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e918b00 con 0x563b9e8ea1f0 2024-02-15T23:29:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e918b00 con 0x563b9e8ea1f0 2024-02-15T23:29:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e918b00 con 0x563b9e8e4430 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e8af0 con 0x563b9e8e4430 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v31'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.803+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e8af0 con 0x7f2b88038020 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 [pgnls start_epoch 31 out=127b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.807+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(80 [pgnls start_epoch 31 out=70b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.811+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b8c027940 2024-02-15T23:29:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8e4430 2024-02-15T23:29:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8eccb0 con 0x7f2b88038020 2024-02-15T23:29:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b9527d980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b9527d980 20 RGWRados::pool_iterate: got myfoo 2024-02-15T23:29:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2a497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.815+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94814063246592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8e8af0 con 0x563b9e8e4430 2024-02-15T23:29:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.819+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94814063246592] v31'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.819+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94814063223488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f3cd0 con 0x7f2b88038020 2024-02-15T23:29:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.819+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94814063223488] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.819+0000 7f2b9527d980 20 remove_watcher() i=0 2024-02-15T23:29:52.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.819+0000 7f2b9527d980 2 removed watcher, disabling cache 2024-02-15T23:29:52.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.819+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94814063228336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8ee2c0 con 0x563b9e8e4430 2024-02-15T23:29:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94814063228336] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b9527d980 20 remove_watcher() i=1 2024-02-15T23:29:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94814063232160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8ee2c0 con 0x563b9e8ea1f0 2024-02-15T23:29:52.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b92597640 1 -- 172.21.15.133:0/2218619712 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94814063232160] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b88035070 con 0x563b9e8ea1f0 2024-02-15T23:29:52.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b9527d980 20 remove_watcher() i=2 2024-02-15T23:29:52.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94814063229392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8ef5b0 con 0x7f2b88038020 2024-02-15T23:29:52.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b93599640 1 -- 172.21.15.133:0/2218619712 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94814063229392] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c03f040 con 0x7f2b88038020 2024-02-15T23:29:52.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b9527d980 20 remove_watcher() i=3 2024-02-15T23:29:52.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.823+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94814063236832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f04a0 con 0x563b9e8e4430 2024-02-15T23:29:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.827+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94814063236832] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x563b9e8e4430 2024-02-15T23:29:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.827+0000 7f2b9527d980 20 remove_watcher() i=4 2024-02-15T23:29:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.827+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94814063234416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f16e0 con 0x7f2b8c027940 2024-02-15T23:29:52.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.827+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94814063234416] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.827+0000 7f2b9527d980 20 remove_watcher() i=5 2024-02-15T23:29:52.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.827+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94814063243488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f16e0 con 0x7f2b8c027940 2024-02-15T23:29:52.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94814063243488] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 20 remove_watcher() i=6 2024-02-15T23:29:52.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94814063241712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563b9e8f16e0 con 0x7f2b8c027940 2024-02-15T23:29:52.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94814063241712] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b840c6070 con 0x7f2b8c027940 2024-02-15T23:29:52.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 20 remove_watcher() i=7 2024-02-15T23:29:52.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2b8c027940 msgr2=0x7f2b8c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2b8c027940 0x7f2b8c0333c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8e4430 msgr2=0x563b9e8e68d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8e4430 0x563b9e8e68d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2b88038020 msgr2=0x7f2b8802e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2b88038020 0x7f2b8802e840 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563b9e8ea1f0 msgr2=0x563b9e8ec5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563b9e8ea1f0 0x563b9e8ec5e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a5c034260 msgr2=0x7f2a5c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a5c034260 0x7f2a5c036720 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c008fd0 tx=0x7f2b8c01c070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 msgr2=0x563b9e8d8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 --2- 172.21.15.133:0/2218619712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8d1f60 0x563b9e8d8e50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2b880199a0 tx=0x7f2b88049a30 comp rx=0 tx=0).stop 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b92d98640 1 -- 172.21.15.133:0/2218619712 reap_dead start 2024-02-15T23:29:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 shutdown_connections 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 >> 172.21.15.133:0/2218619712 conn(0x563b9e8ce2f0 msgr2=0x563b9e8cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 shutdown_connections 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.831+0000 7f2b9527d980 1 -- 172.21.15.133:0/2218619712 wait complete. 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/3613184581 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a6c0342b0 msgr2=0x7f2a6c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/3613184581 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a6c0342b0 0x7f2a6c036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x563b9e8b5540 tx=0x7f2b8c003070 comp rx=0 tx=0).stop 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/3613184581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8c4fe0 msgr2=0x563b9e8c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/3613184581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8c4fe0 0x563b9e8c5400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2b88001ee0 tx=0x7f2b8800da30 comp rx=0 tx=0).stop 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/3613184581 shutdown_connections 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/3613184581 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a6c0342b0 0x7f2a6c036770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/3613184581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e8c4fe0 0x563b9e8c5400 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/3613184581 >> 172.21.15.133:0/3613184581 conn(0x563b9e8b9df0 msgr2=0x563b9e8ba900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/3613184581 shutdown_connections 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/3613184581 wait complete. 2024-02-15T23:29:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8b2410 msgr2=0x563b9e8b4800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8b2410 0x563b9e8b4800 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a780342b0 msgr2=0x7f2a78036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a780342b0 0x7f2a78036770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2b88000f70 tx=0x7f2b880012c0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bcc60 msgr2=0x563b9e8ad790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bcc60 0x563b9e8ad790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2b84003430 tx=0x7f2b84019810 comp rx=0 tx=0).stop 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 shutdown_connections 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563b9e8b2410 0x563b9e8b4800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2a780342b0 0x7f2a78036770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 --2- 172.21.15.133:0/1510306579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563b9e7bcc60 0x563b9e8ad790 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 >> 172.21.15.133:0/1510306579 conn(0x563b9e72fa30 msgr2=0x563b9e8a0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 shutdown_connections 2024-02-15T23:29:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:52.835+0000 7f2b9527d980 1 -- 172.21.15.133:0/1510306579 wait complete. 2024-02-15T23:29:52.851 INFO:teuthology.orchestra.run.smithi133.stdout:["myfoo"] 2024-02-15T23:29:52.851 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-15T23:29:52.864 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:52.882 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:52.899 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:52.944 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-02-15T23:29:53.015 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:53.089 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:53.165 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:53.165 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T23:29:53.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T23:29:53.165 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-15T23:29:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f2015194980 1 Processor -- start 2024-02-15T23:29:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f2015194980 1 -- start start 2024-02-15T23:29:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f2015194980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609ed6556a0 0x5609ed6e9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f2015194980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5609ed62c4c0 con 0x5609ed6569e0 2024-02-15T23:29:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f2015194980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5609ed5f3180 con 0x5609ed6556a0 2024-02-15T23:29:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f20124ae640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609ed6556a0 0x5609ed6e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f20124ae640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5609ed6556a0 0x5609ed6e9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43134/0 (socket says 172.21.15.133:43134) 2024-02-15T23:29:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f20124ae640 1 -- 172.21.15.133:0/3650541674 learned_addr learned my addr 172.21.15.133:0/3650541674 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f2012caf640 1 --1- 172.21.15.133:0/3650541674 >> v1:172.21.15.131:6789/0 conn(0x5609ed6569e0 0x5609ed654f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39908/0 (socket says 172.21.15.133:39908) 2024-02-15T23:29:53.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f20124ae640 1 -- 172.21.15.133:0/3650541674 >> v1:172.21.15.131:6789/0 conn(0x5609ed6569e0 legacy=0x5609ed654f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.195+0000 7f20124ae640 1 -- 172.21.15.133:0/3650541674 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609ed655ab0 con 0x5609ed6556a0 2024-02-15T23:29:53.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f20124ae640 1 --2- 172.21.15.133:0/3650541674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed6e9140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f200400a5c0 tx=0x7f200401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd5e377933a88f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2011cad640 1 -- 172.21.15.133:0/3650541674 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20040ac460 con 0x5609ed6556a0 2024-02-15T23:29:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2011cad640 1 -- 172.21.15.133:0/3650541674 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20040ac5c0 con 0x5609ed6556a0 2024-02-15T23:29:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2011cad640 1 -- 172.21.15.133:0/3650541674 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20040ac880 con 0x5609ed6556a0 2024-02-15T23:29:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2015194980 1 -- 172.21.15.133:0/3650541674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 msgr2=0x5609ed6e9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2015194980 1 --2- 172.21.15.133:0/3650541674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed6e9140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f200400a5c0 tx=0x7f200401b340 comp rx=0 tx=0).stop 2024-02-15T23:29:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2015194980 1 -- 172.21.15.133:0/3650541674 shutdown_connections 2024-02-15T23:29:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2015194980 1 --2- 172.21.15.133:0/3650541674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed6e9140 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2015194980 1 -- 172.21.15.133:0/3650541674 >> 172.21.15.133:0/3650541674 conn(0x5609ed6dba00 msgr2=0x5609ed6dde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2015194980 1 -- 172.21.15.133:0/3650541674 shutdown_connections 2024-02-15T23:29:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.199+0000 7f2015194980 1 -- 172.21.15.133:0/3650541674 wait complete. 2024-02-15T23:29:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 Processor -- start 2024-02-15T23:29:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 -- start start 2024-02-15T23:29:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609ed5f06b0 con 0x5609ed6556a0 2024-02-15T23:29:53.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2012caf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2012caf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43142/0 (socket says 172.21.15.133:43142) 2024-02-15T23:29:53.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2012caf640 1 -- 172.21.15.133:0/2701438461 learned_addr learned my addr 172.21.15.133:0/2701438461 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2012caf640 1 -- 172.21.15.133:0/2701438461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004005df0 con 0x5609ed6556a0 2024-02-15T23:29:53.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2012caf640 1 --2- 172.21.15.133:0/2701438461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7cc5b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc006fb0 tx=0x7f1ffc001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c660f856f71faa20 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f1f00e09640 1 -- 172.21.15.133:0/2701438461 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ffc013420 con 0x5609ed6556a0 2024-02-15T23:29:53.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f1f00e09640 1 -- 172.21.15.133:0/2701438461 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc013580 con 0x5609ed6556a0 2024-02-15T23:29:53.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f1f00e09640 1 -- 172.21.15.133:0/2701438461 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ffc013860 con 0x5609ed6556a0 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 -- 172.21.15.133:0/2701438461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 msgr2=0x5609ed7cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 --2- 172.21.15.133:0/2701438461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7cc5b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc006fb0 tx=0x7f1ffc001940 comp rx=0 tx=0).stop 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 -- 172.21.15.133:0/2701438461 shutdown_connections 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 --2- 172.21.15.133:0/2701438461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7cc5b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.215+0000 7f2015194980 1 -- 172.21.15.133:0/2701438461 >> 172.21.15.133:0/2701438461 conn(0x5609ed6dba00 msgr2=0x5609ed7c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2015194980 1 -- 172.21.15.133:0/2701438461 shutdown_connections 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2015194980 1 -- 172.21.15.133:0/2701438461 wait complete. 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2015194980 1 Processor -- start 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2015194980 1 -- start start 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2015194980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7d3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2015194980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609ed5ebe90 con 0x5609ed6556a0 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2012caf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2012caf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43146/0 (socket says 172.21.15.133:43146) 2024-02-15T23:29:53.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2012caf640 1 -- 172.21.15.133:0/2486585236 learned_addr learned my addr 172.21.15.133:0/2486585236 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2012caf640 1 -- 172.21.15.133:0/2486585236 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609ed62c4c0 con 0x5609ed6556a0 2024-02-15T23:29:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2012caf640 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7d3440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x5609ed7cd440 tx=0x7f1ffc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f1eff606640 1 -- 172.21.15.133:0/2486585236 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ffc0037a0 con 0x5609ed6556a0 2024-02-15T23:29:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f1eff606640 1 -- 172.21.15.133:0/2486585236 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc003900 con 0x5609ed6556a0 2024-02-15T23:29:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609ed7d3980 con 0x5609ed6556a0 2024-02-15T23:29:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f1eff606640 1 -- 172.21.15.133:0/2486585236 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ffc003ba0 con 0x5609ed6556a0 2024-02-15T23:29:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609ed7d3dd0 con 0x5609ed6556a0 2024-02-15T23:29:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f1eff606640 1 -- 172.21.15.133:0/2486585236 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1ffc028460 con 0x5609ed6556a0 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f1eff606640 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ef80342b0 0x7f1ef8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f1eff606640 1 -- 172.21.15.133:0/2486585236 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1ffc049550 con 0x5609ed6556a0 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.219+0000 7f20124ae640 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ef80342b0 0x7f1ef8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed6569e0 0x5609ed7da090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed7da5d0 con 0x5609ed6569e0 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20134b0640 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed6569e0 0x5609ed7da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20124ae640 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ef80342b0 0x7f1ef8036770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f20040ae000 tx=0x7f20040a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20134b0640 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed6569e0 0x5609ed7da090 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20134b0640 1 -- 172.21.15.133:0/2486585236 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f200c0083f0 con 0x5609ed6569e0 2024-02-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed7d77c0 con 0x5609ed6569e0 2024-02-15T23:29:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20134b0640 1 -- 172.21.15.133:0/2486585236 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f200c0083f0 con 0x5609ed6569e0 2024-02-15T23:29:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed7dc2d0 con 0x5609ed6569e0 2024-02-15T23:29:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20134b0640 1 -- 172.21.15.133:0/2486585236 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f200c0083f0 con 0x5609ed6569e0 2024-02-15T23:29:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed7db4d0 con 0x5609ed6569e0 2024-02-15T23:29:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20134b0640 1 -- 172.21.15.133:0/2486585236 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f200c0083f0 con 0x5609ed6569e0 2024-02-15T23:29:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed7db8e0 con 0x5609ed6569e0 2024-02-15T23:29:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20134b0640 1 -- 172.21.15.133:0/2486585236 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f200c012040 con 0x5609ed6569e0 2024-02-15T23:29:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 Processor -- start 2024-02-15T23:29:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 -- start start 2024-02-15T23:29:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7ea9b0 0x5609ed7eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f2015194980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609ed584f20 con 0x5609ed7ea9b0 2024-02-15T23:29:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20124ae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7ea9b0 0x5609ed7eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20124ae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7ea9b0 0x5609ed7eadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43162/0 (socket says 172.21.15.133:43162) 2024-02-15T23:29:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.223+0000 7f20124ae640 1 -- 172.21.15.133:0/2523948529 learned_addr learned my addr 172.21.15.133:0/2523948529 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f20124ae640 1 -- 172.21.15.133:0/2523948529 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609ed7eb310 con 0x5609ed7ea9b0 2024-02-15T23:29:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f20124ae640 1 --2- 172.21.15.133:0/2523948529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7ea9b0 0x5609ed7eadd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f200401b380 tx=0x7f20040180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f1efce01640 1 -- 172.21.15.133:0/2523948529 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20040acd00 con 0x5609ed7ea9b0 2024-02-15T23:29:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f1efce01640 1 -- 172.21.15.133:0/2523948529 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20040ace60 con 0x5609ed7ea9b0 2024-02-15T23:29:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f2015194980 1 -- 172.21.15.133:0/2523948529 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609ed7eb500 con 0x5609ed7ea9b0 2024-02-15T23:29:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f1efce01640 1 -- 172.21.15.133:0/2523948529 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20040c0540 con 0x5609ed7ea9b0 2024-02-15T23:29:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f2015194980 1 -- 172.21.15.133:0/2523948529 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609ed7ebff0 con 0x5609ed7ea9b0 2024-02-15T23:29:53.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f1efce01640 1 -- 172.21.15.133:0/2523948529 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f20040c06f0 con 0x5609ed7ea9b0 2024-02-15T23:29:53.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f1efce01640 1 --2- 172.21.15.133:0/2523948529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eec0342b0 0x7f1eec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f1efce01640 1 -- 172.21.15.133:0/2523948529 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f20040e5de0 con 0x5609ed7ea9b0 2024-02-15T23:29:53.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f20134b0640 1 --2- 172.21.15.133:0/2523948529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eec0342b0 0x7f1eec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f2015194980 1 Processor -- start 2024-02-15T23:29:53.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f2015194980 1 -- start start 2024-02-15T23:29:53.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f20134b0640 1 --2- 172.21.15.133:0/2523948529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eec0342b0 0x7f1eec036770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5609ed7daf10 tx=0x7f200c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f2015194980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f2015194980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609ed578790 con 0x5609ed7f7a10 2024-02-15T23:29:53.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f20124ae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f20124ae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43168/0 (socket says 172.21.15.133:43168) 2024-02-15T23:29:53.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f20124ae640 1 -- 172.21.15.133:0/363972524 learned_addr learned my addr 172.21.15.133:0/363972524 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.227+0000 7f20124ae640 1 -- 172.21.15.133:0/363972524 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609ed7f8400 con 0x5609ed7f7a10 2024-02-15T23:29:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f20124ae640 1 --2- 172.21.15.133:0/363972524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7f7e30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f20040e4110 tx=0x7f20040aacd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5ac0edb6f9035e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f1ef67fc640 1 -- 172.21.15.133:0/363972524 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20040b9b50 con 0x5609ed7f7a10 2024-02-15T23:29:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f1ef67fc640 1 -- 172.21.15.133:0/363972524 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20040b9cb0 con 0x5609ed7f7a10 2024-02-15T23:29:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f1ef67fc640 1 -- 172.21.15.133:0/363972524 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20040bf370 con 0x5609ed7f7a10 2024-02-15T23:29:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- 172.21.15.133:0/363972524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 msgr2=0x5609ed7f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 --2- 172.21.15.133:0/363972524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7f7e30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f20040e4110 tx=0x7f20040aacd0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- 172.21.15.133:0/363972524 shutdown_connections 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 --2- 172.21.15.133:0/363972524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7f7e30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- 172.21.15.133:0/363972524 >> 172.21.15.133:0/363972524 conn(0x5609ed7f3da0 msgr2=0x5609ed7f1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- 172.21.15.133:0/363972524 shutdown_connections 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- 172.21.15.133:0/363972524 wait complete. 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 Processor -- start 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- start start 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7fe960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609ed7feea0 con 0x5609ed7f7a10 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f20124ae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f20124ae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7fe960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43172/0 (socket says 172.21.15.133:43172) 2024-02-15T23:29:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 learned_addr learned my addr 172.21.15.133:0/1527089036 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609ed7ebff0 con 0x5609ed7f7a10 2024-02-15T23:29:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f20124ae640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7fe960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f20040aad10 tx=0x7f2004006500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f1ef4ff9640 1 -- 172.21.15.133:0/1527089036 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20040e8040 con 0x5609ed7f7a10 2024-02-15T23:29:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609ed7ff0a0 con 0x5609ed7f7a10 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609ed7ff4d0 con 0x5609ed7f7a10 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f1ef4ff9640 1 -- 172.21.15.133:0/1527089036 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20040bfb10 con 0x5609ed7f7a10 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.231+0000 7f1ef4ff9640 1 -- 172.21.15.133:0/1527089036 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20040b92b0 con 0x5609ed7f7a10 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f1ef4ff9640 1 -- 172.21.15.133:0/1527089036 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f20040b9410 con 0x5609ed7f7a10 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f1ef4ff9640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1edc034260 0x7f1edc036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f1ef4ff9640 1 -- 172.21.15.133:0/1527089036 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f20040e10d0 con 0x5609ed7f7a10 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f20134b0640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1edc034260 0x7f1edc036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed809ec0 0x5609ed80c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed80cad0 con 0x5609ed809ec0 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2012caf640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed809ec0 0x5609ed80c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f20134b0640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1edc034260 0x7f1edc036720 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f200c008fd0 tx=0x7f200c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2012caf640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed809ec0 0x5609ed80c380 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 realm 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed80cef0 con 0x5609ed809ec0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed80d740 con 0x5609ed809ec0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed80daa0 con 0x5609ed809ec0 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed80d3e0 con 0x5609ed809ec0 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 20 searching for the correct realm 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609ed80fcf0 0x5609ed812120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f20124ae640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609ed80fcf0 0x5609ed812120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.235+0000 7f20124ae640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609ed80fcf0 0x5609ed812120 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f20124ae640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f20040f7060 0x7f20040d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f20040f7060 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f20134b0640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f20040f7060 0x7f20040d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f20134b0640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f20040f7060 0x7f20040d1720 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f200c02c040 con 0x7f20040f7060 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f20134b0640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f200c027940 0x7f200c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f200c027940 0x7f200c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f200c027940 0x7f200c0333c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed809ec0 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed809ec0 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.239+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f20040f7060 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f200c02c040 con 0x7f20040f7060 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed809ec0 2024-02-15T23:29:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed809ec0 2024-02-15T23:29:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f20040f7060 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f200c02c040 con 0x7f20040f7060 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.243+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed809ec0 2024-02-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed809ec0 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f20040f7060 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f200c02c040 con 0x7f20040f7060 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed809ec0 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.247+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f20040f7060 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f200c02c040 con 0x7f20040f7060 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed80fcf0 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f200c027940 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x5609ed809ec0 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8127f0 con 0x7f20040f7060 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f200c02c040 con 0x7f20040f7060 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed80e940 con 0x5609ed809ec0 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed80e5c0 con 0x5609ed809ec0 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed80f2d0 con 0x5609ed809ec0 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 zone default found 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 4 Realm: () 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 zonegroup default 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.251+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed812c30 con 0x7f200c027940 2024-02-15T23:29:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed814ab0 con 0x5609ed80fcf0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed814e10 con 0x5609ed80fcf0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 20 started sync module instance, tier type = 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed814080 con 0x7f20040f7060 2024-02-15T23:29:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94600639366192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed814080 con 0x7f20040f7060 2024-02-15T23:29:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8157d0 con 0x5609ed809ec0 2024-02-15T23:29:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.255+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94600639366192] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94600639370304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed814080 con 0x5609ed809ec0 2024-02-15T23:29:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed816190 con 0x5609ed80fcf0 2024-02-15T23:29:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94600639372528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8169e0 con 0x5609ed80fcf0 2024-02-15T23:29:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed817400 con 0x7f20040f7060 2024-02-15T23:29:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94600639370304] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94600639377120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8177b0 con 0x7f20040f7060 2024-02-15T23:29:53.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.259+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed818120 con 0x5609ed809ec0 2024-02-15T23:29:53.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.263+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94600639372528] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.263+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94600639377120] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.263+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.263+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94600639364064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed817c80 con 0x5609ed809ec0 2024-02-15T23:29:53.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.263+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed818970 con 0x7f200c027940 2024-02-15T23:29:53.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.263+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94600639364064] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.267+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.267+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94600639374656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8186a0 con 0x7f200c027940 2024-02-15T23:29:53.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.267+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed818ea0 con 0x7f200c027940 2024-02-15T23:29:53.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.267+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94600639374656] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.267+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.267+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94600639382288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed818d50 con 0x7f200c027940 2024-02-15T23:29:53.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.267+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed819820 con 0x7f200c027940 2024-02-15T23:29:53.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94600639382288] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94600639386368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8197e0 con 0x7f200c027940 2024-02-15T23:29:53.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 20 add_watcher() i=0 2024-02-15T23:29:53.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 20 add_watcher() i=1 2024-02-15T23:29:53.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 20 add_watcher() i=2 2024-02-15T23:29:53.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 20 add_watcher() i=3 2024-02-15T23:29:53.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 20 add_watcher() i=4 2024-02-15T23:29:53.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 20 add_watcher() i=5 2024-02-15T23:29:53.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 20 add_watcher() i=6 2024-02-15T23:29:53.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94600639386368] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 20 add_watcher() i=7 2024-02-15T23:29:53.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:53.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed81cc60 con 0x5609ed809ec0 2024-02-15T23:29:53.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94600639383472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed81a170 con 0x5609ed809ec0 2024-02-15T23:29:53.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.271+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94600639383472] v31'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f1ec97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:53.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:53.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 5 note: GC not initialized 2024-02-15T23:29:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f1e43fff640 20 reqs_thread_entry: start 2024-02-15T23:29:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 Filter name: none 2024-02-15T23:29:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f1e41ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed83ec20 con 0x7f20040f7060 2024-02-15T23:29:53.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed83f1f0 con 0x5609ed809ec0 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(63 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed83e2a0 con 0x7f20040f7060 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8407c0 con 0x5609ed809ec0 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 4.4 4:225d0aa6:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed83fd80 con 0x7f200c027940 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 4.7 4:e26d1279:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed8452e0 con 0x7f200c027940 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 4.10 4:089e7450:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed83fd80 con 0x5609ed80fcf0 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 4.1b 4:d8953915:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed84a0b0 con 0x7f20040f7060 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 4.26 4:6757ac19:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed84ce00 con 0x7f200c027940 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 4.2d 4:b6243017:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed84f950 con 0x7f200c027940 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 4.f 4:f19f4e25:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed852510 con 0x5609ed809ec0 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 4.18 4:184ef1b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed854eb0 con 0x7f20040f7060 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:74 4.5 4:a039e12f:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed857940 con 0x5609ed80fcf0 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 4.6 4:636a0651:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed85a360 con 0x5609ed80fcf0 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 4.4 4:227d7df5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed85cd40 con 0x7f200c027940 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(69 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(72 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(68 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(73 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(75 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(66 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(74 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(67 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.275+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(70 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(76 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f2015194980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 6.1d 6:ba7aa448:::pubsub..bucket.myfoo%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed84fcb0 con 0x7f200c027940 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(77 pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f2015194980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f1ec97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:53.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94600639383472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed81c9d0 con 0x5609ed809ec0 2024-02-15T23:29:53.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94600639383472] v31'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.279+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94600639366192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed81c9d0 con 0x7f20040f7060 2024-02-15T23:29:53.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.283+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94600639366192] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.283+0000 7f2015194980 20 remove_watcher() i=0 2024-02-15T23:29:53.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.283+0000 7f2015194980 2 removed watcher, disabling cache 2024-02-15T23:29:53.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.283+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94600639370304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed81c9d0 con 0x5609ed809ec0 2024-02-15T23:29:53.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.283+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94600639370304] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.283+0000 7f2015194980 20 remove_watcher() i=1 2024-02-15T23:29:53.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.283+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94600639372528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed815440 con 0x5609ed80fcf0 2024-02-15T23:29:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f20124ae640 1 -- 172.21.15.133:0/1527089036 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94600639372528] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f20040b3040 con 0x5609ed80fcf0 2024-02-15T23:29:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f2015194980 20 remove_watcher() i=2 2024-02-15T23:29:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94600639377120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed81c9d0 con 0x7f20040f7060 2024-02-15T23:29:53.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f20134b0640 1 -- 172.21.15.133:0/1527089036 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94600639377120] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f200c03f040 con 0x7f20040f7060 2024-02-15T23:29:53.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f2015194980 20 remove_watcher() i=3 2024-02-15T23:29:53.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94600639364064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed815440 con 0x5609ed809ec0 2024-02-15T23:29:53.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94600639364064] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x5609ed809ec0 2024-02-15T23:29:53.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f2015194980 20 remove_watcher() i=4 2024-02-15T23:29:53.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.287+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94600639374656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed81c9d0 con 0x7f200c027940 2024-02-15T23:29:53.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.291+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94600639374656] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.291+0000 7f2015194980 20 remove_watcher() i=5 2024-02-15T23:29:53.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.291+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94600639382288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed813be0 con 0x7f200c027940 2024-02-15T23:29:53.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.291+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94600639382288] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.291+0000 7f2015194980 20 remove_watcher() i=6 2024-02-15T23:29:53.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.291+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94600639386368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5609ed815440 con 0x7f200c027940 2024-02-15T23:29:53.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94600639386368] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ffc024020 con 0x7f200c027940 2024-02-15T23:29:53.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 20 remove_watcher() i=7 2024-02-15T23:29:53.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f200c027940 msgr2=0x7f200c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f200c027940 0x7f200c0333c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed809ec0 msgr2=0x5609ed80c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed809ec0 0x5609ed80c380 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f20040f7060 msgr2=0x7f20040d1720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f20040f7060 0x7f20040d1720 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609ed80fcf0 msgr2=0x5609ed812120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5609ed80fcf0 0x5609ed812120 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1edc034260 msgr2=0x7f1edc036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1edc034260 0x7f1edc036720 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f200c008fd0 tx=0x7f200c01c070 comp rx=0 tx=0).stop 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 msgr2=0x5609ed7fe960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2012caf640 1 -- 172.21.15.133:0/1527089036 reap_dead start 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7fe960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f20040aad10 tx=0x7f2004006500 comp rx=0 tx=0).stop 2024-02-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 shutdown_connections 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/1527089036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7f7a10 0x5609ed7fe960 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 >> 172.21.15.133:0/1527089036 conn(0x5609ed7f3da0 msgr2=0x5609ed7f1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 shutdown_connections 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/1527089036 wait complete. 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2523948529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eec0342b0 msgr2=0x7f1eec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2523948529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eec0342b0 0x7f1eec036770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5609ed7daf10 tx=0x7f200c003070 comp rx=0 tx=0).stop 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2523948529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7ea9b0 msgr2=0x5609ed7eadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2523948529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7ea9b0 0x5609ed7eadd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f200401b380 tx=0x7f20040180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2523948529 shutdown_connections 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2523948529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eec0342b0 0x7f1eec036770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2523948529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed7ea9b0 0x5609ed7eadd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2523948529 >> 172.21.15.133:0/2523948529 conn(0x5609ed7df7c0 msgr2=0x5609ed7e02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2523948529 shutdown_connections 2024-02-15T23:29:53.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2523948529 wait complete. 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed6569e0 msgr2=0x5609ed7da090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed6569e0 0x5609ed7da090 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ef80342b0 msgr2=0x7f1ef8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ef80342b0 0x7f1ef8036770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f20040ae000 tx=0x7f20040a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 msgr2=0x5609ed7d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7d3440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x5609ed7cd440 tx=0x7f1ffc000f50 comp rx=0 tx=0).stop 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 shutdown_connections 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5609ed6569e0 0x5609ed7da090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ef80342b0 0x7f1ef8036770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 --2- 172.21.15.133:0/2486585236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609ed6556a0 0x5609ed7d3440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.295+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 >> 172.21.15.133:0/2486585236 conn(0x5609ed6dba00 msgr2=0x5609ed7c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.299+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 shutdown_connections 2024-02-15T23:29:53.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.299+0000 7f2015194980 1 -- 172.21.15.133:0/2486585236 wait complete. 2024-02-15T23:29:53.316 INFO:teuthology.orchestra.run.smithi133.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"deea0f97-f899-4036-a460-801d53f243a7","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","marker":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-15T23:29:52.498920Z","creation_time":"2024-02-15T23:29:52.491594Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-15T23:29:53.316 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'deea0f97-f899-4036-a460-801d53f243a7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'marker': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-15T23:29:52.498920Z', 'creation_time': '2024-02-15T23:29:52.491594Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-15T23:29:53.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-15T23:29:53.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-15T23:29:53.317 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-15T23:29:53.394 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:53.394 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:53.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff11009e980 1 Processor -- start 2024-02-15T23:29:53.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff11009e980 1 -- start start 2024-02-15T23:29:53.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff11009e980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556d65564040 0x556d65564420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff11009e980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556d654b14c0 con 0x556d65564960 2024-02-15T23:29:53.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff11009e980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x556d65478180 con 0x556d65564040 2024-02-15T23:29:53.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff10dbb9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556d65564040 0x556d65564420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff10d3b8640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x556d65564960 0x556d65565320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39924/0 (socket says 172.21.15.133:39924) 2024-02-15T23:29:53.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff10dbb9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556d65564040 0x556d65564420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43174/0 (socket says 172.21.15.133:43174) 2024-02-15T23:29:53.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1393370893 learned_addr learned my addr 172.21.15.133:0/1393370893 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:53.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff10cbb7640 1 -- 172.21.15.133:0/1393370893 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636011540 0 0) 0x556d654b14c0 con 0x556d65564960 2024-02-15T23:29:53.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff10cbb7640 1 -- 172.21.15.133:0/1393370893 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f8004030 con 0x556d65564960 2024-02-15T23:29:53.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1393370893 >> v1:172.21.15.131:6789/0 conn(0x556d65564960 legacy=0x556d65565320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.387+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1393370893 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d65565b50 con 0x556d65564040 2024-02-15T23:29:53.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff10dbb9640 1 --2- 172.21.15.133:0/1393370893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65564420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff10000a480 tx=0x7ff10001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f086a2206c02006 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff10cbb7640 1 -- 172.21.15.133:0/1393370893 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000aa530 con 0x556d65564040 2024-02-15T23:29:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff10cbb7640 1 -- 172.21.15.133:0/1393370893 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000a6050 con 0x556d65564040 2024-02-15T23:29:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff10cbb7640 1 -- 172.21.15.133:0/1393370893 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000aa7e0 con 0x556d65564040 2024-02-15T23:29:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff11009e980 1 -- 172.21.15.133:0/1393370893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 msgr2=0x556d65564420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff11009e980 1 --2- 172.21.15.133:0/1393370893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65564420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff10000a480 tx=0x7ff10001b280 comp rx=0 tx=0).stop 2024-02-15T23:29:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff11009e980 1 -- 172.21.15.133:0/1393370893 shutdown_connections 2024-02-15T23:29:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff11009e980 1 --2- 172.21.15.133:0/1393370893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65564420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff11009e980 1 -- 172.21.15.133:0/1393370893 >> 172.21.15.133:0/1393370893 conn(0x556d6555f910 msgr2=0x556d65561d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff11009e980 1 -- 172.21.15.133:0/1393370893 shutdown_connections 2024-02-15T23:29:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.391+0000 7ff11009e980 1 -- 172.21.15.133:0/1393370893 wait complete. 2024-02-15T23:29:53.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff11009e980 1 Processor -- start 2024-02-15T23:29:53.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff11009e980 1 -- start start 2024-02-15T23:29:53.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff11009e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d6564d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff11009e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d654756b0 con 0x556d65564040 2024-02-15T23:29:53.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff10dbb9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d6564d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff10dbb9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d6564d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43184/0 (socket says 172.21.15.133:43184) 2024-02-15T23:29:53.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff10dbb9640 1 -- 172.21.15.133:0/2118262735 learned_addr learned my addr 172.21.15.133:0/2118262735 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff10dbb9640 1 -- 172.21.15.133:0/2118262735 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100005d30 con 0x556d65564040 2024-02-15T23:29:53.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7ff10dbb9640 1 --2- 172.21.15.133:0/2118262735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d6564d370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff100017e90 tx=0x7ff100003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda5139f6ac5ae09 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7feffbe07640 1 -- 172.21.15.133:0/2118262735 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000aa720 con 0x556d65564040 2024-02-15T23:29:53.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7feffbe07640 1 -- 172.21.15.133:0/2118262735 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000aa880 con 0x556d65564040 2024-02-15T23:29:53.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.407+0000 7feffbe07640 1 -- 172.21.15.133:0/2118262735 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000aab40 con 0x556d65564040 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- 172.21.15.133:0/2118262735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 msgr2=0x556d6564d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 --2- 172.21.15.133:0/2118262735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d6564d370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff100017e90 tx=0x7ff100003030 comp rx=0 tx=0).stop 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- 172.21.15.133:0/2118262735 shutdown_connections 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 --2- 172.21.15.133:0/2118262735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d6564d370 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- 172.21.15.133:0/2118262735 >> 172.21.15.133:0/2118262735 conn(0x556d6555f910 msgr2=0x556d65648f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- 172.21.15.133:0/2118262735 shutdown_connections 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- 172.21.15.133:0/2118262735 wait complete. 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 Processor -- start 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- start start 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65654060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d65470e90 con 0x556d65564040 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff10dbb9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65654060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff10dbb9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65654060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43194/0 (socket says 172.21.15.133:43194) 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1707105144 learned_addr learned my addr 172.21.15.133:0/1707105144 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1707105144 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d65565b50 con 0x556d65564040 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff10dbb9640 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65654060 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff1000b7040 tx=0x7ff100018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7feffa604640 1 -- 172.21.15.133:0/1707105144 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000c3070 con 0x556d65564040 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d656545a0 con 0x556d65564040 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7feffa604640 1 -- 172.21.15.133:0/1707105144 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000b5550 con 0x556d65564040 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7feffa604640 1 -- 172.21.15.133:0/1707105144 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000b5810 con 0x556d65564040 2024-02-15T23:29:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.411+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d65654a30 con 0x556d65564040 2024-02-15T23:29:53.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7feffa604640 1 -- 172.21.15.133:0/1707105144 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1000b5a00 con 0x556d65564040 2024-02-15T23:29:53.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7feffa604640 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feff40342b0 0x7feff4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7feffa604640 1 -- 172.21.15.133:0/1707105144 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff1000e39a0 con 0x556d65564040 2024-02-15T23:29:53.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10d3b8640 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feff40342b0 0x7feff4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d65564960 0x556d6565aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6565b1e0 con 0x556d65564960 2024-02-15T23:29:53.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d65564960 0x556d6565aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10d3b8640 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feff40342b0 0x7feff4036770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff104001dc0 tx=0x7ff104001360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d65564960 0x556d6565aca0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1707105144 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff10800a4d0 con 0x556d65564960 2024-02-15T23:29:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6565b560 con 0x556d65564960 2024-02-15T23:29:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1707105144 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff10800a4d0 con 0x556d65564960 2024-02-15T23:29:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6565ce10 con 0x556d65564960 2024-02-15T23:29:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1707105144 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff10800a4d0 con 0x556d65564960 2024-02-15T23:29:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6565c010 con 0x556d65564960 2024-02-15T23:29:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1707105144 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff10800a4d0 con 0x556d65564960 2024-02-15T23:29:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6565c420 con 0x556d65564960 2024-02-15T23:29:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1707105144 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff10800a4d0 con 0x556d65564960 2024-02-15T23:29:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 Processor -- start 2024-02-15T23:29:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 -- start start 2024-02-15T23:29:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6566b510 0x556d6566b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.415+0000 7ff11009e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d65409f20 con 0x556d6566b510 2024-02-15T23:29:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7ff10d3b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6566b510 0x556d6566b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7ff10d3b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6566b510 0x556d6566b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43196/0 (socket says 172.21.15.133:43196) 2024-02-15T23:29:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7ff10d3b8640 1 -- 172.21.15.133:0/3906888364 learned_addr learned my addr 172.21.15.133:0/3906888364 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7ff10d3b8640 1 -- 172.21.15.133:0/3906888364 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6566be70 con 0x556d6566b510 2024-02-15T23:29:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7ff10d3b8640 1 --2- 172.21.15.133:0/3906888364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6566b510 0x556d6566b930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff10400d660 tx=0x7ff10400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7feff37fe640 1 -- 172.21.15.133:0/3906888364 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff104020070 con 0x556d6566b510 2024-02-15T23:29:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7feff37fe640 1 -- 172.21.15.133:0/3906888364 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400c770 con 0x556d6566b510 2024-02-15T23:29:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7feff37fe640 1 -- 172.21.15.133:0/3906888364 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff104013040 con 0x556d6566b510 2024-02-15T23:29:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7ff11009e980 1 -- 172.21.15.133:0/3906888364 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d6566c0c0 con 0x556d6566b510 2024-02-15T23:29:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7ff11009e980 1 -- 172.21.15.133:0/3906888364 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d6566cc10 con 0x556d6566b510 2024-02-15T23:29:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7feff37fe640 1 -- 172.21.15.133:0/3906888364 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff10400a040 con 0x556d6566b510 2024-02-15T23:29:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7feff37fe640 1 --2- 172.21.15.133:0/3906888364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefe8034320 0x7fefe80367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7feff37fe640 1 -- 172.21.15.133:0/3906888364 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff10404b5f0 con 0x556d6566b510 2024-02-15T23:29:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.419+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/3906888364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefe8034320 0x7fefe80367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 Processor -- start 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- start start 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/3906888364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefe8034320 0x7fefe80367e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x556d6565ba50 tx=0x7ff108005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d6567cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d653fd790 con 0x556d6567c940 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10d3b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d6567cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10d3b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d6567cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43212/0 (socket says 172.21.15.133:43212) 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10d3b8640 1 -- 172.21.15.133:0/2132413454 learned_addr learned my addr 172.21.15.133:0/2132413454 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10d3b8640 1 -- 172.21.15.133:0/2132413454 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6567d310 con 0x556d6567c940 2024-02-15T23:29:53.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10d3b8640 1 --2- 172.21.15.133:0/2132413454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d6567cd40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1040199a0 tx=0x7ff104019f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfbf73f505b563d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7feff17fa640 1 -- 172.21.15.133:0/2132413454 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff10401aca0 con 0x556d6567c940 2024-02-15T23:29:53.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7feff17fa640 1 -- 172.21.15.133:0/2132413454 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104040030 con 0x556d6567c940 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7feff17fa640 1 -- 172.21.15.133:0/2132413454 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff10404b0d0 con 0x556d6567c940 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- 172.21.15.133:0/2132413454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 msgr2=0x556d6567cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 --2- 172.21.15.133:0/2132413454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d6567cd40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1040199a0 tx=0x7ff104019f90 comp rx=0 tx=0).stop 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- 172.21.15.133:0/2132413454 shutdown_connections 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 --2- 172.21.15.133:0/2132413454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d6567cd40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- 172.21.15.133:0/2132413454 >> 172.21.15.133:0/2132413454 conn(0x556d65674870 msgr2=0x556d656728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- 172.21.15.133:0/2132413454 shutdown_connections 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- 172.21.15.133:0/2132413454 wait complete. 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 Processor -- start 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- start start 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d656838a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff11009e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d65683de0 con 0x556d6567c940 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10d3b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d656838a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10d3b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d656838a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43220/0 (socket says 172.21.15.133:43220) 2024-02-15T23:29:53.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.423+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 learned_addr learned my addr 172.21.15.133:0/1349937935 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6566cc10 con 0x556d6567c940 2024-02-15T23:29:53.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10d3b8640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d656838a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff1040199a0 tx=0x7ff104049970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7fefdf7fe640 1 -- 172.21.15.133:0/1349937935 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff104049e20 con 0x556d6567c940 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d65683fe0 con 0x556d6567c940 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7fefdf7fe640 1 -- 172.21.15.133:0/1349937935 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104033070 con 0x556d6567c940 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7fefdf7fe640 1 -- 172.21.15.133:0/1349937935 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff104048400 con 0x556d6567c940 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d65684410 con 0x556d6567c940 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7fefdf7fe640 1 -- 172.21.15.133:0/1349937935 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff104024a80 con 0x556d6567c940 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7fefdf7fe640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefd80342b0 0x7fefd8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7fefdf7fe640 1 -- 172.21.15.133:0/1349937935 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff10403ac90 con 0x556d6567c940 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefd80342b0 0x7fefd8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d6568ee50 0x556d65691310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65691a60 con 0x556d6568ee50 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10dbb9640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d6568ee50 0x556d65691310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10dbb9640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d6568ee50 0x556d65691310 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefd80342b0 0x7fefd8036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff108011010 tx=0x7ff108020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1000b1040 con 0x556d6568ee50 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 20 realm 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65691e30 con 0x556d6568ee50 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1000b1040 con 0x556d6568ee50 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65692680 con 0x556d6568ee50 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1000b1040 con 0x556d6568ee50 2024-02-15T23:29:53.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656929e0 con 0x556d6568ee50 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.427+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1000b1040 con 0x556d6568ee50 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff11009e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65692320 con 0x556d6568ee50 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff1000b1040 con 0x556d6568ee50 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff11009e980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff11009e980 20 searching for the correct realm 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556d65694c30 0x556d65697080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10d3b8640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556d65694c30 0x556d65697080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10d3b8640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556d65694c30 0x556d65697080 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10d3b8640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff104014240 0x7ff10401a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff104014240 2024-02-15T23:29:53.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff104014240 0x7ff10401a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff104014240 0x7ff10401a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff10800a4d0 con 0x7ff104014240 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10e3ba640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff1080141d0 0x7ff108015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10dbb9640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff1080141d0 0x7ff108015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10dbb9640 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff1080141d0 0x7ff108015940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000b1040 con 0x7ff1080141d0 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.431+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d6568ee50 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff1000b1040 con 0x556d6568ee50 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d6568ee50 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff104014240 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff10800a4d0 con 0x7ff104014240 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d6568ee50 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d6568ee50 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff104014240 2024-02-15T23:29:53.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.435+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d6568ee50 2024-02-15T23:29:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d6568ee50 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff104014240 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d6568ee50 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.439+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff104014240 2024-02-15T23:29:53.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d65694c30 2024-02-15T23:29:53.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff1080141d0 2024-02-15T23:29:53.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x556d6568ee50 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697750 con 0x7ff104014240 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65693850 con 0x556d6568ee50 2024-02-15T23:29:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.443+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656934d0 con 0x556d6568ee50 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656941e0 con 0x556d6568ee50 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 zone default found 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 4 Realm: () 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 zonegroup default 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65697b90 con 0x7ff1080141d0 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65699a10 con 0x556d65694c30 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65699d70 con 0x556d65694c30 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 started sync module instance, tier type = 2024-02-15T23:29:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65698fe0 con 0x7ff104014240 2024-02-15T23:29:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93928341214096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d65698fe0 con 0x7ff104014240 2024-02-15T23:29:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.447+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569a6e0 con 0x556d6568ee50 2024-02-15T23:29:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.451+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93928341214096] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.451+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.451+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93928341212240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569a6e0 con 0x556d6568ee50 2024-02-15T23:29:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.451+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569b050 con 0x556d65694c30 2024-02-15T23:29:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.451+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93928341212240] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.451+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.451+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93928341217856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569a660 con 0x556d65694c30 2024-02-15T23:29:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.451+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569bdb0 con 0x7ff104014240 2024-02-15T23:29:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.455+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.455+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93928341223632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569c600 con 0x7ff104014240 2024-02-15T23:29:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.455+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569d000 con 0x556d6568ee50 2024-02-15T23:29:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.455+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93928341217856] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.455+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93928341223632] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.455+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.455+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93928341228288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569c160 con 0x556d6568ee50 2024-02-15T23:29:53.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.455+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569d850 con 0x7ff1080141d0 2024-02-15T23:29:53.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.459+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93928341228288] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.459+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.459+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93928341222448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569c160 con 0x7ff1080141d0 2024-02-15T23:29:53.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.459+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569dd60 con 0x7ff1080141d0 2024-02-15T23:29:53.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.459+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93928341222448] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.459+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.459+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93928341231680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569dd20 con 0x7ff1080141d0 2024-02-15T23:29:53.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.459+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569e710 con 0x7ff1080141d0 2024-02-15T23:29:53.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93928341231680] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93928341234160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569e6d0 con 0x7ff1080141d0 2024-02-15T23:29:53.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 20 add_watcher() i=0 2024-02-15T23:29:53.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 20 add_watcher() i=1 2024-02-15T23:29:53.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 20 add_watcher() i=2 2024-02-15T23:29:53.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 20 add_watcher() i=3 2024-02-15T23:29:53.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 20 add_watcher() i=4 2024-02-15T23:29:53.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 20 add_watcher() i=5 2024-02-15T23:29:53.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 20 add_watcher() i=6 2024-02-15T23:29:53.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93928341234160] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 20 add_watcher() i=7 2024-02-15T23:29:53.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:53.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.463+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1b50 con 0x556d6568ee50 2024-02-15T23:29:53.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93928341230000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d6569f060 con 0x556d6568ee50 2024-02-15T23:29:53.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93928341230000] v31'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7fefbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:53.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:53.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:53.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 5 note: GC not initialized 2024-02-15T23:29:53.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7fefbe7fc640 20 reqs_thread_entry: start 2024-02-15T23:29:53.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:53.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 20 Filter name: none 2024-02-15T23:29:53.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7fef2ffff640 20 reqs_thread_entry: start 2024-02-15T23:29:53.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656c35c0 con 0x556d6568ee50 2024-02-15T23:29:53.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:53.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656c4970 con 0x7ff104014240 2024-02-15T23:29:53.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656c24f0 con 0x7ff104014240 2024-02-15T23:29:53.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.467+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656c29d0 con 0x556d6568ee50 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 4.4 4:225d0aa6:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656c5f70 con 0x7ff1080141d0 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 4.7 4:e26d1279:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656c8ac0 con 0x7ff1080141d0 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 4.10 4:089e7450:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656cb590 con 0x556d65694c30 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 4.1b 4:d8953915:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656cddb0 con 0x7ff104014240 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 4.26 4:6757ac19:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656d07a0 con 0x7ff1080141d0 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 4.2d 4:b6243017:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656d3560 con 0x7ff1080141d0 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 4.f 4:f19f4e25:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656d5e00 con 0x556d6568ee50 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 4.18 4:184ef1b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656d8620 con 0x7ff104014240 2024-02-15T23:29:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:74 4.5 4:a039e12f:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656db3e0 con 0x556d65694c30 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 4.6 4:636a0651:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656de200 con 0x556d65694c30 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 4.4 4:227d7df5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656e0aa0 con 0x7ff1080141d0 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(69 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(72 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(73 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(67 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(68 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(75 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(74 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(66 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(70 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(76 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 6.1d 6:ba7aa448:::pubsub..bucket.myfoo%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656c2a10 con 0x7ff1080141d0 2024-02-15T23:29:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(77 pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7fefbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.471+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93928341230000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x556d6568ee50 2024-02-15T23:29:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.475+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93928341230000] v31'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.475+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93928341214096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x7ff104014240 2024-02-15T23:29:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.475+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93928341214096] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.475+0000 7ff11009e980 20 remove_watcher() i=0 2024-02-15T23:29:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.475+0000 7ff11009e980 2 removed watcher, disabling cache 2024-02-15T23:29:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.475+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93928341212240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x556d6568ee50 2024-02-15T23:29:53.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93928341212240] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff11009e980 20 remove_watcher() i=1 2024-02-15T23:29:53.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93928341217856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x556d65694c30 2024-02-15T23:29:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff10d3b8640 1 -- 172.21.15.133:0/1349937935 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93928341217856] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff104022070 con 0x556d65694c30 2024-02-15T23:29:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff11009e980 20 remove_watcher() i=2 2024-02-15T23:29:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93928341223632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x7ff104014240 2024-02-15T23:29:53.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff10e3ba640 1 -- 172.21.15.133:0/1349937935 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93928341223632] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff10803a040 con 0x7ff104014240 2024-02-15T23:29:53.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff11009e980 20 remove_watcher() i=3 2024-02-15T23:29:53.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.479+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93928341228288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x556d6568ee50 2024-02-15T23:29:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.483+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93928341228288] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x556d6568ee50 2024-02-15T23:29:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.483+0000 7ff11009e980 20 remove_watcher() i=4 2024-02-15T23:29:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.483+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93928341222448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x7ff1080141d0 2024-02-15T23:29:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.483+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93928341222448] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.483+0000 7ff11009e980 20 remove_watcher() i=5 2024-02-15T23:29:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.483+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93928341231680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x7ff1080141d0 2024-02-15T23:29:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.487+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93928341231680] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.487+0000 7ff11009e980 20 remove_watcher() i=6 2024-02-15T23:29:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.487+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93928341234160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556d656a1910 con 0x7ff1080141d0 2024-02-15T23:29:53.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93928341234160] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000dd040 con 0x7ff1080141d0 2024-02-15T23:29:53.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 20 remove_watcher() i=7 2024-02-15T23:29:53.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff1080141d0 msgr2=0x7ff108015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff1080141d0 0x7ff108015940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d6568ee50 msgr2=0x556d65691310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d6568ee50 0x556d65691310 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff104014240 msgr2=0x7ff10401a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff104014240 0x7ff10401a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556d65694c30 msgr2=0x556d65697080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556d65694c30 0x556d65697080 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefd80342b0 msgr2=0x7fefd8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefd80342b0 0x7fefd8036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff108011010 tx=0x7ff108020000 comp rx=0 tx=0).stop 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 msgr2=0x556d656838a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff10dbb9640 1 -- 172.21.15.133:0/1349937935 reap_dead start 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d656838a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff1040199a0 tx=0x7ff104049970 comp rx=0 tx=0).stop 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 shutdown_connections 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1349937935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6567c940 0x556d656838a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 >> 172.21.15.133:0/1349937935 conn(0x556d65674870 msgr2=0x556d65671ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 shutdown_connections 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1349937935 wait complete. 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/3906888364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefe8034320 msgr2=0x7fefe80367e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/3906888364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefe8034320 0x7fefe80367e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x556d6565ba50 tx=0x7ff108005850 comp rx=0 tx=0).stop 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/3906888364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6566b510 msgr2=0x556d6566b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/3906888364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6566b510 0x556d6566b930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff10400d660 tx=0x7ff10400da60 comp rx=0 tx=0).stop 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/3906888364 shutdown_connections 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/3906888364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fefe8034320 0x7fefe80367e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/3906888364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d6566b510 0x556d6566b930 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/3906888364 >> 172.21.15.133:0/3906888364 conn(0x556d65660320 msgr2=0x556d65660e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/3906888364 shutdown_connections 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/3906888364 wait complete. 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d65564960 msgr2=0x556d6565aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d65564960 0x556d6565aca0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feff40342b0 msgr2=0x7feff4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feff40342b0 0x7feff4036770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff104001dc0 tx=0x7ff104001360 comp rx=0 tx=0).stop 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 msgr2=0x556d65654060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65654060 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff1000b7040 tx=0x7ff100018020 comp rx=0 tx=0).stop 2024-02-15T23:29:53.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 shutdown_connections 2024-02-15T23:29:53.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556d65564960 0x556d6565aca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7feff40342b0 0x7feff4036770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 --2- 172.21.15.133:0/1707105144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d65564040 0x556d65654060 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 >> 172.21.15.133:0/1707105144 conn(0x556d6555f910 msgr2=0x556d65647a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 shutdown_connections 2024-02-15T23:29:53.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.491+0000 7ff11009e980 1 -- 172.21.15.133:0/1707105144 wait complete. 2024-02-15T23:29:53.510 INFO:teuthology.orchestra.run.smithi133.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"deea0f97-f899-4036-a460-801d53f243a7","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","marker":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-15T23:29:52.498920Z","creation_time":"2024-02-15T23:29:52.491594Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2024-02-15T23:29:53.511 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'deea0f97-f899-4036-a460-801d53f243a7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'marker': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-15T23:29:52.498920Z', 'creation_time': '2024-02-15T23:29:52.491594Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2024-02-15T23:29:53.520 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-15T23:29:53.520 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T23:29:53.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T23:29:53.521 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-15T23:29:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:53.591 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:53.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535ac61980 1 Processor -- start 2024-02-15T23:29:53.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535ac61980 1 -- start start 2024-02-15T23:29:53.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535ac61980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55853c802900 0x55853c890df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535ac61980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55853c7da4c0 con 0x55853c891330 2024-02-15T23:29:53.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535ac61980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55853c7a1180 con 0x55853c802900 2024-02-15T23:29:53.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535877c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55853c802900 0x55853c890df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535877c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55853c802900 0x55853c890df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43222/0 (socket says 172.21.15.133:43222) 2024-02-15T23:29:53.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535877c640 1 -- 172.21.15.133:0/1659244230 learned_addr learned my addr 172.21.15.133:0/1659244230 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535877c640 1 -- 172.21.15.133:0/1659244230 >> v1:172.21.15.131:6789/0 conn(0x55853c891330 legacy=0x55853c893720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.583+0000 7f535877c640 1 -- 172.21.15.133:0/1659244230 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55853c895ee0 con 0x55853c802900 2024-02-15T23:29:53.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535877c640 1 --2- 172.21.15.133:0/1659244230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c890df0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f534800a5c0 tx=0x7f534801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748d4a59fde54bd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535777a640 1 -- 172.21.15.133:0/1659244230 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53480aa470 con 0x55853c802900 2024-02-15T23:29:53.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535777a640 1 -- 172.21.15.133:0/1659244230 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480aa5d0 con 0x55853c802900 2024-02-15T23:29:53.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535777a640 1 -- 172.21.15.133:0/1659244230 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53480aa890 con 0x55853c802900 2024-02-15T23:29:53.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535ac61980 1 -- 172.21.15.133:0/1659244230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 msgr2=0x55853c890df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535ac61980 1 --2- 172.21.15.133:0/1659244230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c890df0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f534800a5c0 tx=0x7f534801b340 comp rx=0 tx=0).stop 2024-02-15T23:29:53.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535ac61980 1 -- 172.21.15.133:0/1659244230 shutdown_connections 2024-02-15T23:29:53.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535ac61980 1 --2- 172.21.15.133:0/1659244230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c890df0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535ac61980 1 -- 172.21.15.133:0/1659244230 >> 172.21.15.133:0/1659244230 conn(0x55853c888910 msgr2=0x55853c88ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535ac61980 1 -- 172.21.15.133:0/1659244230 shutdown_connections 2024-02-15T23:29:53.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.587+0000 7f535ac61980 1 -- 172.21.15.133:0/1659244230 wait complete. 2024-02-15T23:29:53.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 Processor -- start 2024-02-15T23:29:53.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 -- start start 2024-02-15T23:29:53.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c9780a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55853c79e6b0 con 0x55853c802900 2024-02-15T23:29:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535877c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c9780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535877c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c9780a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43234/0 (socket says 172.21.15.133:43234) 2024-02-15T23:29:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535877c640 1 -- 172.21.15.133:0/3072888697 learned_addr learned my addr 172.21.15.133:0/3072888697 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535877c640 1 -- 172.21.15.133:0/3072888697 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348005df0 con 0x55853c802900 2024-02-15T23:29:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535877c640 1 --2- 172.21.15.133:0/3072888697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c9780a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f53480ac040 tx=0x7f5348003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35b83e06cf369af server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f524660c640 1 -- 172.21.15.133:0/3072888697 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53480aa9b0 con 0x55853c802900 2024-02-15T23:29:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f524660c640 1 -- 172.21.15.133:0/3072888697 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480aab30 con 0x55853c802900 2024-02-15T23:29:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f524660c640 1 -- 172.21.15.133:0/3072888697 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53480aae10 con 0x55853c802900 2024-02-15T23:29:53.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 -- 172.21.15.133:0/3072888697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 msgr2=0x55853c9780a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 --2- 172.21.15.133:0/3072888697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c9780a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f53480ac040 tx=0x7f5348003030 comp rx=0 tx=0).stop 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 -- 172.21.15.133:0/3072888697 shutdown_connections 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 --2- 172.21.15.133:0/3072888697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c802900 0x55853c9780a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 -- 172.21.15.133:0/3072888697 >> 172.21.15.133:0/3072888697 conn(0x55853c888910 msgr2=0x55853c973c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 -- 172.21.15.133:0/3072888697 shutdown_connections 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.603+0000 7f535ac61980 1 -- 172.21.15.133:0/3072888697 wait complete. 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535ac61980 1 Processor -- start 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535ac61980 1 -- start start 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535ac61980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c891330 0x55853c97eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535ac61980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55853c799e90 con 0x55853c891330 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535877c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c891330 0x55853c97eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535877c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c891330 0x55853c97eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43236/0 (socket says 172.21.15.133:43236) 2024-02-15T23:29:53.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535877c640 1 -- 172.21.15.133:0/976998102 learned_addr learned my addr 172.21.15.133:0/976998102 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535877c640 1 -- 172.21.15.133:0/976998102 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55853c895ee0 con 0x55853c891330 2024-02-15T23:29:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535877c640 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c891330 0x55853c97eff0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5348005940 tx=0x7f53480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f5244e09640 1 -- 172.21.15.133:0/976998102 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53480c6690 con 0x55853c891330 2024-02-15T23:29:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f5244e09640 1 -- 172.21.15.133:0/976998102 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480c67f0 con 0x55853c891330 2024-02-15T23:29:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55853c97f530 con 0x55853c891330 2024-02-15T23:29:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f5244e09640 1 -- 172.21.15.133:0/976998102 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53480c6a90 con 0x55853c891330 2024-02-15T23:29:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55853c97f960 con 0x55853c891330 2024-02-15T23:29:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f5244e09640 1 -- 172.21.15.133:0/976998102 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f53480c6bf0 con 0x55853c891330 2024-02-15T23:29:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f5244e09640 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52400342b0 0x7f5240036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f5244e09640 1 -- 172.21.15.133:0/976998102 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f53480e4530 con 0x55853c891330 2024-02-15T23:29:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f5357f7b640 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52400342b0 0x7f5240036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535ac61980 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c983c70 0x55853c986060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.607+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9865a0 con 0x55853c983c70 2024-02-15T23:29:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5358f7d640 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c983c70 0x55853c986060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5357f7b640 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52400342b0 0x7f5240036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5340001e20 tx=0x7f53400013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5358f7d640 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c983c70 0x55853c986060 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5358f7d640 1 -- 172.21.15.133:0/976998102 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f535000a4d0 con 0x55853c983c70 2024-02-15T23:29:53.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c986940 con 0x55853c983c70 2024-02-15T23:29:53.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5358f7d640 1 -- 172.21.15.133:0/976998102 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f535000a4d0 con 0x55853c983c70 2024-02-15T23:29:53.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9881c0 con 0x55853c983c70 2024-02-15T23:29:53.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5358f7d640 1 -- 172.21.15.133:0/976998102 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f535000a4d0 con 0x55853c983c70 2024-02-15T23:29:53.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9873c0 con 0x55853c983c70 2024-02-15T23:29:53.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5358f7d640 1 -- 172.21.15.133:0/976998102 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f535000a4d0 con 0x55853c983c70 2024-02-15T23:29:53.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9877d0 con 0x55853c983c70 2024-02-15T23:29:53.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5358f7d640 1 -- 172.21.15.133:0/976998102 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f535000a4d0 con 0x55853c983c70 2024-02-15T23:29:53.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f535ac61980 1 Processor -- start 2024-02-15T23:29:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f535ac61980 1 -- start start 2024-02-15T23:29:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f535ac61980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c88e930 0x55853c88cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f535ac61980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55853c732f20 con 0x55853c88e930 2024-02-15T23:29:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5357f7b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c88e930 0x55853c88cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5357f7b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c88e930 0x55853c88cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43250/0 (socket says 172.21.15.133:43250) 2024-02-15T23:29:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5357f7b640 1 -- 172.21.15.133:0/717232465 learned_addr learned my addr 172.21.15.133:0/717232465 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.611+0000 7f5357f7b640 1 -- 172.21.15.133:0/717232465 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55853c88d310 con 0x55853c88e930 2024-02-15T23:29:53.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f5357f7b640 1 --2- 172.21.15.133:0/717232465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c88e930 0x55853c88cdd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5340001780 tx=0x7f534000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f523dffb640 1 -- 172.21.15.133:0/717232465 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f534000e580 con 0x55853c88e930 2024-02-15T23:29:53.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f523dffb640 1 -- 172.21.15.133:0/717232465 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000e6e0 con 0x55853c88e930 2024-02-15T23:29:53.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f523dffb640 1 -- 172.21.15.133:0/717232465 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f534000e980 con 0x55853c88e930 2024-02-15T23:29:53.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f535ac61980 1 -- 172.21.15.133:0/717232465 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55853c88d5c0 con 0x55853c88e930 2024-02-15T23:29:53.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f535ac61980 1 -- 172.21.15.133:0/717232465 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55853c88da50 con 0x55853c88e930 2024-02-15T23:29:53.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f523dffb640 1 -- 172.21.15.133:0/717232465 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f534000eae0 con 0x55853c88e930 2024-02-15T23:29:53.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f523dffb640 1 --2- 172.21.15.133:0/717232465 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5230034350 0x7f5230036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f523dffb640 1 -- 172.21.15.133:0/717232465 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f5340018040 con 0x55853c88e930 2024-02-15T23:29:53.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f5358f7d640 1 --2- 172.21.15.133:0/717232465 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5230034350 0x7f5230036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f535ac61980 1 Processor -- start 2024-02-15T23:29:53.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f535ac61980 1 -- start start 2024-02-15T23:29:53.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f5358f7d640 1 --2- 172.21.15.133:0/717232465 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5230034350 0x7f5230036810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55853c986e00 tx=0x7f5350005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f535ac61980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f535ac61980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55853c726790 con 0x55853c9a5cb0 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f5357f7b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f5357f7b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9a6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43262/0 (socket says 172.21.15.133:43262) 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f5357f7b640 1 -- 172.21.15.133:0/106209329 learned_addr learned my addr 172.21.15.133:0/106209329 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.615+0000 7f5357f7b640 1 -- 172.21.15.133:0/106209329 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55853c9a6660 con 0x55853c9a5cb0 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f5357f7b640 1 --2- 172.21.15.133:0/106209329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9a6090 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5340001150 tx=0x7f534001aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a132c7d1950da3e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f522f7fe640 1 -- 172.21.15.133:0/106209329 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f534004b0d0 con 0x55853c9a5cb0 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f522f7fe640 1 -- 172.21.15.133:0/106209329 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340040030 con 0x55853c9a5cb0 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f522f7fe640 1 -- 172.21.15.133:0/106209329 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5340023d90 con 0x55853c9a5cb0 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- 172.21.15.133:0/106209329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 msgr2=0x55853c9a6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 --2- 172.21.15.133:0/106209329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9a6090 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5340001150 tx=0x7f534001aa60 comp rx=0 tx=0).stop 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- 172.21.15.133:0/106209329 shutdown_connections 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 --2- 172.21.15.133:0/106209329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9a6090 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- 172.21.15.133:0/106209329 >> 172.21.15.133:0/106209329 conn(0x55853c9a1ff0 msgr2=0x55853c9a0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- 172.21.15.133:0/106209329 shutdown_connections 2024-02-15T23:29:53.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- 172.21.15.133:0/106209329 wait complete. 2024-02-15T23:29:53.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 Processor -- start 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- start start 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55853c9ad0a0 con 0x55853c9a5cb0 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f5357f7b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f5357f7b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43278/0 (socket says 172.21.15.133:43278) 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 learned_addr learned my addr 172.21.15.133:0/3705550374 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55853c88da50 con 0x55853c9a5cb0 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f5357f7b640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9acb60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f534000efd0 tx=0x7f53400495b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f522dffb640 1 -- 172.21.15.133:0/3705550374 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f534001ca10 con 0x55853c9a5cb0 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55853c9ad2a0 con 0x55853c9a5cb0 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f522dffb640 1 -- 172.21.15.133:0/3705550374 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534001c410 con 0x55853c9a5cb0 2024-02-15T23:29:53.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55853c9ad2a0 con 0x55853c9a5cb0 2024-02-15T23:29:53.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.619+0000 7f522dffb640 1 -- 172.21.15.133:0/3705550374 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f534001a310 con 0x55853c9a5cb0 2024-02-15T23:29:53.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f522dffb640 1 -- 172.21.15.133:0/3705550374 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5340024c60 con 0x55853c9a5cb0 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f522dffb640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52200342b0 0x7f5220036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f522dffb640 1 -- 172.21.15.133:0/3705550374 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f53400529c0 con 0x55853c9a5cb0 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f5358f7d640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52200342b0 0x7f5220036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c9b7d80 0x55853c9ba220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9ba970 con 0x55853c9b7d80 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535877c640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c9b7d80 0x55853c9ba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f5358f7d640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52200342b0 0x7f5220036770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5350011010 tx=0x7f5350020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535877c640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c9b7d80 0x55853c9ba220 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 realm 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9bad90 con 0x55853c9b7d80 2024-02-15T23:29:53.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9bb5e0 con 0x55853c9b7d80 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9bb940 con 0x55853c9b7d80 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9bb280 con 0x55853c9b7d80 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 20 searching for the correct realm 2024-02-15T23:29:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55853c9bdb90 0x55853c9bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f5357f7b640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55853c9bdb90 0x55853c9bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.623+0000 7f5357f7b640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55853c9bdb90 0x55853c9bff80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f5357f7b640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f534001c030 0x7f53400435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f534001c030 2024-02-15T23:29:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f5358f7d640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f534001c030 0x7f53400435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f5358f7d640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f534001c030 0x7f53400435b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f535000a4d0 con 0x7f534001c030 2024-02-15T23:29:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f5358f7d640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f53500141d0 0x7f5350015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f535877c640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f53500141d0 0x7f5350015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f535877c640 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f53500141d0 0x7f5350015940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x7f53500141d0 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9b7d80 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9b7d80 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.627+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x7f53500141d0 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x7f53500141d0 2024-02-15T23:29:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f534001c030 2024-02-15T23:29:53.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f535000a4d0 con 0x7f534001c030 2024-02-15T23:29:53.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9b7d80 2024-02-15T23:29:53.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x7f53500141d0 2024-02-15T23:29:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9b7d80 2024-02-15T23:29:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f534001c030 2024-02-15T23:29:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.631+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x7f53500141d0 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9b7d80 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9b7d80 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x7f53500141d0 2024-02-15T23:29:53.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f534001c030 2024-02-15T23:29:53.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9b7d80 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480b0020 con 0x55853c9b7d80 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.635+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f534001c030 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9bdb90 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f53500141d0 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x55853c9b7d80 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c0650 con 0x7f534001c030 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9bc810 con 0x55853c9b7d80 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9bc490 con 0x55853c9b7d80 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9bd0e0 con 0x55853c9b7d80 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 zone default found 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 4 Realm: () 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 zonegroup default 2024-02-15T23:29:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.639+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9bd0e0 con 0x7f53500141d0 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c24c0 con 0x55853c9bdb90 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c2820 con 0x55853c9bdb90 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 20 started sync module instance, tier type = 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:53.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c1da0 con 0x7f534001c030 2024-02-15T23:29:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94030735874304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c2150 con 0x7f534001c030 2024-02-15T23:29:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c3530 con 0x55853c9b7d80 2024-02-15T23:29:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.643+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94030735874304] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94030735879152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c3530 con 0x55853c9b7d80 2024-02-15T23:29:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c4000 con 0x55853c9bdb90 2024-02-15T23:29:53.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94030735882976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c4850 con 0x55853c9bdb90 2024-02-15T23:29:53.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c5200 con 0x7f534001c030 2024-02-15T23:29:53.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94030735879152] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94030735880208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c55b0 con 0x7f534001c030 2024-02-15T23:29:53.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.647+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c5f20 con 0x55853c9b7d80 2024-02-15T23:29:53.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.651+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94030735882976] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.651+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94030735880208] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.651+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.651+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94030735887648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c5a80 con 0x55853c9b7d80 2024-02-15T23:29:53.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.651+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c6770 con 0x7f53500141d0 2024-02-15T23:29:53.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.651+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94030735887648] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.651+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.651+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94030735885232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c64d0 con 0x7f53500141d0 2024-02-15T23:29:53.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.655+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c6cd0 con 0x7f53500141d0 2024-02-15T23:29:53.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.655+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.655+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94030735894224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c7150 con 0x7f53500141d0 2024-02-15T23:29:53.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.655+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c7c20 con 0x7f53500141d0 2024-02-15T23:29:53.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.655+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94030735885232] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94030735894224] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94030735898368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c6bb0 con 0x7f53500141d0 2024-02-15T23:29:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 20 add_watcher() i=0 2024-02-15T23:29:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 20 add_watcher() i=1 2024-02-15T23:29:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 20 add_watcher() i=2 2024-02-15T23:29:53.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 20 add_watcher() i=3 2024-02-15T23:29:53.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 20 add_watcher() i=4 2024-02-15T23:29:53.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 20 add_watcher() i=5 2024-02-15T23:29:53.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 20 add_watcher() i=6 2024-02-15T23:29:53.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94030735898368] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 20 add_watcher() i=7 2024-02-15T23:29:53.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:53.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9cac10 con 0x55853c9b7d80 2024-02-15T23:29:53.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.659+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94030735892528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9c8080 con 0x55853c9b7d80 2024-02-15T23:29:53.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94030735892528] v31'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f520e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:53.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:53.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 5 note: GC not initialized 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f520d7e2640 20 reqs_thread_entry: start 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 Filter name: none 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f517effd640 20 reqs_thread_entry: start 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9eca30 con 0x7f534001c030 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9ed270 con 0x55853c9b7d80 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(63 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9ec0b0 con 0x7f534001c030 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9ee5c0 con 0x55853c9b7d80 2024-02-15T23:29:53.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 4.4 4:225d0aa6:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9ed4b0 con 0x7f53500141d0 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 4.7 4:e26d1279:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9f30e0 con 0x7f53500141d0 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 4.10 4:089e7450:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9ed4b0 con 0x55853c9bdb90 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 4.1b 4:d8953915:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9f7ec0 con 0x7f534001c030 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 4.26 4:6757ac19:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9fac90 con 0x7f53500141d0 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 4.2d 4:b6243017:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9fda60 con 0x7f53500141d0 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 4.f 4:f19f4e25:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853ca00440 con 0x55853c9b7d80 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 4.18 4:184ef1b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853ca02ce0 con 0x7f534001c030 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:74 4.5 4:a039e12f:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853ca05700 con 0x55853c9bdb90 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(68 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 4.6 4:636a0651:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853ca02ce0 con 0x55853c9bdb90 2024-02-15T23:29:53.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(72 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 4.4 4:227d7df5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9fe2a0 con 0x7f53500141d0 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(66 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.663+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(74 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(73 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(69 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(67 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(70 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(71 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(75 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(76 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535ac61980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 6.1d 6:ba7aa448:::pubsub..bucket.myfoo%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9fe080 con 0x7f53500141d0 2024-02-15T23:29:53.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(77 pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535ac61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f520e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:53.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94030735892528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de7c0 con 0x55853c9b7d80 2024-02-15T23:29:53.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94030735892528] v31'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.667+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94030735874304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de7c0 con 0x7f534001c030 2024-02-15T23:29:53.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.671+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94030735874304] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.671+0000 7f535ac61980 20 remove_watcher() i=0 2024-02-15T23:29:53.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.671+0000 7f535ac61980 2 removed watcher, disabling cache 2024-02-15T23:29:53.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.671+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94030735879152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de7c0 con 0x55853c9b7d80 2024-02-15T23:29:53.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.671+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94030735879152] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.671+0000 7f535ac61980 20 remove_watcher() i=1 2024-02-15T23:29:53.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.671+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94030735882976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de7c0 con 0x55853c9bdb90 2024-02-15T23:29:53.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.675+0000 7f5357f7b640 1 -- 172.21.15.133:0/3705550374 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94030735882976] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5340043cc0 con 0x55853c9bdb90 2024-02-15T23:29:53.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.675+0000 7f535ac61980 20 remove_watcher() i=2 2024-02-15T23:29:53.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.675+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94030735880208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de7c0 con 0x7f534001c030 2024-02-15T23:29:53.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.675+0000 7f5358f7d640 1 -- 172.21.15.133:0/3705550374 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94030735880208] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f535003a040 con 0x7f534001c030 2024-02-15T23:29:53.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.675+0000 7f535ac61980 20 remove_watcher() i=3 2024-02-15T23:29:53.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.675+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94030735887648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de770 con 0x55853c9b7d80 2024-02-15T23:29:53.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.679+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94030735887648] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x55853c9b7d80 2024-02-15T23:29:53.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.679+0000 7f535ac61980 20 remove_watcher() i=4 2024-02-15T23:29:53.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.679+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94030735885232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de770 con 0x7f53500141d0 2024-02-15T23:29:53.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.679+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94030735885232] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.679+0000 7f535ac61980 20 remove_watcher() i=5 2024-02-15T23:29:53.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.679+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94030735894224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de770 con 0x7f53500141d0 2024-02-15T23:29:53.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94030735894224] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 20 remove_watcher() i=6 2024-02-15T23:29:53.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94030735898368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55853c9de770 con 0x7f53500141d0 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94030735898368] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53480f7040 con 0x7f53500141d0 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 20 remove_watcher() i=7 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f53500141d0 msgr2=0x7f5350015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f53500141d0 0x7f5350015940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c9b7d80 msgr2=0x55853c9ba220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c9b7d80 0x55853c9ba220 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f534001c030 msgr2=0x7f53400435b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f534001c030 0x7f53400435b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55853c9bdb90 msgr2=0x55853c9bff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55853c9bdb90 0x55853c9bff80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52200342b0 msgr2=0x7f5220036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52200342b0 0x7f5220036770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5350011010 tx=0x7f5350020000 comp rx=0 tx=0).stop 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 msgr2=0x55853c9acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535877c640 1 -- 172.21.15.133:0/3705550374 reap_dead start 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9acb60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f534000efd0 tx=0x7f53400495b0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 shutdown_connections 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/3705550374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c9a5cb0 0x55853c9acb60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 >> 172.21.15.133:0/3705550374 conn(0x55853c9a1ff0 msgr2=0x55853c99f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 shutdown_connections 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/3705550374 wait complete. 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/717232465 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5230034350 msgr2=0x7f5230036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/717232465 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5230034350 0x7f5230036810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55853c986e00 tx=0x7f5350005850 comp rx=0 tx=0).stop 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/717232465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c88e930 msgr2=0x55853c88cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/717232465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c88e930 0x55853c88cdd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5340001780 tx=0x7f534000f7a0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/717232465 shutdown_connections 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/717232465 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5230034350 0x7f5230036810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/717232465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c88e930 0x55853c88cdd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/717232465 >> 172.21.15.133:0/717232465 conn(0x55853c98b6d0 msgr2=0x55853c98c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/717232465 shutdown_connections 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/717232465 wait complete. 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c983c70 msgr2=0x55853c986060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c983c70 0x55853c986060 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52400342b0 msgr2=0x7f5240036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52400342b0 0x7f5240036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5340001e20 tx=0x7f53400013a0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c891330 msgr2=0x55853c97eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c891330 0x55853c97eff0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5348005940 tx=0x7f53480180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 shutdown_connections 2024-02-15T23:29:53.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55853c983c70 0x55853c986060 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f52400342b0 0x7f5240036770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 --2- 172.21.15.133:0/976998102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55853c891330 0x55853c97eff0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 >> 172.21.15.133:0/976998102 conn(0x55853c888910 msgr2=0x55853c972740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 shutdown_connections 2024-02-15T23:29:53.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.683+0000 7f535ac61980 1 -- 172.21.15.133:0/976998102 wait complete. 2024-02-15T23:29:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"deea0f97-f899-4036-a460-801d53f243a7","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","marker":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-15T23:29:52.498920Z","creation_time":"2024-02-15T23:29:52.491594Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-15T23:29:53.704 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'deea0f97-f899-4036-a460-801d53f243a7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'marker': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-15T23:29:52.498920Z', 'creation_time': '2024-02-15T23:29:52.491594Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-15T23:29:53.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-15T23:29:53.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-15T23:29:53.705 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-02-15T23:29:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:53.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f408064e980 1 Processor -- start 2024-02-15T23:29:53.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f408064e980 1 -- start start 2024-02-15T23:29:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f408064e980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x560dc47a9360 0x560dc47a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f408064e980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560dc46f34d0 con 0x560dc47a9c80 2024-02-15T23:29:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f408064e980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x560dc46ba180 con 0x560dc47a9360 2024-02-15T23:29:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f407e169640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x560dc47a9360 0x560dc47a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f407d968640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x560dc47a9c80 0x560dc47aa630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39944/0 (socket says 172.21.15.133:39944) 2024-02-15T23:29:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f407d968640 1 -- 172.21.15.133:0/63373493 learned_addr learned my addr 172.21.15.133:0/63373493 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f407e169640 1 -- 172.21.15.133:0/63373493 >> v1:172.21.15.131:6789/0 conn(0x560dc47a9c80 legacy=0x560dc47aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.771+0000 7f407e169640 1 -- 172.21.15.133:0/63373493 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dc47aae60 con 0x560dc47a9360 2024-02-15T23:29:53.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f407e169640 1 --2- 172.21.15.133:0/63373493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc47a9740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f407000a480 tx=0x7f407001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5b81c145da47a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f407d167640 1 -- 172.21.15.133:0/63373493 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40700ab540 con 0x560dc47a9360 2024-02-15T23:29:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f407d167640 1 -- 172.21.15.133:0/63373493 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40700ab6a0 con 0x560dc47a9360 2024-02-15T23:29:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f407d167640 1 -- 172.21.15.133:0/63373493 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40700ab960 con 0x560dc47a9360 2024-02-15T23:29:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f408064e980 1 -- 172.21.15.133:0/63373493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 msgr2=0x560dc47a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f408064e980 1 --2- 172.21.15.133:0/63373493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc47a9740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f407000a480 tx=0x7f407001b280 comp rx=0 tx=0).stop 2024-02-15T23:29:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f408064e980 1 -- 172.21.15.133:0/63373493 shutdown_connections 2024-02-15T23:29:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f408064e980 1 --2- 172.21.15.133:0/63373493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc47a9740 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f408064e980 1 -- 172.21.15.133:0/63373493 >> 172.21.15.133:0/63373493 conn(0x560dc471ca50 msgr2=0x560dc471ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f408064e980 1 -- 172.21.15.133:0/63373493 shutdown_connections 2024-02-15T23:29:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.775+0000 7f408064e980 1 -- 172.21.15.133:0/63373493 wait complete. 2024-02-15T23:29:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f408064e980 1 Processor -- start 2024-02-15T23:29:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f408064e980 1 -- start start 2024-02-15T23:29:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f408064e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc48938a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f408064e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc46b76b0 con 0x560dc47a9360 2024-02-15T23:29:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f407e169640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc48938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f407e169640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc48938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43298/0 (socket says 172.21.15.133:43298) 2024-02-15T23:29:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f407e169640 1 -- 172.21.15.133:0/3857829354 learned_addr learned my addr 172.21.15.133:0/3857829354 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f407e169640 1 -- 172.21.15.133:0/3857829354 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4070005d30 con 0x560dc47a9360 2024-02-15T23:29:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f407e169640 1 --2- 172.21.15.133:0/3857829354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc48938a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4070018eb0 tx=0x7f4070003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d509114d38860da server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.791+0000 7f3f6c608640 1 -- 172.21.15.133:0/3857829354 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40700ab810 con 0x560dc47a9360 2024-02-15T23:29:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f3f6c608640 1 -- 172.21.15.133:0/3857829354 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40700ab970 con 0x560dc47a9360 2024-02-15T23:29:53.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f3f6c608640 1 -- 172.21.15.133:0/3857829354 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40700abc30 con 0x560dc47a9360 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- 172.21.15.133:0/3857829354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 msgr2=0x560dc48938a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 --2- 172.21.15.133:0/3857829354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc48938a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4070018eb0 tx=0x7f4070003030 comp rx=0 tx=0).stop 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- 172.21.15.133:0/3857829354 shutdown_connections 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 --2- 172.21.15.133:0/3857829354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc48938a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- 172.21.15.133:0/3857829354 >> 172.21.15.133:0/3857829354 conn(0x560dc471ca50 msgr2=0x560dc488f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- 172.21.15.133:0/3857829354 shutdown_connections 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- 172.21.15.133:0/3857829354 wait complete. 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 Processor -- start 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- start start 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc489a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc46b2e90 con 0x560dc47a9360 2024-02-15T23:29:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f407e169640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc489a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f407e169640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc489a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43306/0 (socket says 172.21.15.133:43306) 2024-02-15T23:29:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f407e169640 1 -- 172.21.15.133:0/3202792025 learned_addr learned my addr 172.21.15.133:0/3202792025 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f407e169640 1 -- 172.21.15.133:0/3202792025 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dc47aae60 con 0x560dc47a9360 2024-02-15T23:29:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f407e169640 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc489a550 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f407001b2c0 tx=0x7f4070018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f3f6ae05640 1 -- 172.21.15.133:0/3202792025 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40700c3070 con 0x560dc47a9360 2024-02-15T23:29:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f3f6ae05640 1 -- 172.21.15.133:0/3202792025 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40700beaa0 con 0x560dc47a9360 2024-02-15T23:29:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560dc489aa90 con 0x560dc47a9360 2024-02-15T23:29:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f3f6ae05640 1 -- 172.21.15.133:0/3202792025 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40700bed40 con 0x560dc47a9360 2024-02-15T23:29:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.795+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560dc489aec0 con 0x560dc47a9360 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f3f6ae05640 1 -- 172.21.15.133:0/3202792025 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f40700b2070 con 0x560dc47a9360 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f3f6ae05640 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f640342b0 0x7f3f64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f3f6ae05640 1 -- 172.21.15.133:0/3202792025 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f40700e3950 con 0x560dc47a9360 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407d968640 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f640342b0 0x7f3f64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f408064e980 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc47a9c80 0x560dc48a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48a16d0 con 0x560dc47a9c80 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407e96a640 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc47a9c80 0x560dc48a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407d968640 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f640342b0 0x7f3f64036770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4074000f70 tx=0x7f40740012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407e96a640 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc47a9c80 0x560dc48a1190 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407e96a640 1 -- 172.21.15.133:0/3202792025 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f407800a4d0 con 0x560dc47a9c80 2024-02-15T23:29:53.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48a1a30 con 0x560dc47a9c80 2024-02-15T23:29:53.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407e96a640 1 -- 172.21.15.133:0/3202792025 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f407800a4d0 con 0x560dc47a9c80 2024-02-15T23:29:53.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48a32b0 con 0x560dc47a9c80 2024-02-15T23:29:53.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407e96a640 1 -- 172.21.15.133:0/3202792025 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f407800a4d0 con 0x560dc47a9c80 2024-02-15T23:29:53.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48a24b0 con 0x560dc47a9c80 2024-02-15T23:29:53.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407e96a640 1 -- 172.21.15.133:0/3202792025 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f407800a4d0 con 0x560dc47a9c80 2024-02-15T23:29:53.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48a28c0 con 0x560dc47a9c80 2024-02-15T23:29:53.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f407e96a640 1 -- 172.21.15.133:0/3202792025 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f407800a4d0 con 0x560dc47a9c80 2024-02-15T23:29:53.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f408064e980 1 Processor -- start 2024-02-15T23:29:53.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.799+0000 7f408064e980 1 -- start start 2024-02-15T23:29:53.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f408064e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48b19b0 0x560dc48b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f408064e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc464bf20 con 0x560dc48b19b0 2024-02-15T23:29:53.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f407d968640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48b19b0 0x560dc48b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f407d968640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48b19b0 0x560dc48b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43318/0 (socket says 172.21.15.133:43318) 2024-02-15T23:29:53.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f407d968640 1 -- 172.21.15.133:0/1946788521 learned_addr learned my addr 172.21.15.133:0/1946788521 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f407d968640 1 -- 172.21.15.133:0/1946788521 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dc48b2310 con 0x560dc48b19b0 2024-02-15T23:29:53.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f407d968640 1 --2- 172.21.15.133:0/1946788521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48b19b0 0x560dc48b1dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4074001ee0 tx=0x7f407400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f3f63fff640 1 -- 172.21.15.133:0/1946788521 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4074020070 con 0x560dc48b19b0 2024-02-15T23:29:53.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f408064e980 1 -- 172.21.15.133:0/1946788521 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560dc48b2560 con 0x560dc48b19b0 2024-02-15T23:29:53.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f3f63fff640 1 -- 172.21.15.133:0/1946788521 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407400c770 con 0x560dc48b19b0 2024-02-15T23:29:53.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f3f63fff640 1 -- 172.21.15.133:0/1946788521 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4074013040 con 0x560dc48b19b0 2024-02-15T23:29:53.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f408064e980 1 -- 172.21.15.133:0/1946788521 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560dc48b30b0 con 0x560dc48b19b0 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f3f63fff640 1 -- 172.21.15.133:0/1946788521 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f407400a040 con 0x560dc48b19b0 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f3f63fff640 1 --2- 172.21.15.133:0/1946788521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f580342b0 0x7f3f58036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f3f63fff640 1 -- 172.21.15.133:0/1946788521 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f407404b6b0 con 0x560dc48b19b0 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f407e96a640 1 --2- 172.21.15.133:0/1946788521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f580342b0 0x7f3f58036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f408064e980 1 Processor -- start 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f408064e980 1 -- start start 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f407e96a640 1 --2- 172.21.15.133:0/1946788521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f580342b0 0x7f3f58036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x560dc48a1ef0 tx=0x7f4078005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f408064e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48bed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.803+0000 7f408064e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc463f790 con 0x560dc48be930 2024-02-15T23:29:53.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48bed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43320/0 (socket says 172.21.15.133:43320) 2024-02-15T23:29:53.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 -- 172.21.15.133:0/2347969097 learned_addr learned my addr 172.21.15.133:0/2347969097 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 -- 172.21.15.133:0/2347969097 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dc48bf320 con 0x560dc48be930 2024-02-15T23:29:53.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 --2- 172.21.15.133:0/2347969097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48bed50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4074049aa0 tx=0x7f40740198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505e0944d9ee55fb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f3f61ffb640 1 -- 172.21.15.133:0/2347969097 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4074048070 con 0x560dc48be930 2024-02-15T23:29:53.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f3f61ffb640 1 -- 172.21.15.133:0/2347969097 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407403a2b0 con 0x560dc48be930 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f3f61ffb640 1 -- 172.21.15.133:0/2347969097 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407403a440 con 0x560dc48be930 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 -- 172.21.15.133:0/2347969097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 msgr2=0x560dc48bed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 --2- 172.21.15.133:0/2347969097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48bed50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4074049aa0 tx=0x7f40740198d0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 -- 172.21.15.133:0/2347969097 shutdown_connections 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 --2- 172.21.15.133:0/2347969097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48bed50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 -- 172.21.15.133:0/2347969097 >> 172.21.15.133:0/2347969097 conn(0x560dc48bacc0 msgr2=0x560dc48b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 -- 172.21.15.133:0/2347969097 shutdown_connections 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 -- 172.21.15.133:0/2347969097 wait complete. 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 Processor -- start 2024-02-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 -- start start 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f408064e980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc48c5d60 con 0x560dc48be930 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43336/0 (socket says 172.21.15.133:43336) 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 learned_addr learned my addr 172.21.15.133:0/1617976401 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.807+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dc48b30b0 con 0x560dc48be930 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407d968640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48c5820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f407403f040 tx=0x7f4074049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f3f4ffff640 1 -- 172.21.15.133:0/1617976401 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407403bbe0 con 0x560dc48be930 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f3f4ffff640 1 -- 172.21.15.133:0/1617976401 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407403bd40 con 0x560dc48be930 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560dc48c5f60 con 0x560dc48be930 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f3f4ffff640 1 -- 172.21.15.133:0/1617976401 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4074048070 con 0x560dc48be930 2024-02-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560dc48c63f0 con 0x560dc48be930 2024-02-15T23:29:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f3f4ffff640 1 -- 172.21.15.133:0/1617976401 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f407404ba10 con 0x560dc48be930 2024-02-15T23:29:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f3f4ffff640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f48034300 0x7f3f480367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f3f4ffff640 1 -- 172.21.15.133:0/1617976401 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4074039c60 con 0x560dc48be930 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407e96a640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f48034300 0x7f3f480367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc48d0e00 0x560dc48d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d39f0 con 0x560dc48d0e00 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407e169640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc48d0e00 0x560dc48d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407e96a640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f48034300 0x7f3f480367c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4078011010 tx=0x7f4078020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407e169640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc48d0e00 0x560dc48d32a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 realm 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d3dc0 con 0x560dc48d0e00 2024-02-15T23:29:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d4610 con 0x560dc48d0e00 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d4970 con 0x560dc48d0e00 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.811+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d42b0 con 0x560dc48d0e00 2024-02-15T23:29:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f408064e980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f408064e980 20 searching for the correct realm 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560dc48d6bc0 0x560dc48d8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407d968640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560dc48d6bc0 0x560dc48d8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407d968640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560dc48d6bc0 0x560dc48d8ff0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407d968640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4074038020 0x7f407402e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f4074038020 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e96a640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4074038020 0x7f407402e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e96a640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4074038020 0x7f407402e810 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407800a4d0 con 0x7f4074038020 2024-02-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e96a640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f40780141d0 0x7f4078015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e169640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f40780141d0 0x7f4078015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e169640 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f40780141d0 0x7f4078015940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d0e00 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.815+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d0e00 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f4074038020 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407800a4d0 con 0x7f4074038020 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d0e00 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d0e00 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f4074038020 2024-02-15T23:29:53.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.819+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d0e00 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d0e00 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f4074038020 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d0e00 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x560dc48d0e00 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.823+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f4074038020 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d6bc0 2024-02-15T23:29:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f40780141d0 2024-02-15T23:29:53.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40700aabd0 con 0x7f40780141d0 2024-02-15T23:29:53.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x560dc48d0e00 2024-02-15T23:29:53.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d96c0 con 0x7f4074038020 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d5810 con 0x560dc48d0e00 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d5490 con 0x560dc48d0e00 2024-02-15T23:29:53.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.827+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d61a0 con 0x560dc48d0e00 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 zone default found 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 4 Realm: () 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 zonegroup default 2024-02-15T23:29:53.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48d9b00 con 0x7f40780141d0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48db890 con 0x560dc48d6bc0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dbbf0 con 0x560dc48d6bc0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 started sync module instance, tier type = 2024-02-15T23:29:53.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:53.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48db170 con 0x7f4074038020 2024-02-15T23:29:53.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94617132182736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48db520 con 0x7f4074038020 2024-02-15T23:29:53.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.831+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dc8e0 con 0x560dc48d0e00 2024-02-15T23:29:53.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.835+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94617132182736] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.835+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.835+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94617132187552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dc860 con 0x560dc48d0e00 2024-02-15T23:29:53.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.835+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dd310 con 0x560dc48d6bc0 2024-02-15T23:29:53.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.835+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.835+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94617132191248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48ddb60 con 0x560dc48d6bc0 2024-02-15T23:29:53.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.835+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48de510 con 0x7f4074038020 2024-02-15T23:29:53.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.835+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94617132187552] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94617132188608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48de8f0 con 0x7f4074038020 2024-02-15T23:29:53.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48df260 con 0x560dc48d0e00 2024-02-15T23:29:53.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94617132191248] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94617132188608] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94617132195888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dedc0 con 0x560dc48d0e00 2024-02-15T23:29:53.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dfab0 con 0x7f40780141d0 2024-02-15T23:29:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.839+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94617132195888] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.843+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.843+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94617132193472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48df7e0 con 0x7f40780141d0 2024-02-15T23:29:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.843+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dffe0 con 0x7f40780141d0 2024-02-15T23:29:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.843+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.843+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94617132202432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48e0420 con 0x7f40780141d0 2024-02-15T23:29:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.843+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48e0ef0 con 0x7f40780141d0 2024-02-15T23:29:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.843+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94617132193472] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.843+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94617132202432] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94617132206544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dfe80 con 0x7f40780141d0 2024-02-15T23:29:53.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 20 add_watcher() i=0 2024-02-15T23:29:53.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 20 add_watcher() i=1 2024-02-15T23:29:53.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 20 add_watcher() i=2 2024-02-15T23:29:53.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 20 add_watcher() i=3 2024-02-15T23:29:53.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 20 add_watcher() i=4 2024-02-15T23:29:53.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 20 add_watcher() i=5 2024-02-15T23:29:53.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 20 add_watcher() i=6 2024-02-15T23:29:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94617132206544] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 20 add_watcher() i=7 2024-02-15T23:29:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48e3ee0 con 0x560dc48d0e00 2024-02-15T23:29:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94617132200768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48e1350 con 0x560dc48d0e00 2024-02-15T23:29:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.847+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94617132200768] v31'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f3f34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 5 note: GC not initialized 2024-02-15T23:29:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f3eaf7fe640 20 reqs_thread_entry: start 2024-02-15T23:29:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 Filter name: none 2024-02-15T23:29:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f3ead7fa640 20 reqs_thread_entry: start 2024-02-15T23:29:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc4905860 con 0x560dc48d0e00 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc4906c10 con 0x7f4074038020 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc4904c20 con 0x560dc48d0e00 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T23:29:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:65 4.4 4:225d0aa6:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc49080c0 con 0x7f40780141d0 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 4.7 4:e26d1279:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc490ab70 con 0x7f40780141d0 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 4.10 4:089e7450:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc490ab70 con 0x560dc48d6bc0 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 4.1b 4:d8953915:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc490fd00 con 0x7f4074038020 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 4.26 4:6757ac19:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc4912970 con 0x7f40780141d0 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 4.2d 4:b6243017:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc4915660 con 0x7f40780141d0 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 4.f 4:f19f4e25:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc4917e80 con 0x560dc48d0e00 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 4.18 4:184ef1b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc491a6a0 con 0x7f4074038020 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 4.5 4:a039e12f:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc491d0e0 con 0x560dc48d6bc0 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:74 4.6 4:636a0651:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc491fae0 con 0x560dc48d6bc0 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 4.4 4:227d7df5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc4922380 con 0x7f40780141d0 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(71 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(72 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(68 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(73 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(66 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(74 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(65 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(69 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(70 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(75 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.851+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc490a550 con 0x7f4074038020 2024-02-15T23:29:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.855+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(76 foo.buckets [call] v31'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.855+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc490a550 con 0x7f4074038020 2024-02-15T23:29:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.855+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(77 foo.buckets [call] v31'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.855+0000 7f408064e980 20 rados->read ofs=0 len=0 2024-02-15T23:29:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.855+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc490a550 con 0x560dc48d0e00 2024-02-15T23:29:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.855+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(78 foo [stat out=16b,read 0~358 out=358b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+374 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.855+0000 7f408064e980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.855+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc490a550 con 0x7f4074038020 2024-02-15T23:29:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f3f34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94617132200768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48f7aa0 con 0x560dc48d0e00 2024-02-15T23:29:53.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94617132200768] v31'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94617132182736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48f7aa0 con 0x7f4074038020 2024-02-15T23:29:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94617132182736] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f408064e980 20 remove_watcher() i=0 2024-02-15T23:29:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f408064e980 2 removed watcher, disabling cache 2024-02-15T23:29:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.859+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94617132187552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dacd0 con 0x560dc48d0e00 2024-02-15T23:29:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.863+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94617132187552] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.863+0000 7f408064e980 20 remove_watcher() i=1 2024-02-15T23:29:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.863+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94617132191248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48f7aa0 con 0x560dc48d6bc0 2024-02-15T23:29:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.863+0000 7f407d968640 1 -- 172.21.15.133:0/1617976401 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94617132191248] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4074035070 con 0x560dc48d6bc0 2024-02-15T23:29:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.863+0000 7f408064e980 20 remove_watcher() i=2 2024-02-15T23:29:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.863+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94617132188608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dbfa0 con 0x7f4074038020 2024-02-15T23:29:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.867+0000 7f407e96a640 1 -- 172.21.15.133:0/1617976401 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94617132188608] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f407803a040 con 0x7f4074038020 2024-02-15T23:29:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.867+0000 7f408064e980 20 remove_watcher() i=3 2024-02-15T23:29:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.867+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94617132195888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dacd0 con 0x560dc48d0e00 2024-02-15T23:29:53.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.867+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94617132195888] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x560dc48d0e00 2024-02-15T23:29:53.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.867+0000 7f408064e980 20 remove_watcher() i=4 2024-02-15T23:29:53.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.867+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94617132193472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48f7aa0 con 0x7f40780141d0 2024-02-15T23:29:53.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.871+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94617132193472] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.871+0000 7f408064e980 20 remove_watcher() i=5 2024-02-15T23:29:53.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.871+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94617132202432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48de030 con 0x7f40780141d0 2024-02-15T23:29:53.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.871+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94617132202432] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.871+0000 7f408064e980 20 remove_watcher() i=6 2024-02-15T23:29:53.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.871+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94617132206544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560dc48dacd0 con 0x7f40780141d0 2024-02-15T23:29:53.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94617132206544] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40700f2080 con 0x7f40780141d0 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 20 remove_watcher() i=7 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f40780141d0 msgr2=0x7f4078015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f40780141d0 0x7f4078015940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc48d0e00 msgr2=0x560dc48d32a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc48d0e00 0x560dc48d32a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4074038020 msgr2=0x7f407402e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4074038020 0x7f407402e810 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560dc48d6bc0 msgr2=0x560dc48d8ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560dc48d6bc0 0x560dc48d8ff0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f48034300 msgr2=0x7f3f480367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f48034300 0x7f3f480367c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4078011010 tx=0x7f4078020000 comp rx=0 tx=0).stop 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 msgr2=0x560dc48c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48c5820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f407403f040 tx=0x7f4074049a30 comp rx=0 tx=0).stop 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f407e169640 1 -- 172.21.15.133:0/1617976401 reap_dead start 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 shutdown_connections 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1617976401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48be930 0x560dc48c5820 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 >> 172.21.15.133:0/1617976401 conn(0x560dc48bacc0 msgr2=0x560dc48b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 shutdown_connections 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1617976401 wait complete. 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1946788521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f580342b0 msgr2=0x7f3f58036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1946788521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f580342b0 0x7f3f58036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x560dc48a1ef0 tx=0x7f4078005850 comp rx=0 tx=0).stop 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1946788521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48b19b0 msgr2=0x560dc48b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1946788521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48b19b0 0x560dc48b1dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4074001ee0 tx=0x7f407400da30 comp rx=0 tx=0).stop 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1946788521 shutdown_connections 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1946788521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f580342b0 0x7f3f58036770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/1946788521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc48b19b0 0x560dc48b1dd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1946788521 >> 172.21.15.133:0/1946788521 conn(0x560dc48a67c0 msgr2=0x560dc48a72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1946788521 shutdown_connections 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/1946788521 wait complete. 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc47a9c80 msgr2=0x560dc48a1190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc47a9c80 0x560dc48a1190 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f640342b0 msgr2=0x7f3f64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f640342b0 0x7f3f64036770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4074000f70 tx=0x7f40740012c0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 msgr2=0x560dc489a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc489a550 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f407001b2c0 tx=0x7f4070018020 comp rx=0 tx=0).stop 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 shutdown_connections 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560dc47a9c80 0x560dc48a1190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3f640342b0 0x7f3f64036770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 --2- 172.21.15.133:0/3202792025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc47a9360 0x560dc489a550 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 >> 172.21.15.133:0/3202792025 conn(0x560dc471ca50 msgr2=0x560dc488df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 shutdown_connections 2024-02-15T23:29:53.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.875+0000 7f408064e980 1 -- 172.21.15.133:0/3202792025 wait complete. 2024-02-15T23:29:53.895 INFO:teuthology.orchestra.run.smithi133.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-02-15T23:29:53.858519Z","last_stats_update":"2024-02-15T23:29:53.856531Z"} 2024-02-15T23:29:53.895 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-02-15T23:29:53.858519Z', 'last_stats_update': '2024-02-15T23:29:53.856531Z'} 2024-02-15T23:29:53.903 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:53.903 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-15T23:29:53.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-15T23:29:53.903 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-02-15T23:29:53.970 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:53.970 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:53.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1ab1f8980 1 Processor -- start 2024-02-15T23:29:53.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1ab1f8980 1 -- start start 2024-02-15T23:29:53.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1ab1f8980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x560440984920 0x560440986d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1ab1f8980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5604408ca4d0 con 0x5604408f2910 2024-02-15T23:29:53.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1ab1f8980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x560440891180 con 0x560440984920 2024-02-15T23:29:53.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1a8512640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x560440984920 0x560440986d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1a8d13640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5604408f2910 0x560440983200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39950/0 (socket says 172.21.15.133:39950) 2024-02-15T23:29:53.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1a8d13640 1 -- 172.21.15.133:0/931316426 learned_addr learned my addr 172.21.15.133:0/931316426 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:53.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1a8512640 1 -- 172.21.15.133:0/931316426 >> v1:172.21.15.131:6789/0 conn(0x5604408f2910 legacy=0x560440983200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.963+0000 7fa1a8512640 1 -- 172.21.15.133:0/931316426 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560440988260 con 0x560440984920 2024-02-15T23:29:53.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1a8512640 1 --2- 172.21.15.133:0/931316426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440984920 0x560440986d10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00a480 tx=0x7fa19c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49827fb207125174 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1a7d11640 1 -- 172.21.15.133:0/931316426 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19c0ab540 con 0x560440984920 2024-02-15T23:29:53.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1a7d11640 1 -- 172.21.15.133:0/931316426 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c0ab6a0 con 0x560440984920 2024-02-15T23:29:53.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1a7d11640 1 -- 172.21.15.133:0/931316426 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19c0ab960 con 0x560440984920 2024-02-15T23:29:53.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/931316426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440984920 msgr2=0x560440986d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/931316426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440984920 0x560440986d10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00a480 tx=0x7fa19c01b280 comp rx=0 tx=0).stop 2024-02-15T23:29:53.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/931316426 shutdown_connections 2024-02-15T23:29:53.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/931316426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440984920 0x560440986d10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/931316426 >> 172.21.15.133:0/931316426 conn(0x560440978920 msgr2=0x56044097ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/931316426 shutdown_connections 2024-02-15T23:29:53.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.967+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/931316426 wait complete. 2024-02-15T23:29:53.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1ab1f8980 1 Processor -- start 2024-02-15T23:29:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1ab1f8980 1 -- start start 2024-02-15T23:29:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1ab1f8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a6a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1ab1f8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56044088e6b0 con 0x5604408f2910 2024-02-15T23:29:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1a8d13640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a6a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1a8d13640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a6a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43368/0 (socket says 172.21.15.133:43368) 2024-02-15T23:29:53.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1a8d13640 1 -- 172.21.15.133:0/3338869591 learned_addr learned my addr 172.21.15.133:0/3338869591 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1a8d13640 1 -- 172.21.15.133:0/3338869591 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c005d30 con 0x5604408f2910 2024-02-15T23:29:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1a8d13640 1 --2- 172.21.15.133:0/3338869591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a6a340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa198006fb0 tx=0x7fa198001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca0ccd34f4c3120 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa096e0d640 1 -- 172.21.15.133:0/3338869591 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa198004530 con 0x5604408f2910 2024-02-15T23:29:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa096e0d640 1 -- 172.21.15.133:0/3338869591 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa198004690 con 0x5604408f2910 2024-02-15T23:29:53.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa096e0d640 1 -- 172.21.15.133:0/3338869591 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1980049b0 con 0x5604408f2910 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3338869591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 msgr2=0x560440a6a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.983+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3338869591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a6a340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa198006fb0 tx=0x7fa198001940 comp rx=0 tx=0).stop 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3338869591 shutdown_connections 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3338869591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a6a340 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3338869591 >> 172.21.15.133:0/3338869591 conn(0x560440978920 msgr2=0x560440a65ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3338869591 shutdown_connections 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3338869591 wait complete. 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 Processor -- start 2024-02-15T23:29:53.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 -- start start 2024-02-15T23:29:53.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a71150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560440889e90 con 0x5604408f2910 2024-02-15T23:29:53.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1a8d13640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a71150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1a8d13640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a71150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43374/0 (socket says 172.21.15.133:43374) 2024-02-15T23:29:53.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1a8d13640 1 -- 172.21.15.133:0/3834367625 learned_addr learned my addr 172.21.15.133:0/3834367625 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:53.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1a8d13640 1 -- 172.21.15.133:0/3834367625 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604408ca4d0 con 0x5604408f2910 2024-02-15T23:29:53.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1a8d13640 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a71150 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x560440a6b1d0 tx=0x7fa198000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa09560a640 1 -- 172.21.15.133:0/3834367625 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa198013760 con 0x5604408f2910 2024-02-15T23:29:53.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560440a71690 con 0x5604408f2910 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa09560a640 1 -- 172.21.15.133:0/3834367625 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1980138c0 con 0x5604408f2910 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa09560a640 1 -- 172.21.15.133:0/3834367625 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa198013b60 con 0x5604408f2910 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560440a71ac0 con 0x5604408f2910 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa09560a640 1 -- 172.21.15.133:0/3834367625 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa198028460 con 0x5604408f2910 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa09560a640 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0900342b0 0x7fa090036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.987+0000 7fa09560a640 1 -- 172.21.15.133:0/3834367625 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa198049550 con 0x5604408f2910 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a8512640 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0900342b0 0x7fa090036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440984920 0x560440a77de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440a78320 con 0x560440984920 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a9514640 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440984920 0x560440a77de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a8512640 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0900342b0 0x7fa090036770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0ad000 tx=0x7fa19c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:53.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a9514640 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440984920 0x560440a77de0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a9514640 1 -- 172.21.15.133:0/3834367625 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1a00083f0 con 0x560440984920 2024-02-15T23:29:54.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440a786e0 con 0x560440984920 2024-02-15T23:29:54.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a9514640 1 -- 172.21.15.133:0/3834367625 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa1a00083f0 con 0x560440984920 2024-02-15T23:29:54.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440a79f90 con 0x560440984920 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a9514640 1 -- 172.21.15.133:0/3834367625 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa1a00083f0 con 0x560440984920 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440a79190 con 0x560440984920 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a9514640 1 -- 172.21.15.133:0/3834367625 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa1a00083f0 con 0x560440984920 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440a795a0 con 0x560440984920 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a9514640 1 -- 172.21.15.133:0/3834367625 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa1a0012040 con 0x560440984920 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 Processor -- start 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 -- start start 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a88670 0x560440a88a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1ab1f8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560440822f20 con 0x560440a88670 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a8512640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a88670 0x560440a88a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a8512640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a88670 0x560440a88a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43382/0 (socket says 172.21.15.133:43382) 2024-02-15T23:29:54.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a8512640 1 -- 172.21.15.133:0/790809804 learned_addr learned my addr 172.21.15.133:0/790809804 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.991+0000 7fa1a8512640 1 -- 172.21.15.133:0/790809804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560440a88fd0 con 0x560440a88670 2024-02-15T23:29:54.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1a8512640 1 --2- 172.21.15.133:0/790809804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a88670 0x560440a88a90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa19c000c10 tx=0x7fa19c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa08e7fc640 1 -- 172.21.15.133:0/790809804 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19c0bf410 con 0x560440a88670 2024-02-15T23:29:54.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa08e7fc640 1 -- 172.21.15.133:0/790809804 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c0bf570 con 0x560440a88670 2024-02-15T23:29:54.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/790809804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560440a891c0 con 0x560440a88670 2024-02-15T23:29:54.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa08e7fc640 1 -- 172.21.15.133:0/790809804 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19c0bf850 con 0x560440a88670 2024-02-15T23:29:54.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/790809804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560440a89d10 con 0x560440a88670 2024-02-15T23:29:54.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa08e7fc640 1 -- 172.21.15.133:0/790809804 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa19c0bfa00 con 0x560440a88670 2024-02-15T23:29:54.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa08e7fc640 1 --2- 172.21.15.133:0/790809804 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0800342b0 0x7fa080036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa08e7fc640 1 -- 172.21.15.133:0/790809804 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa19c0e5f20 con 0x560440a88670 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1a9514640 1 --2- 172.21.15.133:0/790809804 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0800342b0 0x7fa080036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1ab1f8980 1 Processor -- start 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1ab1f8980 1 -- start start 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1a9514640 1 --2- 172.21.15.133:0/790809804 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0800342b0 0x7fa080036770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x560440a78bd0 tx=0x7fa1a0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1ab1f8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1ab1f8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560440816790 con 0x560440a95650 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1a8512640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1a8512640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a95a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43398/0 (socket says 172.21.15.133:43398) 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1a8512640 1 -- 172.21.15.133:0/2079589814 learned_addr learned my addr 172.21.15.133:0/2079589814 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1a8512640 1 -- 172.21.15.133:0/2079589814 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560440a96040 con 0x560440a95650 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.995+0000 7fa1a8512640 1 --2- 172.21.15.133:0/2079589814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a95a70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa19c005730 tx=0x7fa19c006590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d464cec57af63ff1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa07ffff640 1 -- 172.21.15.133:0/2079589814 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19c006990 con 0x560440a95650 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa07ffff640 1 -- 172.21.15.133:0/2079589814 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c006af0 con 0x560440a95650 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa07ffff640 1 -- 172.21.15.133:0/2079589814 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19c006dd0 con 0x560440a95650 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/2079589814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 msgr2=0x560440a95a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/2079589814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a95a70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa19c005730 tx=0x7fa19c006590 comp rx=0 tx=0).stop 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/2079589814 shutdown_connections 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/2079589814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a95a70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/2079589814 >> 172.21.15.133:0/2079589814 conn(0x560440a919e0 msgr2=0x560440a8fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/2079589814 shutdown_connections 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/2079589814 wait complete. 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 Processor -- start 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- start start 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a9c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560440a9cad0 con 0x560440a95650 2024-02-15T23:29:54.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1a8512640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a9c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1a8512640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a9c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43414/0 (socket says 172.21.15.133:43414) 2024-02-15T23:29:54.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 learned_addr learned my addr 172.21.15.133:0/277714051 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560440a89d10 con 0x560440a95650 2024-02-15T23:29:54.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1a8512640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a9c590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0e3270 tx=0x7fa19c0e42e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa07e7fc640 1 -- 172.21.15.133:0/277714051 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19c0b5520 con 0x560440a95650 2024-02-15T23:29:54.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560440a9ccd0 con 0x560440a95650 2024-02-15T23:29:54.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa07e7fc640 1 -- 172.21.15.133:0/277714051 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c0e1040 con 0x560440a95650 2024-02-15T23:29:54.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa07e7fc640 1 -- 172.21.15.133:0/277714051 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19c0b57f0 con 0x560440a95650 2024-02-15T23:29:54.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:53.999+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560440a9d100 con 0x560440a95650 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa07e7fc640 1 -- 172.21.15.133:0/277714051 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa19c0b5950 con 0x560440a95650 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa07e7fc640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa074034300 0x7fa0740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa07e7fc640 1 -- 172.21.15.133:0/277714051 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa19c0f5ca0 con 0x560440a95650 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a9514640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa074034300 0x7fa0740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440aa7b70 0x560440aaa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440aaa760 con 0x560440aa7b70 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8d13640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440aa7b70 0x560440aaa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a9514640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa074034300 0x7fa0740367c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0008fd0 tx=0x7fa1a001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8d13640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440aa7b70 0x560440aaa010 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 realm 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440aaab30 con 0x560440aa7b70 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440aab380 con 0x560440aa7b70 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440aab6e0 con 0x560440aa7b70 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440aabee0 con 0x560440aa7b70 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 20 searching for the correct realm 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560440aade30 0x560440ab0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8512640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560440aade30 0x560440ab0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8512640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560440aade30 0x560440ab0260 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8512640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa19c0f4060 0x7fa19c0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa19c0f4060 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.003+0000 7fa1a9514640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa19c0f4060 0x7fa19c0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a9514640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa19c0f4060 0x7fa19c0c88b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1a002c040 con 0x7fa19c0f4060 2024-02-15T23:29:54.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a9514640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa1a0027940 0x7fa1a00333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa1a0027940 0x7fa1a00333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa1a0027940 0x7fa1a00333c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aa7b70 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aa7b70 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.007+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa19c0f4060 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1a002c040 con 0x7fa19c0f4060 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aa7b70 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aa7b70 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa19c0f4060 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa1a002c040 con 0x7fa19c0f4060 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.011+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aa7b70 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aa7b70 2024-02-15T23:29:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa19c0f4060 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1a002c040 con 0x7fa19c0f4060 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aa7b70 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.015+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa19c0f4060 2024-02-15T23:29:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1a002c040 con 0x7fa19c0f4060 2024-02-15T23:29:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aade30 2024-02-15T23:29:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa1a0027940 2024-02-15T23:29:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x560440aa7b70 2024-02-15T23:29:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab08e0 con 0x7fa19c0f4060 2024-02-15T23:29:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1a002c040 con 0x7fa19c0f4060 2024-02-15T23:29:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440aac8a0 con 0x560440aa7b70 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440aad0f0 con 0x560440aa7b70 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab0d20 con 0x560440aa7b70 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 zone default found 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 4 Realm: () 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 zonegroup default 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab0d20 con 0x7fa1a0027940 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.019+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab2ba0 con 0x560440aade30 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab2f00 con 0x560440aade30 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 20 started sync module instance, tier type = 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab2170 con 0x7fa19c0f4060 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94576264815952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab2170 con 0x7fa19c0f4060 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab3870 con 0x560440aa7b70 2024-02-15T23:29:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94576264815952] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94576264814048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab3870 con 0x560440aa7b70 2024-02-15T23:29:54.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.023+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab41e0 con 0x560440aade30 2024-02-15T23:29:54.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.027+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94576264814048] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.027+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.027+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94576264819664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab37f0 con 0x560440aade30 2024-02-15T23:29:54.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.027+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab4ed0 con 0x7fa19c0f4060 2024-02-15T23:29:54.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.027+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.027+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94576264825664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab5720 con 0x7fa19c0f4060 2024-02-15T23:29:54.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.027+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab6120 con 0x560440aa7b70 2024-02-15T23:29:54.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.031+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94576264819664] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.031+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94576264825664] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.031+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.031+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94576264829984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab5280 con 0x560440aa7b70 2024-02-15T23:29:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.031+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab6970 con 0x7fa1a0027940 2024-02-15T23:29:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.031+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94576264829984] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.035+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.035+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94576264824208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab5280 con 0x7fa1a0027940 2024-02-15T23:29:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.035+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab6e20 con 0x7fa1a0027940 2024-02-15T23:29:54.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.035+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.035+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94576264833312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab7280 con 0x7fa1a0027940 2024-02-15T23:29:54.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.035+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab7c90 con 0x7fa1a0027940 2024-02-15T23:29:54.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.035+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94576264824208] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94576264836992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab7c90 con 0x7fa1a0027940 2024-02-15T23:29:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 20 add_watcher() i=0 2024-02-15T23:29:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 20 add_watcher() i=1 2024-02-15T23:29:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 20 add_watcher() i=2 2024-02-15T23:29:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 20 add_watcher() i=3 2024-02-15T23:29:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 20 add_watcher() i=4 2024-02-15T23:29:54.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 20 add_watcher() i=5 2024-02-15T23:29:54.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94576264833312] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 20 add_watcher() i=6 2024-02-15T23:29:54.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94576264836992] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 20 add_watcher() i=7 2024-02-15T23:29:54.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:54.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab6de0 con 0x560440aa7b70 2024-02-15T23:29:54.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94576264831680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab6de0 con 0x560440aa7b70 2024-02-15T23:29:54.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.039+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94576264831680] v31'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa05efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 5 note: GC not initialized 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa05dfe3640 20 reqs_thread_entry: start 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 Filter name: none 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7f9fcf7fe640 20 reqs_thread_entry: start 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440adcac0 con 0x560440aa7b70 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ade540 con 0x7fa19c0f4060 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440adfbf0 con 0x560440aa7b70 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fa198024020 con 0x560440aa7b70 2024-02-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-15T23:29:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.043+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ae30e0 con 0x7fa19c0f4060 2024-02-15T23:29:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(65 foo.buckets [call] v31'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-15T23:29:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ae20d0 con 0x7fa19c0f4060 2024-02-15T23:29:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-15T23:29:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ae6c40 con 0x7fa19c0f4060 2024-02-15T23:29:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-15T23:29:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T23:29:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.047+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94576265029344 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ae3a40 con 0x7fa1a0027940 2024-02-15T23:29:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== watch-notify(notify (1) cookie 94576264833312 notify 133143986186 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x560440a71ac0 con 0x7fa1a0027940 2024-02-15T23:29:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa07ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94576264833312 notifier 4479 bl.length()=338 2024-02-15T23:29:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa07ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-15T23:29:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa07ffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(68 notify.6 [notify cookie 94576265029344 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa07ffff640 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa06c003ea0 con 0x7fa1a0027940 2024-02-15T23:29:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198024020 con 0x7fa1a0027940 2024-02-15T23:29:54.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== watch-notify(notify_complete (2) cookie 94576265029344 notify 133143986186 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa198060020 con 0x7fa1a0027940 2024-02-15T23:29:54.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa05efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94576264831680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ae66e0 con 0x560440aa7b70 2024-02-15T23:29:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.051+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94576264831680] v31'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa198062040 con 0x560440aa7b70 2024-02-15T23:29:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.055+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94576264815952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab62c0 con 0x7fa19c0f4060 2024-02-15T23:29:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.055+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94576264815952] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1a003f040 con 0x7fa19c0f4060 2024-02-15T23:29:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.055+0000 7fa1ab1f8980 20 remove_watcher() i=0 2024-02-15T23:29:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.055+0000 7fa1ab1f8980 2 removed watcher, disabling cache 2024-02-15T23:29:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.055+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94576264814048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab2550 con 0x560440aa7b70 2024-02-15T23:29:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.055+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94576264814048] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198062040 con 0x560440aa7b70 2024-02-15T23:29:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.055+0000 7fa1ab1f8980 20 remove_watcher() i=1 2024-02-15T23:29:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.055+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94576264819664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab2550 con 0x560440aade30 2024-02-15T23:29:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.059+0000 7fa1a8512640 1 -- 172.21.15.133:0/277714051 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94576264819664] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa19c0b2040 con 0x560440aade30 2024-02-15T23:29:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.059+0000 7fa1ab1f8980 20 remove_watcher() i=2 2024-02-15T23:29:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.059+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94576264825664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab33d0 con 0x7fa19c0f4060 2024-02-15T23:29:54.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.059+0000 7fa1a9514640 1 -- 172.21.15.133:0/277714051 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94576264825664] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1a0048040 con 0x7fa19c0f4060 2024-02-15T23:29:54.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.059+0000 7fa1ab1f8980 20 remove_watcher() i=3 2024-02-15T23:29:54.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.059+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94576264829984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab33d0 con 0x560440aa7b70 2024-02-15T23:29:54.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.063+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94576264829984] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198062040 con 0x560440aa7b70 2024-02-15T23:29:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.063+0000 7fa1ab1f8980 20 remove_watcher() i=4 2024-02-15T23:29:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.063+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94576264824208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab33d0 con 0x7fa1a0027940 2024-02-15T23:29:54.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.063+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94576264824208] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198062040 con 0x7fa1a0027940 2024-02-15T23:29:54.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.063+0000 7fa1ab1f8980 20 remove_watcher() i=5 2024-02-15T23:29:54.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.063+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94576264833312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab4590 con 0x7fa1a0027940 2024-02-15T23:29:54.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94576264833312] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198062040 con 0x7fa1a0027940 2024-02-15T23:29:54.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 20 remove_watcher() i=6 2024-02-15T23:29:54.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94576264836992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560440ab4590 con 0x7fa1a0027940 2024-02-15T23:29:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94576264836992] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa198062040 con 0x7fa1a0027940 2024-02-15T23:29:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 20 remove_watcher() i=7 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa1a0027940 msgr2=0x7fa1a00333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa1a0027940 0x7fa1a00333c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440aa7b70 msgr2=0x560440aaa010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440aa7b70 0x560440aaa010 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa19c0f4060 msgr2=0x7fa19c0c88b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa19c0f4060 0x7fa19c0c88b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560440aade30 msgr2=0x560440ab0260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.067+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560440aade30 0x560440ab0260 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa074034300 msgr2=0x7fa0740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa074034300 0x7fa0740367c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0008fd0 tx=0x7fa1a001c070 comp rx=0 tx=0).stop 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1a8d13640 1 -- 172.21.15.133:0/277714051 reap_dead start 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 msgr2=0x560440a9c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a9c590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0e3270 tx=0x7fa19c0e42e0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 shutdown_connections 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/277714051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a95650 0x560440a9c590 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 >> 172.21.15.133:0/277714051 conn(0x560440a919e0 msgr2=0x560440a8f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 shutdown_connections 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/277714051 wait complete. 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/790809804 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0800342b0 msgr2=0x7fa080036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/790809804 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0800342b0 0x7fa080036770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x560440a78bd0 tx=0x7fa1a0003070 comp rx=0 tx=0).stop 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/790809804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a88670 msgr2=0x560440a88a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/790809804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a88670 0x560440a88a90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa19c000c10 tx=0x7fa19c018020 comp rx=0 tx=0).stop 2024-02-15T23:29:54.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/790809804 shutdown_connections 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/790809804 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0800342b0 0x7fa080036770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/790809804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560440a88670 0x560440a88a90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/790809804 >> 172.21.15.133:0/790809804 conn(0x560440a7d480 msgr2=0x560440a7df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/790809804 shutdown_connections 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/790809804 wait complete. 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440984920 msgr2=0x560440a77de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440984920 0x560440a77de0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0900342b0 msgr2=0x7fa090036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0900342b0 0x7fa090036770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0ad000 tx=0x7fa19c0a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 msgr2=0x560440a71150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a71150 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x560440a6b1d0 tx=0x7fa198000f50 comp rx=0 tx=0).stop 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 shutdown_connections 2024-02-15T23:29:54.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560440984920 0x560440a77de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa0900342b0 0x7fa090036770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 --2- 172.21.15.133:0/3834367625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604408f2910 0x560440a71150 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 >> 172.21.15.133:0/3834367625 conn(0x560440978920 msgr2=0x560440a649e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 shutdown_connections 2024-02-15T23:29:54.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.071+0000 7fa1ab1f8980 1 -- 172.21.15.133:0/3834367625 wait complete. 2024-02-15T23:29:54.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-15T23:29:54.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-15T23:29:54.090 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-15T23:29:54.178 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:54.179 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:54.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfdaa1d980 1 Processor -- start 2024-02-15T23:29:54.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfdaa1d980 1 -- start start 2024-02-15T23:29:54.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfdaa1d980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55796067b390 0x55796067b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfdaa1d980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5579605c5460 con 0x55796067bcb0 2024-02-15T23:29:54.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfdaa1d980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55796058c180 con 0x55796067b390 2024-02-15T23:29:54.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfd8538640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55796067b390 0x55796067b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfd7d37640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55796067bcb0 0x55796067c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39966/0 (socket says 172.21.15.133:39966) 2024-02-15T23:29:54.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfd7d37640 1 -- 172.21.15.133:0/823991762 learned_addr learned my addr 172.21.15.133:0/823991762 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:54.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfd8538640 1 -- 172.21.15.133:0/823991762 >> v1:172.21.15.131:6789/0 conn(0x55796067bcb0 legacy=0x55796067c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.171+0000 7fbfd8538640 1 -- 172.21.15.133:0/823991762 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55796067ce90 con 0x55796067b390 2024-02-15T23:29:54.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.175+0000 7fbfd8538640 1 --2- 172.21.15.133:0/823991762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796067b770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000a480 tx=0x7fbfc001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9b5609dfefc807 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.175+0000 7fbfd7536640 1 -- 172.21.15.133:0/823991762 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc00ab540 con 0x55796067b390 2024-02-15T23:29:54.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.175+0000 7fbfd7536640 1 -- 172.21.15.133:0/823991762 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00ab6a0 con 0x55796067b390 2024-02-15T23:29:54.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.175+0000 7fbfd7536640 1 -- 172.21.15.133:0/823991762 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc00ab960 con 0x55796067b390 2024-02-15T23:29:54.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.179+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/823991762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 msgr2=0x55796067b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.179+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/823991762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796067b770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000a480 tx=0x7fbfc001b280 comp rx=0 tx=0).stop 2024-02-15T23:29:54.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.179+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/823991762 shutdown_connections 2024-02-15T23:29:54.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.179+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/823991762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796067b770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.179+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/823991762 >> 172.21.15.133:0/823991762 conn(0x5579605eea80 msgr2=0x5579605eee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.179+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/823991762 shutdown_connections 2024-02-15T23:29:54.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.179+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/823991762 wait complete. 2024-02-15T23:29:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.191+0000 7fbfdaa1d980 1 Processor -- start 2024-02-15T23:29:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.191+0000 7fbfdaa1d980 1 -- start start 2024-02-15T23:29:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.191+0000 7fbfdaa1d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x557960765930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.191+0000 7fbfdaa1d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579605896b0 con 0x55796067b390 2024-02-15T23:29:54.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.191+0000 7fbfd8538640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x557960765930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.191+0000 7fbfd8538640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x557960765930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43432/0 (socket says 172.21.15.133:43432) 2024-02-15T23:29:54.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.191+0000 7fbfd8538640 1 -- 172.21.15.133:0/2793559460 learned_addr learned my addr 172.21.15.133:0/2793559460 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfd8538640 1 -- 172.21.15.133:0/2793559460 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc0005d30 con 0x55796067b390 2024-02-15T23:29:54.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfd8538640 1 --2- 172.21.15.133:0/2793559460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x557960765930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00ae040 tx=0x7fbfc0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ddaef54c9efc3b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbec660c640 1 -- 172.21.15.133:0/2793559460 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc00ab810 con 0x55796067b390 2024-02-15T23:29:54.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbec660c640 1 -- 172.21.15.133:0/2793559460 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00ab970 con 0x55796067b390 2024-02-15T23:29:54.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbec660c640 1 -- 172.21.15.133:0/2793559460 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc00abc10 con 0x55796067b390 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/2793559460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 msgr2=0x557960765930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/2793559460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x557960765930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00ae040 tx=0x7fbfc0003030 comp rx=0 tx=0).stop 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/2793559460 shutdown_connections 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/2793559460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x557960765930 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/2793559460 >> 172.21.15.133:0/2793559460 conn(0x5579605eea80 msgr2=0x5579607614c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/2793559460 shutdown_connections 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/2793559460 wait complete. 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 Processor -- start 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 -- start start 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796076c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfdaa1d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557960584e90 con 0x55796067b390 2024-02-15T23:29:54.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfd8538640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796076c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfd8538640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796076c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43436/0 (socket says 172.21.15.133:43436) 2024-02-15T23:29:54.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfd8538640 1 -- 172.21.15.133:0/3981923931 learned_addr learned my addr 172.21.15.133:0/3981923931 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfd8538640 1 -- 172.21.15.133:0/3981923931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55796067ce90 con 0x55796067b390 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.195+0000 7fbfd8538640 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796076c5e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbfc001bb20 tx=0x7fbfc0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbec4e09640 1 -- 172.21.15.133:0/3981923931 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc00c2070 con 0x55796067b390 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbec4e09640 1 -- 172.21.15.133:0/3981923931 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00b59d0 con 0x55796067b390 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55796076cb20 con 0x55796067b390 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbec4e09640 1 -- 172.21.15.133:0/3981923931 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc00b5c70 con 0x55796067b390 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55796076cfb0 con 0x55796067b390 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbec4e09640 1 -- 172.21.15.133:0/3981923931 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbfc00b2070 con 0x55796067b390 2024-02-15T23:29:54.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbec4e09640 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbec00342b0 0x7fbec0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbec4e09640 1 -- 172.21.15.133:0/3981923931 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbfc00e3470 con 0x55796067b390 2024-02-15T23:29:54.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfd7d37640 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbec00342b0 0x7fbec0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55796067bcb0 0x557960773220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557960773760 con 0x55796067bcb0 2024-02-15T23:29:54.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55796067bcb0 0x557960773220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfd7d37640 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbec00342b0 0x7fbec0036770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80012f0 tx=0x7fbfc8006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55796067bcb0 0x557960773220 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfd8d39640 1 -- 172.21.15.133:0/3981923931 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbfd00083f0 con 0x55796067bcb0 2024-02-15T23:29:54.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557960773b20 con 0x55796067bcb0 2024-02-15T23:29:54.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfd8d39640 1 -- 172.21.15.133:0/3981923931 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbfd00083f0 con 0x55796067bcb0 2024-02-15T23:29:54.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607753d0 con 0x55796067bcb0 2024-02-15T23:29:54.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfd8d39640 1 -- 172.21.15.133:0/3981923931 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbfd00083f0 con 0x55796067bcb0 2024-02-15T23:29:54.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.199+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607745d0 con 0x55796067bcb0 2024-02-15T23:29:54.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfd8d39640 1 -- 172.21.15.133:0/3981923931 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbfd00083f0 con 0x55796067bcb0 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607749e0 con 0x55796067bcb0 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfd8d39640 1 -- 172.21.15.133:0/3981923931 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbfd0012040 con 0x55796067bcb0 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfdaa1d980 1 Processor -- start 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfdaa1d980 1 -- start start 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfdaa1d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960783ab0 0x557960783ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfdaa1d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55796051df20 con 0x557960783ab0 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfd7d37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960783ab0 0x557960783ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfd7d37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960783ab0 0x557960783ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43438/0 (socket says 172.21.15.133:43438) 2024-02-15T23:29:54.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfd7d37640 1 -- 172.21.15.133:0/90489019 learned_addr learned my addr 172.21.15.133:0/90489019 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfd7d37640 1 -- 172.21.15.133:0/90489019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557960784410 con 0x557960783ab0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfd7d37640 1 --2- 172.21.15.133:0/90489019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960783ab0 0x557960783ed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8004f20 tx=0x7fbfc8006500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbebdffb640 1 -- 172.21.15.133:0/90489019 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc801a070 con 0x557960783ab0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/90489019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557960784660 con 0x557960783ab0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbebdffb640 1 -- 172.21.15.133:0/90489019 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8011440 con 0x557960783ab0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbebdffb640 1 -- 172.21.15.133:0/90489019 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc8011700 con 0x557960783ab0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/90489019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579607851b0 con 0x557960783ab0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.203+0000 7fbebdffb640 1 -- 172.21.15.133:0/90489019 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbfc8011860 con 0x557960783ab0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbebdffb640 1 --2- 172.21.15.133:0/90489019 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbeb0034300 0x7fbeb00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbebdffb640 1 -- 172.21.15.133:0/90489019 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbfc804aa90 con 0x557960783ab0 2024-02-15T23:29:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/90489019 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbeb0034300 0x7fbeb00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 Processor -- start 2024-02-15T23:29:54.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- start start 2024-02-15T23:29:54.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/90489019 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbeb0034300 0x7fbeb00367c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x557960774010 tx=0x7fbfd0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x557960790e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557960511790 con 0x557960790a30 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd7d37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x557960790e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd7d37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x557960790e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43444/0 (socket says 172.21.15.133:43444) 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd7d37640 1 -- 172.21.15.133:0/10589475 learned_addr learned my addr 172.21.15.133:0/10589475 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd7d37640 1 -- 172.21.15.133:0/10589475 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557960791420 con 0x557960790a30 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd7d37640 1 --2- 172.21.15.133:0/10589475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x557960790e50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8048dc0 tx=0x7fbfc8013ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f091a36610ba3662 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbeb77fe640 1 -- 172.21.15.133:0/10589475 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc801ee40 con 0x557960790a30 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbeb77fe640 1 -- 172.21.15.133:0/10589475 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc801f570 con 0x557960790a30 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbeb77fe640 1 -- 172.21.15.133:0/10589475 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc801f810 con 0x557960790a30 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/10589475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 msgr2=0x557960790e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/10589475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x557960790e50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8048dc0 tx=0x7fbfc8013ac0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/10589475 shutdown_connections 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/10589475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x557960790e50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/10589475 >> 172.21.15.133:0/10589475 conn(0x55796078cdc0 msgr2=0x55796078ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/10589475 shutdown_connections 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/10589475 wait complete. 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 Processor -- start 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- start start 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x5579607979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfdaa1d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557960797f00 con 0x557960790a30 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd7d37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x5579607979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd7d37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x5579607979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43456/0 (socket says 172.21.15.133:43456) 2024-02-15T23:29:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.207+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 learned_addr learned my addr 172.21.15.133:0/1865741000 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579607851b0 con 0x557960790a30 2024-02-15T23:29:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfd7d37640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x5579607979c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbfc801f410 tx=0x7fbfc8048d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbeb5ffb640 1 -- 172.21.15.133:0/1865741000 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc802e040 con 0x557960790a30 2024-02-15T23:29:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557960798100 con 0x557960790a30 2024-02-15T23:29:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbeb5ffb640 1 -- 172.21.15.133:0/1865741000 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc80135d0 con 0x557960790a30 2024-02-15T23:29:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbeb5ffb640 1 -- 172.21.15.133:0/1865741000 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc801e870 con 0x557960790a30 2024-02-15T23:29:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557960798590 con 0x557960790a30 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbeb5ffb640 1 -- 172.21.15.133:0/1865741000 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbfc804a070 con 0x557960790a30 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbeb5ffb640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbea80342b0 0x7fbea8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbeb5ffb640 1 -- 172.21.15.133:0/1865741000 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbfc8008050 con 0x557960790a30 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbea80342b0 0x7fbea8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5579607a2f20 0x5579607a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607a5b30 con 0x5579607a2f20 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfd8538640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5579607a2f20 0x5579607a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbea80342b0 0x7fbea8036770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0008fd0 tx=0x7fbfd001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfd8538640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5579607a2f20 0x5579607a53e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbfc00aacb0 con 0x5579607a2f20 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 20 realm 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607a5f00 con 0x5579607a2f20 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbfc00aacb0 con 0x5579607a2f20 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.211+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607a6780 con 0x5579607a2f20 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbfc00aacb0 con 0x5579607a2f20 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607a6ae0 con 0x5579607a2f20 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607a72e0 con 0x5579607a2f20 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 20 searching for the correct realm 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5579607a9170 0x5579607ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd7d37640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5579607a9170 0x5579607ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd7d37640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5579607a9170 0x5579607ab600 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd7d37640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fbfc8033070 0x7fbfc80472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfc8033070 2024-02-15T23:29:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fbfc8033070 0x7fbfc80472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fbfc8033070 0x7fbfc80472d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfd002c040 con 0x7fbfc8033070 2024-02-15T23:29:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8d39640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fbfd0027940 0x7fbfd00333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8538640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fbfd0027940 0x7fbfd00333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.215+0000 7fbfd8538640 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fbfd0027940 0x7fbfd00333c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a2f20 2024-02-15T23:29:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a2f20 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfc8033070 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfd002c040 con 0x7fbfc8033070 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a2f20 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a2f20 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.219+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfc8033070 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbfd002c040 con 0x7fbfc8033070 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a2f20 2024-02-15T23:29:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a2f20 2024-02-15T23:29:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfc8033070 2024-02-15T23:29:54.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfd002c040 con 0x7fbfc8033070 2024-02-15T23:29:54.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.223+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a2f20 2024-02-15T23:29:54.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfc8033070 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfd002c040 con 0x7fbfc8033070 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a9170 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfd0027940 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x5579607a2f20 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.227+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607abcd0 con 0x7fbfc8033070 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfd002c040 con 0x7fbfc8033070 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607a7c10 con 0x5579607a2f20 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607a8460 con 0x5579607a2f20 2024-02-15T23:29:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ac110 con 0x5579607a2f20 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 zone default found 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 4 Realm: () 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 zonegroup default 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ac110 con 0x7fbfd0027940 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607adf90 con 0x5579607a9170 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ae2f0 con 0x5579607a9170 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 started sync module instance, tier type = 2024-02-15T23:29:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ad560 con 0x7fbfc8033070 2024-02-15T23:29:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.231+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfd003f040 con 0x7fbfc8033070 2024-02-15T23:29:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.235+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93979798067472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ad560 con 0x7fbfc8033070 2024-02-15T23:29:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.235+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607aec60 con 0x5579607a2f20 2024-02-15T23:29:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.235+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93979798067472] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfd003f040 con 0x7fbfc8033070 2024-02-15T23:29:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.235+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.235+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93979798065616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607aec60 con 0x5579607a2f20 2024-02-15T23:29:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.235+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607af5d0 con 0x5579607a9170 2024-02-15T23:29:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93979798065616] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93979798071232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607aebe0 con 0x5579607a9170 2024-02-15T23:29:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b02c0 con 0x7fbfc8033070 2024-02-15T23:29:54.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfd003f040 con 0x7fbfc8033070 2024-02-15T23:29:54.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93979798077264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b0b10 con 0x7fbfc8033070 2024-02-15T23:29:54.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b1500 con 0x5579607a2f20 2024-02-15T23:29:54.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93979798071232] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93979798077264] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfd003f040 con 0x7fbfc8033070 2024-02-15T23:29:54.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.239+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.243+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93979798081504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b0670 con 0x5579607a2f20 2024-02-15T23:29:54.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.243+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b1d50 con 0x7fbfd0027940 2024-02-15T23:29:54.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.243+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93979798081504] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.243+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.243+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93979798075776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b0670 con 0x7fbfd0027940 2024-02-15T23:29:54.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.243+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b2220 con 0x7fbfd0027940 2024-02-15T23:29:54.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93979798084896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b2680 con 0x7fbfd0027940 2024-02-15T23:29:54.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b3050 con 0x7fbfd0027940 2024-02-15T23:29:54.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93979798075776] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93979798088528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b3010 con 0x7fbfd0027940 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 20 add_watcher() i=0 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 20 add_watcher() i=1 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 20 add_watcher() i=2 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 20 add_watcher() i=3 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 20 add_watcher() i=4 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 20 add_watcher() i=5 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93979798084896] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.247+0000 7fbfdaa1d980 20 add_watcher() i=6 2024-02-15T23:29:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93979798088528] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 20 add_watcher() i=7 2024-02-15T23:29:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b21e0 con 0x5579607a2f20 2024-02-15T23:29:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93979798083216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b21e0 con 0x5579607a2f20 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93979798083216] v31'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbe8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 5 note: GC not initialized 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbe8d7e2640 20 reqs_thread_entry: start 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 20 Filter name: none 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbdfeffd640 20 reqs_thread_entry: start 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607d7f70 con 0x7fbfd0027940 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.251+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607d6760 con 0x7fbfd0027940 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-15T23:29:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T23:29:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T23:29:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607d6b40 con 0x7fbfd0027940 2024-02-15T23:29:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v31'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-15T23:29:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-15T23:29:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.255+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93979798239696 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607d7380 con 0x7fbfd0027940 2024-02-15T23:29:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== watch-notify(notify (1) cookie 93979798075776 notify 133143986187 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x55796076cfb0 con 0x7fbfd0027940 2024-02-15T23:29:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbeb77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 93979798075776 notifier 4486 bl.length()=523 2024-02-15T23:29:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbeb77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-15T23:29:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbeb77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbeb77fe640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbe9c003ea0 con 0x7fbfd0027940 2024-02-15T23:29:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(65 notify.5 [notify cookie 93979798239696 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== watch-notify(notify_complete (2) cookie 93979798239696 notify 133143986187 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55796076cb20 con 0x7fbfd0027940 2024-02-15T23:29:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.259+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607d7380 con 0x7fbfd0027940 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfdaa1d980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfdaa1d980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfdaa1d980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93979798239696 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607db3c0 con 0x5579607a9170 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== watch-notify(notify (1) cookie 93979798071232 notify 133143986178 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x557960798590 con 0x5579607a9170 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbeb6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 93979798071232 notifier 4486 bl.length()=177 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbeb6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbeb6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(68 notify.2 [notify cookie 93979798239696 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbeb6ffd640 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbe0c003400 con 0x5579607a9170 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== watch-notify(notify_complete (2) cookie 93979798239696 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557960798100 con 0x5579607a9170 2024-02-15T23:29:54.272 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbe8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93979798083216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b82d0 con 0x5579607a2f20 2024-02-15T23:29:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93979798083216] v31'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.263+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93979798067472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b1690 con 0x7fbfc8033070 2024-02-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.267+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93979798067472] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfd003f040 con 0x7fbfc8033070 2024-02-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.267+0000 7fbfdaa1d980 20 remove_watcher() i=0 2024-02-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.267+0000 7fbfdaa1d980 2 removed watcher, disabling cache 2024-02-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.267+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93979798065616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b1690 con 0x5579607a2f20 2024-02-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.267+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93979798065616] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.267+0000 7fbfdaa1d980 20 remove_watcher() i=1 2024-02-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.267+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93979798071232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ad1d0 con 0x5579607a9170 2024-02-15T23:29:54.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.271+0000 7fbfd7d37640 1 -- 172.21.15.133:0/1865741000 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93979798071232] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc80323b0 con 0x5579607a9170 2024-02-15T23:29:54.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.271+0000 7fbfdaa1d980 20 remove_watcher() i=2 2024-02-15T23:29:54.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.271+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93979798077264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b1690 con 0x7fbfc8033070 2024-02-15T23:29:54.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.271+0000 7fbfd8d39640 1 -- 172.21.15.133:0/1865741000 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93979798077264] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfd003f040 con 0x7fbfc8033070 2024-02-15T23:29:54.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.271+0000 7fbfdaa1d980 20 remove_watcher() i=3 2024-02-15T23:29:54.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.271+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93979798081504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ae7c0 con 0x5579607a2f20 2024-02-15T23:29:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.275+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93979798081504] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x5579607a2f20 2024-02-15T23:29:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.275+0000 7fbfdaa1d980 20 remove_watcher() i=4 2024-02-15T23:29:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.275+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93979798075776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ad1d0 con 0x7fbfd0027940 2024-02-15T23:29:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.275+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93979798075776] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.275+0000 7fbfdaa1d980 20 remove_watcher() i=5 2024-02-15T23:29:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.275+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93979798084896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607b0fe0 con 0x7fbfd0027940 2024-02-15T23:29:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93979798084896] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 20 remove_watcher() i=6 2024-02-15T23:29:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93979798088528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579607ae7c0 con 0x7fbfd0027940 2024-02-15T23:29:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93979798088528] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfc00d9040 con 0x7fbfd0027940 2024-02-15T23:29:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 20 remove_watcher() i=7 2024-02-15T23:29:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fbfd0027940 msgr2=0x7fbfd00333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fbfd0027940 0x7fbfd00333c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5579607a2f20 msgr2=0x5579607a53e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5579607a2f20 0x5579607a53e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fbfc8033070 msgr2=0x7fbfc80472d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fbfc8033070 0x7fbfc80472d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5579607a9170 msgr2=0x5579607ab600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5579607a9170 0x5579607ab600 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbea80342b0 msgr2=0x7fbea8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbea80342b0 0x7fbea8036770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0008fd0 tx=0x7fbfd001c070 comp rx=0 tx=0).stop 2024-02-15T23:29:54.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 msgr2=0x5579607979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x5579607979c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbfc801f410 tx=0x7fbfc8048d50 comp rx=0 tx=0).stop 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfd8538640 1 -- 172.21.15.133:0/1865741000 reap_dead start 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 shutdown_connections 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/1865741000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960790a30 0x5579607979c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 >> 172.21.15.133:0/1865741000 conn(0x55796078cdc0 msgr2=0x55796078a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 shutdown_connections 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/1865741000 wait complete. 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/90489019 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbeb0034300 msgr2=0x7fbeb00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/90489019 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbeb0034300 0x7fbeb00367c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x557960774010 tx=0x7fbfd0003070 comp rx=0 tx=0).stop 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/90489019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960783ab0 msgr2=0x557960783ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/90489019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960783ab0 0x557960783ed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8004f20 tx=0x7fbfc8006500 comp rx=0 tx=0).stop 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/90489019 shutdown_connections 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/90489019 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbeb0034300 0x7fbeb00367c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/90489019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557960783ab0 0x557960783ed0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/90489019 >> 172.21.15.133:0/90489019 conn(0x5579607788c0 msgr2=0x5579607793d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/90489019 shutdown_connections 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/90489019 wait complete. 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55796067bcb0 msgr2=0x557960773220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.279+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55796067bcb0 0x557960773220 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbec00342b0 msgr2=0x7fbec0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbec00342b0 0x7fbec0036770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80012f0 tx=0x7fbfc8006700 comp rx=0 tx=0).stop 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 msgr2=0x55796076c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796076c5e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbfc001bb20 tx=0x7fbfc0018020 comp rx=0 tx=0).stop 2024-02-15T23:29:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 shutdown_connections 2024-02-15T23:29:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55796067bcb0 0x557960773220 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fbec00342b0 0x7fbec0036770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 --2- 172.21.15.133:0/3981923931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55796067b390 0x55796076c5e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 >> 172.21.15.133:0/3981923931 conn(0x5579605eea80 msgr2=0x55796075ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 shutdown_connections 2024-02-15T23:29:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.283+0000 7fbfdaa1d980 1 -- 172.21.15.133:0/3981923931 wait complete. 2024-02-15T23:29:54.301 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:54.309 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-15T23:29:54.317 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:54.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-02-15T23:29:54.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-02-15T23:29:54.317 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-02-15T23:29:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:54.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e25596980 1 Processor -- start 2024-02-15T23:29:54.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e25596980 1 -- start start 2024-02-15T23:29:54.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e25596980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f11a5938b0 0x55f11a593c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e25596980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f11a4de4c0 con 0x55f11a5941d0 2024-02-15T23:29:54.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e25596980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f11a4a5180 con 0x55f11a5938b0 2024-02-15T23:29:54.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e230b1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f11a5938b0 0x55f11a593c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e230b1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f11a5938b0 0x55f11a593c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43464/0 (socket says 172.21.15.133:43464) 2024-02-15T23:29:54.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e230b1640 1 -- 172.21.15.133:0/77102724 learned_addr learned my addr 172.21.15.133:0/77102724 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e228b0640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55f11a5941d0 0x55f11a590320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39978/0 (socket says 172.21.15.133:39978) 2024-02-15T23:29:54.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e220af640 1 -- 172.21.15.133:0/77102724 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828532160 0 0) 0x55f11a4de4c0 con 0x55f11a5941d0 2024-02-15T23:29:54.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e220af640 1 -- 172.21.15.133:0/77102724 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e0c001e20 con 0x55f11a5941d0 2024-02-15T23:29:54.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e230b1640 1 -- 172.21.15.133:0/77102724 >> v1:172.21.15.131:6789/0 conn(0x55f11a5941d0 legacy=0x55f11a590320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.339+0000 7f1e230b1640 1 -- 172.21.15.133:0/77102724 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f11a590a30 con 0x55f11a5938b0 2024-02-15T23:29:54.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e230b1640 1 --2- 172.21.15.133:0/77102724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a593c90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400a5c0 tx=0x7f1e1401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2c659488d21ffd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e220af640 1 -- 172.21.15.133:0/77102724 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e140aa470 con 0x55f11a5938b0 2024-02-15T23:29:54.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e220af640 1 -- 172.21.15.133:0/77102724 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e140aa5d0 con 0x55f11a5938b0 2024-02-15T23:29:54.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e220af640 1 -- 172.21.15.133:0/77102724 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e140aa870 con 0x55f11a5938b0 2024-02-15T23:29:54.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e25596980 1 -- 172.21.15.133:0/77102724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 msgr2=0x55f11a593c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e25596980 1 --2- 172.21.15.133:0/77102724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a593c90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400a5c0 tx=0x7f1e1401b340 comp rx=0 tx=0).stop 2024-02-15T23:29:54.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e25596980 1 -- 172.21.15.133:0/77102724 shutdown_connections 2024-02-15T23:29:54.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e25596980 1 --2- 172.21.15.133:0/77102724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a593c90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e25596980 1 -- 172.21.15.133:0/77102724 >> 172.21.15.133:0/77102724 conn(0x55f11a58c060 msgr2=0x55f11a58e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e25596980 1 -- 172.21.15.133:0/77102724 shutdown_connections 2024-02-15T23:29:54.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.343+0000 7f1e25596980 1 -- 172.21.15.133:0/77102724 wait complete. 2024-02-15T23:29:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.359+0000 7f1e25596980 1 Processor -- start 2024-02-15T23:29:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.359+0000 7f1e25596980 1 -- start start 2024-02-15T23:29:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.359+0000 7f1e25596980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a67c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.359+0000 7f1e25596980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11a4a26b0 con 0x55f11a5938b0 2024-02-15T23:29:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.359+0000 7f1e230b1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a67c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.359+0000 7f1e230b1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a67c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43478/0 (socket says 172.21.15.133:43478) 2024-02-15T23:29:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.359+0000 7f1e230b1640 1 -- 172.21.15.133:0/3151492005 learned_addr learned my addr 172.21.15.133:0/3151492005 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.359+0000 7f1e230b1640 1 -- 172.21.15.133:0/3151492005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14005df0 con 0x55f11a5938b0 2024-02-15T23:29:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e230b1640 1 --2- 172.21.15.133:0/3151492005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a67c590 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e14017f50 tx=0x7f1e14003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a28c09e4a6522e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1d1160a640 1 -- 172.21.15.133:0/3151492005 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e140aa870 con 0x55f11a5938b0 2024-02-15T23:29:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1d1160a640 1 -- 172.21.15.133:0/3151492005 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e140aa9f0 con 0x55f11a5938b0 2024-02-15T23:29:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1d1160a640 1 -- 172.21.15.133:0/3151492005 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e140aacd0 con 0x55f11a5938b0 2024-02-15T23:29:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- 172.21.15.133:0/3151492005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 msgr2=0x55f11a67c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 --2- 172.21.15.133:0/3151492005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a67c590 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e14017f50 tx=0x7f1e14003030 comp rx=0 tx=0).stop 2024-02-15T23:29:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- 172.21.15.133:0/3151492005 shutdown_connections 2024-02-15T23:29:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 --2- 172.21.15.133:0/3151492005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a67c590 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- 172.21.15.133:0/3151492005 >> 172.21.15.133:0/3151492005 conn(0x55f11a58c060 msgr2=0x55f11a678120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- 172.21.15.133:0/3151492005 shutdown_connections 2024-02-15T23:29:54.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- 172.21.15.133:0/3151492005 wait complete. 2024-02-15T23:29:54.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 Processor -- start 2024-02-15T23:29:54.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- start start 2024-02-15T23:29:54.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a6832b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11a49de90 con 0x55f11a5938b0 2024-02-15T23:29:54.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e230b1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a6832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e230b1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a6832b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43484/0 (socket says 172.21.15.133:43484) 2024-02-15T23:29:54.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e230b1640 1 -- 172.21.15.133:0/1692761909 learned_addr learned my addr 172.21.15.133:0/1692761909 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e230b1640 1 -- 172.21.15.133:0/1692761909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f11a590a30 con 0x55f11a5938b0 2024-02-15T23:29:54.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e230b1640 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a6832b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1e1401b170 tx=0x7f1e140180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1d0fe07640 1 -- 172.21.15.133:0/1692761909 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e140c6690 con 0x55f11a5938b0 2024-02-15T23:29:54.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1d0fe07640 1 -- 172.21.15.133:0/1692761909 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e140c67f0 con 0x55f11a5938b0 2024-02-15T23:29:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1d0fe07640 1 -- 172.21.15.133:0/1692761909 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e140c6a90 con 0x55f11a5938b0 2024-02-15T23:29:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f11a6837f0 con 0x55f11a5938b0 2024-02-15T23:29:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.363+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f11a683ca0 con 0x55f11a5938b0 2024-02-15T23:29:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1d0fe07640 1 -- 172.21.15.133:0/1692761909 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1e140c6cc0 con 0x55f11a5938b0 2024-02-15T23:29:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1d0fe07640 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d08034300 0x7f1d080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1d0fe07640 1 -- 172.21.15.133:0/1692761909 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1e140e4cb0 con 0x55f11a5938b0 2024-02-15T23:29:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e228b0640 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d08034300 0x7f1d080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e25596980 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a5941d0 0x55f11a689f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a68a490 con 0x55f11a5941d0 2024-02-15T23:29:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e238b2640 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a5941d0 0x55f11a689f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e228b0640 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d08034300 0x7f1d080367c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e18000f70 tx=0x7f1e180013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e238b2640 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a5941d0 0x55f11a689f50 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e238b2640 1 -- 172.21.15.133:0/1692761909 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1e1c00a4d0 con 0x55f11a5941d0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a68a880 con 0x55f11a5941d0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e238b2640 1 -- 172.21.15.133:0/1692761909 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1e1c00a4d0 con 0x55f11a5941d0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a68c130 con 0x55f11a5941d0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e238b2640 1 -- 172.21.15.133:0/1692761909 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1e1c00a4d0 con 0x55f11a5941d0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a68b270 con 0x55f11a5941d0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e238b2640 1 -- 172.21.15.133:0/1692761909 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1e1c00a4d0 con 0x55f11a5941d0 2024-02-15T23:29:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a68b680 con 0x55f11a5941d0 2024-02-15T23:29:54.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.367+0000 7f1e238b2640 1 -- 172.21.15.133:0/1692761909 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1e1c00a4d0 con 0x55f11a5941d0 2024-02-15T23:29:54.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e25596980 1 Processor -- start 2024-02-15T23:29:54.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e25596980 1 -- start start 2024-02-15T23:29:54.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e25596980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a69a7f0 0x55f11a69ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e25596980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11a436f20 con 0x55f11a69a7f0 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e228b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a69a7f0 0x55f11a69ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e228b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a69a7f0 0x55f11a69ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43486/0 (socket says 172.21.15.133:43486) 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e228b0640 1 -- 172.21.15.133:0/821645604 learned_addr learned my addr 172.21.15.133:0/821645604 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e228b0640 1 -- 172.21.15.133:0/821645604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f11a69b150 con 0x55f11a69a7f0 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e228b0640 1 --2- 172.21.15.133:0/821645604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a69a7f0 0x55f11a69ac10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1e18001ee0 tx=0x7f1e1800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1d0d602640 1 -- 172.21.15.133:0/821645604 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e18007040 con 0x55f11a69a7f0 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1d0d602640 1 -- 172.21.15.133:0/821645604 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1800d530 con 0x55f11a69a7f0 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e25596980 1 -- 172.21.15.133:0/821645604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f11a69b3a0 con 0x55f11a69a7f0 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1d0d602640 1 -- 172.21.15.133:0/821645604 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e1800d7f0 con 0x55f11a69a7f0 2024-02-15T23:29:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e25596980 1 -- 172.21.15.133:0/821645604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f11a69bef0 con 0x55f11a69a7f0 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1d0d602640 1 -- 172.21.15.133:0/821645604 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1e1801a070 con 0x55f11a69a7f0 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1d0d602640 1 --2- 172.21.15.133:0/821645604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cfc0342b0 0x7f1cfc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1d0d602640 1 -- 172.21.15.133:0/821645604 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1e18017050 con 0x55f11a69a7f0 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e238b2640 1 --2- 172.21.15.133:0/821645604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cfc0342b0 0x7f1cfc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e25596980 1 Processor -- start 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.371+0000 7f1e25596980 1 -- start start 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a592fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e238b2640 1 --2- 172.21.15.133:0/821645604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cfc0342b0 0x7f1cfc036770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55f11a68acb0 tx=0x7f1e1c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11a42a790 con 0x55f11a592c00 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a592fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a592fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43488/0 (socket says 172.21.15.133:43488) 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 -- 172.21.15.133:0/3403648547 learned_addr learned my addr 172.21.15.133:0/3403648547 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 -- 172.21.15.133:0/3403648547 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f11a591430 con 0x55f11a592c00 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 --2- 172.21.15.133:0/3403648547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a592fe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800c010 tx=0x7f1e18024800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89c3fb5d1c85dc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1d06ffd640 1 -- 172.21.15.133:0/3403648547 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e1800dcd0 con 0x55f11a592c00 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1d06ffd640 1 -- 172.21.15.133:0/3403648547 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1800de30 con 0x55f11a592c00 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1d06ffd640 1 -- 172.21.15.133:0/3403648547 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e1803ac40 con 0x55f11a592c00 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 -- 172.21.15.133:0/3403648547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 msgr2=0x55f11a592fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 --2- 172.21.15.133:0/3403648547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a592fe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800c010 tx=0x7f1e18024800 comp rx=0 tx=0).stop 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 -- 172.21.15.133:0/3403648547 shutdown_connections 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 --2- 172.21.15.133:0/3403648547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a592fe0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 -- 172.21.15.133:0/3403648547 >> 172.21.15.133:0/3403648547 conn(0x55f11a6a3b10 msgr2=0x55f11a6a1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 -- 172.21.15.133:0/3403648547 shutdown_connections 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 -- 172.21.15.133:0/3403648547 wait complete. 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 Processor -- start 2024-02-15T23:29:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 -- start start 2024-02-15T23:29:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a6b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e25596980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11a6b0e40 con 0x55f11a592c00 2024-02-15T23:29:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a6b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a6b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43492/0 (socket says 172.21.15.133:43492) 2024-02-15T23:29:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 learned_addr learned my addr 172.21.15.133:0/3614071430 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.375+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f11a69bef0 con 0x55f11a592c00 2024-02-15T23:29:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e228b0640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a6b0900 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1e18047b50 tx=0x7f1e18048b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1d057fa640 1 -- 172.21.15.133:0/3614071430 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e18035070 con 0x55f11a592c00 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f11a6b1040 con 0x55f11a592c00 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1d057fa640 1 -- 172.21.15.133:0/3614071430 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18025360 con 0x55f11a592c00 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1d057fa640 1 -- 172.21.15.133:0/3614071430 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e1803ae30 con 0x55f11a592c00 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f11a6b14d0 con 0x55f11a592c00 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1d057fa640 1 -- 172.21.15.133:0/3614071430 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1e18041070 con 0x55f11a592c00 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1d057fa640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cec034260 0x7f1cec036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1d057fa640 1 -- 172.21.15.133:0/3614071430 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1e180328d0 con 0x55f11a592c00 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e238b2640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cec034260 0x7f1cec036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a6bbeb0 0x55f11a6be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6bea90 con 0x55f11a6bbeb0 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e230b1640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a6bbeb0 0x55f11a6be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e238b2640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cec034260 0x7f1cec036720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c011010 tx=0x7f1e1c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e230b1640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a6bbeb0 0x55f11a6be340 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 20 realm 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6bee60 con 0x55f11a6bbeb0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6bf6b0 con 0x55f11a6bbeb0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.379+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6bfa10 con 0x55f11a6bbeb0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e25596980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6bf350 con 0x55f11a6bbeb0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e25596980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e25596980 20 searching for the correct realm 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f11a6c1c60 0x55f11a6c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e228b0640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f11a6c1c60 0x55f11a6c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e228b0640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f11a6c1c60 0x55f11a6c4090 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e228b0640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1e18043c20 0x7f1e1804b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e18043c20 2024-02-15T23:29:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e238b2640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1e18043c20 0x7f1e1804b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e238b2640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1e18043c20 0x7f1e1804b070 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e1c00a4d0 con 0x7f1e18043c20 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e238b2640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1e1c0141d0 0x7f1e1c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e230b1640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1e1c0141d0 0x7f1e1c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e230b1640 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1e1c0141d0 0x7f1e1c015940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6bbeb0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.383+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6bbeb0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e18043c20 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e1c00a4d0 con 0x7f1e18043c20 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6bbeb0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6bbeb0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e18043c20 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.387+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6bbeb0 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6bbeb0 2024-02-15T23:29:54.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e18043c20 2024-02-15T23:29:54.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6bbeb0 2024-02-15T23:29:54.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.391+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e18043c20 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6c1c60 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e1c0141d0 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x55f11a6bbeb0 2024-02-15T23:29:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c4760 con 0x7f1e18043c20 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c08b0 con 0x55f11a6bbeb0 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.395+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c0530 con 0x55f11a6bbeb0 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c1180 con 0x55f11a6bbeb0 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 zone default found 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 4 Realm: () 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 zonegroup default 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c1180 con 0x7f1e1c0141d0 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c65b0 con 0x55f11a6c1c60 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c6910 con 0x55f11a6c1c60 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 started sync module instance, tier type = 2024-02-15T23:29:54.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:54.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c5e90 con 0x7f1e18043c20 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94494018787824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c6240 con 0x7f1e18043c20 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.399+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c7640 con 0x55f11a6bbeb0 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.403+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94494018787824] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.403+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.403+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94494018792704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c75c0 con 0x55f11a6bbeb0 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.403+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c8030 con 0x55f11a6c1c60 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.403+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.403+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94494018796304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c8880 con 0x55f11a6c1c60 2024-02-15T23:29:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.403+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c9250 con 0x7f1e18043c20 2024-02-15T23:29:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.403+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94494018792704] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.407+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.407+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94494018800976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c9600 con 0x7f1e18043c20 2024-02-15T23:29:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.407+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c9f70 con 0x55f11a6bbeb0 2024-02-15T23:29:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.407+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94494018796304] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.407+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94494018800976] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.407+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.407+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94494018793760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c9ad0 con 0x55f11a6bbeb0 2024-02-15T23:29:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.407+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6ca7c0 con 0x7f1e1c0141d0 2024-02-15T23:29:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.411+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94494018793760] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.411+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.411+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94494018798560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6ca520 con 0x7f1e1c0141d0 2024-02-15T23:29:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.411+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cad20 con 0x7f1e1c0141d0 2024-02-15T23:29:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.411+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94494018798560] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.411+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.411+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94494018806368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cac40 con 0x7f1e1c0141d0 2024-02-15T23:29:54.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.411+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cb6e0 con 0x7f1e1c0141d0 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94494018810304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cbb40 con 0x7f1e1c0141d0 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 20 add_watcher() i=0 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 20 add_watcher() i=1 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 20 add_watcher() i=2 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 20 add_watcher() i=3 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 20 add_watcher() i=4 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 20 add_watcher() i=5 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94494018806368] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 20 add_watcher() i=6 2024-02-15T23:29:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94494018810304] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 20 add_watcher() i=7 2024-02-15T23:29:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cbb40 con 0x55f11a6bbeb0 2024-02-15T23:29:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.415+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94494018811552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cbac0 con 0x55f11a6bbeb0 2024-02-15T23:29:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94494018811552] v31'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1cd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 5 note: GC not initialized 2024-02-15T23:29:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1cd8fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 20 Filter name: none 2024-02-15T23:29:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1c527fc640 20 reqs_thread_entry: start 2024-02-15T23:29:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6f0420 con 0x7f1e18043c20 2024-02-15T23:29:54.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:54.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1cd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.419+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94494018811552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6d1150 con 0x55f11a6bbeb0 2024-02-15T23:29:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94494018811552] v31'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94494018787824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cb6a0 con 0x7f1e18043c20 2024-02-15T23:29:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94494018787824] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e25596980 20 remove_watcher() i=0 2024-02-15T23:29:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e25596980 2 removed watcher, disabling cache 2024-02-15T23:29:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94494018792704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cb6a0 con 0x55f11a6bbeb0 2024-02-15T23:29:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94494018792704] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e25596980 20 remove_watcher() i=1 2024-02-15T23:29:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.423+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94494018796304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c6d00 con 0x55f11a6c1c60 2024-02-15T23:29:54.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.427+0000 7f1e228b0640 1 -- 172.21.15.133:0/3614071430 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94494018796304] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e18037070 con 0x55f11a6c1c60 2024-02-15T23:29:54.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.427+0000 7f1e25596980 20 remove_watcher() i=2 2024-02-15T23:29:54.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.427+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94494018800976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cb6a0 con 0x7f1e18043c20 2024-02-15T23:29:54.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.427+0000 7f1e238b2640 1 -- 172.21.15.133:0/3614071430 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94494018800976] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e1c03a040 con 0x7f1e18043c20 2024-02-15T23:29:54.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.427+0000 7f1e25596980 20 remove_watcher() i=3 2024-02-15T23:29:54.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.427+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94494018793760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c8d50 con 0x55f11a6bbeb0 2024-02-15T23:29:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.431+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94494018793760] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x55f11a6bbeb0 2024-02-15T23:29:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.431+0000 7f1e25596980 20 remove_watcher() i=4 2024-02-15T23:29:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.431+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94494018798560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cb6a0 con 0x7f1e1c0141d0 2024-02-15T23:29:54.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.431+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94494018798560] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.431+0000 7f1e25596980 20 remove_watcher() i=5 2024-02-15T23:29:54.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.431+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94494018806368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6c8d50 con 0x7f1e1c0141d0 2024-02-15T23:29:54.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94494018806368] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 20 remove_watcher() i=6 2024-02-15T23:29:54.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94494018810304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11a6cb6a0 con 0x7f1e1c0141d0 2024-02-15T23:29:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94494018810304] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1e140cd020 con 0x7f1e1c0141d0 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 20 remove_watcher() i=7 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1e1c0141d0 msgr2=0x7f1e1c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1e1c0141d0 0x7f1e1c015940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a6bbeb0 msgr2=0x55f11a6be340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a6bbeb0 0x55f11a6be340 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1e18043c20 msgr2=0x7f1e1804b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1e18043c20 0x7f1e1804b070 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f11a6c1c60 msgr2=0x55f11a6c4090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f11a6c1c60 0x55f11a6c4090 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cec034260 msgr2=0x7f1cec036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cec034260 0x7f1cec036720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c011010 tx=0x7f1e1c020000 comp rx=0 tx=0).stop 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 msgr2=0x55f11a6b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e230b1640 1 -- 172.21.15.133:0/3614071430 reap_dead start 2024-02-15T23:29:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a6b0900 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1e18047b50 tx=0x7f1e18048b70 comp rx=0 tx=0).stop 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 shutdown_connections 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/3614071430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a592c00 0x55f11a6b0900 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 >> 172.21.15.133:0/3614071430 conn(0x55f11a6a3b10 msgr2=0x55f11a6a1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 shutdown_connections 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/3614071430 wait complete. 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/821645604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cfc0342b0 msgr2=0x7f1cfc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/821645604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cfc0342b0 0x7f1cfc036770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55f11a68acb0 tx=0x7f1e1c005850 comp rx=0 tx=0).stop 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/821645604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a69a7f0 msgr2=0x55f11a69ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/821645604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a69a7f0 0x55f11a69ac10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1e18001ee0 tx=0x7f1e1800ea10 comp rx=0 tx=0).stop 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/821645604 shutdown_connections 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/821645604 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1cfc0342b0 0x7f1cfc036770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/821645604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a69a7f0 0x55f11a69ac10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/821645604 >> 172.21.15.133:0/821645604 conn(0x55f11a68f600 msgr2=0x55f11a690110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/821645604 shutdown_connections 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/821645604 wait complete. 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a5941d0 msgr2=0x55f11a689f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.435+0000 7f1e25596980 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a5941d0 0x55f11a689f50 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d08034300 msgr2=0x7f1d080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d08034300 0x7f1d080367c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e18000f70 tx=0x7f1e180013a0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 msgr2=0x55f11a6832b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a6832b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1e1401b170 tx=0x7f1e140180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 shutdown_connections 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f11a5941d0 0x55f11a689f50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d08034300 0x7f1d080367c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 --2- 172.21.15.133:0/1692761909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11a5938b0 0x55f11a6832b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 >> 172.21.15.133:0/1692761909 conn(0x55f11a58c060 msgr2=0x55f11a676c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 shutdown_connections 2024-02-15T23:29:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.439+0000 7f1e25596980 1 -- 172.21.15.133:0/1692761909 wait complete. 2024-02-15T23:29:54.457 INFO:teuthology.orchestra.run.smithi133.stdout:{"key":"bucket:myfoo","ver":{"tag":"_8M5mTJlZ2g2OisSzac12vp1","ver":2},"mtime":"2024-02-15T23:29:54.050081Z","data":{"bucket":{"name":"myfoo","marker":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","bucket_id":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-02-15T23:29:52.491594Z","linked":false,"has_bucket_info":false}} 2024-02-15T23:29:54.457 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_8M5mTJlZ2g2OisSzac12vp1', 'ver': 2}, 'mtime': '2024-02-15T23:29:54.050081Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'bucket_id': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-02-15T23:29:52.491594Z', 'linked': False, 'has_bucket_info': False}} 2024-02-15T23:29:54.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1'] 2024-02-15T23:29:54.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1'] 2024-02-15T23:29:54.457 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:54.558 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3e527980 1 Processor -- start 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3e527980 1 -- start start 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3e527980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f7ae006020 0x55f7ae094da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3e527980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f7adfde460 con 0x55f7ae0952e0 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3e527980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f7adfa5180 con 0x55f7ae006020 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3c042640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f7ae006020 0x55f7ae094da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3b841640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55f7ae0952e0 0x55f7ae0976d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39984/0 (socket says 172.21.15.133:39984) 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3b841640 1 -- 172.21.15.133:0/2614413536 learned_addr learned my addr 172.21.15.133:0/2614413536 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3b040640 1 -- 172.21.15.133:0/2614413536 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692935617 0 0) 0x55f7adfde460 con 0x55f7ae0952e0 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3b040640 1 -- 172.21.15.133:0/2614413536 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c28001e20 con 0x55f7ae0952e0 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3c042640 1 -- 172.21.15.133:0/2614413536 >> v1:172.21.15.131:6789/0 conn(0x55f7ae0952e0 legacy=0x55f7ae0976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.527+0000 7f3c3c042640 1 -- 172.21.15.133:0/2614413536 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7ae099e90 con 0x55f7ae006020 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3c042640 1 --2- 172.21.15.133:0/2614413536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae094da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00a420 tx=0x7f3c2c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cb5369007740a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3b040640 1 -- 172.21.15.133:0/2614413536 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c0aa530 con 0x55f7ae006020 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3b040640 1 -- 172.21.15.133:0/2614413536 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0a6050 con 0x55f7ae006020 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3b040640 1 -- 172.21.15.133:0/2614413536 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c0aa800 con 0x55f7ae006020 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3e527980 1 -- 172.21.15.133:0/2614413536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 msgr2=0x55f7ae094da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2614413536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae094da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00a420 tx=0x7f3c2c01afd0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3e527980 1 -- 172.21.15.133:0/2614413536 shutdown_connections 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2614413536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae094da0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3e527980 1 -- 172.21.15.133:0/2614413536 >> 172.21.15.133:0/2614413536 conn(0x55f7ae08c880 msgr2=0x55f7ae08eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3e527980 1 -- 172.21.15.133:0/2614413536 shutdown_connections 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.531+0000 7f3c3e527980 1 -- 172.21.15.133:0/2614413536 wait complete. 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3e527980 1 Processor -- start 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3e527980 1 -- start start 2024-02-15T23:29:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3e527980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae17bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3e527980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7adfa26b0 con 0x55f7ae006020 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3c042640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae17bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3c042640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae17bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43508/0 (socket says 172.21.15.133:43508) 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3c042640 1 -- 172.21.15.133:0/2476203783 learned_addr learned my addr 172.21.15.133:0/2476203783 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3c042640 1 -- 172.21.15.133:0/2476203783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c00a100 con 0x55f7ae006020 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.547+0000 7f3c3c042640 1 --2- 172.21.15.133:0/2476203783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae17bec0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c018c00 tx=0x7f3c2c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401b48687df16e6a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3b2a60c640 1 -- 172.21.15.133:0/2476203783 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c0aa6c0 con 0x55f7ae006020 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3b2a60c640 1 -- 172.21.15.133:0/2476203783 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0aa820 con 0x55f7ae006020 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3b2a60c640 1 -- 172.21.15.133:0/2476203783 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c0aaac0 con 0x55f7ae006020 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- 172.21.15.133:0/2476203783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 msgr2=0x55f7ae17bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2476203783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae17bec0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c018c00 tx=0x7f3c2c0033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- 172.21.15.133:0/2476203783 shutdown_connections 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2476203783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae17bec0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- 172.21.15.133:0/2476203783 >> 172.21.15.133:0/2476203783 conn(0x55f7ae08c880 msgr2=0x55f7ae177a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- 172.21.15.133:0/2476203783 shutdown_connections 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- 172.21.15.133:0/2476203783 wait complete. 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 Processor -- start 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- start start 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae092500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7adf9de90 con 0x55f7ae006020 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3c042640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae092500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3c042640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae092500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43512/0 (socket says 172.21.15.133:43512) 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3c042640 1 -- 172.21.15.133:0/4166537703 learned_addr learned my addr 172.21.15.133:0/4166537703 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3c042640 1 -- 172.21.15.133:0/4166537703 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7ae099e90 con 0x55f7ae006020 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3c042640 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae092500 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000f90 tx=0x7f3c2c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3b28e09640 1 -- 172.21.15.133:0/4166537703 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c0b4b10 con 0x55f7ae006020 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f7ae092a40 con 0x55f7ae006020 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3b28e09640 1 -- 172.21.15.133:0/4166537703 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0b4c70 con 0x55f7ae006020 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3b28e09640 1 -- 172.21.15.133:0/4166537703 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c0be450 con 0x55f7ae006020 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.551+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7ae090ee0 con 0x55f7ae006020 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3b28e09640 1 -- 172.21.15.133:0/4166537703 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c2c0c4070 con 0x55f7ae006020 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3b28e09640 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b240342b0 0x7f3b24036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3b28e09640 1 -- 172.21.15.133:0/4166537703 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3c2c0e3db0 con 0x55f7ae006020 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3b841640 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b240342b0 0x7f3b24036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae0952e0 0x55f7ae18bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae18c100 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3c843640 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae0952e0 0x55f7ae18bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3b841640 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b240342b0 0x7f3b24036770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c24001dc0 tx=0x7f3c24001360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3c843640 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae0952e0 0x55f7ae18bbc0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3c843640 1 -- 172.21.15.133:0/4166537703 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c340083f0 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae18c460 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3c843640 1 -- 172.21.15.133:0/4166537703 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3c340083f0 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae18dcc0 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3c843640 1 -- 172.21.15.133:0/4166537703 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3c340083f0 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae18cec0 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3c843640 1 -- 172.21.15.133:0/4166537703 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c340083f0 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae18d2d0 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3c843640 1 -- 172.21.15.133:0/4166537703 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3c34012040 con 0x55f7ae0952e0 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 Processor -- start 2024-02-15T23:29:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 -- start start 2024-02-15T23:29:54.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae19c3a0 0x55f7ae19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.555+0000 7f3c3e527980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7adf36f20 con 0x55f7ae19c3a0 2024-02-15T23:29:54.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3b841640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae19c3a0 0x55f7ae19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3b841640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae19c3a0 0x55f7ae19c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43522/0 (socket says 172.21.15.133:43522) 2024-02-15T23:29:54.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3b841640 1 -- 172.21.15.133:0/480674287 learned_addr learned my addr 172.21.15.133:0/480674287 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3b841640 1 -- 172.21.15.133:0/480674287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7ae19cd00 con 0x55f7ae19c3a0 2024-02-15T23:29:54.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3b841640 1 --2- 172.21.15.133:0/480674287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae19c3a0 0x55f7ae19c7c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400d660 tx=0x7f3c2400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3b21ffb640 1 -- 172.21.15.133:0/480674287 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c24020070 con 0x55f7ae19c3a0 2024-02-15T23:29:54.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3b21ffb640 1 -- 172.21.15.133:0/480674287 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2400c770 con 0x55f7ae19c3a0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3e527980 1 -- 172.21.15.133:0/480674287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f7ae19cf50 con 0x55f7ae19c3a0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3b21ffb640 1 -- 172.21.15.133:0/480674287 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c24013040 con 0x55f7ae19c3a0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3e527980 1 -- 172.21.15.133:0/480674287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7ae19daa0 con 0x55f7ae19c3a0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3b21ffb640 1 -- 172.21.15.133:0/480674287 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c2400a040 con 0x55f7ae19c3a0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3b21ffb640 1 --2- 172.21.15.133:0/480674287 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b14034300 0x7f3b140367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3b21ffb640 1 -- 172.21.15.133:0/480674287 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3c2404b590 con 0x55f7ae19c3a0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3c843640 1 --2- 172.21.15.133:0/480674287 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b14034300 0x7f3b140367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3e527980 1 Processor -- start 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3e527980 1 -- start start 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3c843640 1 --2- 172.21.15.133:0/480674287 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b14034300 0x7f3b140367c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55f7ae18c900 tx=0x7f3c34003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3e527980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1a9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.559+0000 7f3c3e527980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7adf2a790 con 0x55f7ae1a9370 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1a9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43524/0 (socket says 172.21.15.133:43524) 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 -- 172.21.15.133:0/2826556598 learned_addr learned my addr 172.21.15.133:0/2826556598 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 -- 172.21.15.133:0/2826556598 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7ae1a9d60 con 0x55f7ae1a9370 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 --2- 172.21.15.133:0/2826556598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1a9790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3c24049980 tx=0x7f3c24019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84edfb6434712acd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3b1b7fe640 1 -- 172.21.15.133:0/2826556598 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2401b920 con 0x55f7ae1a9370 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3b1b7fe640 1 -- 172.21.15.133:0/2826556598 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c24024c70 con 0x55f7ae1a9370 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3b1b7fe640 1 -- 172.21.15.133:0/2826556598 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c24024de0 con 0x55f7ae1a9370 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- 172.21.15.133:0/2826556598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 msgr2=0x55f7ae1a9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2826556598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1a9790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3c24049980 tx=0x7f3c24019a70 comp rx=0 tx=0).stop 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- 172.21.15.133:0/2826556598 shutdown_connections 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2826556598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1a9790 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- 172.21.15.133:0/2826556598 >> 172.21.15.133:0/2826556598 conn(0x55f7ae1a5700 msgr2=0x55f7ae1a3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- 172.21.15.133:0/2826556598 shutdown_connections 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- 172.21.15.133:0/2826556598 wait complete. 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 Processor -- start 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- start start 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7ae1b0810 con 0x55f7ae1a9370 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43534/0 (socket says 172.21.15.133:43534) 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 learned_addr learned my addr 172.21.15.133:0/2911585180 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7ae19daa0 con 0x55f7ae1a9370 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3b841640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1b02d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3c24047040 tx=0x7f3c24049910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3b19ffb640 1 -- 172.21.15.133:0/2911585180 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c24049e50 con 0x55f7ae1a9370 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3b19ffb640 1 -- 172.21.15.133:0/2911585180 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2401b920 con 0x55f7ae1a9370 2024-02-15T23:29:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f7ae1b0a10 con 0x55f7ae1a9370 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3b19ffb640 1 -- 172.21.15.133:0/2911585180 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2400cd90 con 0x55f7ae1a9370 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.563+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7ae1b0e40 con 0x55f7ae1a9370 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3b19ffb640 1 -- 172.21.15.133:0/2911585180 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c240480d0 con 0x55f7ae1a9370 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3b19ffb640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b0c0342b0 0x7f3b0c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3b19ffb640 1 -- 172.21.15.133:0/2911585180 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3c2400f070 con 0x55f7ae1a9370 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c843640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b0c0342b0 0x7f3b0c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae1bb820 0x55f7ae1bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1be430 con 0x55f7ae1bb820 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c042640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae1bb820 0x55f7ae1bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c843640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b0c0342b0 0x7f3b0c036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c34008fd0 tx=0x7f3c3401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c042640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae1bb820 0x55f7ae1bdce0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 realm 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1be800 con 0x55f7ae1bb820 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1bf080 con 0x55f7ae1bb820 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1bf3e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1bfbe0 con 0x55f7ae1bb820 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 20 searching for the correct realm 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f7ae1c1a70 0x55f7ae1c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.567+0000 7f3c3b841640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f7ae1c1a70 0x55f7ae1c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3b841640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f7ae1c1a70 0x55f7ae1c3f10 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3b841640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3c24048380 0x7f3c240320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c24048380 2024-02-15T23:29:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c843640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3c24048380 0x7f3c240320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c843640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3c24048380 0x7f3c240320b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c3402c040 con 0x7f3c24048380 2024-02-15T23:29:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c843640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3c34027940 0x7f3c340333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c042640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3c34027940 0x7f3c340333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c042640 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3c34027940 0x7f3c340333c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.571+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c24048380 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c3402c040 con 0x7f3c24048380 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c24048380 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3c3402c040 con 0x7f3c24048380 2024-02-15T23:29:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.575+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c24048380 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c3402c040 con 0x7f3c24048380 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x55f7ae1bb820 2024-02-15T23:29:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.579+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c24048380 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c3402c040 con 0x7f3c24048380 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c34027940 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2c0c3030 con 0x7f3c34027940 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c45e0 con 0x7f3c24048380 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c3402c040 con 0x7f3c24048380 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c04e0 con 0x55f7ae1bb820 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c0d30 con 0x55f7ae1bb820 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.583+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c4a20 con 0x55f7ae1bb820 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 zone default found 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 4 Realm: () 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 zonegroup default 2024-02-15T23:29:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c4a20 con 0x7f3c34027940 2024-02-15T23:29:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c68a0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c6c00 con 0x55f7ae1c1a70 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 started sync module instance, tier type = 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c5e70 con 0x7f3c24048380 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522266378784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c5e70 con 0x7f3c24048380 2024-02-15T23:29:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.587+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c7570 con 0x55f7ae1bb820 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.591+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522266378784] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.591+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.591+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522266382816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c5e70 con 0x55f7ae1bb820 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.591+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c7f30 con 0x55f7ae1c1a70 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.591+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522266382816] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.591+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.591+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522266376656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c5df0 con 0x55f7ae1c1a70 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.591+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c8bd0 con 0x7f3c24048380 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.595+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.595+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522266388576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c9420 con 0x7f3c24048380 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.595+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c9e40 con 0x55f7ae1bb820 2024-02-15T23:29:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.595+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522266376656] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.595+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522266388576] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.595+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.595+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522266392864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c8f80 con 0x55f7ae1bb820 2024-02-15T23:29:54.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.595+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1ca690 con 0x7f3c34027940 2024-02-15T23:29:54.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.599+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522266392864] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.599+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.599+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522266387088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c8f80 con 0x7f3c34027940 2024-02-15T23:29:54.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.599+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1cab10 con 0x7f3c34027940 2024-02-15T23:29:54.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.599+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.599+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522266396208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1caef0 con 0x7f3c34027940 2024-02-15T23:29:54.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.599+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1cb960 con 0x7f3c34027940 2024-02-15T23:29:54.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.599+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522266387088] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522266396208] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522266399808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1caa50 con 0x7f3c34027940 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3e527980 20 add_watcher() i=0 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3e527980 20 add_watcher() i=1 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3e527980 20 add_watcher() i=2 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3e527980 20 add_watcher() i=3 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3e527980 20 add_watcher() i=4 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3e527980 20 add_watcher() i=5 2024-02-15T23:29:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.603+0000 7f3c3e527980 20 add_watcher() i=6 2024-02-15T23:29:54.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522266399808] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 20 add_watcher() i=7 2024-02-15T23:29:54.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:54.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1cea60 con 0x55f7ae1bb820 2024-02-15T23:29:54.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522266394576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1cbed0 con 0x55f7ae1bb820 2024-02-15T23:29:54.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522266394576] v31'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3af2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 5 note: GC not initialized 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3af1fe3640 20 reqs_thread_entry: start 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 20 Filter name: none 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3aeaffd640 20 reqs_thread_entry: start 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.607+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f07a0 con 0x7f3c34027940 2024-02-15T23:29:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T23:29:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T23:29:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f2220 con 0x7f3c24048380 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f3920 con 0x55f7ae1bb820 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(64 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:54.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-15T23:29:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f7bd0 con 0x7f3c24048380 2024-02-15T23:29:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(65 foo.buckets [call] v31'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.611+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1fdbe0 con 0x55f7ae1bb820 2024-02-15T23:29:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(66 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'4 uv4 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:54.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1, ofs0, ns] 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94522266566096 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f7fc0 con 0x55f7ae1bb820 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94522266392864 notify 133143986188 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55f7ae090ee0 con 0x55f7ae1bb820 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3b1b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94522266392864 notifier 4500 bl.length()=725 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3b1b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3b1b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3b1b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(67 notify.4 [notify cookie 94522266566096 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3b1b7fe640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3b00003ea0 con 0x55f7ae1bb820 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 94522266566096 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f7ae092a40 con 0x55f7ae1bb820 2024-02-15T23:29:54.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_sources= new_sources= 2024-02-15T23:29:54.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential sources added=[] removed=[] 2024-02-15T23:29:54.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_dests= new_dests= 2024-02-15T23:29:54.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential dests added=[] removed=[] 2024-02-15T23:29:54.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.615+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f3ed0 con 0x7f3c34027940 2024-02-15T23:29:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 fud.buckets [call] v31'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f3ed0 con 0x7f3c24048380 2024-02-15T23:29:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3e527980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T23:29:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3e527980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3e527980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T23:29:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94522266566352 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1fc850 con 0x7f3c34027940 2024-02-15T23:29:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== watch-notify(notify (1) cookie 94522266396208 notify 133143986188 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x55f7ae092a40 con 0x7f3c34027940 2024-02-15T23:29:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3b1b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94522266396208 notifier 4500 bl.length()=314 2024-02-15T23:29:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3b1b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T23:29:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3b1b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3b1b7fe640 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3b00004200 con 0x7f3c34027940 2024-02-15T23:29:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.619+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(71 notify.6 [notify cookie 94522266566352 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.623+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.623+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== watch-notify(notify_complete (2) cookie 94522266566352 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f7ae099e90 con 0x7f3c34027940 2024-02-15T23:29:54.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.623+0000 7f3af2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.623+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522266394576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f3ed0 con 0x55f7ae1bb820 2024-02-15T23:29:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.623+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94522266394576] v31'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.623+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522266378784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1f3ed0 con 0x7f3c24048380 2024-02-15T23:29:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.627+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94522266378784] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.627+0000 7f3c3e527980 20 remove_watcher() i=0 2024-02-15T23:29:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.627+0000 7f3c3e527980 2 removed watcher, disabling cache 2024-02-15T23:29:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.627+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522266382816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c0d30 con 0x55f7ae1bb820 2024-02-15T23:29:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.627+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94522266382816] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.627+0000 7f3c3e527980 20 remove_watcher() i=1 2024-02-15T23:29:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.627+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522266376656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c0d30 con 0x55f7ae1c1a70 2024-02-15T23:29:54.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3b841640 1 -- 172.21.15.133:0/2911585180 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94522266376656] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x55f7ae1c1a70 2024-02-15T23:29:54.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3e527980 20 remove_watcher() i=2 2024-02-15T23:29:54.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522266388576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c59d0 con 0x7f3c24048380 2024-02-15T23:29:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3c843640 1 -- 172.21.15.133:0/2911585180 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94522266388576] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c3403f040 con 0x7f3c24048380 2024-02-15T23:29:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3e527980 20 remove_watcher() i=3 2024-02-15T23:29:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522266392864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c59d0 con 0x55f7ae1bb820 2024-02-15T23:29:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94522266392864] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x55f7ae1bb820 2024-02-15T23:29:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3e527980 20 remove_watcher() i=4 2024-02-15T23:29:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.631+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522266387088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c59d0 con 0x7f3c34027940 2024-02-15T23:29:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.635+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94522266387088] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.635+0000 7f3c3e527980 20 remove_watcher() i=5 2024-02-15T23:29:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.635+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522266396208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c8290 con 0x7f3c34027940 2024-02-15T23:29:54.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94522266396208] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 20 remove_watcher() i=6 2024-02-15T23:29:54.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522266399808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ae1c59d0 con 0x7f3c34027940 2024-02-15T23:29:54.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94522266399808] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2c0f0080 con 0x7f3c34027940 2024-02-15T23:29:54.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 20 remove_watcher() i=7 2024-02-15T23:29:54.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3c34027940 msgr2=0x7f3c340333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3c34027940 0x7f3c340333c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae1bb820 msgr2=0x55f7ae1bdce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae1bb820 0x55f7ae1bdce0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3c24048380 msgr2=0x7f3c240320b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3c24048380 0x7f3c240320b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f7ae1c1a70 msgr2=0x55f7ae1c3f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f7ae1c1a70 0x55f7ae1c3f10 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b0c0342b0 msgr2=0x7f3b0c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b0c0342b0 0x7f3b0c036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c34008fd0 tx=0x7f3c3401c070 comp rx=0 tx=0).stop 2024-02-15T23:29:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3c042640 1 -- 172.21.15.133:0/2911585180 reap_dead start 2024-02-15T23:29:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 msgr2=0x55f7ae1b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1b02d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3c24047040 tx=0x7f3c24049910 comp rx=0 tx=0).stop 2024-02-15T23:29:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 shutdown_connections 2024-02-15T23:29:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/2911585180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae1a9370 0x55f7ae1b02d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 >> 172.21.15.133:0/2911585180 conn(0x55f7ae1a5700 msgr2=0x55f7ae1a2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 shutdown_connections 2024-02-15T23:29:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/2911585180 wait complete. 2024-02-15T23:29:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/480674287 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b14034300 msgr2=0x7f3b140367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/480674287 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b14034300 0x7f3b140367c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55f7ae18c900 tx=0x7f3c34003070 comp rx=0 tx=0).stop 2024-02-15T23:29:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/480674287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae19c3a0 msgr2=0x55f7ae19c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/480674287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae19c3a0 0x55f7ae19c7c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400d660 tx=0x7f3c2400da60 comp rx=0 tx=0).stop 2024-02-15T23:29:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/480674287 shutdown_connections 2024-02-15T23:29:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/480674287 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b14034300 0x7f3b140367c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 --2- 172.21.15.133:0/480674287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae19c3a0 0x55f7ae19c7c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.639+0000 7f3c3e527980 1 -- 172.21.15.133:0/480674287 >> 172.21.15.133:0/480674287 conn(0x55f7ae1911b0 msgr2=0x55f7ae191cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/480674287 shutdown_connections 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/480674287 wait complete. 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae0952e0 msgr2=0x55f7ae18bbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae0952e0 0x55f7ae18bbc0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b240342b0 msgr2=0x7f3b24036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b240342b0 0x7f3b24036770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c24001dc0 tx=0x7f3c24001360 comp rx=0 tx=0).stop 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 msgr2=0x55f7ae092500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae092500 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000f90 tx=0x7f3c2c017d70 comp rx=0 tx=0).stop 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 shutdown_connections 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f7ae0952e0 0x55f7ae18bbc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3b240342b0 0x7f3b24036770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 --2- 172.21.15.133:0/4166537703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7ae006020 0x55f7ae092500 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 >> 172.21.15.133:0/4166537703 conn(0x55f7ae08c880 msgr2=0x55f7ae176560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 shutdown_connections 2024-02-15T23:29:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.643+0000 7f3c3e527980 1 -- 172.21.15.133:0/4166537703 wait complete. 2024-02-15T23:29:54.661 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-15T23:29:54.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-15T23:29:54.662 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-15T23:29:54.741 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:54.742 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:54.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd381396980 1 Processor -- start 2024-02-15T23:29:54.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd381396980 1 -- start start 2024-02-15T23:29:54.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd381396980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557b68ea4680 0x557b68ea6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd381396980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557b68dec4c0 con 0x557b68ea0170 2024-02-15T23:29:54.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd381396980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x557b68db3180 con 0x557b68ea4680 2024-02-15T23:29:54.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd37e6b0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557b68ea4680 0x557b68ea6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd37eeb1640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x557b68ea0170 0x557b68ea0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:39986/0 (socket says 172.21.15.133:39986) 2024-02-15T23:29:54.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd37eeb1640 1 -- 172.21.15.133:0/3716063565 learned_addr learned my addr 172.21.15.133:0/3716063565 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:54.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd37deaf640 1 -- 172.21.15.133:0/3716063565 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728431196 0 0) 0x557b68dec4c0 con 0x557b68ea0170 2024-02-15T23:29:54.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd37e6b0640 1 -- 172.21.15.133:0/3716063565 >> v1:172.21.15.131:6789/0 conn(0x557b68ea0170 legacy=0x557b68ea0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.735+0000 7fd37e6b0640 1 -- 172.21.15.133:0/3716063565 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b68ea7fc0 con 0x557b68ea4680 2024-02-15T23:29:54.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/3716063565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea4680 0x557b68ea6a70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd36800a480 tx=0x7fd36801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dd58abec5f20f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd37deaf640 1 -- 172.21.15.133:0/3716063565 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3680ab540 con 0x557b68ea4680 2024-02-15T23:29:54.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd37deaf640 1 -- 172.21.15.133:0/3716063565 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680ab6a0 con 0x557b68ea4680 2024-02-15T23:29:54.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd37deaf640 1 -- 172.21.15.133:0/3716063565 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3680ab960 con 0x557b68ea4680 2024-02-15T23:29:54.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd381396980 1 -- 172.21.15.133:0/3716063565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea4680 msgr2=0x557b68ea6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd381396980 1 --2- 172.21.15.133:0/3716063565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea4680 0x557b68ea6a70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd36800a480 tx=0x7fd36801b280 comp rx=0 tx=0).stop 2024-02-15T23:29:54.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd381396980 1 -- 172.21.15.133:0/3716063565 shutdown_connections 2024-02-15T23:29:54.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd381396980 1 --2- 172.21.15.133:0/3716063565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea4680 0x557b68ea6a70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd381396980 1 -- 172.21.15.133:0/3716063565 >> 172.21.15.133:0/3716063565 conn(0x557b68e9ba40 msgr2=0x557b68e9de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd381396980 1 -- 172.21.15.133:0/3716063565 shutdown_connections 2024-02-15T23:29:54.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.739+0000 7fd381396980 1 -- 172.21.15.133:0/3716063565 wait complete. 2024-02-15T23:29:54.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 Processor -- start 2024-02-15T23:29:54.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 -- start start 2024-02-15T23:29:54.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f89e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b68db06b0 con 0x557b68ea0170 2024-02-15T23:29:54.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd37eeb1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f89e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd37eeb1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f89e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43556/0 (socket says 172.21.15.133:43556) 2024-02-15T23:29:54.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2281127641 learned_addr learned my addr 172.21.15.133:0/2281127641 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2281127641 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368005d30 con 0x557b68ea0170 2024-02-15T23:29:54.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd37eeb1640 1 --2- 172.21.15.133:0/2281127641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f89e90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd37000b250 tx=0x7fd37000b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada4d2d30989a94c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd26ce09640 1 -- 172.21.15.133:0/2281127641 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd370014070 con 0x557b68ea0170 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd26ce09640 1 -- 172.21.15.133:0/2281127641 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37000d640 con 0x557b68ea0170 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd26ce09640 1 -- 172.21.15.133:0/2281127641 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd37000d960 con 0x557b68ea0170 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 -- 172.21.15.133:0/2281127641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 msgr2=0x557b68f89e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 --2- 172.21.15.133:0/2281127641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f89e90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd37000b250 tx=0x7fd37000b710 comp rx=0 tx=0).stop 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 -- 172.21.15.133:0/2281127641 shutdown_connections 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 --2- 172.21.15.133:0/2281127641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f89e90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.755+0000 7fd381396980 1 -- 172.21.15.133:0/2281127641 >> 172.21.15.133:0/2281127641 conn(0x557b68e9ba40 msgr2=0x557b68f85a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd381396980 1 -- 172.21.15.133:0/2281127641 shutdown_connections 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd381396980 1 -- 172.21.15.133:0/2281127641 wait complete. 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd381396980 1 Processor -- start 2024-02-15T23:29:54.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd381396980 1 -- start start 2024-02-15T23:29:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd381396980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f90d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd381396980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b68dabe90 con 0x557b68ea0170 2024-02-15T23:29:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd37eeb1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f90d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd37eeb1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f90d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43560/0 (socket says 172.21.15.133:43560) 2024-02-15T23:29:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd37eeb1640 1 -- 172.21.15.133:0/4035089832 learned_addr learned my addr 172.21.15.133:0/4035089832 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd37eeb1640 1 -- 172.21.15.133:0/4035089832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370001bb0 con 0x557b68ea0170 2024-02-15T23:29:54.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd37eeb1640 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f90d80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x557b68f8ad20 tx=0x7fd370000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd26b606640 1 -- 172.21.15.133:0/4035089832 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3700012c0 con 0x557b68ea0170 2024-02-15T23:29:54.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b68f912c0 con 0x557b68ea0170 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd26b606640 1 -- 172.21.15.133:0/4035089832 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370021070 con 0x557b68ea0170 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd26b606640 1 -- 172.21.15.133:0/4035089832 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd37000fae0 con 0x557b68ea0170 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b68f91770 con 0x557b68ea0170 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd26b606640 1 -- 172.21.15.133:0/4035089832 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd37000fc40 con 0x557b68ea0170 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd26b606640 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2640342b0 0x7fd264036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.759+0000 7fd26b606640 1 -- 172.21.15.133:0/4035089832 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd37004a140 con 0x557b68ea0170 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2640342b0 0x7fd264036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68ea4680 0x557b68f97a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68f97f60 con 0x557b68ea4680 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68ea4680 0x557b68f97a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2640342b0 0x7fd264036770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd3680ad000 tx=0x7fd3680a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68ea4680 0x557b68f97a20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37f6b2640 1 -- 172.21.15.133:0/4035089832 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd37800a4d0 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68f98350 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37f6b2640 1 -- 172.21.15.133:0/4035089832 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd37800a4d0 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68f99c00 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37f6b2640 1 -- 172.21.15.133:0/4035089832 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd37800a4d0 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68f98e00 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37f6b2640 1 -- 172.21.15.133:0/4035089832 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd37800a4d0 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68f99210 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37f6b2640 1 -- 172.21.15.133:0/4035089832 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd37800a4d0 con 0x557b68ea4680 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 Processor -- start 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 -- start start 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fa82e0 0x557b68fa8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd381396980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b68d44f20 con 0x557b68fa82e0 2024-02-15T23:29:54.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37e6b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fa82e0 0x557b68fa8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37e6b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fa82e0 0x557b68fa8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43566/0 (socket says 172.21.15.133:43566) 2024-02-15T23:29:54.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.763+0000 7fd37e6b0640 1 -- 172.21.15.133:0/3279204601 learned_addr learned my addr 172.21.15.133:0/3279204601 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd37e6b0640 1 -- 172.21.15.133:0/3279204601 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b68fa8c40 con 0x557b68fa82e0 2024-02-15T23:29:54.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/3279204601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fa82e0 0x557b68fa8700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd3680ab670 tx=0x7fd368018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd268e01640 1 -- 172.21.15.133:0/3279204601 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3680be7c0 con 0x557b68fa82e0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd381396980 1 -- 172.21.15.133:0/3279204601 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b68fa8e30 con 0x557b68fa82e0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd268e01640 1 -- 172.21.15.133:0/3279204601 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680be920 con 0x557b68fa82e0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd268e01640 1 -- 172.21.15.133:0/3279204601 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3680bebc0 con 0x557b68fa82e0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd381396980 1 -- 172.21.15.133:0/3279204601 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b68fa9980 con 0x557b68fa82e0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd268e01640 1 -- 172.21.15.133:0/3279204601 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3680bd3e0 con 0x557b68fa82e0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd268e01640 1 --2- 172.21.15.133:0/3279204601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2580342b0 0x7fd258036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd268e01640 1 -- 172.21.15.133:0/3279204601 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd3680e6300 con 0x557b68fa82e0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/3279204601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2580342b0 0x7fd258036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd381396980 1 Processor -- start 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd381396980 1 -- start start 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/3279204601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2580342b0 0x7fd258036770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x557b68f98840 tx=0x7fd378005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd381396980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fb56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd381396980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b68d38790 con 0x557b68fb52b0 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd37e6b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fb56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd37e6b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fb56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43582/0 (socket says 172.21.15.133:43582) 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd37e6b0640 1 -- 172.21.15.133:0/1606233045 learned_addr learned my addr 172.21.15.133:0/1606233045 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.767+0000 7fd37e6b0640 1 -- 172.21.15.133:0/1606233045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b68fb5ca0 con 0x557b68fb52b0 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/1606233045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fb56d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3680e46f0 tx=0x7fd3680c5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab13da249c60372 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd2627fc640 1 -- 172.21.15.133:0/1606233045 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3680e60d0 con 0x557b68fb52b0 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd2627fc640 1 -- 172.21.15.133:0/1606233045 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680bd690 con 0x557b68fb52b0 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd2627fc640 1 -- 172.21.15.133:0/1606233045 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3680b4c10 con 0x557b68fb52b0 2024-02-15T23:29:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- 172.21.15.133:0/1606233045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 msgr2=0x557b68fb56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 --2- 172.21.15.133:0/1606233045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fb56d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3680e46f0 tx=0x7fd3680c5f50 comp rx=0 tx=0).stop 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- 172.21.15.133:0/1606233045 shutdown_connections 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 --2- 172.21.15.133:0/1606233045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fb56d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- 172.21.15.133:0/1606233045 >> 172.21.15.133:0/1606233045 conn(0x557b68fb1640 msgr2=0x557b68faf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- 172.21.15.133:0/1606233045 shutdown_connections 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- 172.21.15.133:0/1606233045 wait complete. 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 Processor -- start 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- start start 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fbc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b68fbc750 con 0x557b68fb52b0 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd37e6b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fbc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd37e6b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fbc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43586/0 (socket says 172.21.15.133:43586) 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 learned_addr learned my addr 172.21.15.133:0/2048489758 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b68fa9980 con 0x557b68fb52b0 2024-02-15T23:29:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fbc210 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b5ec0 tx=0x7fd3680e4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd260ff9640 1 -- 172.21.15.133:0/2048489758 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3680bd800 con 0x557b68fb52b0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b68fbc950 con 0x557b68fb52b0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd260ff9640 1 -- 172.21.15.133:0/2048489758 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680e60d0 con 0x557b68fb52b0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd260ff9640 1 -- 172.21.15.133:0/2048489758 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3680aae90 con 0x557b68fb52b0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.771+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b68fbcd80 con 0x557b68fb52b0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd260ff9640 1 -- 172.21.15.133:0/2048489758 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3680e4830 con 0x557b68fb52b0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd260ff9640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd248034300 0x7fd2480367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd260ff9640 1 -- 172.21.15.133:0/2048489758 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd3680f2ca0 con 0x557b68fb52b0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd248034300 0x7fd2480367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68fc7620 0x557b68fc9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fca230 con 0x557b68fc7620 2024-02-15T23:29:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37eeb1640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68fc7620 0x557b68fc9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd248034300 0x7fd2480367c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd378011010 tx=0x7fd378020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37eeb1640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68fc7620 0x557b68fc9ae0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 realm 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fca600 con 0x557b68fc7620 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fcae80 con 0x557b68fc7620 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fcb1e0 con 0x557b68fc7620 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fcb9e0 con 0x557b68fc7620 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 20 searching for the correct realm 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b68fcd870 0x557b68fcfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd03b0 con 0x557b68fcd870 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b68fcd870 0x557b68fcfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.775+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b68fcd870 0x557b68fcfce0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37e6b0640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd3680f1060 0x7fd3680c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd03b0 con 0x7fd3680f1060 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd3680f1060 0x7fd3680c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd3680f1060 0x7fd3680c8070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd37800a4d0 con 0x7fd3680f1060 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37f6b2640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd3780141d0 0x7fd378015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd03b0 con 0x7fd3780141d0 2024-02-15T23:29:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd3780141d0 0x7fd378015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd3780141d0 0x7fd378015940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd03b0 con 0x557b68fc7620 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd03b0 con 0x557b68fc7620 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd03b0 con 0x7fd3780141d0 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.779+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3780141d0 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3680f1060 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd37800a4d0 con 0x7fd3680f1060 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fcd870 2024-02-15T23:29:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fc7620 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3780141d0 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fc7620 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3680f1060 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fcd870 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fcd870 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3780141d0 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fcd870 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.783+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fcd870 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fc7620 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fc7620 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3780141d0 2024-02-15T23:29:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fcd870 2024-02-15T23:29:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3680f1060 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fc7620 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3780141d0 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fcd870 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3780141d0 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.787+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3680f1060 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fcd870 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3780141d0 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x557b68fc7620 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd37003e040 con 0x7fd3680f1060 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fcc310 con 0x557b68fc7620 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fccb60 con 0x557b68fc7620 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fccb60 con 0x557b68fc7620 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 zone default found 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 4 Realm: () 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 zonegroup default 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fccb60 con 0x7fd3780141d0 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd21d0 con 0x557b68fcd870 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd2530 con 0x557b68fcd870 2024-02-15T23:29:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.791+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd381396980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd381396980 20 started sync module instance, tier type = 2024-02-15T23:29:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd381396980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd1ab0 con 0x7fd3680f1060 2024-02-15T23:29:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93988530755088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd1a30 con 0x7fd3680f1060 2024-02-15T23:29:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd3240 con 0x557b68fc7620 2024-02-15T23:29:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93988530755088] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93988530759936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd1a30 con 0x557b68fc7620 2024-02-15T23:29:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.795+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd38e0 con 0x557b68fcd870 2024-02-15T23:29:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.799+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.799+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93988530762720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd4130 con 0x557b68fcd870 2024-02-15T23:29:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.799+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd4b00 con 0x7fd3680f1060 2024-02-15T23:29:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.799+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93988530759936] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.799+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.799+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93988530767360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd4eb0 con 0x7fd3680f1060 2024-02-15T23:29:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.799+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd5860 con 0x557b68fc7620 2024-02-15T23:29:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93988530762720] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93988530767360] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93988530760992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd5380 con 0x557b68fc7620 2024-02-15T23:29:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd60b0 con 0x7fd3780141d0 2024-02-15T23:29:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93988530760992] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93988530764944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd5da0 con 0x7fd3780141d0 2024-02-15T23:29:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.803+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd65e0 con 0x7fd3780141d0 2024-02-15T23:29:54.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93988530773408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd6bb0 con 0x7fd3780141d0 2024-02-15T23:29:54.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd7430 con 0x7fd3780141d0 2024-02-15T23:29:54.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93988530764944] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93988530773408] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93988530772224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd6bb0 con 0x7fd3780141d0 2024-02-15T23:29:54.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 20 add_watcher() i=0 2024-02-15T23:29:54.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 20 add_watcher() i=1 2024-02-15T23:29:54.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 20 add_watcher() i=2 2024-02-15T23:29:54.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 20 add_watcher() i=3 2024-02-15T23:29:54.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 20 add_watcher() i=4 2024-02-15T23:29:54.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 20 add_watcher() i=5 2024-02-15T23:29:54.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.807+0000 7fd381396980 20 add_watcher() i=6 2024-02-15T23:29:54.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93988530772224] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd381396980 20 add_watcher() i=7 2024-02-15T23:29:54.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd381396980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:54.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fda640 con 0x557b68fc7620 2024-02-15T23:29:54.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93988530775792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd7ab0 con 0x557b68fc7620 2024-02-15T23:29:54.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93988530775792] v31'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd2357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd381396980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:54.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd381396980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.811+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe2960 con 0x557b68fc7620 2024-02-15T23:29:54.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.815+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.815+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe2da0 con 0x7fd3780141d0 2024-02-15T23:29:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.815+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.815+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe3240 con 0x557b68fcd870 2024-02-15T23:29:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.819+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.819+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe3a40 con 0x557b68fc7620 2024-02-15T23:29:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.819+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'113 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.819+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe0940 con 0x7fd3680f1060 2024-02-15T23:29:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.819+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.819+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe0940 con 0x557b68fcd870 2024-02-15T23:29:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.823+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'21 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.823+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe4c20 con 0x557b68fc7620 2024-02-15T23:29:54.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.823+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.823+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe4c20 con 0x7fd3780141d0 2024-02-15T23:29:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.827+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.827+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe4c20 con 0x7fd3680f1060 2024-02-15T23:29:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.827+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.827+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe5150 con 0x557b68fcd870 2024-02-15T23:29:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.827+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.827+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe5b20 con 0x7fd3680f1060 2024-02-15T23:29:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.831+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.831+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdf9f0 con 0x7fd3780141d0 2024-02-15T23:29:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.831+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.831+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdf9f0 con 0x7fd3680f1060 2024-02-15T23:29:54.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.835+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.835+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdf9c0 con 0x7fd3780141d0 2024-02-15T23:29:54.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.835+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'27 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.835+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdfb90 con 0x557b68fc7620 2024-02-15T23:29:54.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.835+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'114 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.835+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdfb90 con 0x557b68fcd870 2024-02-15T23:29:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.839+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.839+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x7fd3680f1060 2024-02-15T23:29:54.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.839+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.839+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fcd870 2024-02-15T23:29:54.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.843+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.843+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fc7620 2024-02-15T23:29:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.843+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.843+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fc7620 2024-02-15T23:29:54.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.847+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'115 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.847+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fcd870 2024-02-15T23:29:54.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.847+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.847+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x7fd3680f1060 2024-02-15T23:29:54.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.847+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.847+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fcd870 2024-02-15T23:29:54.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.851+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.851+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fcd870 2024-02-15T23:29:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.851+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.851+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fcd870 2024-02-15T23:29:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.851+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.851+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fcd870 2024-02-15T23:29:54.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.855+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.855+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x7fd3780141d0 2024-02-15T23:29:54.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.855+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.855+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fcd870 2024-02-15T23:29:54.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.859+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.859+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x7fd3780141d0 2024-02-15T23:29:54.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.859+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.859+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x557b68fcd870 2024-02-15T23:29:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.863+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.863+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x7fd3780141d0 2024-02-15T23:29:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.863+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'28 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.863+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fe6690 con 0x7fd3680f1060 2024-02-15T23:29:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd1affff640 20 reqs_thread_entry: start 2024-02-15T23:29:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 20 Filter name: none 2024-02-15T23:29:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd1adffb640 20 reqs_thread_entry: start 2024-02-15T23:29:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:29:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 20 rados->read ofs=0 len=0 2024-02-15T23:29:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdf140 con 0x7fd3780141d0 2024-02-15T23:29:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T23:29:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T23:29:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdf560 con 0x7fd3780141d0 2024-02-15T23:29:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.867+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-15T23:29:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.871+0000 7fd2357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:54.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.871+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93988530775792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdf560 con 0x557b68fc7620 2024-02-15T23:29:54.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.871+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93988530775792] v31'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.871+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93988530755088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fdf510 con 0x7fd3680f1060 2024-02-15T23:29:54.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.871+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93988530755088] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.871+0000 7fd381396980 20 remove_watcher() i=0 2024-02-15T23:29:54.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.871+0000 7fd381396980 2 removed watcher, disabling cache 2024-02-15T23:29:54.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.871+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93988530759936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd1610 con 0x557b68fc7620 2024-02-15T23:29:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.875+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93988530759936] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.875+0000 7fd381396980 20 remove_watcher() i=1 2024-02-15T23:29:54.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.875+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93988530762720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd1610 con 0x557b68fcd870 2024-02-15T23:29:54.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.875+0000 7fd37e6b0640 1 -- 172.21.15.133:0/2048489758 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93988530762720] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3680bfc50 con 0x557b68fcd870 2024-02-15T23:29:54.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.875+0000 7fd381396980 20 remove_watcher() i=2 2024-02-15T23:29:54.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.875+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93988530767360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd1610 con 0x7fd3680f1060 2024-02-15T23:29:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.879+0000 7fd37f6b2640 1 -- 172.21.15.133:0/2048489758 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93988530767360] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd37803a040 con 0x7fd3680f1060 2024-02-15T23:29:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.879+0000 7fd381396980 20 remove_watcher() i=3 2024-02-15T23:29:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.879+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93988530760992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd4600 con 0x557b68fc7620 2024-02-15T23:29:54.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.879+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93988530760992] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x557b68fc7620 2024-02-15T23:29:54.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.879+0000 7fd381396980 20 remove_watcher() i=4 2024-02-15T23:29:54.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.879+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93988530764944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd4600 con 0x7fd3780141d0 2024-02-15T23:29:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.883+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93988530764944] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370016070 con 0x7fd3780141d0 2024-02-15T23:29:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.883+0000 7fd381396980 20 remove_watcher() i=5 2024-02-15T23:29:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.883+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93988530773408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd3c90 con 0x7fd3780141d0 2024-02-15T23:29:54.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.883+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93988530773408] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370064040 con 0x7fd3780141d0 2024-02-15T23:29:54.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.883+0000 7fd381396980 20 remove_watcher() i=6 2024-02-15T23:29:54.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.883+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93988530772224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557b68fd5da0 con 0x7fd3780141d0 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93988530772224] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd370064040 con 0x7fd3780141d0 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 20 remove_watcher() i=7 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd3780141d0 msgr2=0x7fd378015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd3780141d0 0x7fd378015940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68fc7620 msgr2=0x557b68fc9ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68fc7620 0x557b68fc9ae0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd3680f1060 msgr2=0x7fd3680c8070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd3680f1060 0x7fd3680c8070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b68fcd870 msgr2=0x557b68fcfce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b68fcd870 0x557b68fcfce0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd248034300 msgr2=0x7fd2480367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd248034300 0x7fd2480367c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd378011010 tx=0x7fd378020000 comp rx=0 tx=0).stop 2024-02-15T23:29:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 msgr2=0x557b68fbc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd37eeb1640 1 -- 172.21.15.133:0/2048489758 reap_dead start 2024-02-15T23:29:54.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fbc210 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b5ec0 tx=0x7fd3680e4680 comp rx=0 tx=0).stop 2024-02-15T23:29:54.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 shutdown_connections 2024-02-15T23:29:54.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/2048489758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fb52b0 0x557b68fbc210 secure :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b5ec0 tx=0x7fd3680e4680 comp rx=0 tx=0).stop 2024-02-15T23:29:54.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 >> 172.21.15.133:0/2048489758 conn(0x557b68fb1640 msgr2=0x557b68faeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 shutdown_connections 2024-02-15T23:29:54.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/2048489758 wait complete. 2024-02-15T23:29:54.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/3279204601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2580342b0 msgr2=0x7fd258036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/3279204601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2580342b0 0x7fd258036770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x557b68f98840 tx=0x7fd378005850 comp rx=0 tx=0).stop 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/3279204601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fa82e0 msgr2=0x557b68fa8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/3279204601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fa82e0 0x557b68fa8700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd3680ab670 tx=0x7fd368018020 comp rx=0 tx=0).stop 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/3279204601 shutdown_connections 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/3279204601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2580342b0 0x7fd258036770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 --2- 172.21.15.133:0/3279204601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68fa82e0 0x557b68fa8700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/3279204601 >> 172.21.15.133:0/3279204601 conn(0x557b68f9d0f0 msgr2=0x557b68f9dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/3279204601 shutdown_connections 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.887+0000 7fd381396980 1 -- 172.21.15.133:0/3279204601 wait complete. 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68ea4680 msgr2=0x557b68f97a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68ea4680 0x557b68f97a20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2640342b0 msgr2=0x7fd264036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2640342b0 0x7fd264036770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd3680ad000 tx=0x7fd3680a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 msgr2=0x557b68f90d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f90d80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x557b68f8ad20 tx=0x7fd370000ee0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 shutdown_connections 2024-02-15T23:29:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b68ea4680 0x557b68f97a20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd2640342b0 0x7fd264036770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 --2- 172.21.15.133:0/4035089832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b68ea0170 0x557b68f90d80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 >> 172.21.15.133:0/4035089832 conn(0x557b68e9ba40 msgr2=0x557b68f84530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 shutdown_connections 2024-02-15T23:29:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.891+0000 7fd381396980 1 -- 172.21.15.133:0/4035089832 wait complete. 2024-02-15T23:29:54.909 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-15T23:29:54.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-15T23:29:54.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-15T23:29:54.910 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-02-15T23:29:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb9688980 1 Processor -- start 2024-02-15T23:29:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb9688980 1 -- start start 2024-02-15T23:29:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb9688980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56011122b910 0x5601112b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb9688980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5601112034d0 con 0x5601112ba340 2024-02-15T23:29:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb9688980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5601111ca180 con 0x56011122b910 2024-02-15T23:29:54.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb71a3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56011122b910 0x5601112b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:54.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb69a2640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5601112ba340 0x5601112bc730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:40000/0 (socket says 172.21.15.133:40000) 2024-02-15T23:29:54.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3630816993 learned_addr learned my addr 172.21.15.133:0/3630816993 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:54.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb61a1640 1 -- 172.21.15.133:0/3630816993 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277187885 0 0) 0x5601112034d0 con 0x5601112ba340 2024-02-15T23:29:54.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb61a1640 1 -- 172.21.15.133:0/3630816993 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea4001e20 con 0x5601112ba340 2024-02-15T23:29:54.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3630816993 >> v1:172.21.15.131:6789/0 conn(0x5601112ba340 legacy=0x5601112bc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.983+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3630816993 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601112beef0 con 0x56011122b910 2024-02-15T23:29:54.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb71a3640 1 --2- 172.21.15.133:0/3630816993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b9e00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800a480 tx=0x7f3ea801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adcfb4b187a0c99 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:54.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb61a1640 1 -- 172.21.15.133:0/3630816993 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea80ab540 con 0x56011122b910 2024-02-15T23:29:54.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb61a1640 1 -- 172.21.15.133:0/3630816993 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea80ab6a0 con 0x56011122b910 2024-02-15T23:29:54.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb61a1640 1 -- 172.21.15.133:0/3630816993 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea80ab960 con 0x56011122b910 2024-02-15T23:29:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb9688980 1 -- 172.21.15.133:0/3630816993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 msgr2=0x5601112b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3630816993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b9e00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800a480 tx=0x7f3ea801b280 comp rx=0 tx=0).stop 2024-02-15T23:29:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb9688980 1 -- 172.21.15.133:0/3630816993 shutdown_connections 2024-02-15T23:29:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3630816993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b9e00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb9688980 1 -- 172.21.15.133:0/3630816993 >> 172.21.15.133:0/3630816993 conn(0x5601112b1920 msgr2=0x5601112b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.987+0000 7f3eb9688980 1 -- 172.21.15.133:0/3630816993 shutdown_connections 2024-02-15T23:29:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:54.991+0000 7f3eb9688980 1 -- 172.21.15.133:0/3630816993 wait complete. 2024-02-15T23:29:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.003+0000 7f3eb9688980 1 Processor -- start 2024-02-15T23:29:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.003+0000 7f3eb9688980 1 -- start start 2024-02-15T23:29:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.003+0000 7f3eb9688980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601113a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.003+0000 7f3eb9688980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601111c76b0 con 0x56011122b910 2024-02-15T23:29:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb71a3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601113a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb71a3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601113a0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43594/0 (socket says 172.21.15.133:43594) 2024-02-15T23:29:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb71a3640 1 -- 172.21.15.133:0/1154765195 learned_addr learned my addr 172.21.15.133:0/1154765195 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb71a3640 1 -- 172.21.15.133:0/1154765195 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8005d30 con 0x56011122b910 2024-02-15T23:29:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb71a3640 1 --2- 172.21.15.133:0/1154765195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601113a0f70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8018eb0 tx=0x7f3ea8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45672d97dc5d95 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3da560a640 1 -- 172.21.15.133:0/1154765195 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea80ab810 con 0x56011122b910 2024-02-15T23:29:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3da560a640 1 -- 172.21.15.133:0/1154765195 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea80ab970 con 0x56011122b910 2024-02-15T23:29:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3da560a640 1 -- 172.21.15.133:0/1154765195 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea80abc10 con 0x56011122b910 2024-02-15T23:29:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 -- 172.21.15.133:0/1154765195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 msgr2=0x5601113a0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 --2- 172.21.15.133:0/1154765195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601113a0f70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8018eb0 tx=0x7f3ea8003030 comp rx=0 tx=0).stop 2024-02-15T23:29:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 -- 172.21.15.133:0/1154765195 shutdown_connections 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 --2- 172.21.15.133:0/1154765195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601113a0f70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 -- 172.21.15.133:0/1154765195 >> 172.21.15.133:0/1154765195 conn(0x5601112b1920 msgr2=0x56011139cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 -- 172.21.15.133:0/1154765195 shutdown_connections 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 -- 172.21.15.133:0/1154765195 wait complete. 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 Processor -- start 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 -- start start 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb9688980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601111c2e90 con 0x56011122b910 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb71a3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb71a3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43608/0 (socket says 172.21.15.133:43608) 2024-02-15T23:29:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.007+0000 7f3eb71a3640 1 -- 172.21.15.133:0/432875106 learned_addr learned my addr 172.21.15.133:0/432875106 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3eb71a3640 1 -- 172.21.15.133:0/432875106 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601112beef0 con 0x56011122b910 2024-02-15T23:29:55.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3eb71a3640 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b74c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3ea801b2c0 tx=0x7f3ea8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3da3e07640 1 -- 172.21.15.133:0/432875106 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea80c3070 con 0x56011122b910 2024-02-15T23:29:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3da3e07640 1 -- 172.21.15.133:0/432875106 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea80ab530 con 0x56011122b910 2024-02-15T23:29:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3da3e07640 1 -- 172.21.15.133:0/432875106 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea80bed90 con 0x56011122b910 2024-02-15T23:29:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601112b7a00 con 0x56011122b910 2024-02-15T23:29:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601112b5f40 con 0x56011122b910 2024-02-15T23:29:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3da3e07640 1 -- 172.21.15.133:0/432875106 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3ea80b2070 con 0x56011122b910 2024-02-15T23:29:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3da3e07640 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d9c0342b0 0x7f3d9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3da3e07640 1 -- 172.21.15.133:0/432875106 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3ea80e38b0 con 0x56011122b910 2024-02-15T23:29:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3eb69a2640 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d9c0342b0 0x7f3d9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3eb9688980 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601112ba340 0x5601113b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113b1190 con 0x5601112ba340 2024-02-15T23:29:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.011+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601112ba340 0x5601113b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb69a2640 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d9c0342b0 0x7f3d9c036770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00012f0 tx=0x7f3ea0001430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601112ba340 0x5601113b0c50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb79a4640 1 -- 172.21.15.133:0/432875106 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3eb00083f0 con 0x5601112ba340 2024-02-15T23:29:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113b14f0 con 0x5601112ba340 2024-02-15T23:29:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb79a4640 1 -- 172.21.15.133:0/432875106 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3eb00083f0 con 0x5601112ba340 2024-02-15T23:29:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113b2940 con 0x5601112ba340 2024-02-15T23:29:55.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb79a4640 1 -- 172.21.15.133:0/432875106 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3eb00083f0 con 0x5601112ba340 2024-02-15T23:29:55.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113b1cf0 con 0x5601112ba340 2024-02-15T23:29:55.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb79a4640 1 -- 172.21.15.133:0/432875106 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3eb00083f0 con 0x5601112ba340 2024-02-15T23:29:55.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113b2100 con 0x5601112ba340 2024-02-15T23:29:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb79a4640 1 -- 172.21.15.133:0/432875106 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3eb0012040 con 0x5601112ba340 2024-02-15T23:29:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb9688980 1 Processor -- start 2024-02-15T23:29:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb9688980 1 -- start start 2024-02-15T23:29:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb9688980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113c1330 0x5601113c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb9688980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011115bf20 con 0x5601113c1330 2024-02-15T23:29:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb69a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113c1330 0x5601113c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb69a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113c1330 0x5601113c1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43620/0 (socket says 172.21.15.133:43620) 2024-02-15T23:29:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb69a2640 1 -- 172.21.15.133:0/949500943 learned_addr learned my addr 172.21.15.133:0/949500943 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.015+0000 7f3eb69a2640 1 -- 172.21.15.133:0/949500943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601113c1c90 con 0x5601113c1330 2024-02-15T23:29:55.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb69a2640 1 --2- 172.21.15.133:0/949500943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113c1330 0x5601113c1750 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0004ef0 tx=0x7f3ea0015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3da1602640 1 -- 172.21.15.133:0/949500943 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea001a070 con 0x5601113c1330 2024-02-15T23:29:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3da1602640 1 -- 172.21.15.133:0/949500943 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0011440 con 0x5601113c1330 2024-02-15T23:29:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb9688980 1 -- 172.21.15.133:0/949500943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601113c1ee0 con 0x5601113c1330 2024-02-15T23:29:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3da1602640 1 -- 172.21.15.133:0/949500943 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea0011700 con 0x5601113c1330 2024-02-15T23:29:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb9688980 1 -- 172.21.15.133:0/949500943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601113c2a30 con 0x5601113c1330 2024-02-15T23:29:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3da1602640 1 -- 172.21.15.133:0/949500943 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3ea0011860 con 0x5601113c1330 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3da1602640 1 --2- 172.21.15.133:0/949500943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d900342b0 0x7f3d90036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3da1602640 1 -- 172.21.15.133:0/949500943 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3ea004aa30 con 0x5601113c1330 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/949500943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d900342b0 0x7f3d90036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb9688980 1 Processor -- start 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb9688980 1 -- start start 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/949500943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d900342b0 0x7f3d90036770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x5601112b6d60 tx=0x7f3eb0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb9688980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb9688980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011114f790 con 0x5601113ce2a0 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb69a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb69a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43630/0 (socket says 172.21.15.133:43630) 2024-02-15T23:29:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb69a2640 1 -- 172.21.15.133:0/551527668 learned_addr learned my addr 172.21.15.133:0/551527668 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb69a2640 1 -- 172.21.15.133:0/551527668 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601113cec90 con 0x5601113ce2a0 2024-02-15T23:29:55.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.019+0000 7f3eb69a2640 1 --2- 172.21.15.133:0/551527668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113ce6c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0048e20 tx=0x7f3ea0013ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7be4fff802f5af server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3d9affd640 1 -- 172.21.15.133:0/551527668 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea0047070 con 0x5601113ce2a0 2024-02-15T23:29:55.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3d9affd640 1 -- 172.21.15.133:0/551527668 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea00135b0 con 0x5601113ce2a0 2024-02-15T23:29:55.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3d9affd640 1 -- 172.21.15.133:0/551527668 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea001dd20 con 0x5601113ce2a0 2024-02-15T23:29:55.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- 172.21.15.133:0/551527668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 msgr2=0x5601113ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 --2- 172.21.15.133:0/551527668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113ce6c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0048e20 tx=0x7f3ea0013ac0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- 172.21.15.133:0/551527668 shutdown_connections 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 --2- 172.21.15.133:0/551527668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113ce6c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- 172.21.15.133:0/551527668 >> 172.21.15.133:0/551527668 conn(0x5601113ca630 msgr2=0x5601113c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- 172.21.15.133:0/551527668 shutdown_connections 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- 172.21.15.133:0/551527668 wait complete. 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 Processor -- start 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- start start 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601113d5720 con 0x5601113ce2a0 2024-02-15T23:29:55.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb69a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb69a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113d51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43634/0 (socket says 172.21.15.133:43634) 2024-02-15T23:29:55.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 learned_addr learned my addr 172.21.15.133:0/3174340359 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601113c2a30 con 0x5601113ce2a0 2024-02-15T23:29:55.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb69a2640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113d51e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0015d70 tx=0x7f3ea0048db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3d997fa640 1 -- 172.21.15.133:0/3174340359 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea002e040 con 0x5601113ce2a0 2024-02-15T23:29:55.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601113d5920 con 0x5601113ce2a0 2024-02-15T23:29:55.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3d997fa640 1 -- 172.21.15.133:0/3174340359 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0011e40 con 0x5601113ce2a0 2024-02-15T23:29:55.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3d997fa640 1 -- 172.21.15.133:0/3174340359 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea001d530 con 0x5601113ce2a0 2024-02-15T23:29:55.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.023+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601113d5db0 con 0x5601113ce2a0 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3d997fa640 1 -- 172.21.15.133:0/3174340359 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3ea003ad50 con 0x5601113ce2a0 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3d997fa640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d800342b0 0x7f3d80036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3d997fa640 1 -- 172.21.15.133:0/3174340359 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3ea0034ce0 con 0x5601113ce2a0 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d800342b0 0x7f3d80036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601113e0810 0x5601113e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e3400 con 0x5601113e0810 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb71a3640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601113e0810 0x5601113e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d800342b0 0x7f3d80036770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0008fd0 tx=0x7f3eb001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb71a3640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601113e0810 0x5601113e2cb0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ea80aa9c0 con 0x5601113e0810 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 realm 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e37d0 con 0x5601113e0810 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ea80aa9c0 con 0x5601113e0810 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e4020 con 0x5601113e0810 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e4380 con 0x5601113e0810 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e4b80 con 0x5601113e0810 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 20 searching for the correct realm 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5601113e6ad0 0x5601113e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb69a2640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5601113e6ad0 0x5601113e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb69a2640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5601113e6ad0 0x5601113e8f20 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb69a2640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ea0037c20 0x7f3ea0039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.027+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3ea0037c20 2024-02-15T23:29:55.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ea0037c20 0x7f3ea0039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ea0037c20 0x7f3ea0039070 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb002c040 con 0x7f3ea0037c20 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb79a4640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3eb0027940 0x7f3eb00333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3eb0027940 0x7f3eb00333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3eb0027940 0x7f3eb00333c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e0810 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e0810 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.031+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3ea0037c20 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb002c040 con 0x7f3ea0037c20 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e0810 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e0810 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3ea0037c20 2024-02-15T23:29:55.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3eb002c040 con 0x7f3ea0037c20 2024-02-15T23:29:55.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.035+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e0810 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e0810 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3ea0037c20 2024-02-15T23:29:55.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb002c040 con 0x7f3ea0037c20 2024-02-15T23:29:55.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e0810 2024-02-15T23:29:55.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x5601113e0810 2024-02-15T23:29:55.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.039+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3ea0037c20 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb002c040 con 0x7f3ea0037c20 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e6ad0 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3eb0027940 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ea80d7040 con 0x7f3eb0027940 2024-02-15T23:29:55.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x5601113e0810 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e95a0 con 0x7f3ea0037c20 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb002c040 con 0x7f3ea0037c20 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e5540 con 0x5601113e0810 2024-02-15T23:29:55.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e5d90 con 0x5601113e0810 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e99e0 con 0x5601113e0810 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 zone default found 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 4 Realm: () 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:55.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 zonegroup default 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.043+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113e99e0 con 0x7f3eb0027940 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113eb860 con 0x5601113e6ad0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ebbc0 con 0x5601113e6ad0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 20 started sync module instance, tier type = 2024-02-15T23:29:55.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:55.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113eae30 con 0x7f3ea0037c20 2024-02-15T23:29:55.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb003f040 con 0x7f3ea0037c20 2024-02-15T23:29:55.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94562584277520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113eae30 con 0x7f3ea0037c20 2024-02-15T23:29:55.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ec530 con 0x5601113e0810 2024-02-15T23:29:55.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.047+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94562584277520] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb003f040 con 0x7f3ea0037c20 2024-02-15T23:29:55.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.051+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.051+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94562584275616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ec530 con 0x5601113e0810 2024-02-15T23:29:55.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.051+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ecea0 con 0x5601113e6ad0 2024-02-15T23:29:55.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.051+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.051+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94562584283648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ed6f0 con 0x5601113e6ad0 2024-02-15T23:29:55.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.051+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ee0a0 con 0x7f3ea0037c20 2024-02-15T23:29:55.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.051+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94562584275616] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.055+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb003f040 con 0x7f3ea0037c20 2024-02-15T23:29:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.055+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94562584281232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ee450 con 0x7f3ea0037c20 2024-02-15T23:29:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.055+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113eee00 con 0x5601113e0810 2024-02-15T23:29:55.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.055+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94562584281232] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb003f040 con 0x7f3ea0037c20 2024-02-15T23:29:55.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.055+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94562584283648] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.055+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.055+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94562584285776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ee920 con 0x5601113e0810 2024-02-15T23:29:55.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.055+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ef650 con 0x7f3eb0027940 2024-02-15T23:29:55.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.059+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94562584285776] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.059+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.059+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94562584288192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ef370 con 0x7f3eb0027940 2024-02-15T23:29:55.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.059+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113efb70 con 0x7f3eb0027940 2024-02-15T23:29:55.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.059+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.059+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94562584294560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113efee0 con 0x7f3eb0027940 2024-02-15T23:29:55.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.059+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113f09b0 con 0x7f3eb0027940 2024-02-15T23:29:55.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.059+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94562584288192] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94562584298640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113f0970 con 0x7f3eb0027940 2024-02-15T23:29:55.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 20 add_watcher() i=0 2024-02-15T23:29:55.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 20 add_watcher() i=1 2024-02-15T23:29:55.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 20 add_watcher() i=2 2024-02-15T23:29:55.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 20 add_watcher() i=3 2024-02-15T23:29:55.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 20 add_watcher() i=4 2024-02-15T23:29:55.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 20 add_watcher() i=5 2024-02-15T23:29:55.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94562584294560] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 20 add_watcher() i=6 2024-02-15T23:29:55.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94562584298640] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 20 add_watcher() i=7 2024-02-15T23:29:55.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:55.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ef980 con 0x5601113e0810 2024-02-15T23:29:55.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.063+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94562584293072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ef940 con 0x5601113e0810 2024-02-15T23:29:55.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94562584293072] v31'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3d6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:55.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:55.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 5 note: GC not initialized 2024-02-15T23:29:55.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3d6cfe1640 20 reqs_thread_entry: start 2024-02-15T23:29:55.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:55.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 Filter name: none 2024-02-15T23:29:55.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3ce67fc640 20 reqs_thread_entry: start 2024-02-15T23:29:55.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:29:55.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560111415880 con 0x7f3eb0027940 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560111417280 con 0x7f3ea0037c20 2024-02-15T23:29:55.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f3eb003f040 con 0x7f3ea0037c20 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601114188a0 con 0x5601113e0810 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(64 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv4 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:55.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:55.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-15T23:29:55.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.067+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56011141bd90 con 0x7f3eb0027940 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(65 fud.buckets [call] v31'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb9688980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb9688980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56011141ad80 con 0x7f3ea0037c20 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7f3eb003f040 con 0x7f3ea0037c20 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb9688980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb9688980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb9688980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb9688980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.071+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56011141fa10 con 0x7f3ea0037c20 2024-02-15T23:29:55.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f3eb003f040 con 0x7f3ea0037c20 2024-02-15T23:29:55.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb9688980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-15T23:29:55.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb9688980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:55.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb9688980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T23:29:55.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94562584491376 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56011141c710 con 0x7f3eb0027940 2024-02-15T23:29:55.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== watch-notify(notify (1) cookie 94562584294560 notify 133143986189 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7f3ea80e7040 con 0x7f3eb0027940 2024-02-15T23:29:55.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3d9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94562584294560 notifier 4514 bl.length()=338 2024-02-15T23:29:55.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3d9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-15T23:29:55.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3d9affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:55.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3d9affd640 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3d7c003ea0 con 0x7f3eb0027940 2024-02-15T23:29:55.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(68 notify.6 [notify cookie 94562584491376 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== watch-notify(notify_complete (2) cookie 94562584491376 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5601112b5f40 con 0x7f3eb0027940 2024-02-15T23:29:55.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3d6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.075+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94562584293072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56011141f570 con 0x5601113e0810 2024-02-15T23:29:55.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.079+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94562584293072] v31'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.079+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94562584277520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56011141f570 con 0x7f3ea0037c20 2024-02-15T23:29:55.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.079+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94562584277520] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb003f040 con 0x7f3ea0037c20 2024-02-15T23:29:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.079+0000 7f3eb9688980 20 remove_watcher() i=0 2024-02-15T23:29:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.079+0000 7f3eb9688980 2 removed watcher, disabling cache 2024-02-15T23:29:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.079+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94562584275616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113eb210 con 0x5601113e0810 2024-02-15T23:29:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.079+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94562584275616] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.083+0000 7f3eb9688980 20 remove_watcher() i=1 2024-02-15T23:29:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.083+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94562584283648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113eb210 con 0x5601113e6ad0 2024-02-15T23:29:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.083+0000 7f3eb69a2640 1 -- 172.21.15.133:0/3174340359 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94562584283648] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea001e330 con 0x5601113e6ad0 2024-02-15T23:29:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.083+0000 7f3eb9688980 20 remove_watcher() i=2 2024-02-15T23:29:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.083+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94562584281232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113eca00 con 0x7f3ea0037c20 2024-02-15T23:29:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.083+0000 7f3eb79a4640 1 -- 172.21.15.133:0/3174340359 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94562584281232] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb0048040 con 0x7f3ea0037c20 2024-02-15T23:29:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.083+0000 7f3eb9688980 20 remove_watcher() i=3 2024-02-15T23:29:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.083+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94562584285776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ec090 con 0x5601113e0810 2024-02-15T23:29:55.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.087+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94562584285776] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x5601113e0810 2024-02-15T23:29:55.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.087+0000 7f3eb9688980 20 remove_watcher() i=4 2024-02-15T23:29:55.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.087+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94562584288192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113eca00 con 0x7f3eb0027940 2024-02-15T23:29:55.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.087+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94562584288192] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.087+0000 7f3eb9688980 20 remove_watcher() i=5 2024-02-15T23:29:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.087+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94562584294560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ed250 con 0x7f3eb0027940 2024-02-15T23:29:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.091+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94562584294560] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.091+0000 7f3eb9688980 20 remove_watcher() i=6 2024-02-15T23:29:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.091+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94562584298640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601113ec090 con 0x7f3eb0027940 2024-02-15T23:29:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.091+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94562584298640] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ea80f2080 con 0x7f3eb0027940 2024-02-15T23:29:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.091+0000 7f3eb9688980 20 remove_watcher() i=7 2024-02-15T23:29:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.091+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3eb0027940 msgr2=0x7f3eb00333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3eb0027940 0x7f3eb00333c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601113e0810 msgr2=0x5601113e2cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601113e0810 0x5601113e2cb0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ea0037c20 msgr2=0x7f3ea0039070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ea0037c20 0x7f3ea0039070 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5601113e6ad0 msgr2=0x5601113e8f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5601113e6ad0 0x5601113e8f20 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d800342b0 msgr2=0x7f3d80036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d800342b0 0x7f3d80036770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0008fd0 tx=0x7f3eb001c070 comp rx=0 tx=0).stop 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 msgr2=0x5601113d51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/3174340359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113ce2a0 0x5601113d51e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0015d70 tx=0x7f3ea0048db0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 reap_dead start 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb71a3640 1 -- 172.21.15.133:0/3174340359 reap_dead start 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 shutdown_connections 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 >> 172.21.15.133:0/3174340359 conn(0x5601113ca630 msgr2=0x5601113c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 shutdown_connections 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/3174340359 wait complete. 2024-02-15T23:29:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/949500943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d900342b0 msgr2=0x7f3d90036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/949500943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d900342b0 0x7f3d90036770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x5601112b6d60 tx=0x7f3eb0003070 comp rx=0 tx=0).stop 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/949500943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113c1330 msgr2=0x5601113c1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/949500943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113c1330 0x5601113c1750 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0004ef0 tx=0x7f3ea0015820 comp rx=0 tx=0).stop 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/949500943 shutdown_connections 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/949500943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d900342b0 0x7f3d90036770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/949500943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601113c1330 0x5601113c1750 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/949500943 >> 172.21.15.133:0/949500943 conn(0x5601113b6140 msgr2=0x5601113b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/949500943 shutdown_connections 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/949500943 wait complete. 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601112ba340 msgr2=0x5601113b0c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601112ba340 0x5601113b0c50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d9c0342b0 msgr2=0x7f3d9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d9c0342b0 0x7f3d9c036770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00012f0 tx=0x7f3ea0001430 comp rx=0 tx=0).stop 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 msgr2=0x5601112b74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b74c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3ea801b2c0 tx=0x7f3ea8018020 comp rx=0 tx=0).stop 2024-02-15T23:29:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 shutdown_connections 2024-02-15T23:29:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5601112ba340 0x5601113b0c50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3d9c0342b0 0x7f3d9c036770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 --2- 172.21.15.133:0/432875106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56011122b910 0x5601112b74c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 >> 172.21.15.133:0/432875106 conn(0x5601112b1920 msgr2=0x56011139b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 shutdown_connections 2024-02-15T23:29:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.095+0000 7f3eb9688980 1 -- 172.21.15.133:0/432875106 wait complete. 2024-02-15T23:29:55.114 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1'] 2024-02-15T23:29:55.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1'] 2024-02-15T23:29:55.115 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:55.193 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:55.193 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96aa1f1980 1 Processor -- start 2024-02-15T23:29:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96aa1f1980 1 -- start start 2024-02-15T23:29:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96aa1f1980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557601bde4c0 0x557601be08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96aa1f1980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557601b26460 con 0x557601b4e020 2024-02-15T23:29:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96aa1f1980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x557601aed180 con 0x557601bde4c0 2024-02-15T23:29:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96a750b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557601bde4c0 0x557601be08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96a7d0c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x557601b4e020 0x557601bdcda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:40004/0 (socket says 172.21.15.133:40004) 2024-02-15T23:29:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96a7d0c640 1 -- 172.21.15.133:0/2050463577 learned_addr learned my addr 172.21.15.133:0/2050463577 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96a750b640 1 -- 172.21.15.133:0/2050463577 >> v1:172.21.15.131:6789/0 conn(0x557601b4e020 legacy=0x557601bdcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96a750b640 1 -- 172.21.15.133:0/2050463577 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557601be1e90 con 0x557601bde4c0 2024-02-15T23:29:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.187+0000 7f96a750b640 1 --2- 172.21.15.133:0/2050463577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601bde4c0 0x557601be08b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f969c00a480 tx=0x7f969c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b59dc7f63eb4cc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96a6d0a640 1 -- 172.21.15.133:0/2050463577 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969c0ab540 con 0x557601bde4c0 2024-02-15T23:29:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96a6d0a640 1 -- 172.21.15.133:0/2050463577 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0ab6a0 con 0x557601bde4c0 2024-02-15T23:29:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96a6d0a640 1 -- 172.21.15.133:0/2050463577 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969c0ab960 con 0x557601bde4c0 2024-02-15T23:29:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2050463577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601bde4c0 msgr2=0x557601be08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/2050463577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601bde4c0 0x557601be08b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f969c00a480 tx=0x7f969c01b280 comp rx=0 tx=0).stop 2024-02-15T23:29:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2050463577 shutdown_connections 2024-02-15T23:29:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/2050463577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601bde4c0 0x557601be08b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2050463577 >> 172.21.15.133:0/2050463577 conn(0x557601bd4880 msgr2=0x557601bd6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2050463577 shutdown_connections 2024-02-15T23:29:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.191+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2050463577 wait complete. 2024-02-15T23:29:55.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.203+0000 7f96aa1f1980 1 Processor -- start 2024-02-15T23:29:55.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- start start 2024-02-15T23:29:55.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601bda500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557601aea6b0 con 0x557601b4e020 2024-02-15T23:29:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96a7d0c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601bda500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96a7d0c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601bda500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43654/0 (socket says 172.21.15.133:43654) 2024-02-15T23:29:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3133238919 learned_addr learned my addr 172.21.15.133:0/3133238919 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3133238919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c005d30 con 0x557601b4e020 2024-02-15T23:29:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96a7d0c640 1 --2- 172.21.15.133:0/3133238919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601bda500 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9698001c00 tx=0x7f969800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8cb5c475b1d1f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f9595e0b640 1 -- 172.21.15.133:0/3133238919 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969800e690 con 0x557601b4e020 2024-02-15T23:29:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f9595e0b640 1 -- 172.21.15.133:0/3133238919 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969800e810 con 0x557601b4e020 2024-02-15T23:29:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f9595e0b640 1 -- 172.21.15.133:0/3133238919 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969800eb30 con 0x557601b4e020 2024-02-15T23:29:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3133238919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 msgr2=0x557601bda500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3133238919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601bda500 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9698001c00 tx=0x7f969800b6d0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3133238919 shutdown_connections 2024-02-15T23:29:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3133238919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601bda500 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3133238919 >> 172.21.15.133:0/3133238919 conn(0x557601bd4880 msgr2=0x557601cbfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3133238919 shutdown_connections 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3133238919 wait complete. 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 Processor -- start 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- start start 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601ccd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96aa1f1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557601ae5e90 con 0x557601b4e020 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96a7d0c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601ccd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96a7d0c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601ccd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43656/0 (socket says 172.21.15.133:43656) 2024-02-15T23:29:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.207+0000 7f96a7d0c640 1 -- 172.21.15.133:0/4042834104 learned_addr learned my addr 172.21.15.133:0/4042834104 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96a7d0c640 1 -- 172.21.15.133:0/4042834104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557601b26460 con 0x557601b4e020 2024-02-15T23:29:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96a7d0c640 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601ccd280 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f969800b710 tx=0x7f9698000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f958ffff640 1 -- 172.21.15.133:0/4042834104 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969801f070 con 0x557601b4e020 2024-02-15T23:29:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557601ccd7c0 con 0x557601b4e020 2024-02-15T23:29:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f958ffff640 1 -- 172.21.15.133:0/4042834104 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969801a910 con 0x557601b4e020 2024-02-15T23:29:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f958ffff640 1 -- 172.21.15.133:0/4042834104 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969801abf0 con 0x557601b4e020 2024-02-15T23:29:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557601ccdbf0 con 0x557601b4e020 2024-02-15T23:29:55.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f958ffff640 1 -- 172.21.15.133:0/4042834104 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f969800a040 con 0x557601b4e020 2024-02-15T23:29:55.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f958ffff640 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95900342b0 0x7f9590036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f958ffff640 1 -- 172.21.15.133:0/4042834104 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9698049f50 con 0x557601b4e020 2024-02-15T23:29:55.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96a750b640 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95900342b0 0x7f9590036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601bde4c0 0x557601cd3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601cd4450 con 0x557601bde4c0 2024-02-15T23:29:55.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96a850d640 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601bde4c0 0x557601cd3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96a750b640 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95900342b0 0x7f9590036770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f969c0ad000 tx=0x7f969c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96a850d640 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601bde4c0 0x557601cd3f10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96a850d640 1 -- 172.21.15.133:0/4042834104 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f96a000a4d0 con 0x557601bde4c0 2024-02-15T23:29:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.211+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601cd47b0 con 0x557601bde4c0 2024-02-15T23:29:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a850d640 1 -- 172.21.15.133:0/4042834104 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f96a000a4d0 con 0x557601bde4c0 2024-02-15T23:29:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601cd6030 con 0x557601bde4c0 2024-02-15T23:29:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a850d640 1 -- 172.21.15.133:0/4042834104 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f96a000a4d0 con 0x557601bde4c0 2024-02-15T23:29:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601cd5230 con 0x557601bde4c0 2024-02-15T23:29:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a850d640 1 -- 172.21.15.133:0/4042834104 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f96a000a4d0 con 0x557601bde4c0 2024-02-15T23:29:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601cd5640 con 0x557601bde4c0 2024-02-15T23:29:55.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a850d640 1 -- 172.21.15.133:0/4042834104 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f96a000a4d0 con 0x557601bde4c0 2024-02-15T23:29:55.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 Processor -- start 2024-02-15T23:29:55.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 -- start start 2024-02-15T23:29:55.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601ce46b0 0x557601ce4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557601a7ef20 con 0x557601ce46b0 2024-02-15T23:29:55.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a750b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601ce46b0 0x557601ce4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a750b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601ce46b0 0x557601ce4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43666/0 (socket says 172.21.15.133:43666) 2024-02-15T23:29:55.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a750b640 1 -- 172.21.15.133:0/4106576872 learned_addr learned my addr 172.21.15.133:0/4106576872 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a750b640 1 -- 172.21.15.133:0/4106576872 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557601ce5010 con 0x557601ce46b0 2024-02-15T23:29:55.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96a750b640 1 --2- 172.21.15.133:0/4106576872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601ce46b0 0x557601ce4ad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f969c096e80 tx=0x7f969c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f958d7fa640 1 -- 172.21.15.133:0/4106576872 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969c0bd8a0 con 0x557601ce46b0 2024-02-15T23:29:55.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4106576872 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557601ce5200 con 0x557601ce46b0 2024-02-15T23:29:55.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f958d7fa640 1 -- 172.21.15.133:0/4106576872 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0bda00 con 0x557601ce46b0 2024-02-15T23:29:55.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f958d7fa640 1 -- 172.21.15.133:0/4106576872 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969c0bdca0 con 0x557601ce46b0 2024-02-15T23:29:55.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.215+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4106576872 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557601ce5d50 con 0x557601ce46b0 2024-02-15T23:29:55.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f958d7fa640 1 -- 172.21.15.133:0/4106576872 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f969c0be480 con 0x557601ce46b0 2024-02-15T23:29:55.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f958d7fa640 1 --2- 172.21.15.133:0/4106576872 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95800342b0 0x7f9580036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f958d7fa640 1 -- 172.21.15.133:0/4106576872 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f969c0e6360 con 0x557601ce46b0 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96a850d640 1 --2- 172.21.15.133:0/4106576872 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95800342b0 0x7f9580036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 Processor -- start 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 -- start start 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96a850d640 1 --2- 172.21.15.133:0/4106576872 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95800342b0 0x7f9580036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x557601cd4c70 tx=0x7f96a0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557601a72790 con 0x557601cf1690 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96a750b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96a750b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43668/0 (socket says 172.21.15.133:43668) 2024-02-15T23:29:55.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96a750b640 1 -- 172.21.15.133:0/2965748239 learned_addr learned my addr 172.21.15.133:0/2965748239 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96a750b640 1 -- 172.21.15.133:0/2965748239 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557601cf2080 con 0x557601cf1690 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96a750b640 1 --2- 172.21.15.133:0/2965748239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf1ab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f969c0e4780 tx=0x7f969c0aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ada1bdb3f81382 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f9586ffd640 1 -- 172.21.15.133:0/2965748239 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969c0064c0 con 0x557601cf1690 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f9586ffd640 1 -- 172.21.15.133:0/2965748239 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0be730 con 0x557601cf1690 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f9586ffd640 1 -- 172.21.15.133:0/2965748239 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969c0b4c50 con 0x557601cf1690 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2965748239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 msgr2=0x557601cf1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/2965748239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf1ab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f969c0e4780 tx=0x7f969c0aae30 comp rx=0 tx=0).stop 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2965748239 shutdown_connections 2024-02-15T23:29:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/2965748239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf1ab0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2965748239 >> 172.21.15.133:0/2965748239 conn(0x557601ceda20 msgr2=0x557601ceba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2965748239 shutdown_connections 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 -- 172.21.15.133:0/2965748239 wait complete. 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 Processor -- start 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.219+0000 7f96aa1f1980 1 -- start start 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96aa1f1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96aa1f1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557601cf8ae0 con 0x557601cf1690 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a750b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a750b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43682/0 (socket says 172.21.15.133:43682) 2024-02-15T23:29:55.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 learned_addr learned my addr 172.21.15.133:0/3461064057 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557601ce5d50 con 0x557601cf1690 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a750b640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf85a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f969c0aae70 tx=0x7f969c0e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f95857fa640 1 -- 172.21.15.133:0/3461064057 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969c0d5050 con 0x557601cf1690 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f95857fa640 1 -- 172.21.15.133:0/3461064057 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0d6040 con 0x557601cf1690 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557601cf8ce0 con 0x557601cf1690 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f95857fa640 1 -- 172.21.15.133:0/3461064057 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969c0068e0 con 0x557601cf1690 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557601cf9110 con 0x557601cf1690 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f95857fa640 1 -- 172.21.15.133:0/3461064057 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f969c0b4c50 con 0x557601cf1690 2024-02-15T23:29:55.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f95857fa640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95700342b0 0x7f9570036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f95857fa640 1 -- 172.21.15.133:0/3461064057 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f969c0ac050 con 0x557601cf1690 2024-02-15T23:29:55.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a850d640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95700342b0 0x7f9570036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601d03b30 0x557601d05ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d06740 con 0x557601d03b30 2024-02-15T23:29:55.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a7d0c640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601d03b30 0x557601d05ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a850d640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95700342b0 0x7f9570036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96a0011010 tx=0x7f96a0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.223+0000 7f96a7d0c640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601d03b30 0x557601d05ff0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 realm 2024-02-15T23:29:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d06b10 con 0x557601d03b30 2024-02-15T23:29:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d07390 con 0x557601d03b30 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d076f0 con 0x557601d03b30 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d07ef0 con 0x557601d03b30 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 20 searching for the correct realm 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557601d09d80 0x557601d0c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a750b640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557601d09d80 0x557601d0c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a750b640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557601d09d80 0x557601d0c220 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a750b640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f969c0f0060 0x7f969c0dc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f969c0f0060 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a850d640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f969c0f0060 0x7f969c0dc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a850d640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f969c0f0060 0x7f969c0dc870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f96a000a4d0 con 0x7f969c0f0060 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a850d640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f96a00141d0 0x7f96a0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.227+0000 7f96a7d0c640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f96a00141d0 0x7f96a0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f96a00141d0 0x7f96a0015940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d03b30 2024-02-15T23:29:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d03b30 2024-02-15T23:29:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f969c0f0060 2024-02-15T23:29:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f96a000a4d0 con 0x7f969c0f0060 2024-02-15T23:29:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d03b30 2024-02-15T23:29:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.231+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d03b30 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f969c0f0060 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d03b30 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d03b30 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.235+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f969c0f0060 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d03b30 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f969c0f0060 2024-02-15T23:29:55.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d09d80 2024-02-15T23:29:55.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.239+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f96a00141d0 2024-02-15T23:29:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x557601d03b30 2024-02-15T23:29:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0c8f0 con 0x7f969c0f0060 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d08820 con 0x557601d03b30 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d09070 con 0x557601d03b30 2024-02-15T23:29:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0cd30 con 0x557601d03b30 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 zone default found 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 4 Realm: () 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 zonegroup default 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0cd30 con 0x7f96a00141d0 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0ebb0 con 0x557601d09d80 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0ef10 con 0x557601d09d80 2024-02-15T23:29:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 started sync module instance, tier type = 2024-02-15T23:29:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.243+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0e180 con 0x7f969c0f0060 2024-02-15T23:29:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.247+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.247+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93965324969312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0e180 con 0x7f969c0f0060 2024-02-15T23:29:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.247+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0f880 con 0x557601d03b30 2024-02-15T23:29:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.247+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93965324969312] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.247+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.247+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93965324973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0e180 con 0x557601d03b30 2024-02-15T23:29:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.247+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d10240 con 0x557601d09d80 2024-02-15T23:29:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.251+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.251+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93965324975520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d10a90 con 0x557601d09d80 2024-02-15T23:29:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.251+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d11440 con 0x7f969c0f0060 2024-02-15T23:29:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.251+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93965324973296] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.251+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.251+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93965324967136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d117f0 con 0x7f969c0f0060 2024-02-15T23:29:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.251+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d12160 con 0x557601d03b30 2024-02-15T23:29:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.251+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93965324975520] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.255+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93965324967136] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.255+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.255+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93965324980064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d11cc0 con 0x557601d03b30 2024-02-15T23:29:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.255+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d12630 con 0x7f96a00141d0 2024-02-15T23:29:55.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.255+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93965324980064] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.255+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.255+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93965324977648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d12630 con 0x7f96a00141d0 2024-02-15T23:29:55.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.255+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d12e70 con 0x7f96a00141d0 2024-02-15T23:29:55.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93965324986208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d13310 con 0x7f96a00141d0 2024-02-15T23:29:55.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d13ce0 con 0x7f96a00141d0 2024-02-15T23:29:55.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93965324977648] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93965324986208] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93965324984720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d13310 con 0x7f96a00141d0 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 20 add_watcher() i=0 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 20 add_watcher() i=1 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 20 add_watcher() i=2 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 20 add_watcher() i=3 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 20 add_watcher() i=4 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 20 add_watcher() i=5 2024-02-15T23:29:55.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.259+0000 7f96aa1f1980 20 add_watcher() i=6 2024-02-15T23:29:55.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93965324984720] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 20 add_watcher() i=7 2024-02-15T23:29:55.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:55.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d16cd0 con 0x557601d03b30 2024-02-15T23:29:55.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93965324988480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d14140 con 0x557601d03b30 2024-02-15T23:29:55.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93965324988480] v31'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f955dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:55.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:55.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 5 note: GC not initialized 2024-02-15T23:29:55.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f955cfe1640 20 reqs_thread_entry: start 2024-02-15T23:29:55.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:55.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 20 Filter name: none 2024-02-15T23:29:55.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f94d67fc640 20 reqs_thread_entry: start 2024-02-15T23:29:55.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:55.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.263+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d38af0 con 0x557601d03b30 2024-02-15T23:29:55.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:55.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:55.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:55.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:55.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:29:55.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d3a4f0 con 0x7f969c0f0060 2024-02-15T23:29:55.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:55.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:29:55.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d3bc20 con 0x557601d03b30 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv4 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-15T23:29:55.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d3ff60 con 0x7f96a00141d0 2024-02-15T23:29:55.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(65 fud.buckets [call] v31'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.267+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d45f20 con 0x557601d03b30 2024-02-15T23:29:55.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'5 uv5 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1, ofs0, ns] 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93965325156560 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d40350 con 0x557601d03b30 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== watch-notify(notify (1) cookie 93965324980064 notify 133143986189 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x557601ccdbf0 con 0x557601d03b30 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f9586ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 93965324980064 notifier 4521 bl.length()=725 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f9586ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f9586ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f9586ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f9586ffd640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f956c003ea0 con 0x557601d03b30 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(67 notify.4 [notify cookie 93965325156560 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== watch-notify(notify_complete (2) cookie 93965325156560 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557601ccd7c0 con 0x557601d03b30 2024-02-15T23:29:55.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_sources= new_sources= 2024-02-15T23:29:55.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential sources added=[] removed=[] 2024-02-15T23:29:55.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_dests= new_dests= 2024-02-15T23:29:55.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential dests added=[] removed=[] 2024-02-15T23:29:55.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.271+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d44710 con 0x7f969c0f0060 2024-02-15T23:29:55.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(69 foo.buckets [call] v31'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d45720 con 0x7f969c0f0060 2024-02-15T23:29:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96aa1f1980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T23:29:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96aa1f1980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96aa1f1980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T23:29:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93965325156528 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d44bb0 con 0x7f96a00141d0 2024-02-15T23:29:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== watch-notify(notify (1) cookie 93965324986208 notify 133143986190 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x557601ccd7c0 con 0x7f96a00141d0 2024-02-15T23:29:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f95867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 93965324986208 notifier 4521 bl.length()=314 2024-02-15T23:29:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f95867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T23:29:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f95867fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.6 [notify cookie 93965325156528 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.275+0000 7f95867fc640 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f94dc003400 con 0x7f96a00141d0 2024-02-15T23:29:55.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== watch-notify(notify_complete (2) cookie 93965325156528 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f9698029030 con 0x7f96a00141d0 2024-02-15T23:29:55.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f955dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93965324988480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d00f50 con 0x557601d03b30 2024-02-15T23:29:55.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93965324988480] v31'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93965324969312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d13010 con 0x7f969c0f0060 2024-02-15T23:29:55.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93965324969312] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96aa1f1980 20 remove_watcher() i=0 2024-02-15T23:29:55.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96aa1f1980 2 removed watcher, disabling cache 2024-02-15T23:29:55.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.279+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93965324973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d09070 con 0x557601d03b30 2024-02-15T23:29:55.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.283+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93965324973296] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.283+0000 7f96aa1f1980 20 remove_watcher() i=1 2024-02-15T23:29:55.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.283+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93965324975520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d09070 con 0x557601d09d80 2024-02-15T23:29:55.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.283+0000 7f96a750b640 1 -- 172.21.15.133:0/3461064057 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93965324975520] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f969c0d8070 con 0x557601d09d80 2024-02-15T23:29:55.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.283+0000 7f96aa1f1980 20 remove_watcher() i=2 2024-02-15T23:29:55.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.283+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93965324967136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0f4f0 con 0x7f969c0f0060 2024-02-15T23:29:55.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.287+0000 7f96a850d640 1 -- 172.21.15.133:0/3461064057 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93965324967136] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f96a003a040 con 0x7f969c0f0060 2024-02-15T23:29:55.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.287+0000 7f96aa1f1980 20 remove_watcher() i=3 2024-02-15T23:29:55.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.287+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93965324980064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0f4f0 con 0x557601d03b30 2024-02-15T23:29:55.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.287+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93965324980064] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x557601d03b30 2024-02-15T23:29:55.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.287+0000 7f96aa1f1980 20 remove_watcher() i=4 2024-02-15T23:29:55.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.287+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93965324977648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d10f60 con 0x7f96a00141d0 2024-02-15T23:29:55.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.291+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93965324977648] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.291+0000 7f96aa1f1980 20 remove_watcher() i=5 2024-02-15T23:29:55.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.291+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93965324986208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d0f4f0 con 0x7f96a00141d0 2024-02-15T23:29:55.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93965324986208] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 20 remove_watcher() i=6 2024-02-15T23:29:55.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93965324984720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557601d105f0 con 0x7f96a00141d0 2024-02-15T23:29:55.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93965324984720] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9698024cd0 con 0x7f96a00141d0 2024-02-15T23:29:55.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 20 remove_watcher() i=7 2024-02-15T23:29:55.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f96a00141d0 msgr2=0x7f96a0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f96a00141d0 0x7f96a0015940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601d03b30 msgr2=0x557601d05ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601d03b30 0x557601d05ff0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f969c0f0060 msgr2=0x7f969c0dc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f969c0f0060 0x7f969c0dc870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557601d09d80 msgr2=0x557601d0c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557601d09d80 0x557601d0c220 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95700342b0 msgr2=0x7f9570036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95700342b0 0x7f9570036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96a0011010 tx=0x7f96a0020000 comp rx=0 tx=0).stop 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 msgr2=0x557601cf85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96a7d0c640 1 -- 172.21.15.133:0/3461064057 reap_dead start 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf85a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f969c0aae70 tx=0x7f969c0e46e0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 shutdown_connections 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/3461064057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601cf1690 0x557601cf85a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 >> 172.21.15.133:0/3461064057 conn(0x557601ceda20 msgr2=0x557601ceb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 shutdown_connections 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.295+0000 7f96aa1f1980 1 -- 172.21.15.133:0/3461064057 wait complete. 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4106576872 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95800342b0 msgr2=0x7f9580036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4106576872 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95800342b0 0x7f9580036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x557601cd4c70 tx=0x7f96a0005850 comp rx=0 tx=0).stop 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4106576872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601ce46b0 msgr2=0x557601ce4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4106576872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601ce46b0 0x557601ce4ad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f969c096e80 tx=0x7f969c018020 comp rx=0 tx=0).stop 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4106576872 shutdown_connections 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4106576872 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95800342b0 0x7f9580036770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4106576872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601ce46b0 0x557601ce4ad0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4106576872 >> 172.21.15.133:0/4106576872 conn(0x557601cd94c0 msgr2=0x557601cd9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4106576872 shutdown_connections 2024-02-15T23:29:55.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4106576872 wait complete. 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601bde4c0 msgr2=0x557601cd3f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601bde4c0 0x557601cd3f10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95900342b0 msgr2=0x7f9590036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95900342b0 0x7f9590036770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f969c0ad000 tx=0x7f969c0a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 msgr2=0x557601ccd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601ccd280 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f969800b710 tx=0x7f9698000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 shutdown_connections 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557601bde4c0 0x557601cd3f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f95900342b0 0x7f9590036770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 --2- 172.21.15.133:0/4042834104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557601b4e020 0x557601ccd280 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 >> 172.21.15.133:0/4042834104 conn(0x557601bd4880 msgr2=0x557601bd8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 shutdown_connections 2024-02-15T23:29:55.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.299+0000 7f96aa1f1980 1 -- 172.21.15.133:0/4042834104 wait complete. 2024-02-15T23:29:55.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-15T23:29:55.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-15T23:29:55.318 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-15T23:29:55.397 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:55.397 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc7119b980 1 Processor -- start 2024-02-15T23:29:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc7119b980 1 -- start start 2024-02-15T23:29:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc7119b980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55fa4270d860 0x55fa4270dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc7119b980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fa426564c0 con 0x55fa4270c320 2024-02-15T23:29:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc7119b980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fa4261d180 con 0x55fa4270d860 2024-02-15T23:29:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc6ecb6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55fa4270d860 0x55fa4270dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc6ecb6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55fa4270d860 0x55fa4270dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43696/0 (socket says 172.21.15.133:43696) 2024-02-15T23:29:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/2765665086 learned_addr learned my addr 172.21.15.133:0/2765665086 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc6e4b5640 1 --1- 172.21.15.133:0/2765665086 >> v1:172.21.15.131:6789/0 conn(0x55fa4270c320 0x55fa4270c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:40014/0 (socket says 172.21.15.133:40014) 2024-02-15T23:29:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/2765665086 >> v1:172.21.15.131:6789/0 conn(0x55fa4270c320 legacy=0x55fa4270c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.391+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/2765665086 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa4270e3c0 con 0x55fa4270d860 2024-02-15T23:29:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc6ecb6640 1 --2- 172.21.15.133:0/2765665086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270d860 0x55fa4270dc40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800a4e0 tx=0x7fcc6801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf02175d48926aa5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc6dcb4640 1 -- 172.21.15.133:0/2765665086 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc680aa540 con 0x55fa4270d860 2024-02-15T23:29:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc6dcb4640 1 -- 172.21.15.133:0/2765665086 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680a6070 con 0x55fa4270d860 2024-02-15T23:29:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc6dcb4640 1 -- 172.21.15.133:0/2765665086 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc680aa850 con 0x55fa4270d860 2024-02-15T23:29:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc7119b980 1 -- 172.21.15.133:0/2765665086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270d860 msgr2=0x55fa4270dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc7119b980 1 --2- 172.21.15.133:0/2765665086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270d860 0x55fa4270dc40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800a4e0 tx=0x7fcc6801b090 comp rx=0 tx=0).stop 2024-02-15T23:29:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc7119b980 1 -- 172.21.15.133:0/2765665086 shutdown_connections 2024-02-15T23:29:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc7119b980 1 --2- 172.21.15.133:0/2765665086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270d860 0x55fa4270dc40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc7119b980 1 -- 172.21.15.133:0/2765665086 >> 172.21.15.133:0/2765665086 conn(0x55fa4267fa40 msgr2=0x55fa4267fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc7119b980 1 -- 172.21.15.133:0/2765665086 shutdown_connections 2024-02-15T23:29:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.395+0000 7fcc7119b980 1 -- 172.21.15.133:0/2765665086 wait complete. 2024-02-15T23:29:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc7119b980 1 Processor -- start 2024-02-15T23:29:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc7119b980 1 -- start start 2024-02-15T23:29:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc7119b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc7119b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4261a6b0 con 0x55fa4270c320 2024-02-15T23:29:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc6ecb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc6ecb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427f67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43698/0 (socket says 172.21.15.133:43698) 2024-02-15T23:29:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/2316975375 learned_addr learned my addr 172.21.15.133:0/2316975375 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/2316975375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6800a1c0 con 0x55fa4270c320 2024-02-15T23:29:55.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcc6ecb6640 1 --2- 172.21.15.133:0/2316975375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427f67a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcc68018cc0 tx=0x7fcc680033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a6fadbaca37bc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcb5ce09640 1 -- 172.21.15.133:0/2316975375 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc680aa700 con 0x55fa4270c320 2024-02-15T23:29:55.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcb5ce09640 1 -- 172.21.15.133:0/2316975375 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680aa860 con 0x55fa4270c320 2024-02-15T23:29:55.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.411+0000 7fcb5ce09640 1 -- 172.21.15.133:0/2316975375 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc680aab20 con 0x55fa4270c320 2024-02-15T23:29:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- 172.21.15.133:0/2316975375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 msgr2=0x55fa427f67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 --2- 172.21.15.133:0/2316975375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427f67a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcc68018cc0 tx=0x7fcc680033b0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- 172.21.15.133:0/2316975375 shutdown_connections 2024-02-15T23:29:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 --2- 172.21.15.133:0/2316975375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427f67a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- 172.21.15.133:0/2316975375 >> 172.21.15.133:0/2316975375 conn(0x55fa4267fa40 msgr2=0x55fa427f2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- 172.21.15.133:0/2316975375 shutdown_connections 2024-02-15T23:29:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- 172.21.15.133:0/2316975375 wait complete. 2024-02-15T23:29:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 Processor -- start 2024-02-15T23:29:55.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- start start 2024-02-15T23:29:55.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa42615e90 con 0x55fa4270c320 2024-02-15T23:29:55.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc6ecb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc6ecb6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43704/0 (socket says 172.21.15.133:43704) 2024-02-15T23:29:55.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/198584473 learned_addr learned my addr 172.21.15.133:0/198584473 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/198584473 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa4270e3c0 con 0x55fa4270c320 2024-02-15T23:29:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc6ecb6640 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427fd510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcc68000f90 tx=0x7fcc68017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcb5b606640 1 -- 172.21.15.133:0/198584473 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc680c4070 con 0x55fa4270c320 2024-02-15T23:29:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcb5b606640 1 -- 172.21.15.133:0/198584473 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680b5650 con 0x55fa4270c320 2024-02-15T23:29:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa427fda50 con 0x55fa4270c320 2024-02-15T23:29:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcb5b606640 1 -- 172.21.15.133:0/198584473 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc680b58f0 con 0x55fa4270c320 2024-02-15T23:29:55.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa427fde80 con 0x55fa4270c320 2024-02-15T23:29:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.415+0000 7fcb5b606640 1 -- 172.21.15.133:0/198584473 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcc680a8070 con 0x55fa4270c320 2024-02-15T23:29:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcb5b606640 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb540342b0 0x7fcb54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcb5b606640 1 -- 172.21.15.133:0/198584473 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcc680e3a70 con 0x55fa4270c320 2024-02-15T23:29:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6e4b5640 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb540342b0 0x7fcb54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa4270d860 0x55fa428041a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428046e0 con 0x55fa4270d860 2024-02-15T23:29:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa4270d860 0x55fa428041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6e4b5640 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb540342b0 0x7fcb54036770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc60000f70 tx=0x7fcc60001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa4270d860 0x55fa428041a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/198584473 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc580083f0 con 0x55fa4270d860 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42804a60 con 0x55fa4270d860 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/198584473 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcc580083f0 con 0x55fa4270d860 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42806310 con 0x55fa4270d860 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/198584473 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fcc580083f0 con 0x55fa4270d860 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42805510 con 0x55fa4270d860 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/198584473 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcc580083f0 con 0x55fa4270d860 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42805920 con 0x55fa4270d860 2024-02-15T23:29:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/198584473 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcc58012040 con 0x55fa4270d860 2024-02-15T23:29:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 Processor -- start 2024-02-15T23:29:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 -- start start 2024-02-15T23:29:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42814a20 0x55fa42814e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc7119b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa425aef20 con 0x55fa42814a20 2024-02-15T23:29:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6e4b5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42814a20 0x55fa42814e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6e4b5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42814a20 0x55fa42814e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43706/0 (socket says 172.21.15.133:43706) 2024-02-15T23:29:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.419+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/1940569263 learned_addr learned my addr 172.21.15.133:0/1940569263 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/1940569263 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa42815380 con 0x55fa42814a20 2024-02-15T23:29:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc6e4b5640 1 --2- 172.21.15.133:0/1940569263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42814a20 0x55fa42814e40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcc60001ee0 tx=0x7fcc6000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcb58e01640 1 -- 172.21.15.133:0/1940569263 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc60007040 con 0x55fa42814a20 2024-02-15T23:29:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcb58e01640 1 -- 172.21.15.133:0/1940569263 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6000d660 con 0x55fa42814a20 2024-02-15T23:29:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc7119b980 1 -- 172.21.15.133:0/1940569263 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa428155d0 con 0x55fa42814a20 2024-02-15T23:29:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcb58e01640 1 -- 172.21.15.133:0/1940569263 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6000d900 con 0x55fa42814a20 2024-02-15T23:29:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc7119b980 1 -- 172.21.15.133:0/1940569263 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa42816120 con 0x55fa42814a20 2024-02-15T23:29:55.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcb58e01640 1 -- 172.21.15.133:0/1940569263 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcc6001a070 con 0x55fa42814a20 2024-02-15T23:29:55.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcb58e01640 1 --2- 172.21.15.133:0/1940569263 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb480343a0 0x7fcb48036860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcb58e01640 1 -- 172.21.15.133:0/1940569263 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcc60017050 con 0x55fa42814a20 2024-02-15T23:29:55.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/1940569263 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb480343a0 0x7fcb48036860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc7119b980 1 Processor -- start 2024-02-15T23:29:55.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc7119b980 1 -- start start 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/1940569263 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb480343a0 0x7fcb48036860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55fa42804f50 tx=0x7fcc58003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc7119b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42821d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc7119b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa425a2790 con 0x55fa42821940 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc6e4b5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42821d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc6e4b5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42821d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43712/0 (socket says 172.21.15.133:43712) 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/1599911902 learned_addr learned my addr 172.21.15.133:0/1599911902 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.423+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/1599911902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa42822310 con 0x55fa42821940 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc6e4b5640 1 --2- 172.21.15.133:0/1599911902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42821d40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcc60048b50 tx=0x7fcc6001aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cd8c97505ded6d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcb527fc640 1 -- 172.21.15.133:0/1599911902 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc60026d70 con 0x55fa42821940 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcb527fc640 1 -- 172.21.15.133:0/1599911902 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc60026ed0 con 0x55fa42821940 2024-02-15T23:29:55.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcb527fc640 1 -- 172.21.15.133:0/1599911902 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc60039480 con 0x55fa42821940 2024-02-15T23:29:55.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- 172.21.15.133:0/1599911902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 msgr2=0x55fa42821d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 --2- 172.21.15.133:0/1599911902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42821d40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcc60048b50 tx=0x7fcc6001aef0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- 172.21.15.133:0/1599911902 shutdown_connections 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 --2- 172.21.15.133:0/1599911902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42821d40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- 172.21.15.133:0/1599911902 >> 172.21.15.133:0/1599911902 conn(0x55fa4281dc80 msgr2=0x55fa4281bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- 172.21.15.133:0/1599911902 shutdown_connections 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- 172.21.15.133:0/1599911902 wait complete. 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 Processor -- start 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- start start 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42828780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa42828cc0 con 0x55fa42821940 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc6e4b5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42828780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc6e4b5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42828780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43720/0 (socket says 172.21.15.133:43720) 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 learned_addr learned my addr 172.21.15.133:0/3994960818 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa42816120 con 0x55fa42821940 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc6e4b5640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42828780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcc600479f0 tx=0x7fcc60048ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcb50ff9640 1 -- 172.21.15.133:0/3994960818 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6003e070 con 0x55fa42821940 2024-02-15T23:29:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa42828ec0 con 0x55fa42821940 2024-02-15T23:29:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcb50ff9640 1 -- 172.21.15.133:0/3994960818 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6003f040 con 0x55fa42821940 2024-02-15T23:29:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcb50ff9640 1 -- 172.21.15.133:0/3994960818 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6003ac60 con 0x55fa42821940 2024-02-15T23:29:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.427+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa42829350 con 0x55fa42821940 2024-02-15T23:29:55.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcb50ff9640 1 -- 172.21.15.133:0/3994960818 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcc6004a0d0 con 0x55fa42821940 2024-02-15T23:29:55.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcb50ff9640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb380342b0 0x7fcb38036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcb50ff9640 1 -- 172.21.15.133:0/3994960818 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcc60036c60 con 0x55fa42821940 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb380342b0 0x7fcb38036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa42833d60 0x55fa42836220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42836970 con 0x55fa42833d60 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6ecb6640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa42833d60 0x55fa42836220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb380342b0 0x7fcb38036770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcc58008fd0 tx=0x7fcc5801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6ecb6640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa42833d60 0x55fa42836220 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 realm 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42836d40 con 0x55fa42833d60 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428375c0 con 0x55fa42833d60 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42837920 con 0x55fa42833d60 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42838120 con 0x55fa42833d60 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 20 searching for the correct realm 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fa42839fb0 0x55fa4283c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283ca50 con 0x55fa42839fb0 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6e4b5640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fa42839fb0 0x55fa4283c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.431+0000 7fcc6e4b5640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fa42839fb0 0x55fa4283c3a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6e4b5640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc60035020 0x7fcc6001b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283ca50 con 0x7fcc60035020 2024-02-15T23:29:55.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc60035020 0x7fcc6001b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc60035020 0x7fcc6001b520 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc5802c040 con 0x7fcc60035020 2024-02-15T23:29:55.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6f4b7640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fcc58027940 0x7fcc580333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283ca50 con 0x7fcc58027940 2024-02-15T23:29:55.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fcc58027940 0x7fcc580333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fcc58027940 0x7fcc580333c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680c9810 con 0x7fcc58027940 2024-02-15T23:29:55.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283ca50 con 0x55fa42833d60 2024-02-15T23:29:55.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283ca50 con 0x55fa42833d60 2024-02-15T23:29:55.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc58027940 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.435+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680c9810 con 0x7fcc58027940 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc58027940 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680c9810 con 0x7fcc58027940 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc60035020 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc5802c040 con 0x7fcc60035020 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42839fb0 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42833d60 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc58027940 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680c9810 con 0x7fcc58027940 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42833d60 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc60035020 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcc5802c040 con 0x7fcc60035020 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42839fb0 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42839fb0 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.439+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc58027940 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680c9810 con 0x7fcc58027940 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42839fb0 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42839fb0 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42833d60 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42833d60 2024-02-15T23:29:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcc680c9810 con 0x55fa42833d60 2024-02-15T23:29:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc58027940 2024-02-15T23:29:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42839fb0 2024-02-15T23:29:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc60035020 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc5802c040 con 0x7fcc60035020 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42833d60 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc58027940 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.443+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42839fb0 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc58027940 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc60035020 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc5802c040 con 0x7fcc60035020 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42839fb0 2024-02-15T23:29:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc58027940 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x55fa42833d60 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcc680ed040 con 0x7fcc60035020 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc5802c040 con 0x7fcc60035020 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42838920 con 0x55fa42833d60 2024-02-15T23:29:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42838cd0 con 0x55fa42833d60 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42838cd0 con 0x55fa42833d60 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 zone default found 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 4 Realm: () 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 zonegroup default 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.447+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42839120 con 0x7fcc58027940 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42839520 con 0x55fa42839fb0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283e850 con 0x55fa42839fb0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 20 started sync module instance, tier type = 2024-02-15T23:29:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:55.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283e130 con 0x7fcc60035020 2024-02-15T23:29:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94533346122896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283e0b0 con 0x7fcc60035020 2024-02-15T23:29:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283f560 con 0x55fa42833d60 2024-02-15T23:29:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.451+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94533346122896] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.455+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.455+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94533346126880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283f4e0 con 0x55fa42833d60 2024-02-15T23:29:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.455+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283fce0 con 0x55fa42839fb0 2024-02-15T23:29:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.455+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.455+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94533346129424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428404e0 con 0x55fa42839fb0 2024-02-15T23:29:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.455+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42840e90 con 0x7fcc60035020 2024-02-15T23:29:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.455+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94533346126880] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.459+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.459+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94533346127936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42841240 con 0x7fcc60035020 2024-02-15T23:29:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.459+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42841bb0 con 0x55fa42833d60 2024-02-15T23:29:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.459+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94533346129424] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.459+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94533346127936] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.459+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.459+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94533346134448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42841710 con 0x55fa42833d60 2024-02-15T23:29:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.459+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42842400 con 0x7fcc58027940 2024-02-15T23:29:55.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.463+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94533346134448] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.463+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.463+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94533346132032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42842130 con 0x7fcc58027940 2024-02-15T23:29:55.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.463+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42842930 con 0x7fcc58027940 2024-02-15T23:29:55.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.463+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94533346132032] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.463+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.463+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94533346139552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428427e0 con 0x7fcc58027940 2024-02-15T23:29:55.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.463+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428432b0 con 0x7fcc58027940 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94533346143632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42843750 con 0x7fcc58027940 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 20 add_watcher() i=0 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 20 add_watcher() i=1 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 20 add_watcher() i=2 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 20 add_watcher() i=3 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 20 add_watcher() i=4 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 20 add_watcher() i=5 2024-02-15T23:29:55.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94533346139552] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 20 add_watcher() i=6 2024-02-15T23:29:55.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94533346143632] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 20 add_watcher() i=7 2024-02-15T23:29:55.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:55.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42842280 con 0x55fa42833d60 2024-02-15T23:29:55.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.467+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94533346140736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42843c30 con 0x55fa42833d60 2024-02-15T23:29:55.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.471+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94533346140736] v31'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.471+0000 7fcb257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.471+0000 7fcc7119b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:55.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.471+0000 7fcc7119b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:55.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.471+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ed10 con 0x55fa42833d60 2024-02-15T23:29:55.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.471+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.471+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284f150 con 0x7fcc58027940 2024-02-15T23:29:55.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.475+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.475+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284f5f0 con 0x55fa42839fb0 2024-02-15T23:29:55.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.475+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.475+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284fdf0 con 0x55fa42833d60 2024-02-15T23:29:55.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.475+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'122 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.475+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ce30 con 0x7fcc60035020 2024-02-15T23:29:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.479+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.479+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ce00 con 0x55fa42839fb0 2024-02-15T23:29:55.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.479+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'23 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.479+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42851050 con 0x55fa42833d60 2024-02-15T23:29:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.483+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.483+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42851050 con 0x7fcc58027940 2024-02-15T23:29:55.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.483+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.483+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42851050 con 0x7fcc60035020 2024-02-15T23:29:55.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.487+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.487+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42851620 con 0x55fa42839fb0 2024-02-15T23:29:55.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.487+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.487+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42851ff0 con 0x7fcc60035020 2024-02-15T23:29:55.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.487+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.487+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284bd60 con 0x7fcc58027940 2024-02-15T23:29:55.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.491+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.491+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x7fcc60035020 2024-02-15T23:29:55.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.491+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.491+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x7fcc58027940 2024-02-15T23:29:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.495+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'29 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.495+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42833d60 2024-02-15T23:29:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.495+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'123 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.495+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42839fb0 2024-02-15T23:29:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.499+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.499+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x7fcc60035020 2024-02-15T23:29:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.499+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'37 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.499+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42839fb0 2024-02-15T23:29:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.499+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.499+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42833d60 2024-02-15T23:29:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.503+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.503+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42833d60 2024-02-15T23:29:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.503+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'124 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.503+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42839fb0 2024-02-15T23:29:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.507+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.507+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x7fcc60035020 2024-02-15T23:29:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.507+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.507+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42839fb0 2024-02-15T23:29:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.507+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.507+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42839fb0 2024-02-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.511+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.511+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42839fb0 2024-02-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.511+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.511+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284c370 con 0x55fa42839fb0 2024-02-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.515+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.515+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42852b80 con 0x7fcc58027940 2024-02-15T23:29:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.515+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.515+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42852b80 con 0x55fa42839fb0 2024-02-15T23:29:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.515+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.515+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428529b0 con 0x7fcc58027940 2024-02-15T23:29:55.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.519+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.519+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428529b0 con 0x55fa42839fb0 2024-02-15T23:29:55.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.523+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'31 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.523+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428529b0 con 0x7fcc58027940 2024-02-15T23:29:55.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.523+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'30 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.523+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa428529b0 con 0x7fcc60035020 2024-02-15T23:29:55.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fca9ffff640 20 reqs_thread_entry: start 2024-02-15T23:29:55.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:55.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 20 Filter name: none 2024-02-15T23:29:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fca9dffb640 20 reqs_thread_entry: start 2024-02-15T23:29:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:29:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284b440 con 0x7fcc58027940 2024-02-15T23:29:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T23:29:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T23:29:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:29:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:55.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.527+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284b400 con 0x7fcc58027940 2024-02-15T23:29:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc7119b980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-15T23:29:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc7119b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T23:29:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94533346176512 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4286ee90 con 0x55fa42839fb0 2024-02-15T23:29:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== watch-notify(notify (1) cookie 94533346129424 notify 133143986179 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55fa42829350 con 0x55fa42839fb0 2024-02-15T23:29:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(96 notify.2 [notify cookie 94533346176512 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcb527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94533346129424 notifier 4528 bl.length()=170 2024-02-15T23:29:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcb527fc640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcb34003d60 con 0x55fa42839fb0 2024-02-15T23:29:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== watch-notify(notify_complete (2) cookie 94533346176512 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fa42828ec0 con 0x55fa42839fb0 2024-02-15T23:29:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.531+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x7fcc58027940 2024-02-15T23:29:55.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v31'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc7119b980 10 removing email index: 2024-02-15T23:29:55.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc7119b980 10 removing user buckets index 2024-02-15T23:29:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc7119b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-15T23:29:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94533346176512 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4286ee90 con 0x7fcc58027940 2024-02-15T23:29:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== watch-notify(notify (1) cookie 94533346139552 notify 133143986191 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7fcc68105040 con 0x7fcc58027940 2024-02-15T23:29:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcb527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94533346139552 notifier 4528 bl.length()=160 2024-02-15T23:29:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcb527fc640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcb34003d60 con 0x7fcc58027940 2024-02-15T23:29:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(99 notify.6 [notify cookie 94533346176512 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== watch-notify(notify_complete (2) cookie 94533346176512 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fa427fde80 con 0x7fcc58027940 2024-02-15T23:29:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.535+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x7fcc58027940 2024-02-15T23:29:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(101 fud.buckets [delete] v31'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc7119b980 10 removing user index: fud 2024-02-15T23:29:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc7119b980 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-15T23:29:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc7119b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-15T23:29:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94533346176512 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4286de80 con 0x7fcc58027940 2024-02-15T23:29:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== watch-notify(notify (1) cookie 94533346132032 notify 133143986192 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55fa427fde80 con 0x7fcc58027940 2024-02-15T23:29:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcb51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94533346132032 notifier 4528 bl.length()=152 2024-02-15T23:29:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcb51ffb640 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcaa40032c0 con 0x7fcc58027940 2024-02-15T23:29:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(102 notify.5 [notify cookie 94533346176512 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== watch-notify(notify_complete (2) cookie 94533346176512 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fa427fda50 con 0x7fcc58027940 2024-02-15T23:29:55.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.539+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x7fcc58027940 2024-02-15T23:29:55.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.543+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(104 fud [call,call,delete] v31'4 uv4 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.543+0000 7fcb257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.543+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94533346140736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x55fa42833d60 2024-02-15T23:29:55.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.543+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94533346140736] v31'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.547+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94533346122896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x7fcc60035020 2024-02-15T23:29:55.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.547+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94533346122896] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.547+0000 7fcc7119b980 20 remove_watcher() i=0 2024-02-15T23:29:55.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.547+0000 7fcc7119b980 2 removed watcher, disabling cache 2024-02-15T23:29:55.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.547+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94533346126880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x55fa42833d60 2024-02-15T23:29:55.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.547+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94533346126880] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.547+0000 7fcc7119b980 20 remove_watcher() i=1 2024-02-15T23:29:55.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.547+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94533346129424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4283ec20 con 0x55fa42839fb0 2024-02-15T23:29:55.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.551+0000 7fcc6e4b5640 1 -- 172.21.15.133:0/3994960818 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94533346129424] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc60051040 con 0x55fa42839fb0 2024-02-15T23:29:55.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.551+0000 7fcc7119b980 20 remove_watcher() i=2 2024-02-15T23:29:55.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.551+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94533346127936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x7fcc60035020 2024-02-15T23:29:55.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.551+0000 7fcc6f4b7640 1 -- 172.21.15.133:0/3994960818 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94533346127936] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc5803f040 con 0x7fcc60035020 2024-02-15T23:29:55.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.551+0000 7fcc7119b980 20 remove_watcher() i=3 2024-02-15T23:29:55.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.551+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94533346134448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x55fa42833d60 2024-02-15T23:29:55.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.555+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94533346134448] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x55fa42833d60 2024-02-15T23:29:55.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.555+0000 7fcc7119b980 20 remove_watcher() i=4 2024-02-15T23:29:55.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.555+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94533346132032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x7fcc58027940 2024-02-15T23:29:55.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.555+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94533346132032] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.555+0000 7fcc7119b980 20 remove_watcher() i=5 2024-02-15T23:29:55.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.555+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94533346139552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa42840040 con 0x7fcc58027940 2024-02-15T23:29:55.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.559+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94533346139552] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.559+0000 7fcc7119b980 20 remove_watcher() i=6 2024-02-15T23:29:55.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.559+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94533346143632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fa4284ae00 con 0x7fcc58027940 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94533346143632] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc680fd040 con 0x7fcc58027940 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 20 remove_watcher() i=7 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fcc58027940 msgr2=0x7fcc580333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fcc58027940 0x7fcc580333c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa42833d60 msgr2=0x55fa42836220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa42833d60 0x55fa42836220 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc60035020 msgr2=0x7fcc6001b520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fcc60035020 0x7fcc6001b520 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fa42839fb0 msgr2=0x55fa4283c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fa42839fb0 0x55fa4283c3a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb380342b0 msgr2=0x7fcb38036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb380342b0 0x7fcb38036770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcc58008fd0 tx=0x7fcc5801c070 comp rx=0 tx=0).stop 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 msgr2=0x55fa42828780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/3994960818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42821940 0x55fa42828780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcc600479f0 tx=0x7fcc60048ab0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 reap_dead start 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc6ecb6640 1 -- 172.21.15.133:0/3994960818 reap_dead start 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 shutdown_connections 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 >> 172.21.15.133:0/3994960818 conn(0x55fa4281dc80 msgr2=0x55fa4281b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 shutdown_connections 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/3994960818 wait complete. 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/1940569263 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb480343a0 msgr2=0x7fcb48036860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/1940569263 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb480343a0 0x7fcb48036860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55fa42804f50 tx=0x7fcc58003070 comp rx=0 tx=0).stop 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/1940569263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42814a20 msgr2=0x55fa42814e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/1940569263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42814a20 0x55fa42814e40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcc60001ee0 tx=0x7fcc6000ea10 comp rx=0 tx=0).stop 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/1940569263 shutdown_connections 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/1940569263 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb480343a0 0x7fcb48036860 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/1940569263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa42814a20 0x55fa42814e40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/1940569263 >> 172.21.15.133:0/1940569263 conn(0x55fa42809830 msgr2=0x55fa4280a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/1940569263 shutdown_connections 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/1940569263 wait complete. 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa4270d860 msgr2=0x55fa428041a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa4270d860 0x55fa428041a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb540342b0 msgr2=0x7fcb54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb540342b0 0x7fcb54036770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc60000f70 tx=0x7fcc60001380 comp rx=0 tx=0).stop 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 msgr2=0x55fa427fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427fd510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcc68000f90 tx=0x7fcc68017e30 comp rx=0 tx=0).stop 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 shutdown_connections 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fa4270d860 0x55fa428041a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fcb540342b0 0x7fcb54036770 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 --2- 172.21.15.133:0/198584473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fa4270c320 0x55fa427fd510 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 >> 172.21.15.133:0/198584473 conn(0x55fa4267fa40 msgr2=0x55fa427f0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 shutdown_connections 2024-02-15T23:29:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.563+0000 7fcc7119b980 1 -- 172.21.15.133:0/198584473 wait complete. 2024-02-15T23:29:55.584 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-15T23:29:55.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-15T23:29:55.584 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-15T23:29:55.674 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:55.675 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e7f38980 1 Processor -- start 2024-02-15T23:29:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e7f38980 1 -- start start 2024-02-15T23:29:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e7f38980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5627cd3a8800 0x5627cd3a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e7f38980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5627cd2f1460 con 0x5627cd3a72c0 2024-02-15T23:29:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e7f38980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5627cd2b8180 con 0x5627cd3a8800 2024-02-15T23:29:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e5a53640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5627cd3a8800 0x5627cd3a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e5252640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5627cd3a72c0 0x5627cd3a76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:40022/0 (socket says 172.21.15.133:40022) 2024-02-15T23:29:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e5252640 1 -- 172.21.15.133:0/4229910772 learned_addr learned my addr 172.21.15.133:0/4229910772 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e4a51640 1 -- 172.21.15.133:0/4229910772 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929108217 0 0) 0x5627cd2f1460 con 0x5627cd3a72c0 2024-02-15T23:29:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e5a53640 1 -- 172.21.15.133:0/4229910772 >> v1:172.21.15.131:6789/0 conn(0x5627cd3a72c0 legacy=0x5627cd3a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.667+0000 7fe3e5a53640 1 -- 172.21.15.133:0/4229910772 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cd3a9360 con 0x5627cd3a8800 2024-02-15T23:29:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e5a53640 1 --2- 172.21.15.133:0/4229910772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a8800 0x5627cd3a8be0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00a480 tx=0x7fe3dc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9801107c7bf21d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e4a51640 1 -- 172.21.15.133:0/4229910772 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0ab540 con 0x5627cd3a8800 2024-02-15T23:29:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e4a51640 1 -- 172.21.15.133:0/4229910772 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0ab6a0 con 0x5627cd3a8800 2024-02-15T23:29:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e4a51640 1 -- 172.21.15.133:0/4229910772 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0ab960 con 0x5627cd3a8800 2024-02-15T23:29:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4229910772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a8800 msgr2=0x5627cd3a8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/4229910772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a8800 0x5627cd3a8be0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00a480 tx=0x7fe3dc01b280 comp rx=0 tx=0).stop 2024-02-15T23:29:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4229910772 shutdown_connections 2024-02-15T23:29:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/4229910772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a8800 0x5627cd3a8be0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4229910772 >> 172.21.15.133:0/4229910772 conn(0x5627cd31a9e0 msgr2=0x5627cd31adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4229910772 shutdown_connections 2024-02-15T23:29:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.671+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4229910772 wait complete. 2024-02-15T23:29:55.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.687+0000 7fe3e7f38980 1 Processor -- start 2024-02-15T23:29:55.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.687+0000 7fe3e7f38980 1 -- start start 2024-02-15T23:29:55.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.687+0000 7fe3e7f38980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd491650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.687+0000 7fe3e7f38980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd2b56b0 con 0x5627cd3a72c0 2024-02-15T23:29:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.687+0000 7fe3e5a53640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd491650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.687+0000 7fe3e5a53640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd491650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43740/0 (socket says 172.21.15.133:43740) 2024-02-15T23:29:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.687+0000 7fe3e5a53640 1 -- 172.21.15.133:0/3052955503 learned_addr learned my addr 172.21.15.133:0/3052955503 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.687+0000 7fe3e5a53640 1 -- 172.21.15.133:0/3052955503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc005d30 con 0x5627cd3a72c0 2024-02-15T23:29:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e5a53640 1 --2- 172.21.15.133:0/3052955503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd491650 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00a480 tx=0x7fe3dc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafbc4e3c28a10d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe2d3e07640 1 -- 172.21.15.133:0/3052955503 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0ab940 con 0x5627cd3a72c0 2024-02-15T23:29:55.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe2d3e07640 1 -- 172.21.15.133:0/3052955503 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0abaa0 con 0x5627cd3a72c0 2024-02-15T23:29:55.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe2d3e07640 1 -- 172.21.15.133:0/3052955503 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0abd80 con 0x5627cd3a72c0 2024-02-15T23:29:55.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3052955503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 msgr2=0x5627cd491650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/3052955503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd491650 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00a480 tx=0x7fe3dc003030 comp rx=0 tx=0).stop 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3052955503 shutdown_connections 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/3052955503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd491650 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3052955503 >> 172.21.15.133:0/3052955503 conn(0x5627cd31a9e0 msgr2=0x5627cd48d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3052955503 shutdown_connections 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3052955503 wait complete. 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 Processor -- start 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- start start 2024-02-15T23:29:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd498330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd2b0e90 con 0x5627cd3a72c0 2024-02-15T23:29:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e5a53640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd498330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e5a53640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd498330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43744/0 (socket says 172.21.15.133:43744) 2024-02-15T23:29:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e5a53640 1 -- 172.21.15.133:0/1007155748 learned_addr learned my addr 172.21.15.133:0/1007155748 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e5a53640 1 -- 172.21.15.133:0/1007155748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cd3a9360 con 0x5627cd3a72c0 2024-02-15T23:29:55.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e5a53640 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd498330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0b8040 tx=0x7fe3dc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe2d2604640 1 -- 172.21.15.133:0/1007155748 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0c0670 con 0x5627cd3a72c0 2024-02-15T23:29:55.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe2d2604640 1 -- 172.21.15.133:0/1007155748 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0c07d0 con 0x5627cd3a72c0 2024-02-15T23:29:55.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627cd498870 con 0x5627cd3a72c0 2024-02-15T23:29:55.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe2d2604640 1 -- 172.21.15.133:0/1007155748 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0c0a90 con 0x5627cd3a72c0 2024-02-15T23:29:55.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.691+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627cd498ca0 con 0x5627cd3a72c0 2024-02-15T23:29:55.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe2d2604640 1 -- 172.21.15.133:0/1007155748 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe3dc0c0bf0 con 0x5627cd3a72c0 2024-02-15T23:29:55.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe2d2604640 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2cc034300 0x7fe2cc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe2d2604640 1 -- 172.21.15.133:0/1007155748 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe3dc0e4580 con 0x5627cd3a72c0 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e5252640 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2cc034300 0x7fe2cc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd3a8800 0x5627cd49efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd49f500 con 0x5627cd3a8800 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e6254640 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd3a8800 0x5627cd49efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e5252640 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2cc034300 0x7fe2cc0367c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8000c10 tx=0x7fe3d80013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e6254640 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd3a8800 0x5627cd49efc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e6254640 1 -- 172.21.15.133:0/1007155748 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e000a4d0 con 0x5627cd3a8800 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd49f860 con 0x5627cd3a8800 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e6254640 1 -- 172.21.15.133:0/1007155748 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe3e000a4d0 con 0x5627cd3a8800 2024-02-15T23:29:55.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4a10c0 con 0x5627cd3a8800 2024-02-15T23:29:55.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e6254640 1 -- 172.21.15.133:0/1007155748 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe3e000a4d0 con 0x5627cd3a8800 2024-02-15T23:29:55.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4a02c0 con 0x5627cd3a8800 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e6254640 1 -- 172.21.15.133:0/1007155748 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3e000a4d0 con 0x5627cd3a8800 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.695+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4a06d0 con 0x5627cd3a8800 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e6254640 1 -- 172.21.15.133:0/1007155748 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe3e000a4d0 con 0x5627cd3a8800 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e7f38980 1 Processor -- start 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e7f38980 1 -- start start 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e7f38980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4af800 0x5627cd4afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e7f38980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd249f20 con 0x5627cd4af800 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e5252640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4af800 0x5627cd4afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e5252640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4af800 0x5627cd4afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43754/0 (socket says 172.21.15.133:43754) 2024-02-15T23:29:55.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e5252640 1 -- 172.21.15.133:0/4202430181 learned_addr learned my addr 172.21.15.133:0/4202430181 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e5252640 1 -- 172.21.15.133:0/4202430181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cd4b0160 con 0x5627cd4af800 2024-02-15T23:29:55.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e5252640 1 --2- 172.21.15.133:0/4202430181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4af800 0x5627cd4afc20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800e620 tx=0x7fe3d800e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe2cb7fe640 1 -- 172.21.15.133:0/4202430181 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d801b380 con 0x5627cd4af800 2024-02-15T23:29:55.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4202430181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627cd4b03b0 con 0x5627cd4af800 2024-02-15T23:29:55.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe2cb7fe640 1 -- 172.21.15.133:0/4202430181 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d801b4e0 con 0x5627cd4af800 2024-02-15T23:29:55.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe2cb7fe640 1 -- 172.21.15.133:0/4202430181 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d801b780 con 0x5627cd4af800 2024-02-15T23:29:55.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4202430181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627cd4b0f00 con 0x5627cd4af800 2024-02-15T23:29:55.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.699+0000 7fe2cb7fe640 1 -- 172.21.15.133:0/4202430181 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe3d801a070 con 0x5627cd4af800 2024-02-15T23:29:55.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe2cb7fe640 1 --2- 172.21.15.133:0/4202430181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2c00342b0 0x7fe2c0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe2cb7fe640 1 -- 172.21.15.133:0/4202430181 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe3d8017050 con 0x5627cd4af800 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e6254640 1 --2- 172.21.15.133:0/4202430181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2c00342b0 0x7fe2c0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 Processor -- start 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e6254640 1 --2- 172.21.15.133:0/4202430181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2c00342b0 0x7fe2c0036770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5627cd49fca0 tx=0x7fe3e0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- start start 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd23d790 con 0x5627cd4bc780 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e5252640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e5252640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4bcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43758/0 (socket says 172.21.15.133:43758) 2024-02-15T23:29:55.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e5252640 1 -- 172.21.15.133:0/3542963269 learned_addr learned my addr 172.21.15.133:0/3542963269 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e5252640 1 -- 172.21.15.133:0/3542963269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cd4bd170 con 0x5627cd4bc780 2024-02-15T23:29:55.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e5252640 1 --2- 172.21.15.133:0/3542963269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4bcba0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c010 tx=0x7fe3d800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f426d73a73671a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe2c97fa640 1 -- 172.21.15.133:0/3542963269 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d8047070 con 0x5627cd4bc780 2024-02-15T23:29:55.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe2c97fa640 1 -- 172.21.15.133:0/3542963269 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d801bc60 con 0x5627cd4bc780 2024-02-15T23:29:55.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe2c97fa640 1 -- 172.21.15.133:0/3542963269 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d800d300 con 0x5627cd4bc780 2024-02-15T23:29:55.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3542963269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 msgr2=0x5627cd4bcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/3542963269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4bcba0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c010 tx=0x7fe3d800da50 comp rx=0 tx=0).stop 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3542963269 shutdown_connections 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/3542963269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4bcba0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3542963269 >> 172.21.15.133:0/3542963269 conn(0x5627cd4b8b10 msgr2=0x5627cd4b6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3542963269 shutdown_connections 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- 172.21.15.133:0/3542963269 wait complete. 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 Processor -- start 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- start start 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.703+0000 7fe3e7f38980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cd4c3bf0 con 0x5627cd4bc780 2024-02-15T23:29:55.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e5252640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e5252640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43768/0 (socket says 172.21.15.133:43768) 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 learned_addr learned my addr 172.21.15.133:0/2033343214 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cd4b0f00 con 0x5627cd4bc780 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e5252640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4c36b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8024460 tx=0x7fe3d8048a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe2b77fe640 1 -- 172.21.15.133:0/2033343214 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d801bdd0 con 0x5627cd4bc780 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627cd4c3df0 con 0x5627cd4bc780 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627cd4c4220 con 0x5627cd4bc780 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe2b77fe640 1 -- 172.21.15.133:0/2033343214 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d804a070 con 0x5627cd4bc780 2024-02-15T23:29:55.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe2b77fe640 1 -- 172.21.15.133:0/2033343214 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d804a330 con 0x5627cd4bc780 2024-02-15T23:29:55.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe2b77fe640 1 -- 172.21.15.133:0/2033343214 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe3d804a840 con 0x5627cd4bc780 2024-02-15T23:29:55.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe2b77fe640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2b0034300 0x7fe2b00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe2b77fe640 1 -- 172.21.15.133:0/2033343214 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe3d8009050 con 0x5627cd4bc780 2024-02-15T23:29:55.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e6254640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2b0034300 0x7fe2b00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd4cec80 0x5627cd4d1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d1870 con 0x5627cd4cec80 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e5a53640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd4cec80 0x5627cd4d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e6254640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2b0034300 0x7fe2b00367c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0011010 tx=0x7fe3e0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.707+0000 7fe3e5a53640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd4cec80 0x5627cd4d1120 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 realm 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d1c40 con 0x5627cd4cec80 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d2490 con 0x5627cd4cec80 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d27f0 con 0x5627cd4cec80 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d2ff0 con 0x5627cd4cec80 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 20 searching for the correct realm 2024-02-15T23:29:55.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5627cd4d4e80 0x5627cd4d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x5627cd4d4e80 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5252640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5627cd4d4e80 0x5627cd4d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5252640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5627cd4d4e80 0x5627cd4d72b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5252640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe3d8036070 0x7fe3d8036860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x7fe3d8036070 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e6254640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe3d8036070 0x7fe3d8036860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e6254640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe3d8036070 0x7fe3d8036860 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000a4d0 con 0x7fe3d8036070 2024-02-15T23:29:55.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e6254640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe3e00141d0 0x7fe3e0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x7fe3e00141d0 2024-02-15T23:29:55.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.711+0000 7fe3e5a53640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe3e00141d0 0x7fe3e0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe3e00141d0 0x7fe3e0015940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x5627cd4cec80 2024-02-15T23:29:55.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x5627cd4cec80 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x7fe3e00141d0 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x7fe3e00141d0 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x7fe3d8036070 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000a4d0 con 0x7fe3d8036070 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x5627cd4d4e80 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d7930 con 0x5627cd4cec80 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3e00141d0 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.715+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4cec80 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3d8036070 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4d4e80 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4d4e80 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3e00141d0 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4d4e80 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4d4e80 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4cec80 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4cec80 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3e00141d0 2024-02-15T23:29:55.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4d4e80 2024-02-15T23:29:55.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.719+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3d8036070 2024-02-15T23:29:55.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4cec80 2024-02-15T23:29:55.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x5627cd4cec80 2024-02-15T23:29:55.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3e00141d0 2024-02-15T23:29:55.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4d4e80 2024-02-15T23:29:55.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3e00141d0 2024-02-15T23:29:55.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3d8036070 2024-02-15T23:29:55.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4d4e80 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3e00141d0 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0b2040 con 0x7fe3e00141d0 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x5627cd4cec80 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.723+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe3dc0ed040 con 0x7fe3d8036070 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:55.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d37f0 con 0x5627cd4cec80 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d3ba0 con 0x5627cd4cec80 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d3f80 con 0x5627cd4cec80 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 zone default found 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 4 Realm: () 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 zonegroup default 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d4370 con 0x7fe3e00141d0 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d4370 con 0x5627cd4d4e80 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d9750 con 0x5627cd4d4e80 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 started sync module instance, tier type = 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:55.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d9030 con 0x7fe3d8036070 2024-02-15T23:29:55.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728948124560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d93e0 con 0x7fe3d8036070 2024-02-15T23:29:55.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.727+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4da4b0 con 0x5627cd4cec80 2024-02-15T23:29:55.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.731+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728948124560] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.731+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.731+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728948128624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4da430 con 0x5627cd4cec80 2024-02-15T23:29:55.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.731+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4daea0 con 0x5627cd4d4e80 2024-02-15T23:29:55.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.731+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728948128624] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.731+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.731+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728948129680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4da3b0 con 0x5627cd4d4e80 2024-02-15T23:29:55.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dbb90 con 0x7fe3d8036070 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728948135968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dc3e0 con 0x7fe3d8036070 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dcdd0 con 0x5627cd4cec80 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728948129680] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728948135968] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728948140208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dbf40 con 0x5627cd4cec80 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.735+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dd620 con 0x7fe3e00141d0 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.739+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728948140208] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.739+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.739+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728948134480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dbf40 con 0x7fe3e00141d0 2024-02-15T23:29:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.739+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4ddb30 con 0x7fe3e00141d0 2024-02-15T23:29:55.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.739+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.739+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728948143696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4ddf10 con 0x7fe3e00141d0 2024-02-15T23:29:55.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4de990 con 0x7fe3e00141d0 2024-02-15T23:29:55.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728948134480] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728948143696] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728948147344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dda70 con 0x7fe3e00141d0 2024-02-15T23:29:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 20 add_watcher() i=0 2024-02-15T23:29:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 20 add_watcher() i=1 2024-02-15T23:29:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 20 add_watcher() i=2 2024-02-15T23:29:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 20 add_watcher() i=3 2024-02-15T23:29:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 20 add_watcher() i=4 2024-02-15T23:29:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 20 add_watcher() i=5 2024-02-15T23:29:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.743+0000 7fe3e7f38980 20 add_watcher() i=6 2024-02-15T23:29:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728948147344] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 add_watcher() i=7 2024-02-15T23:29:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dda70 con 0x5627cd4cec80 2024-02-15T23:29:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728948142048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dda70 con 0x5627cd4cec80 2024-02-15T23:29:55.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728948142048] v31'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe2977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 5 note: GC not initialized 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe2967fc640 20 reqs_thread_entry: start 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 Filter name: none 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe207fff640 20 reqs_thread_entry: start 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd503a40 con 0x7fe3e00141d0 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd502160 con 0x7fe3e00141d0 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-15T23:29:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T23:29:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T23:29:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.747+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~386 in=386b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd506030 con 0x7fe3e00141d0 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~386] v31'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e7f38980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e7f38980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e7f38980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94728948304528 in=589b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd5069e0 con 0x7fe3d8036070 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== watch-notify(notify (1) cookie 94728948135968 notify 133143986188 ret 0) v3 ==== 619+0+0 (crc 0 0 0) 0x7fe3e0026c90 con 0x7fe3d8036070 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe2c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94728948135968 notifier 4535 bl.length()=577 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe2c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(65 notify.3 [notify cookie 94728948304528 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe2c97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T23:29:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe2c97fa640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe2a8003ea0 con 0x7fe3d8036070 2024-02-15T23:29:55.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== watch-notify(notify_complete (2) cookie 94728948304528 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe3e0030410 con 0x7fe3d8036070 2024-02-15T23:29:55.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.751+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd506950 con 0x7fe3e00141d0 2024-02-15T23:29:55.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v31'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e7f38980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T23:29:55.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e7f38980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e7f38980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94728948312400 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd506dd0 con 0x5627cd4d4e80 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== watch-notify(notify (1) cookie 94728948129680 notify 133143986180 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x5627cd4c4220 con 0x5627cd4d4e80 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe2c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94728948129680 notifier 4535 bl.length()=192 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe2c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe2c97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe2c97fa640 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe2a8003ea0 con 0x5627cd4d4e80 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(68 notify.2 [notify cookie 94728948312400 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== watch-notify(notify_complete (2) cookie 94728948312400 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe3d804f070 con 0x5627cd4d4e80 2024-02-15T23:29:55.766 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:55.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe2977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.755+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728948142048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4e3ce0 con 0x5627cd4cec80 2024-02-15T23:29:55.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94728948142048] v31'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728948124560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dcfe0 con 0x7fe3d8036070 2024-02-15T23:29:55.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94728948124560] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e7f38980 20 remove_watcher() i=0 2024-02-15T23:29:55.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e7f38980 2 removed watcher, disabling cache 2024-02-15T23:29:55.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728948128624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dcfe0 con 0x5627cd4cec80 2024-02-15T23:29:55.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94728948128624] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e7f38980 20 remove_watcher() i=1 2024-02-15T23:29:55.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.759+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728948129680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4d9b70 con 0x5627cd4d4e80 2024-02-15T23:29:55.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.763+0000 7fe3e5252640 1 -- 172.21.15.133:0/2033343214 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94728948129680] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3d800c040 con 0x5627cd4d4e80 2024-02-15T23:29:55.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.763+0000 7fe3e7f38980 20 remove_watcher() i=2 2024-02-15T23:29:55.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.763+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728948135968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dcfe0 con 0x7fe3d8036070 2024-02-15T23:29:55.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.763+0000 7fe3e6254640 1 -- 172.21.15.133:0/2033343214 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94728948135968] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e003a040 con 0x7fe3d8036070 2024-02-15T23:29:55.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.763+0000 7fe3e7f38980 20 remove_watcher() i=3 2024-02-15T23:29:55.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.763+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728948140208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dcfe0 con 0x5627cd4cec80 2024-02-15T23:29:55.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.767+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94728948140208] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x5627cd4cec80 2024-02-15T23:29:55.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.767+0000 7fe3e7f38980 20 remove_watcher() i=4 2024-02-15T23:29:55.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.767+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728948134480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dc8b0 con 0x7fe3e00141d0 2024-02-15T23:29:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.767+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94728948134480] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.767+0000 7fe3e7f38980 20 remove_watcher() i=5 2024-02-15T23:29:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.767+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728948143696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dc8b0 con 0x7fe3e00141d0 2024-02-15T23:29:55.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94728948143696] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 20 remove_watcher() i=6 2024-02-15T23:29:55.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728948147344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5627cd4dc8b0 con 0x7fe3e00141d0 2024-02-15T23:29:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94728948147344] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0fb080 con 0x7fe3e00141d0 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 20 remove_watcher() i=7 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe3e00141d0 msgr2=0x7fe3e0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fe3e00141d0 0x7fe3e0015940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd4cec80 msgr2=0x5627cd4d1120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd4cec80 0x5627cd4d1120 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe3d8036070 msgr2=0x7fe3d8036860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe3d8036070 0x7fe3d8036860 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5627cd4d4e80 msgr2=0x5627cd4d72b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5627cd4d4e80 0x5627cd4d72b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2b0034300 msgr2=0x7fe2b00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2b0034300 0x7fe2b00367c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0011010 tx=0x7fe3e0020000 comp rx=0 tx=0).stop 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 msgr2=0x5627cd4c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e5a53640 1 -- 172.21.15.133:0/2033343214 reap_dead start 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4c36b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8024460 tx=0x7fe3d8048a20 comp rx=0 tx=0).stop 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 shutdown_connections 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/2033343214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4bc780 0x5627cd4c36b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 >> 172.21.15.133:0/2033343214 conn(0x5627cd4b8b10 msgr2=0x5627cd4b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 shutdown_connections 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.771+0000 7fe3e7f38980 1 -- 172.21.15.133:0/2033343214 wait complete. 2024-02-15T23:29:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4202430181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2c00342b0 msgr2=0x7fe2c0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/4202430181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2c00342b0 0x7fe2c0036770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5627cd49fca0 tx=0x7fe3e0005850 comp rx=0 tx=0).stop 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4202430181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4af800 msgr2=0x5627cd4afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/4202430181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4af800 0x5627cd4afc20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800e620 tx=0x7fe3d800e650 comp rx=0 tx=0).stop 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4202430181 shutdown_connections 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/4202430181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2c00342b0 0x7fe2c0036770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/4202430181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd4af800 0x5627cd4afc20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4202430181 >> 172.21.15.133:0/4202430181 conn(0x5627cd4a4610 msgr2=0x5627cd4a5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4202430181 shutdown_connections 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/4202430181 wait complete. 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd3a8800 msgr2=0x5627cd49efc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd3a8800 0x5627cd49efc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2cc034300 msgr2=0x7fe2cc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2cc034300 0x7fe2cc0367c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8000c10 tx=0x7fe3d80013c0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 msgr2=0x5627cd498330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd498330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0b8040 tx=0x7fe3dc018020 comp rx=0 tx=0).stop 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 shutdown_connections 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5627cd3a8800 0x5627cd49efc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe2cc034300 0x7fe2cc0367c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 --2- 172.21.15.133:0/1007155748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627cd3a72c0 0x5627cd498330 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 >> 172.21.15.133:0/1007155748 conn(0x5627cd31a9e0 msgr2=0x5627cd48bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 shutdown_connections 2024-02-15T23:29:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.775+0000 7fe3e7f38980 1 -- 172.21.15.133:0/1007155748 wait complete. 2024-02-15T23:29:55.794 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:55.795 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-15T23:29:55.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-15T23:29:55.795 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-02-15T23:29:55.829 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:55.829 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:55.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb87baa8980 1 Processor -- start 2024-02-15T23:29:55.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb87baa8980 1 -- start start 2024-02-15T23:29:55.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb87baa8980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556930970640 0x556930a040e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb87baa8980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556930947460 con 0x556930971980 2024-02-15T23:29:55.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb87baa8980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55693090e180 con 0x556930970640 2024-02-15T23:29:55.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb878dc2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556930970640 0x556930a040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb878dc2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556930970640 0x556930a040e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43784/0 (socket says 172.21.15.133:43784) 2024-02-15T23:29:55.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb878dc2640 1 -- 172.21.15.133:0/2709687197 learned_addr learned my addr 172.21.15.133:0/2709687197 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb8795c3640 1 --1- 172.21.15.133:0/2709687197 >> v1:172.21.15.131:6789/0 conn(0x556930971980 0x55693096ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:40026/0 (socket says 172.21.15.133:40026) 2024-02-15T23:29:55.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb878dc2640 1 -- 172.21.15.133:0/2709687197 >> v1:172.21.15.131:6789/0 conn(0x556930971980 legacy=0x55693096ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb878dc2640 1 -- 172.21.15.133:0/2709687197 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556930970a50 con 0x556930970640 2024-02-15T23:29:55.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.823+0000 7fb878dc2640 1 --2- 172.21.15.133:0/2709687197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930a040e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a5c0 tx=0x7fb87001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c774757443949b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb86bfff640 1 -- 172.21.15.133:0/2709687197 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8700ac460 con 0x556930970640 2024-02-15T23:29:55.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb86bfff640 1 -- 172.21.15.133:0/2709687197 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8700ac5c0 con 0x556930970640 2024-02-15T23:29:55.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb86bfff640 1 -- 172.21.15.133:0/2709687197 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8700ac880 con 0x556930970640 2024-02-15T23:29:55.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb87baa8980 1 -- 172.21.15.133:0/2709687197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 msgr2=0x556930a040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb87baa8980 1 --2- 172.21.15.133:0/2709687197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930a040e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a5c0 tx=0x7fb87001b340 comp rx=0 tx=0).stop 2024-02-15T23:29:55.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb87baa8980 1 -- 172.21.15.133:0/2709687197 shutdown_connections 2024-02-15T23:29:55.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb87baa8980 1 --2- 172.21.15.133:0/2709687197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930a040e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb87baa8980 1 -- 172.21.15.133:0/2709687197 >> 172.21.15.133:0/2709687197 conn(0x5569309f69a0 msgr2=0x5569309f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb87baa8980 1 -- 172.21.15.133:0/2709687197 shutdown_connections 2024-02-15T23:29:55.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.827+0000 7fb87baa8980 1 -- 172.21.15.133:0/2709687197 wait complete. 2024-02-15T23:29:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.839+0000 7fb87baa8980 1 Processor -- start 2024-02-15T23:29:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.839+0000 7fb87baa8980 1 -- start start 2024-02-15T23:29:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.839+0000 7fb87baa8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930ae74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.839+0000 7fb87baa8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693090b6b0 con 0x556930970640 2024-02-15T23:29:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.839+0000 7fb8795c3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930ae74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930ae74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43794/0 (socket says 172.21.15.133:43794) 2024-02-15T23:29:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 -- 172.21.15.133:0/7107187 learned_addr learned my addr 172.21.15.133:0/7107187 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 -- 172.21.15.133:0/7107187 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870005df0 con 0x556930970640 2024-02-15T23:29:55.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 --2- 172.21.15.133:0/7107187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930ae74e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb86c001cc0 tx=0x7fb86c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ef86543110cf server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb767606640 1 -- 172.21.15.133:0/7107187 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb86c014070 con 0x556930970640 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb767606640 1 -- 172.21.15.133:0/7107187 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c00f590 con 0x556930970640 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb767606640 1 -- 172.21.15.133:0/7107187 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb86c007040 con 0x556930970640 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- 172.21.15.133:0/7107187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 msgr2=0x556930ae74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 --2- 172.21.15.133:0/7107187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930ae74e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb86c001cc0 tx=0x7fb86c00b610 comp rx=0 tx=0).stop 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- 172.21.15.133:0/7107187 shutdown_connections 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 --2- 172.21.15.133:0/7107187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930ae74e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- 172.21.15.133:0/7107187 >> 172.21.15.133:0/7107187 conn(0x5569309f69a0 msgr2=0x556930ae3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- 172.21.15.133:0/7107187 shutdown_connections 2024-02-15T23:29:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- 172.21.15.133:0/7107187 wait complete. 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 Processor -- start 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- start start 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930aee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556930906e90 con 0x556930970640 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930aee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930aee490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43798/0 (socket says 172.21.15.133:43798) 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 -- 172.21.15.133:0/3317881015 learned_addr learned my addr 172.21.15.133:0/3317881015 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 -- 172.21.15.133:0/3317881015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556930947460 con 0x556930970640 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb8795c3640 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930aee490 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x556930ae8370 tx=0x7fb86c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb765e03640 1 -- 172.21.15.133:0/3317881015 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb86c014030 con 0x556930970640 2024-02-15T23:29:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556930aee9d0 con 0x556930970640 2024-02-15T23:29:55.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb765e03640 1 -- 172.21.15.133:0/3317881015 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c01c840 con 0x556930970640 2024-02-15T23:29:55.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb765e03640 1 -- 172.21.15.133:0/3317881015 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb86c01cb40 con 0x556930970640 2024-02-15T23:29:55.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.843+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556930aeee80 con 0x556930970640 2024-02-15T23:29:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb765e03640 1 -- 172.21.15.133:0/3317881015 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb86c01cca0 con 0x556930970640 2024-02-15T23:29:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb765e03640 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb760034300 0x7fb7600367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb765e03640 1 -- 172.21.15.133:0/3317881015 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb86c006070 con 0x556930970640 2024-02-15T23:29:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb878dc2640 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb760034300 0x7fb7600367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930971980 0x556930af5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930af55d0 con 0x556930971980 2024-02-15T23:29:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb879dc4640 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930971980 0x556930af5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb878dc2640 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb760034300 0x7fb7600367c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb8700ae000 tx=0x7fb8700a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb879dc4640 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930971980 0x556930af5090 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb879dc4640 1 -- 172.21.15.133:0/3317881015 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb87400a4d0 con 0x556930971980 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930af59e0 con 0x556930971980 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb879dc4640 1 -- 172.21.15.133:0/3317881015 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb87400a4d0 con 0x556930971980 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930af7290 con 0x556930971980 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb879dc4640 1 -- 172.21.15.133:0/3317881015 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb87400a4d0 con 0x556930971980 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930af6490 con 0x556930971980 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb879dc4640 1 -- 172.21.15.133:0/3317881015 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb87400a4d0 con 0x556930971980 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930af68a0 con 0x556930971980 2024-02-15T23:29:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb879dc4640 1 -- 172.21.15.133:0/3317881015 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb87400a4d0 con 0x556930971980 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.847+0000 7fb87baa8980 1 Processor -- start 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb87baa8980 1 -- start start 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb87baa8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b05950 0x556930b05d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb87baa8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693089ff20 con 0x556930b05950 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb878dc2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b05950 0x556930b05d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb878dc2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b05950 0x556930b05d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43800/0 (socket says 172.21.15.133:43800) 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb878dc2640 1 -- 172.21.15.133:0/3839283413 learned_addr learned my addr 172.21.15.133:0/3839283413 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb878dc2640 1 -- 172.21.15.133:0/3839283413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556930b062b0 con 0x556930b05950 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb878dc2640 1 --2- 172.21.15.133:0/3839283413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b05950 0x556930b05d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb8700af040 tx=0x7fb8700180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb75effd640 1 -- 172.21.15.133:0/3839283413 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8700bf5b0 con 0x556930b05950 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb75effd640 1 -- 172.21.15.133:0/3839283413 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8700bf710 con 0x556930b05950 2024-02-15T23:29:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb87baa8980 1 -- 172.21.15.133:0/3839283413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556930b064a0 con 0x556930b05950 2024-02-15T23:29:55.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb75effd640 1 -- 172.21.15.133:0/3839283413 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8700bf9b0 con 0x556930b05950 2024-02-15T23:29:55.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb87baa8980 1 -- 172.21.15.133:0/3839283413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556930b06f90 con 0x556930b05950 2024-02-15T23:29:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb75effd640 1 -- 172.21.15.133:0/3839283413 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb8700bfb60 con 0x556930b05950 2024-02-15T23:29:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb75effd640 1 --2- 172.21.15.133:0/3839283413 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7500342b0 0x7fb750036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb75effd640 1 -- 172.21.15.133:0/3839283413 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb8700e61b0 con 0x556930b05950 2024-02-15T23:29:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb879dc4640 1 --2- 172.21.15.133:0/3839283413 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7500342b0 0x7fb750036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb87baa8980 1 Processor -- start 2024-02-15T23:29:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.851+0000 7fb87baa8980 1 -- start start 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb879dc4640 1 --2- 172.21.15.133:0/3839283413 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7500342b0 0x7fb750036770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x556930af5ed0 tx=0x7fb874005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b12d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556930893790 con 0x556930b129a0 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b12d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b12d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43812/0 (socket says 172.21.15.133:43812) 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 -- 172.21.15.133:0/404213686 learned_addr learned my addr 172.21.15.133:0/404213686 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 -- 172.21.15.133:0/404213686 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556930b13350 con 0x556930b129a0 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 --2- 172.21.15.133:0/404213686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b12d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb8700e44e0 tx=0x7fb8700aaf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e13a22b3db1fa0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb75cff9640 1 -- 172.21.15.133:0/404213686 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb870006a30 con 0x556930b129a0 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb75cff9640 1 -- 172.21.15.133:0/404213686 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb870006b90 con 0x556930b129a0 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb75cff9640 1 -- 172.21.15.133:0/404213686 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb870006e30 con 0x556930b129a0 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- 172.21.15.133:0/404213686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 msgr2=0x556930b12d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 --2- 172.21.15.133:0/404213686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b12d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb8700e44e0 tx=0x7fb8700aaf50 comp rx=0 tx=0).stop 2024-02-15T23:29:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- 172.21.15.133:0/404213686 shutdown_connections 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 --2- 172.21.15.133:0/404213686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b12d80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- 172.21.15.133:0/404213686 >> 172.21.15.133:0/404213686 conn(0x556930b0ece0 msgr2=0x556930b0cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- 172.21.15.133:0/404213686 shutdown_connections 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- 172.21.15.133:0/404213686 wait complete. 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 Processor -- start 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- start start 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b19870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556930b19db0 con 0x556930b129a0 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b19870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b19870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:43814/0 (socket says 172.21.15.133:43814) 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 learned_addr learned my addr 172.21.15.133:0/1481906895 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556930b06f90 con 0x556930b129a0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb878dc2640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b19870 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb8700d4040 tx=0x7fb8700e4470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb74effd640 1 -- 172.21.15.133:0/1481906895 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8700e2070 con 0x556930b129a0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556930b19fb0 con 0x556930b129a0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb74effd640 1 -- 172.21.15.133:0/1481906895 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8700bde70 con 0x556930b129a0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.855+0000 7fb74effd640 1 -- 172.21.15.133:0/1481906895 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8700aa950 con 0x556930b129a0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556930b1a440 con 0x556930b129a0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb74effd640 1 -- 172.21.15.133:0/1481906895 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb8700e48f0 con 0x556930b129a0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb74effd640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7440342b0 0x7fb744036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb74effd640 1 -- 172.21.15.133:0/1481906895 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb8700f0cb0 con 0x556930b129a0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb879dc4640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7440342b0 0x7fb744036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930b24e40 0x556930b27300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b27a50 con 0x556930b24e40 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb8795c3640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930b24e40 0x556930b27300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb879dc4640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7440342b0 0x7fb744036770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb874011010 tx=0x7fb874020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb8795c3640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930b24e40 0x556930b27300 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 realm 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b27e20 con 0x556930b24e40 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b286a0 con 0x556930b24e40 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b28a00 con 0x556930b24e40 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b29200 con 0x556930b24e40 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 20 searching for the correct realm 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556930b2b090 0x556930b2d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.859+0000 7fb878dc2640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556930b2b090 0x556930b2d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb878dc2640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556930b2b090 0x556930b2d500 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb878dc2640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb8700f3c20 0x7fb8700c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8700f3c20 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb879dc4640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb8700f3c20 0x7fb8700c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb879dc4640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb8700f3c20 0x7fb8700c4260 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb87400a4d0 con 0x7fb8700f3c20 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb879dc4640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb8740141d0 0x7fb874015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb8795c3640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb8740141d0 0x7fb874015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb8795c3640 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb8740141d0 0x7fb874015940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:55.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x7fb8740141d0 2024-02-15T23:29:55.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b24e40 2024-02-15T23:29:55.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b24e40 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.863+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x7fb8740141d0 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x7fb8740141d0 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8700f3c20 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb87400a4d0 con 0x7fb8700f3c20 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b24e40 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x7fb8740141d0 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b24e40 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8700f3c20 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.867+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x7fb8740141d0 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b24e40 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b24e40 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x7fb8740141d0 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8700f3c20 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b24e40 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c016070 con 0x556930b24e40 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.871+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8700f3c20 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b2b090 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8740141d0 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x556930b24e40 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2dbd0 con 0x7fb8700f3c20 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b29b30 con 0x556930b24e40 2024-02-15T23:29:55.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2a380 con 0x556930b24e40 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2e010 con 0x556930b24e40 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 zone default found 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 4 Realm: () 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 zonegroup default 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.875+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2e010 con 0x7fb8740141d0 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2fda0 con 0x556930b2b090 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b30170 con 0x556930b2b090 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 20 started sync module instance, tier type = 2024-02-15T23:29:55.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:55.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2f680 con 0x7fb8700f3c20 2024-02-15T23:29:55.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93910276960736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b2fa30 con 0x7fb8700f3c20 2024-02-15T23:29:55.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b30ed0 con 0x556930b24e40 2024-02-15T23:29:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.879+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93910276960736] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93910276965776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b30ed0 con 0x556930b24e40 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b319a0 con 0x556930b2b090 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93910276965776] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93910276969600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b31d50 con 0x556930b2b090 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b326c0 con 0x7fb8700f3c20 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93910276973392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b32f10 con 0x7fb8700f3c20 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.883+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b338e0 con 0x556930b24e40 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93910276969600] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93910276973392] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93910276977632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b32a70 con 0x556930b24e40 2024-02-15T23:29:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b34130 con 0x7fb8740141d0 2024-02-15T23:29:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93910276977632] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93910276966832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b32a70 con 0x7fb8740141d0 2024-02-15T23:29:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.887+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b345d0 con 0x7fb8740141d0 2024-02-15T23:29:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.891+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93910276966832] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.891+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.891+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93910276980944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b34590 con 0x7fb8740141d0 2024-02-15T23:29:55.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.891+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b34f00 con 0x7fb8740141d0 2024-02-15T23:29:55.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.891+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93910276980944] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93910276979312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b34f00 con 0x7fb8740141d0 2024-02-15T23:29:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 20 add_watcher() i=0 2024-02-15T23:29:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 20 add_watcher() i=1 2024-02-15T23:29:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 20 add_watcher() i=2 2024-02-15T23:29:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 20 add_watcher() i=3 2024-02-15T23:29:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 20 add_watcher() i=4 2024-02-15T23:29:55.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 20 add_watcher() i=5 2024-02-15T23:29:55.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 20 add_watcher() i=6 2024-02-15T23:29:55.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93910276979312] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 20 add_watcher() i=7 2024-02-15T23:29:55.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:55.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b38350 con 0x556930b24e40 2024-02-15T23:29:55.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.895+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93910276983856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b35860 con 0x556930b24e40 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93910276983856] v31'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb72f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 5 note: GC not initialized 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb72e7e4640 20 reqs_thread_entry: start 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 Filter name: none 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb69ffff640 20 reqs_thread_entry: start 2024-02-15T23:29:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-15T23:29:55.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b5a410 con 0x7fb8740141d0 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 rados_obj.operate() r=0 bl.length=386 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b59ea0 con 0x7fb8700f3c20 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 rados->read ofs=0 len=0 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b5d3b0 con 0x556930b24e40 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(64 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:55.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-02-15T23:29:55.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.899+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b61650 con 0x7fb8700f3c20 2024-02-15T23:29:55.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.903+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(65 foo.buckets [call] v31'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.903+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 8.13 8:cc78e477:root::.bucket.meta.testx%3amyfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b64fa0 con 0x7fb8740141d0 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.903+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [create,call,writefull 0~371,setxattr (203)] v31'7 uv7 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.903+0000 7fb87baa8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x7 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.903+0000 7fb87baa8980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.903+0000 7fb87baa8980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.903+0000 7fb87baa8980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1, ofs0, ns] 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 93910277171792 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b645e0 con 0x7fb8700f3c20 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== watch-notify(notify (1) cookie 93910276973392 notify 133143986189 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x7fb874030410 con 0x7fb8700f3c20 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb75cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 93910276973392 notifier 4542 bl.length()=806 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb75cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x7 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb75cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:55.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb75cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(67 notify.3 [notify cookie 93910277171792 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb75cff9640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb73c003ea0 con 0x7fb8700f3c20 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== watch-notify(notify_complete (2) cookie 93910277171792 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb8740305a0 con 0x7fb8700f3c20 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 20 handle_bi_update(): bucket=testx:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_sources= new_sources= 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 20 handle_bi_update(): bucket=testx:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential sources added=[] removed=[] 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 20 handle_bi_update(): bucket=testx:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_dests= new_dests= 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 20 handle_bi_update(): bucket=testx:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential dests added=[] removed=[] 2024-02-15T23:29:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b646e0 con 0x556930b24e40 2024-02-15T23:29:55.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v31'6 uv6 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b646e0 con 0x556930b24e40 2024-02-15T23:29:55.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v31'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93910277177920 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b64660 con 0x556930b24e40 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== watch-notify(notify (1) cookie 93910276977632 notify 133143986190 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x7fb86c061040 con 0x556930b24e40 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb74ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 93910276977632 notifier 4542 bl.length()=348 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb74ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb74ffff640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(71 notify.4 [notify cookie 93910277177920 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.907+0000 7fb74ffff640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb6ac003400 con 0x556930b24e40 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== watch-notify(notify_complete (2) cookie 93910277177920 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556930aeee80 con 0x556930b24e40 2024-02-15T23:29:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb87baa8980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-15T23:29:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb87baa8980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T23:29:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93910277177856 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b64620 con 0x7fb8740141d0 2024-02-15T23:29:55.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== watch-notify(notify (1) cookie 93910276980944 notify 133143986193 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x556930aeee80 con 0x7fb8740141d0 2024-02-15T23:29:55.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb74ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 93910276980944 notifier 4542 bl.length()=149 2024-02-15T23:29:55.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb74ffff640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb6ac003400 con 0x7fb8740141d0 2024-02-15T23:29:55.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(73 notify.6 [notify cookie 93910277177856 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== watch-notify(notify_complete (2) cookie 93910277177856 notify 133143986193 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556930aee9d0 con 0x7fb8740141d0 2024-02-15T23:29:55.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.911+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b646a0 con 0x7fb8700f3c20 2024-02-15T23:29:55.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(75 myfoo [call,delete] v31'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb87baa8980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 from cache 2024-02-15T23:29:55.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb87baa8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1, ofs0, ns] 2024-02-15T23:29:55.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 7.d 7:b4812045:::notify.4:head [notify cookie 93910277150784 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b63c30 con 0x556930b24e40 2024-02-15T23:29:55.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== watch-notify(notify (1) cookie 93910276977632 notify 133143986191 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x556930aee9d0 con 0x556930b24e40 2024-02-15T23:29:55.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb75cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 93910276977632 notifier 4542 bl.length()=206 2024-02-15T23:29:55.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(76 notify.4 [notify cookie 93910277150784 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb75cff9640 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb73c003ea0 con 0x556930b24e40 2024-02-15T23:29:55.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(77 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== watch-notify(notify_complete (2) cookie 93910277150784 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556930947460 con 0x556930b24e40 2024-02-15T23:29:55.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b63c30 con 0x556930b24e40 2024-02-15T23:29:55.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(78 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call,delete] v31'7 uv7 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb72f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:55.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.915+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93910276983856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b63c30 con 0x556930b24e40 2024-02-15T23:29:55.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.919+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93910276983856] v31'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.919+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93910276960736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b63c30 con 0x7fb8700f3c20 2024-02-15T23:29:55.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.919+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93910276960736] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.919+0000 7fb87baa8980 20 remove_watcher() i=0 2024-02-15T23:29:55.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.919+0000 7fb87baa8980 2 removed watcher, disabling cache 2024-02-15T23:29:55.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.919+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93910276965776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b63c30 con 0x556930b24e40 2024-02-15T23:29:55.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93910276965776] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb87baa8980 20 remove_watcher() i=1 2024-02-15T23:29:55.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93910276969600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b63c30 con 0x556930b2b090 2024-02-15T23:29:55.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb878dc2640 1 -- 172.21.15.133:0/1481906895 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93910276969600] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb8700a9070 con 0x556930b2b090 2024-02-15T23:29:55.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb87baa8980 20 remove_watcher() i=2 2024-02-15T23:29:55.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93910276973392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b38240 con 0x7fb8700f3c20 2024-02-15T23:29:55.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb879dc4640 1 -- 172.21.15.133:0/1481906895 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93910276973392] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb87403a040 con 0x7fb8700f3c20 2024-02-15T23:29:55.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb87baa8980 20 remove_watcher() i=3 2024-02-15T23:29:55.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.923+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93910276977632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b38240 con 0x556930b24e40 2024-02-15T23:29:55.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.927+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93910276977632] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x556930b24e40 2024-02-15T23:29:55.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.927+0000 7fb87baa8980 20 remove_watcher() i=4 2024-02-15T23:29:55.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.927+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93910276966832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b38240 con 0x7fb8740141d0 2024-02-15T23:29:55.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.927+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93910276966832] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.927+0000 7fb87baa8980 20 remove_watcher() i=5 2024-02-15T23:29:55.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.927+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93910276980944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b38240 con 0x7fb8740141d0 2024-02-15T23:29:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.931+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93910276980944] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.931+0000 7fb87baa8980 20 remove_watcher() i=6 2024-02-15T23:29:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.931+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93910276979312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556930b38240 con 0x7fb8740141d0 2024-02-15T23:29:55.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93910276979312] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86c059040 con 0x7fb8740141d0 2024-02-15T23:29:55.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 20 remove_watcher() i=7 2024-02-15T23:29:55.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb8740141d0 msgr2=0x7fb874015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb8740141d0 0x7fb874015940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930b24e40 msgr2=0x556930b27300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930b24e40 0x556930b27300 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb8700f3c20 msgr2=0x7fb8700c4260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb8700f3c20 0x7fb8700c4260 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556930b2b090 msgr2=0x556930b2d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556930b2b090 0x556930b2d500 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7440342b0 msgr2=0x7fb744036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7440342b0 0x7fb744036770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb874011010 tx=0x7fb874020000 comp rx=0 tx=0).stop 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb8795c3640 1 -- 172.21.15.133:0/1481906895 reap_dead start 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 msgr2=0x556930b19870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b19870 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb8700d4040 tx=0x7fb8700e4470 comp rx=0 tx=0).stop 2024-02-15T23:29:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 shutdown_connections 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/1481906895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b129a0 0x556930b19870 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 >> 172.21.15.133:0/1481906895 conn(0x556930b0ece0 msgr2=0x556930b0c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 shutdown_connections 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/1481906895 wait complete. 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3839283413 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7500342b0 msgr2=0x7fb750036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3839283413 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7500342b0 0x7fb750036770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x556930af5ed0 tx=0x7fb874005850 comp rx=0 tx=0).stop 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3839283413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b05950 msgr2=0x556930b05d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3839283413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b05950 0x556930b05d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb8700af040 tx=0x7fb8700180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3839283413 shutdown_connections 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3839283413 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb7500342b0 0x7fb750036770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3839283413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930b05950 0x556930b05d70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3839283413 >> 172.21.15.133:0/3839283413 conn(0x556930afa760 msgr2=0x556930afb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3839283413 shutdown_connections 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3839283413 wait complete. 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930971980 msgr2=0x556930af5090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930971980 0x556930af5090 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb760034300 msgr2=0x7fb7600367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb760034300 0x7fb7600367c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb8700ae000 tx=0x7fb8700a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 msgr2=0x556930aee490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930aee490 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x556930ae8370 tx=0x7fb86c000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 shutdown_connections 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556930971980 0x556930af5090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb760034300 0x7fb7600367c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 --2- 172.21.15.133:0/3317881015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556930970640 0x556930aee490 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 >> 172.21.15.133:0/3317881015 conn(0x5569309f69a0 msgr2=0x556930ae1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 shutdown_connections 2024-02-15T23:29:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:55.935+0000 7fb87baa8980 1 -- 172.21.15.133:0/3317881015 wait complete. 2024-02-15T23:29:55.954 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-02-15T23:29:55.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-02-15T23:29:55.955 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-02-15T23:29:56.031 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:56.031 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:56.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff457417980 1 Processor -- start 2024-02-15T23:29:56.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff457417980 1 -- start start 2024-02-15T23:29:56.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff457417980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ce2ac73080 0x55ce2ad01e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff457417980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ce2ac4b4c0 con 0x55ce2ad02340 2024-02-15T23:29:56.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff457417980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ce2ac12180 con 0x55ce2ac73080 2024-02-15T23:29:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff454f32640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ce2ac73080 0x55ce2ad01e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff454f32640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ce2ac73080 0x55ce2ad01e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40232/0 (socket says 172.21.15.133:40232) 2024-02-15T23:29:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff454f32640 1 -- 172.21.15.133:0/302955491 learned_addr learned my addr 172.21.15.133:0/302955491 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff44ffff640 1 --1- 172.21.15.133:0/302955491 >> v1:172.21.15.131:6789/0 conn(0x55ce2ad02340 0x55ce2ad04730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:41582/0 (socket says 172.21.15.133:41582) 2024-02-15T23:29:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff454f32640 1 -- 172.21.15.133:0/302955491 >> v1:172.21.15.131:6789/0 conn(0x55ce2ad02340 legacy=0x55ce2ad04730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.023+0000 7ff454f32640 1 -- 172.21.15.133:0/302955491 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2ad06ef0 con 0x55ce2ac73080 2024-02-15T23:29:56.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff454f32640 1 --2- 172.21.15.133:0/302955491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ad01e00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff44800a5c0 tx=0x7ff44801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850e6694d4a9f88 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff44f7fe640 1 -- 172.21.15.133:0/302955491 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4480aa470 con 0x55ce2ac73080 2024-02-15T23:29:56.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff44f7fe640 1 -- 172.21.15.133:0/302955491 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4480aa5d0 con 0x55ce2ac73080 2024-02-15T23:29:56.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff44f7fe640 1 -- 172.21.15.133:0/302955491 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4480aa890 con 0x55ce2ac73080 2024-02-15T23:29:56.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff457417980 1 -- 172.21.15.133:0/302955491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 msgr2=0x55ce2ad01e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff457417980 1 --2- 172.21.15.133:0/302955491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ad01e00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff44800a5c0 tx=0x7ff44801b340 comp rx=0 tx=0).stop 2024-02-15T23:29:56.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff457417980 1 -- 172.21.15.133:0/302955491 shutdown_connections 2024-02-15T23:29:56.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff457417980 1 --2- 172.21.15.133:0/302955491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ad01e00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.027+0000 7ff457417980 1 -- 172.21.15.133:0/302955491 >> 172.21.15.133:0/302955491 conn(0x55ce2acf98e0 msgr2=0x55ce2acfbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.031+0000 7ff457417980 1 -- 172.21.15.133:0/302955491 shutdown_connections 2024-02-15T23:29:56.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.031+0000 7ff457417980 1 -- 172.21.15.133:0/302955491 wait complete. 2024-02-15T23:29:56.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.043+0000 7ff457417980 1 Processor -- start 2024-02-15T23:29:56.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.043+0000 7ff457417980 1 -- start start 2024-02-15T23:29:56.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.043+0000 7ff457417980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ade9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.043+0000 7ff457417980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2ac0f6b0 con 0x55ce2ac73080 2024-02-15T23:29:56.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.043+0000 7ff454f32640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ade9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.043+0000 7ff454f32640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ade9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40236/0 (socket says 172.21.15.133:40236) 2024-02-15T23:29:56.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.043+0000 7ff454f32640 1 -- 172.21.15.133:0/1001049630 learned_addr learned my addr 172.21.15.133:0/1001049630 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff454f32640 1 -- 172.21.15.133:0/1001049630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448005df0 con 0x55ce2ac73080 2024-02-15T23:29:56.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff454f32640 1 --2- 172.21.15.133:0/1001049630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ade9080 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff448018f70 tx=0x7ff448003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b4fdcde435333f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff342e05640 1 -- 172.21.15.133:0/1001049630 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4480aa9c0 con 0x55ce2ac73080 2024-02-15T23:29:56.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff342e05640 1 -- 172.21.15.133:0/1001049630 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4480aab20 con 0x55ce2ac73080 2024-02-15T23:29:56.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff342e05640 1 -- 172.21.15.133:0/1001049630 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4480aadc0 con 0x55ce2ac73080 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 -- 172.21.15.133:0/1001049630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 msgr2=0x55ce2ade9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 --2- 172.21.15.133:0/1001049630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ade9080 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff448018f70 tx=0x7ff448003030 comp rx=0 tx=0).stop 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 -- 172.21.15.133:0/1001049630 shutdown_connections 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 --2- 172.21.15.133:0/1001049630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2ade9080 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 -- 172.21.15.133:0/1001049630 >> 172.21.15.133:0/1001049630 conn(0x55ce2acf98e0 msgr2=0x55ce2ade4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 -- 172.21.15.133:0/1001049630 shutdown_connections 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 -- 172.21.15.133:0/1001049630 wait complete. 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 Processor -- start 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 -- start start 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2adefda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff457417980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2ac0ae90 con 0x55ce2ac73080 2024-02-15T23:29:56.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff454f32640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2adefda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff454f32640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2adefda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40250/0 (socket says 172.21.15.133:40250) 2024-02-15T23:29:56.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff454f32640 1 -- 172.21.15.133:0/2024116807 learned_addr learned my addr 172.21.15.133:0/2024116807 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff454f32640 1 -- 172.21.15.133:0/2024116807 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2ad06ef0 con 0x55ce2ac73080 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff454f32640 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2adefda0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff448018f70 tx=0x7ff4480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.047+0000 7ff341602640 1 -- 172.21.15.133:0/2024116807 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4480cb070 con 0x55ce2ac73080 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff341602640 1 -- 172.21.15.133:0/2024116807 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4480bd810 con 0x55ce2ac73080 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce2adf02e0 con 0x55ce2ac73080 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff341602640 1 -- 172.21.15.133:0/2024116807 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4480bdab0 con 0x55ce2ac73080 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce2adf06d0 con 0x55ce2ac73080 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff341602640 1 -- 172.21.15.133:0/2024116807 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff4480bdce0 con 0x55ce2ac73080 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff341602640 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff33c0342b0 0x7ff33c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff341602640 1 -- 172.21.15.133:0/2024116807 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff4480e4a60 con 0x55ce2ac73080 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff44ffff640 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff33c0342b0 0x7ff33c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff457417980 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ad02340 0x55ce2adf69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2adf6f30 con 0x55ce2ad02340 2024-02-15T23:29:56.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff455733640 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ad02340 0x55ce2adf69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff44ffff640 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff33c0342b0 0x7ff33c036770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff440001e50 tx=0x7ff4400013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff455733640 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ad02340 0x55ce2adf69f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff455733640 1 -- 172.21.15.133:0/2024116807 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff45000a4d0 con 0x55ce2ad02340 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2adf7320 con 0x55ce2ad02340 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff455733640 1 -- 172.21.15.133:0/2024116807 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff45000a4d0 con 0x55ce2ad02340 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2adf8bd0 con 0x55ce2ad02340 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff455733640 1 -- 172.21.15.133:0/2024116807 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff45000a4d0 con 0x55ce2ad02340 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2adf7dd0 con 0x55ce2ad02340 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff455733640 1 -- 172.21.15.133:0/2024116807 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff45000a4d0 con 0x55ce2ad02340 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.051+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2adf81e0 con 0x55ce2ad02340 2024-02-15T23:29:56.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff455733640 1 -- 172.21.15.133:0/2024116807 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff45000a4d0 con 0x55ce2ad02340 2024-02-15T23:29:56.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff457417980 1 Processor -- start 2024-02-15T23:29:56.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff457417980 1 -- start start 2024-02-15T23:29:56.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff457417980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae07290 0x55ce2ae076b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff457417980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2aba3f20 con 0x55ce2ae07290 2024-02-15T23:29:56.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae07290 0x55ce2ae076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae07290 0x55ce2ae076b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40258/0 (socket says 172.21.15.133:40258) 2024-02-15T23:29:56.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff44ffff640 1 -- 172.21.15.133:0/1722192429 learned_addr learned my addr 172.21.15.133:0/1722192429 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff44ffff640 1 -- 172.21.15.133:0/1722192429 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2ae07bf0 con 0x55ce2ae07290 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff44ffff640 1 --2- 172.21.15.133:0/1722192429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae07290 0x55ce2ae076b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff44000e640 tx=0x7ff44000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff33a7fc640 1 -- 172.21.15.133:0/1722192429 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff440007040 con 0x55ce2ae07290 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff457417980 1 -- 172.21.15.133:0/1722192429 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce2ae07e40 con 0x55ce2ae07290 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff33a7fc640 1 -- 172.21.15.133:0/1722192429 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000d660 con 0x55ce2ae07290 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff33a7fc640 1 -- 172.21.15.133:0/1722192429 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff44000d900 con 0x55ce2ae07290 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff457417980 1 -- 172.21.15.133:0/1722192429 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce2ae08990 con 0x55ce2ae07290 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff33a7fc640 1 -- 172.21.15.133:0/1722192429 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff44001a070 con 0x55ce2ae07290 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff33a7fc640 1 --2- 172.21.15.133:0/1722192429 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff32c0342b0 0x7ff32c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.055+0000 7ff33a7fc640 1 -- 172.21.15.133:0/1722192429 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff440017050 con 0x55ce2ae07290 2024-02-15T23:29:56.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff455733640 1 --2- 172.21.15.133:0/1722192429 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff32c0342b0 0x7ff32c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 Processor -- start 2024-02-15T23:29:56.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- start start 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff455733640 1 --2- 172.21.15.133:0/1722192429 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff32c0342b0 0x7ff32c036770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55ce2adf7810 tx=0x7ff450005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae14630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2ab97790 con 0x55ce2ae14250 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae14630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae14630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40266/0 (socket says 172.21.15.133:40266) 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff44ffff640 1 -- 172.21.15.133:0/1471415516 learned_addr learned my addr 172.21.15.133:0/1471415516 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff44ffff640 1 -- 172.21.15.133:0/1471415516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2ae14c00 con 0x55ce2ae14250 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff44ffff640 1 --2- 172.21.15.133:0/1471415516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae14630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff440024430 tx=0x7ff440025420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f6ccb3641ad4d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff32bfff640 1 -- 172.21.15.133:0/1471415516 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff44003aaf0 con 0x55ce2ae14250 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff32bfff640 1 -- 172.21.15.133:0/1471415516 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44003ac50 con 0x55ce2ae14250 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff32bfff640 1 -- 172.21.15.133:0/1471415516 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff44004a0d0 con 0x55ce2ae14250 2024-02-15T23:29:56.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- 172.21.15.133:0/1471415516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 msgr2=0x55ce2ae14630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 --2- 172.21.15.133:0/1471415516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae14630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff440024430 tx=0x7ff440025420 comp rx=0 tx=0).stop 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- 172.21.15.133:0/1471415516 shutdown_connections 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 --2- 172.21.15.133:0/1471415516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae14630 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- 172.21.15.133:0/1471415516 >> 172.21.15.133:0/1471415516 conn(0x55ce2ae10590 msgr2=0x55ce2ae0e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- 172.21.15.133:0/1471415516 shutdown_connections 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- 172.21.15.133:0/1471415516 wait complete. 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 Processor -- start 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- start start 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae1b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff457417980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2ae1b630 con 0x55ce2ae14250 2024-02-15T23:29:56.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae1b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae1b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40278/0 (socket says 172.21.15.133:40278) 2024-02-15T23:29:56.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.059+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 learned_addr learned my addr 172.21.15.133:0/2895061478 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2ae08990 con 0x55ce2ae14250 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff44ffff640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae1b0f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff440024480 tx=0x7ff440048b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff32a7fc640 1 -- 172.21.15.133:0/2895061478 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff440042b40 con 0x55ce2ae14250 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce2ae1b830 con 0x55ce2ae14250 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff32a7fc640 1 -- 172.21.15.133:0/2895061478 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44002f070 con 0x55ce2ae14250 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff32a7fc640 1 -- 172.21.15.133:0/2895061478 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff440042dd0 con 0x55ce2ae14250 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce2ae1bcc0 con 0x55ce2ae14250 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff32a7fc640 1 -- 172.21.15.133:0/2895061478 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff440031030 con 0x55ce2ae14250 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff32a7fc640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff3200342b0 0x7ff320036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff32a7fc640 1 -- 172.21.15.133:0/2895061478 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff440035c90 con 0x55ce2ae14250 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff455733640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff3200342b0 0x7ff320036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ae26540 0x55ce2ae289e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae29130 con 0x55ce2ae26540 2024-02-15T23:29:56.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff454f32640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ae26540 0x55ce2ae289e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff455733640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff3200342b0 0x7ff320036770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff450011010 tx=0x7ff450020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff454f32640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ae26540 0x55ce2ae289e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 20 realm 2024-02-15T23:29:56.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae29500 con 0x55ce2ae26540 2024-02-15T23:29:56.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae29d50 con 0x55ce2ae26540 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.063+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2a0b0 con 0x55ce2ae26540 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff457417980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae299f0 con 0x55ce2ae26540 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff457417980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff457417980 20 searching for the correct realm 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ce2ae2c300 0x55ce2ae2e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ee00 con 0x55ce2ae2c300 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff44ffff640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ce2ae2c300 0x55ce2ae2e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff44ffff640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ce2ae2c300 0x55ce2ae2e730 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff44ffff640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff440055040 0x7ff44001a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ee00 con 0x7ff440055040 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff455733640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff440055040 0x7ff44001a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff455733640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff440055040 0x7ff44001a4c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45000a4d0 con 0x7ff440055040 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff455733640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff4500141d0 0x7ff450015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ee00 con 0x7ff4500141d0 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff454f32640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff4500141d0 0x7ff450015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff454f32640 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff4500141d0 0x7ff450015940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x7ff4500141d0 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.067+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ee00 con 0x55ce2ae26540 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ee00 con 0x55ce2ae26540 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ee00 con 0x7ff4500141d0 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x7ff4500141d0 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff4500141d0 2024-02-15T23:29:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x7ff4500141d0 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff440055040 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45000a4d0 con 0x7ff440055040 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae2c300 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae26540 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff4500141d0 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x7ff4500141d0 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae26540 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff440055040 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.071+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae2c300 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae2c300 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff4500141d0 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x7ff4500141d0 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae2c300 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae2c300 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae26540 2024-02-15T23:29:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae26540 2024-02-15T23:29:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff4500141d0 2024-02-15T23:29:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x7ff4500141d0 2024-02-15T23:29:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae2c300 2024-02-15T23:29:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff440055040 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae26540 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x55ce2ae26540 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.075+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff4500141d0 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x7ff4500141d0 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae2c300 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff4500141d0 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480cd070 con 0x7ff4500141d0 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff440055040 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae2c300 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff4500141d0 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x55ce2ae26540 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff4480ed040 con 0x7ff440055040 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ade0 con 0x55ce2ae26540 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.079+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2b190 con 0x55ce2ae26540 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2b190 con 0x55ce2ae26540 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 zone default found 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 4 Realm: () 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 zonegroup default 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ba60 con 0x7ff4500141d0 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae2ba60 con 0x55ce2ae2c300 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae30c20 con 0x55ce2ae2c300 2024-02-15T23:29:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 started sync module instance, tier type = 2024-02-15T23:29:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae30500 con 0x7ff440055040 2024-02-15T23:29:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94343971143776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae308b0 con 0x7ff440055040 2024-02-15T23:29:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.083+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae31950 con 0x55ce2ae26540 2024-02-15T23:29:56.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.087+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94343971143776] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.087+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.087+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94343971147792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae31910 con 0x55ce2ae26540 2024-02-15T23:29:56.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.087+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae323a0 con 0x55ce2ae2c300 2024-02-15T23:29:56.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.087+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94343971147792] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.087+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.087+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94343971151456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae32750 con 0x55ce2ae2c300 2024-02-15T23:29:56.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.087+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae330c0 con 0x7ff440055040 2024-02-15T23:29:56.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.091+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.091+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94343971155280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae33910 con 0x7ff440055040 2024-02-15T23:29:56.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.091+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae34330 con 0x55ce2ae26540 2024-02-15T23:29:56.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.091+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94343971151456] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.091+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94343971155280] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.091+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.091+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94343971159568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae33470 con 0x55ce2ae26540 2024-02-15T23:29:56.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.091+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae34b80 con 0x7ff4500141d0 2024-02-15T23:29:56.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.095+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.095+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94343971161360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae34dd0 con 0x7ff4500141d0 2024-02-15T23:29:56.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.095+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae355d0 con 0x7ff4500141d0 2024-02-15T23:29:56.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.095+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94343971159568] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.095+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.095+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94343971163600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae35690 con 0x7ff4500141d0 2024-02-15T23:29:56.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.095+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae36000 con 0x7ff4500141d0 2024-02-15T23:29:56.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.095+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94343971161360] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94343971163600] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94343971164656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae35610 con 0x7ff4500141d0 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 20 add_watcher() i=0 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 20 add_watcher() i=1 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 20 add_watcher() i=2 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 20 add_watcher() i=3 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 20 add_watcher() i=4 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 20 add_watcher() i=5 2024-02-15T23:29:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 20 add_watcher() i=6 2024-02-15T23:29:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94343971164656] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 20 add_watcher() i=7 2024-02-15T23:29:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.099+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae39030 con 0x55ce2ae26540 2024-02-15T23:29:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94343971167072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae36420 con 0x55ce2ae26540 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94343971167072] v31'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff30afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 5 note: GC not initialized 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff309fe3640 20 reqs_thread_entry: start 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 20 Filter name: none 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff27b7fe640 20 reqs_thread_entry: start 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae5a710 con 0x55ce2ae26540 2024-02-15T23:29:56.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 20 rados_obj.operate() r=0 bl.length=193 2024-02-15T23:29:56.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff30afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:56.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.103+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94343971167072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae3af80 con 0x55ce2ae26540 2024-02-15T23:29:56.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.107+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94343971167072] v31'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.107+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94343971143776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae35b60 con 0x7ff440055040 2024-02-15T23:29:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.107+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94343971143776] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.107+0000 7ff457417980 20 remove_watcher() i=0 2024-02-15T23:29:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.107+0000 7ff457417980 2 removed watcher, disabling cache 2024-02-15T23:29:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.107+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94343971147792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae35b60 con 0x55ce2ae26540 2024-02-15T23:29:56.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94343971147792] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff457417980 20 remove_watcher() i=1 2024-02-15T23:29:56.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94343971151456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae31010 con 0x55ce2ae2c300 2024-02-15T23:29:56.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff44ffff640 1 -- 172.21.15.133:0/2895061478 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94343971151456] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff440040070 con 0x55ce2ae2c300 2024-02-15T23:29:56.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff457417980 20 remove_watcher() i=2 2024-02-15T23:29:56.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94343971155280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae35b60 con 0x7ff440055040 2024-02-15T23:29:56.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff455733640 1 -- 172.21.15.133:0/2895061478 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94343971155280] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45003a040 con 0x7ff440055040 2024-02-15T23:29:56.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff457417980 20 remove_watcher() i=3 2024-02-15T23:29:56.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.111+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94343971159568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae35b60 con 0x55ce2ae26540 2024-02-15T23:29:56.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.115+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94343971159568] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x55ce2ae26540 2024-02-15T23:29:56.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.115+0000 7ff457417980 20 remove_watcher() i=4 2024-02-15T23:29:56.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.115+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94343971161360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae33e10 con 0x7ff4500141d0 2024-02-15T23:29:56.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.115+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94343971161360] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.115+0000 7ff457417980 20 remove_watcher() i=5 2024-02-15T23:29:56.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.115+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94343971163600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae35b60 con 0x7ff4500141d0 2024-02-15T23:29:56.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.119+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94343971163600] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.119+0000 7ff457417980 20 remove_watcher() i=6 2024-02-15T23:29:56.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.119+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94343971164656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ce2ae34510 con 0x7ff4500141d0 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.119+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94343971164656] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4480fd040 con 0x7ff4500141d0 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.119+0000 7ff457417980 20 remove_watcher() i=7 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff4500141d0 msgr2=0x7ff450015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7ff4500141d0 0x7ff450015940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ae26540 msgr2=0x55ce2ae289e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ae26540 0x55ce2ae289e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff440055040 msgr2=0x7ff44001a4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7ff440055040 0x7ff44001a4c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ce2ae2c300 msgr2=0x55ce2ae2e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ce2ae2c300 0x55ce2ae2e730 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff3200342b0 msgr2=0x7ff320036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff3200342b0 0x7ff320036770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff450011010 tx=0x7ff450020000 comp rx=0 tx=0).stop 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 msgr2=0x55ce2ae1b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff454f32640 1 -- 172.21.15.133:0/2895061478 reap_dead start 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae1b0f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff440024480 tx=0x7ff440048b50 comp rx=0 tx=0).stop 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 shutdown_connections 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2895061478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae14250 0x55ce2ae1b0f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 >> 172.21.15.133:0/2895061478 conn(0x55ce2ae10590 msgr2=0x55ce2ae0dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 shutdown_connections 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2895061478 wait complete. 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/1722192429 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff32c0342b0 msgr2=0x7ff32c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/1722192429 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff32c0342b0 0x7ff32c036770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55ce2adf7810 tx=0x7ff450005850 comp rx=0 tx=0).stop 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/1722192429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae07290 msgr2=0x55ce2ae076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/1722192429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae07290 0x55ce2ae076b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff44000e640 tx=0x7ff44000ea40 comp rx=0 tx=0).stop 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/1722192429 shutdown_connections 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/1722192429 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff32c0342b0 0x7ff32c036770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/1722192429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ae07290 0x55ce2ae076b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/1722192429 >> 172.21.15.133:0/1722192429 conn(0x55ce2adfc0a0 msgr2=0x55ce2adfcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/1722192429 shutdown_connections 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/1722192429 wait complete. 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ad02340 msgr2=0x55ce2adf69f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ad02340 0x55ce2adf69f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff33c0342b0 msgr2=0x7ff33c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff33c0342b0 0x7ff33c036770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff440001e50 tx=0x7ff4400013b0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 msgr2=0x55ce2adefda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2adefda0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff448018f70 tx=0x7ff4480180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 shutdown_connections 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ce2ad02340 0x55ce2adf69f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7ff33c0342b0 0x7ff33c036770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 --2- 172.21.15.133:0/2024116807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2ac73080 0x55ce2adefda0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 >> 172.21.15.133:0/2024116807 conn(0x55ce2acf98e0 msgr2=0x55ce2ade3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 shutdown_connections 2024-02-15T23:29:56.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.123+0000 7ff457417980 1 -- 172.21.15.133:0/2024116807 wait complete. 2024-02-15T23:29:56.142 INFO:teuthology.orchestra.run.smithi133.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"wGCOya68m3urAHsYirbIRTME","ver":2},"mtime":"2024-02-15T23:29:55.911205Z","data":{"bucket":{"name":"myfoo","marker":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","bucket_id":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-02-15T23:29:52.491594Z","linked":true,"has_bucket_info":false}} 2024-02-15T23:29:56.142 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'wGCOya68m3urAHsYirbIRTME', 'ver': 2}, 'mtime': '2024-02-15T23:29:55.911205Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'bucket_id': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-02-15T23:29:52.491594Z', 'linked': True, 'has_bucket_info': False}} 2024-02-15T23:29:56.143 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-15T23:29:56.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-15T23:29:56.143 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-02-15T23:29:56.219 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:56.219 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:56.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf320b3980 1 Processor -- start 2024-02-15T23:29:56.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf320b3980 1 -- start start 2024-02-15T23:29:56.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf320b3980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5583117af140 0x5583117af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf320b3980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5583116fb4d0 con 0x5583117afa60 2024-02-15T23:29:56.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf320b3980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5583116c2180 con 0x5583117af140 2024-02-15T23:29:56.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf2fbce640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5583117af140 0x5583117af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf2f3cd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5583117afa60 0x5583117b0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:41588/0 (socket says 172.21.15.133:41588) 2024-02-15T23:29:56.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/2059546927 learned_addr learned my addr 172.21.15.133:0/2059546927 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:56.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf2fbce640 1 -- 172.21.15.133:0/2059546927 >> v1:172.21.15.131:6789/0 conn(0x5583117afa60 legacy=0x5583117b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.211+0000 7fdf2fbce640 1 -- 172.21.15.133:0/2059546927 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583117b0c50 con 0x5583117af140 2024-02-15T23:29:56.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf2fbce640 1 --2- 172.21.15.133:0/2059546927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583117af520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000a480 tx=0x7fdf2001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df63babe9b80d2b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf2ebcc640 1 -- 172.21.15.133:0/2059546927 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf200ab540 con 0x5583117af140 2024-02-15T23:29:56.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf2ebcc640 1 -- 172.21.15.133:0/2059546927 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200ab6a0 con 0x5583117af140 2024-02-15T23:29:56.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf2ebcc640 1 -- 172.21.15.133:0/2059546927 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf200ab960 con 0x5583117af140 2024-02-15T23:29:56.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf320b3980 1 -- 172.21.15.133:0/2059546927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 msgr2=0x5583117af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf320b3980 1 --2- 172.21.15.133:0/2059546927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583117af520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000a480 tx=0x7fdf2001b280 comp rx=0 tx=0).stop 2024-02-15T23:29:56.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf320b3980 1 -- 172.21.15.133:0/2059546927 shutdown_connections 2024-02-15T23:29:56.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf320b3980 1 --2- 172.21.15.133:0/2059546927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583117af520 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf320b3980 1 -- 172.21.15.133:0/2059546927 >> 172.21.15.133:0/2059546927 conn(0x5583117aaa10 msgr2=0x5583117ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf320b3980 1 -- 172.21.15.133:0/2059546927 shutdown_connections 2024-02-15T23:29:56.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.215+0000 7fdf320b3980 1 -- 172.21.15.133:0/2059546927 wait complete. 2024-02-15T23:29:56.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf320b3980 1 Processor -- start 2024-02-15T23:29:56.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf320b3980 1 -- start start 2024-02-15T23:29:56.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf320b3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x558311899680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf320b3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583116bf6b0 con 0x5583117af140 2024-02-15T23:29:56.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf2fbce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x558311899680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf2fbce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x558311899680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40296/0 (socket says 172.21.15.133:40296) 2024-02-15T23:29:56.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf2fbce640 1 -- 172.21.15.133:0/2281461564 learned_addr learned my addr 172.21.15.133:0/2281461564 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf2fbce640 1 -- 172.21.15.133:0/2281461564 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf20005d30 con 0x5583117af140 2024-02-15T23:29:56.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fdf2fbce640 1 --2- 172.21.15.133:0/2281461564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x558311899680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdf20018eb0 tx=0x7fdf20003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba03ae1327271822 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fde1de0b640 1 -- 172.21.15.133:0/2281461564 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf200ab810 con 0x5583117af140 2024-02-15T23:29:56.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fde1de0b640 1 -- 172.21.15.133:0/2281461564 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200ab970 con 0x5583117af140 2024-02-15T23:29:56.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.231+0000 7fde1de0b640 1 -- 172.21.15.133:0/2281461564 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf200abc30 con 0x5583117af140 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- 172.21.15.133:0/2281461564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 msgr2=0x558311899680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 --2- 172.21.15.133:0/2281461564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x558311899680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdf20018eb0 tx=0x7fdf20003030 comp rx=0 tx=0).stop 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- 172.21.15.133:0/2281461564 shutdown_connections 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 --2- 172.21.15.133:0/2281461564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x558311899680 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- 172.21.15.133:0/2281461564 >> 172.21.15.133:0/2281461564 conn(0x5583117aaa10 msgr2=0x558311895210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- 172.21.15.133:0/2281461564 shutdown_connections 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- 172.21.15.133:0/2281461564 wait complete. 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 Processor -- start 2024-02-15T23:29:56.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- start start 2024-02-15T23:29:56.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583118a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583116bae90 con 0x5583117af140 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf2fbce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583118a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf2fbce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583118a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40300/0 (socket says 172.21.15.133:40300) 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3882058995 learned_addr learned my addr 172.21.15.133:0/3882058995 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3882058995 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583117b0c50 con 0x5583117af140 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf2fbce640 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583118a0370 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdf2001b2c0 tx=0x7fdf20018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fde17fff640 1 -- 172.21.15.133:0/3882058995 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf200c3070 con 0x5583117af140 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fde17fff640 1 -- 172.21.15.133:0/3882058995 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200beaa0 con 0x5583117af140 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583118a08b0 con 0x5583117af140 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fde17fff640 1 -- 172.21.15.133:0/3882058995 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf200bed40 con 0x5583117af140 2024-02-15T23:29:56.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.235+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583118a0d60 con 0x5583117af140 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fde17fff640 1 -- 172.21.15.133:0/3882058995 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdf200b2070 con 0x5583117af140 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fde17fff640 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde180342b0 0x7fde18036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fde17fff640 1 -- 172.21.15.133:0/3882058995 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fdf200e3950 con 0x5583117af140 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf2f3cd640 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde180342b0 0x7fde18036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583117afa60 0x5583118a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118a7500 con 0x5583117afa60 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf303cf640 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583117afa60 0x5583118a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf2f3cd640 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde180342b0 0x7fde18036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf24000f70 tx=0x7fdf240012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf303cf640 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583117afa60 0x5583118a6fc0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf303cf640 1 -- 172.21.15.133:0/3882058995 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf2800a4d0 con 0x5583117afa60 2024-02-15T23:29:56.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118a78a0 con 0x5583117afa60 2024-02-15T23:29:56.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf303cf640 1 -- 172.21.15.133:0/3882058995 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdf2800a4d0 con 0x5583117afa60 2024-02-15T23:29:56.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118a9150 con 0x5583117afa60 2024-02-15T23:29:56.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf303cf640 1 -- 172.21.15.133:0/3882058995 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fdf2800a4d0 con 0x5583117afa60 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118a8350 con 0x5583117afa60 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf303cf640 1 -- 172.21.15.133:0/3882058995 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdf2800a4d0 con 0x5583117afa60 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118a8760 con 0x5583117afa60 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf303cf640 1 -- 172.21.15.133:0/3882058995 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdf2800a4d0 con 0x5583117afa60 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 Processor -- start 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 -- start start 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118b7810 0x5583118b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf320b3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558311653f20 con 0x5583118b7810 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.239+0000 7fdf2f3cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118b7810 0x5583118b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf2f3cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118b7810 0x5583118b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40312/0 (socket says 172.21.15.133:40312) 2024-02-15T23:29:56.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/875882621 learned_addr learned my addr 172.21.15.133:0/875882621 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/875882621 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583118b8170 con 0x5583118b7810 2024-02-15T23:29:56.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf2f3cd640 1 --2- 172.21.15.133:0/875882621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118b7810 0x5583118b7c30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdf24001ee0 tx=0x7fdf2400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fde157fa640 1 -- 172.21.15.133:0/875882621 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf24020070 con 0x5583118b7810 2024-02-15T23:29:56.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fde157fa640 1 -- 172.21.15.133:0/875882621 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400c770 con 0x5583118b7810 2024-02-15T23:29:56.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf320b3980 1 -- 172.21.15.133:0/875882621 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583118b83c0 con 0x5583118b7810 2024-02-15T23:29:56.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fde157fa640 1 -- 172.21.15.133:0/875882621 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf24013040 con 0x5583118b7810 2024-02-15T23:29:56.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf320b3980 1 -- 172.21.15.133:0/875882621 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583118b8f10 con 0x5583118b7810 2024-02-15T23:29:56.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fde157fa640 1 -- 172.21.15.133:0/875882621 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdf2400a040 con 0x5583118b7810 2024-02-15T23:29:56.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fde157fa640 1 --2- 172.21.15.133:0/875882621 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde08034300 0x7fde080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fde157fa640 1 -- 172.21.15.133:0/875882621 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fdf2404b6b0 con 0x5583118b7810 2024-02-15T23:29:56.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf303cf640 1 --2- 172.21.15.133:0/875882621 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde08034300 0x7fde080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf320b3980 1 Processor -- start 2024-02-15T23:29:56.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf320b3980 1 -- start start 2024-02-15T23:29:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf303cf640 1 --2- 172.21.15.133:0/875882621 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde08034300 0x7fde080367c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5583118a7d90 tx=0x7fdf28005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf320b3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.243+0000 7fdf320b3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558311647790 con 0x5583118c47e0 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40328/0 (socket says 172.21.15.133:40328) 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/1620776349 learned_addr learned my addr 172.21.15.133:0/1620776349 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/1620776349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583118c51d0 con 0x5583118c47e0 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 --2- 172.21.15.133:0/1620776349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118c4c00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdf24049ad0 tx=0x7fdf24019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d3adf0ed35b260 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fde0effd640 1 -- 172.21.15.133:0/1620776349 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf24048070 con 0x5583118c47e0 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fde0effd640 1 -- 172.21.15.133:0/1620776349 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2401b7a0 con 0x5583118c47e0 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fde0effd640 1 -- 172.21.15.133:0/1620776349 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf24019320 con 0x5583118c47e0 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- 172.21.15.133:0/1620776349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 msgr2=0x5583118c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 --2- 172.21.15.133:0/1620776349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118c4c00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdf24049ad0 tx=0x7fdf24019a70 comp rx=0 tx=0).stop 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- 172.21.15.133:0/1620776349 shutdown_connections 2024-02-15T23:29:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 --2- 172.21.15.133:0/1620776349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118c4c00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- 172.21.15.133:0/1620776349 >> 172.21.15.133:0/1620776349 conn(0x5583118c0b70 msgr2=0x5583118bebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- 172.21.15.133:0/1620776349 shutdown_connections 2024-02-15T23:29:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- 172.21.15.133:0/1620776349 wait complete. 2024-02-15T23:29:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 Processor -- start 2024-02-15T23:29:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- start start 2024-02-15T23:29:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583118cbc30 con 0x5583118c47e0 2024-02-15T23:29:56.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40340/0 (socket says 172.21.15.133:40340) 2024-02-15T23:29:56.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 learned_addr learned my addr 172.21.15.133:0/3943169537 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583118b8f10 con 0x5583118c47e0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf2f3cd640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118cb6f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdf2403e040 tx=0x7fdf24049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fde0d7fa640 1 -- 172.21.15.133:0/3943169537 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf2404b320 con 0x5583118c47e0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583118cbe30 con 0x5583118c47e0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fde0d7fa640 1 -- 172.21.15.133:0/3943169537 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2404b480 con 0x5583118c47e0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fde0d7fa640 1 -- 172.21.15.133:0/3943169537 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf24025bf0 con 0x5583118c47e0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.247+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583118cc260 con 0x5583118c47e0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fde0d7fa640 1 -- 172.21.15.133:0/3943169537 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdf24042050 con 0x5583118c47e0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fde0d7fa640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fddf80342b0 0x7fddf8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fde0d7fa640 1 -- 172.21.15.133:0/3943169537 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fdf24038c60 con 0x5583118c47e0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf303cf640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fddf80342b0 0x7fddf8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583118d6c90 0x5583118d9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118d98a0 con 0x5583118d6c90 2024-02-15T23:29:56.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf2fbce640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583118d6c90 0x5583118d9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf303cf640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fddf80342b0 0x7fddf8036770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf28011010 tx=0x7fdf28020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf2fbce640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583118d6c90 0x5583118d9150 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 realm 2024-02-15T23:29:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118d9c70 con 0x5583118d6c90 2024-02-15T23:29:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118da4f0 con 0x5583118d6c90 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118da850 con 0x5583118d6c90 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118db050 con 0x5583118d6c90 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 20 searching for the correct realm 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5583118dcee0 0x5583118df350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.251+0000 7fdf2f3cd640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5583118dcee0 0x5583118df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2f3cd640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5583118dcee0 0x5583118df350 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2f3cd640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdf24037020 0x7fdf2403a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf24037020 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf303cf640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdf24037020 0x7fdf2403a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf303cf640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdf24037020 0x7fdf2403a720 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf2800a4d0 con 0x7fdf24037020 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf303cf640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdf280141d0 0x7fdf28015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2fbce640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdf280141d0 0x7fdf28015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2fbce640 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdf280141d0 0x7fdf28015940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118d6c90 2024-02-15T23:29:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118d6c90 2024-02-15T23:29:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.255+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf24037020 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf2800a4d0 con 0x7fdf24037020 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118d6c90 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118d6c90 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf24037020 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.259+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118d6c90 2024-02-15T23:29:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118d6c90 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf24037020 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118d6c90 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x5583118d6c90 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.263+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf24037020 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118dcee0 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf280141d0 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf200aabd0 con 0x7fdf280141d0 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x5583118d6c90 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfa20 con 0x7fdf24037020 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118db980 con 0x5583118d6c90 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dc1d0 con 0x5583118d6c90 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.267+0000 7fdf320b3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfe60 con 0x5583118d6c90 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 zone default found 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 4 Realm: () 2024-02-15T23:29:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 zonegroup default 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118dfe60 con 0x7fdf280141d0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e1bf0 con 0x5583118dcee0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e1f50 con 0x5583118dcee0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 started sync module instance, tier type = 2024-02-15T23:29:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e14d0 con 0x7fdf24037020 2024-02-15T23:29:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021423599664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e1880 con 0x7fdf24037020 2024-02-15T23:29:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.271+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e2c90 con 0x5583118d6c90 2024-02-15T23:29:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.275+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021423599664] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.275+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.275+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021423604560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e2c10 con 0x5583118d6c90 2024-02-15T23:29:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.275+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e3680 con 0x5583118dcee0 2024-02-15T23:29:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.275+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.275+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021423608256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e3f00 con 0x5583118dcee0 2024-02-15T23:29:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e48b0 con 0x7fdf24037020 2024-02-15T23:29:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021423604560] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021423605616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e4c60 con 0x7fdf24037020 2024-02-15T23:29:56.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e5610 con 0x5583118d6c90 2024-02-15T23:29:56.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021423608256] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021423605616] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021423612880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e5130 con 0x5583118d6c90 2024-02-15T23:29:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.279+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e5e60 con 0x7fdf280141d0 2024-02-15T23:29:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.283+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.283+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021423617712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e5f70 con 0x7fdf280141d0 2024-02-15T23:29:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.283+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e68e0 con 0x7fdf280141d0 2024-02-15T23:29:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.283+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021423612880] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.283+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.283+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021423610464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e68e0 con 0x7fdf280141d0 2024-02-15T23:29:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.283+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e7250 con 0x7fdf280141d0 2024-02-15T23:29:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021423617712] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021423610464] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021423621184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e6860 con 0x7fdf280141d0 2024-02-15T23:29:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 20 add_watcher() i=0 2024-02-15T23:29:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 20 add_watcher() i=1 2024-02-15T23:29:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 20 add_watcher() i=2 2024-02-15T23:29:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 20 add_watcher() i=3 2024-02-15T23:29:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 20 add_watcher() i=4 2024-02-15T23:29:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 20 add_watcher() i=5 2024-02-15T23:29:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 20 add_watcher() i=6 2024-02-15T23:29:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021423621184] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 20 add_watcher() i=7 2024-02-15T23:29:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.287+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118ea280 con 0x5583118d6c90 2024-02-15T23:29:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021423623600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e7740 con 0x5583118d6c90 2024-02-15T23:29:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021423623600] v31'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdde67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 5 note: GC not initialized 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdde57e2640 20 reqs_thread_entry: start 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 Filter name: none 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fddde7fc640 20 reqs_thread_entry: start 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55831190bff0 con 0x5583118d6c90 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55831190d9f0 con 0x5583118d6c90 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 rados_obj.operate() r=0 bl.length=193 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.291+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:64 8.13 8:cc78e477:root::.bucket.meta.testx%3amyfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55831190f0d0 con 0x7fdf280141d0 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv7 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 20 rados_obj.operate() r=0 bl.length=371 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-15T23:29:56.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311913480 con 0x5583118d6c90 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v31'8 uv8 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311916d40 con 0x5583118d6c90 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(66 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [create,call,writefull 0~352,setxattr (123)] v31'9 uv9 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x7 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1, ofs0, ns] 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94021423811312 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311916780 con 0x5583118d6c90 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== watch-notify(notify (1) cookie 94021423612880 notify 133143986192 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x7fdf200e7040 con 0x5583118d6c90 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fde0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94021423612880 notifier 4556 bl.length()=701 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fde0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x7 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fde0effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fde0effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:56.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fde0effd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fddf4003ea0 con 0x5583118d6c90 2024-02-15T23:29:56.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(67 notify.4 [notify cookie 94021423811312 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.295+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.299+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== watch-notify(notify_complete (2) cookie 94021423811312 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5583118a0d60 con 0x5583118d6c90 2024-02-15T23:29:56.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.299+0000 7fdf320b3980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_sources= new_sources= 2024-02-15T23:29:56.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.299+0000 7fdf320b3980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential sources added=[] removed=[] 2024-02-15T23:29:56.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.299+0000 7fdf320b3980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_dests= new_dests= 2024-02-15T23:29:56.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.299+0000 7fdf320b3980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential dests added=[] removed=[] 2024-02-15T23:29:56.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.299+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311916880 con 0x7fdf24037020 2024-02-15T23:29:56.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.299+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(69 foo.buckets [call] v31'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.299+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311916880 con 0x7fdf24037020 2024-02-15T23:29:56.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf320b3980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T23:29:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf320b3980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf320b3980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T23:29:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94021423817696 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311916800 con 0x7fdf280141d0 2024-02-15T23:29:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== watch-notify(notify (1) cookie 94021423610464 notify 133143986194 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x5583118a0d60 con 0x7fdf280141d0 2024-02-15T23:29:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fde0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94021423610464 notifier 4556 bl.length()=314 2024-02-15T23:29:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fde0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T23:29:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fde0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(71 notify.6 [notify cookie 94021423817696 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fde0e7fc640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdd58003400 con 0x7fdf280141d0 2024-02-15T23:29:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== watch-notify(notify_complete (2) cookie 94021423817696 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5583118a08b0 con 0x7fdf280141d0 2024-02-15T23:29:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf320b3980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf320b3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94021423817696 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311916800 con 0x5583118d6c90 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== watch-notify(notify (1) cookie 94021423612880 notify 133143986193 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x5583118a08b0 con 0x5583118d6c90 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fde0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94021423612880 notifier 4556 bl.length()=155 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(73 notify.4 [notify cookie 94021423817696 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fde0e7fc640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fdd58003400 con 0x5583118d6c90 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== watch-notify(notify_complete (2) cookie 94021423817696 notify 133143986193 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fdf200cb030 con 0x5583118d6c90 2024-02-15T23:29:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.303+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311916880 con 0x5583118d6c90 2024-02-15T23:29:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(75 testx/myfoo [call,delete] v31'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf320b3980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 from cache 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf320b3980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1, ofs0, ns] 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [notify cookie 94021423789440 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558311916880 con 0x7fdf24037020 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== watch-notify(notify (1) cookie 94021423605616 notify 133143986190 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x7fdf280269c0 con 0x7fdf24037020 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fde0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94021423605616 notifier 4556 bl.length()=212 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(76 notify.3 [notify cookie 94021423789440 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fde0effd640 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fddf4003ea0 con 0x7fdf24037020 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(77 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== watch-notify(notify_complete (2) cookie 94021423789440 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fdf28026b50 con 0x7fdf24037020 2024-02-15T23:29:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.307+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 8.13 8:cc78e477:root::.bucket.meta.testx%3amyfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583119163e0 con 0x7fdf280141d0 2024-02-15T23:29:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call,delete] v31'8 uv8 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdde67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:56.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021423623600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118d42b0 con 0x5583118d6c90 2024-02-15T23:29:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94021423623600] v31'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021423599664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e6db0 con 0x7fdf24037020 2024-02-15T23:29:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94021423599664] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdf320b3980 20 remove_watcher() i=0 2024-02-15T23:29:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdf320b3980 2 removed watcher, disabling cache 2024-02-15T23:29:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.311+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021423604560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e6db0 con 0x5583118d6c90 2024-02-15T23:29:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.315+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94021423604560] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.315+0000 7fdf320b3980 20 remove_watcher() i=1 2024-02-15T23:29:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.315+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021423608256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e2350 con 0x5583118dcee0 2024-02-15T23:29:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.315+0000 7fdf2f3cd640 1 -- 172.21.15.133:0/3943169537 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94021423608256] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf24034070 con 0x5583118dcee0 2024-02-15T23:29:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.315+0000 7fdf320b3980 20 remove_watcher() i=2 2024-02-15T23:29:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.315+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021423605616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e6db0 con 0x7fdf24037020 2024-02-15T23:29:56.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.319+0000 7fdf303cf640 1 -- 172.21.15.133:0/3943169537 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94021423605616] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf2803a040 con 0x7fdf24037020 2024-02-15T23:29:56.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.319+0000 7fdf320b3980 20 remove_watcher() i=3 2024-02-15T23:29:56.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.319+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021423612880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e31c0 con 0x5583118d6c90 2024-02-15T23:29:56.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.319+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.1 v2:172.21.15.133:6800/2918336019 38 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94021423612880] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x5583118d6c90 2024-02-15T23:29:56.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.319+0000 7fdf320b3980 20 remove_watcher() i=4 2024-02-15T23:29:56.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.319+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021423617712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e6db0 con 0x7fdf280141d0 2024-02-15T23:29:56.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.323+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94021423617712] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.323+0000 7fdf320b3980 20 remove_watcher() i=5 2024-02-15T23:29:56.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.323+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021423610464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e43d0 con 0x7fdf280141d0 2024-02-15T23:29:56.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.323+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94021423610464] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.323+0000 7fdf320b3980 20 remove_watcher() i=6 2024-02-15T23:29:56.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.323+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021423621184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583118e31c0 con 0x7fdf280141d0 2024-02-15T23:29:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94021423621184] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf200f2080 con 0x7fdf280141d0 2024-02-15T23:29:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 20 remove_watcher() i=7 2024-02-15T23:29:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdf280141d0 msgr2=0x7fdf28015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fdf280141d0 0x7fdf28015940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583118d6c90 msgr2=0x5583118d9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583118d6c90 0x5583118d9150 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdf24037020 msgr2=0x7fdf2403a720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fdf24037020 0x7fdf2403a720 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5583118dcee0 msgr2=0x5583118df350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5583118dcee0 0x5583118df350 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fddf80342b0 msgr2=0x7fddf8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fddf80342b0 0x7fddf8036770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf28011010 tx=0x7fdf28020000 comp rx=0 tx=0).stop 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 msgr2=0x5583118cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf2fbce640 1 -- 172.21.15.133:0/3943169537 reap_dead start 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118cb6f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdf2403e040 tx=0x7fdf24049a30 comp rx=0 tx=0).stop 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 shutdown_connections 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3943169537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118c47e0 0x5583118cb6f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 >> 172.21.15.133:0/3943169537 conn(0x5583118c0b70 msgr2=0x5583118be1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 shutdown_connections 2024-02-15T23:29:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3943169537 wait complete. 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/875882621 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde08034300 msgr2=0x7fde080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/875882621 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde08034300 0x7fde080367c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5583118a7d90 tx=0x7fdf28005850 comp rx=0 tx=0).stop 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/875882621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118b7810 msgr2=0x5583118b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/875882621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118b7810 0x5583118b7c30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdf24001ee0 tx=0x7fdf2400da30 comp rx=0 tx=0).stop 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/875882621 shutdown_connections 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/875882621 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde08034300 0x7fde080367c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/875882621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583118b7810 0x5583118b7c30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/875882621 >> 172.21.15.133:0/875882621 conn(0x5583118ac620 msgr2=0x5583118ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/875882621 shutdown_connections 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/875882621 wait complete. 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583117afa60 msgr2=0x5583118a6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583117afa60 0x5583118a6fc0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde180342b0 msgr2=0x7fde18036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde180342b0 0x7fde18036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf24000f70 tx=0x7fdf240012c0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 msgr2=0x5583118a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583118a0370 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdf2001b2c0 tx=0x7fdf20018020 comp rx=0 tx=0).stop 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 shutdown_connections 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5583117afa60 0x5583118a6fc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fde180342b0 0x7fde18036770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 --2- 172.21.15.133:0/3882058995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583117af140 0x5583118a0370 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 >> 172.21.15.133:0/3882058995 conn(0x5583117aaa10 msgr2=0x558311893d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 shutdown_connections 2024-02-15T23:29:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.327+0000 7fdf320b3980 1 -- 172.21.15.133:0/3882058995 wait complete. 2024-02-15T23:29:56.348 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-15T23:29:56.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-15T23:29:56.348 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-02-15T23:29:56.426 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:56.426 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02ca5e5980 1 Processor -- start 2024-02-15T23:29:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02ca5e5980 1 -- start start 2024-02-15T23:29:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02ca5e5980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55a100956090 0x55a1009e4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02ca5e5980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a10092e4d0 con 0x55a1009e5350 2024-02-15T23:29:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02ca5e5980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a1008f5180 con 0x55a100956090 2024-02-15T23:29:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02c8100640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55a100956090 0x55a1009e4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02c8100640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55a100956090 0x55a1009e4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40342/0 (socket says 172.21.15.133:40342) 2024-02-15T23:29:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02c78ff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55a1009e5350 0x55a1009e7740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:41604/0 (socket says 172.21.15.133:41604) 2024-02-15T23:29:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02c8100640 1 -- 172.21.15.133:0/2418184740 learned_addr learned my addr 172.21.15.133:0/2418184740 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02c8100640 1 -- 172.21.15.133:0/2418184740 >> v1:172.21.15.131:6789/0 conn(0x55a1009e5350 legacy=0x55a1009e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.419+0000 7f02c8100640 1 -- 172.21.15.133:0/2418184740 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1009e9f00 con 0x55a100956090 2024-02-15T23:29:56.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02c8100640 1 --2- 172.21.15.133:0/2418184740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e4e10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f02b800a5c0 tx=0x7f02b801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62a0347e7d636fb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02c70fe640 1 -- 172.21.15.133:0/2418184740 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b80aa470 con 0x55a100956090 2024-02-15T23:29:56.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02c70fe640 1 -- 172.21.15.133:0/2418184740 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b80aa5d0 con 0x55a100956090 2024-02-15T23:29:56.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02c70fe640 1 -- 172.21.15.133:0/2418184740 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b80aa890 con 0x55a100956090 2024-02-15T23:29:56.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02ca5e5980 1 -- 172.21.15.133:0/2418184740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 msgr2=0x55a1009e4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/2418184740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e4e10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f02b800a5c0 tx=0x7f02b801b340 comp rx=0 tx=0).stop 2024-02-15T23:29:56.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02ca5e5980 1 -- 172.21.15.133:0/2418184740 shutdown_connections 2024-02-15T23:29:56.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/2418184740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e4e10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02ca5e5980 1 -- 172.21.15.133:0/2418184740 >> 172.21.15.133:0/2418184740 conn(0x55a1009dc8f0 msgr2=0x55a1009ded10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02ca5e5980 1 -- 172.21.15.133:0/2418184740 shutdown_connections 2024-02-15T23:29:56.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.423+0000 7f02ca5e5980 1 -- 172.21.15.133:0/2418184740 wait complete. 2024-02-15T23:29:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 Processor -- start 2024-02-15T23:29:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 -- start start 2024-02-15T23:29:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1008f26b0 con 0x55a100956090 2024-02-15T23:29:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02c8100640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02c8100640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40344/0 (socket says 172.21.15.133:40344) 2024-02-15T23:29:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02c8100640 1 -- 172.21.15.133:0/608068834 learned_addr learned my addr 172.21.15.133:0/608068834 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02c8100640 1 -- 172.21.15.133:0/608068834 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8005df0 con 0x55a100956090 2024-02-15T23:29:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02c8100640 1 --2- 172.21.15.133:0/608068834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e2570 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f02b80ac040 tx=0x7f02b8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4654cee53a644bef server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f01b660c640 1 -- 172.21.15.133:0/608068834 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b80aa9b0 con 0x55a100956090 2024-02-15T23:29:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f01b660c640 1 -- 172.21.15.133:0/608068834 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b80aab30 con 0x55a100956090 2024-02-15T23:29:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f01b660c640 1 -- 172.21.15.133:0/608068834 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b80aae10 con 0x55a100956090 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 -- 172.21.15.133:0/608068834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 msgr2=0x55a1009e2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/608068834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e2570 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f02b80ac040 tx=0x7f02b8003030 comp rx=0 tx=0).stop 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 -- 172.21.15.133:0/608068834 shutdown_connections 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/608068834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a1009e2570 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 -- 172.21.15.133:0/608068834 >> 172.21.15.133:0/608068834 conn(0x55a1009dc8f0 msgr2=0x55a100ac7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 -- 172.21.15.133:0/608068834 shutdown_connections 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.439+0000 7f02ca5e5980 1 -- 172.21.15.133:0/608068834 wait complete. 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02ca5e5980 1 Processor -- start 2024-02-15T23:29:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02ca5e5980 1 -- start start 2024-02-15T23:29:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02ca5e5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a100ad4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02ca5e5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1008ede90 con 0x55a100956090 2024-02-15T23:29:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02c8100640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a100ad4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02c8100640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a100ad4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40346/0 (socket says 172.21.15.133:40346) 2024-02-15T23:29:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02c8100640 1 -- 172.21.15.133:0/832960787 learned_addr learned my addr 172.21.15.133:0/832960787 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02c8100640 1 -- 172.21.15.133:0/832960787 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1009e9f00 con 0x55a100956090 2024-02-15T23:29:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02c8100640 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a100ad4ff0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f02b8005940 tx=0x7f02b80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f01b4e09640 1 -- 172.21.15.133:0/832960787 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b80c6750 con 0x55a100956090 2024-02-15T23:29:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f01b4e09640 1 -- 172.21.15.133:0/832960787 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b80c68b0 con 0x55a100956090 2024-02-15T23:29:56.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a100ad5530 con 0x55a100956090 2024-02-15T23:29:56.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f01b4e09640 1 -- 172.21.15.133:0/832960787 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b80c6b70 con 0x55a100956090 2024-02-15T23:29:56.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a100ad5980 con 0x55a100956090 2024-02-15T23:29:56.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f01b4e09640 1 -- 172.21.15.133:0/832960787 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f02b80c6cd0 con 0x55a100956090 2024-02-15T23:29:56.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f01b4e09640 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01b00342b0 0x7f01b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f01b4e09640 1 -- 172.21.15.133:0/832960787 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f02b80e4320 con 0x55a100956090 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02c78ff640 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01b00342b0 0x7f01b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a1009e5350 0x55a100adbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100adc100 con 0x55a1009e5350 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.443+0000 7f02c8901640 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a1009e5350 0x55a100adbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c78ff640 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01b00342b0 0x7f01b0036770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001e50 tx=0x7f02bc0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c8901640 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a1009e5350 0x55a100adbbc0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c8901640 1 -- 172.21.15.133:0/832960787 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f02c000a4d0 con 0x55a1009e5350 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100ad92a0 con 0x55a1009e5350 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c8901640 1 -- 172.21.15.133:0/832960787 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f02c000a4d0 con 0x55a1009e5350 2024-02-15T23:29:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100addae0 con 0x55a1009e5350 2024-02-15T23:29:56.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c8901640 1 -- 172.21.15.133:0/832960787 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f02c000a4d0 con 0x55a1009e5350 2024-02-15T23:29:56.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100adc940 con 0x55a1009e5350 2024-02-15T23:29:56.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c8901640 1 -- 172.21.15.133:0/832960787 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f02c000a4d0 con 0x55a1009e5350 2024-02-15T23:29:56.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100adcd50 con 0x55a1009e5350 2024-02-15T23:29:56.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c8901640 1 -- 172.21.15.133:0/832960787 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f02c000a4d0 con 0x55a1009e5350 2024-02-15T23:29:56.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02ca5e5980 1 Processor -- start 2024-02-15T23:29:56.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02ca5e5980 1 -- start start 2024-02-15T23:29:56.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02ca5e5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100aec420 0x55a100aec840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02ca5e5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a100886f20 con 0x55a100aec420 2024-02-15T23:29:56.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c78ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100aec420 0x55a100aec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c78ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100aec420 0x55a100aec840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40352/0 (socket says 172.21.15.133:40352) 2024-02-15T23:29:56.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c78ff640 1 -- 172.21.15.133:0/699548813 learned_addr learned my addr 172.21.15.133:0/699548813 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c78ff640 1 -- 172.21.15.133:0/699548813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a100aecd80 con 0x55a100aec420 2024-02-15T23:29:56.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f02c78ff640 1 --2- 172.21.15.133:0/699548813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100aec420 0x55a100aec840 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00e640 tx=0x7f02bc00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.447+0000 7f01adffb640 1 -- 172.21.15.133:0/699548813 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02bc007040 con 0x55a100aec420 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02ca5e5980 1 -- 172.21.15.133:0/699548813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a100aecfd0 con 0x55a100aec420 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f01adffb640 1 -- 172.21.15.133:0/699548813 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc00d660 con 0x55a100aec420 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f01adffb640 1 -- 172.21.15.133:0/699548813 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02bc00d920 con 0x55a100aec420 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02ca5e5980 1 -- 172.21.15.133:0/699548813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a100aedb20 con 0x55a100aec420 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f01adffb640 1 -- 172.21.15.133:0/699548813 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f02bc01a070 con 0x55a100aec420 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f01adffb640 1 --2- 172.21.15.133:0/699548813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01a00342b0 0x7f01a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f01adffb640 1 -- 172.21.15.133:0/699548813 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f02bc017050 con 0x55a100aec420 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02c8901640 1 --2- 172.21.15.133:0/699548813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01a00342b0 0x7f01a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02ca5e5980 1 Processor -- start 2024-02-15T23:29:56.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02ca5e5980 1 -- start start 2024-02-15T23:29:56.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02c8901640 1 --2- 172.21.15.133:0/699548813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01a00342b0 0x7f01a0036770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55a100add4f0 tx=0x7f02c0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02ca5e5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100af97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02ca5e5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10087a790 con 0x55a100af93a0 2024-02-15T23:29:56.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02c78ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100af97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02c78ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100af97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40364/0 (socket says 172.21.15.133:40364) 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02c78ff640 1 -- 172.21.15.133:0/1560807017 learned_addr learned my addr 172.21.15.133:0/1560807017 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02c78ff640 1 -- 172.21.15.133:0/1560807017 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a100af9d90 con 0x55a100af93a0 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f02c78ff640 1 --2- 172.21.15.133:0/1560807017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100af97c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00ff70 tx=0x7f02bc01ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd335dae79f63d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f01a77fe640 1 -- 172.21.15.133:0/1560807017 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02bc01a320 con 0x55a100af93a0 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f01a77fe640 1 -- 172.21.15.133:0/1560807017 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc025360 con 0x55a100af93a0 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.451+0000 7f01a77fe640 1 -- 172.21.15.133:0/1560807017 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02bc03abb0 con 0x55a100af93a0 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- 172.21.15.133:0/1560807017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 msgr2=0x55a100af97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/1560807017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100af97c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00ff70 tx=0x7f02bc01ae40 comp rx=0 tx=0).stop 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- 172.21.15.133:0/1560807017 shutdown_connections 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/1560807017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100af97c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- 172.21.15.133:0/1560807017 >> 172.21.15.133:0/1560807017 conn(0x55a100af5730 msgr2=0x55a100af3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- 172.21.15.133:0/1560807017 shutdown_connections 2024-02-15T23:29:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- 172.21.15.133:0/1560807017 wait complete. 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 Processor -- start 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- start start 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100b00290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a100b007d0 con 0x55a100af93a0 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02c78ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100b00290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02c78ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100b00290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40366/0 (socket says 172.21.15.133:40366) 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 learned_addr learned my addr 172.21.15.133:0/3253618473 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a100aedb20 con 0x55a100af93a0 2024-02-15T23:29:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02c78ff640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100b00290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f02bc047bf0 tx=0x7f02bc048c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f01a5ffb640 1 -- 172.21.15.133:0/3253618473 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02bc01a320 con 0x55a100af93a0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f01a5ffb640 1 -- 172.21.15.133:0/3253618473 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc03bec0 con 0x55a100af93a0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a100b009d0 con 0x55a100af93a0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f01a5ffb640 1 -- 172.21.15.133:0/3253618473 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02bc00de00 con 0x55a100af93a0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a100b00e60 con 0x55a100af93a0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f01a5ffb640 1 -- 172.21.15.133:0/3253618473 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f02bc04a9e0 con 0x55a100af93a0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f01a5ffb640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01980342b0 0x7f0198036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f01a5ffb640 1 -- 172.21.15.133:0/3253618473 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f02bc01d040 con 0x55a100af93a0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02c8901640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01980342b0 0x7f0198036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a100b0b880 0x55a100b0dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.455+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b0e490 con 0x55a100b0b880 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8100640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a100b0b880 0x55a100b0dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8901640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01980342b0 0x7f0198036770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f02c0011010 tx=0x7f02c0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8100640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a100b0b880 0x55a100b0dd40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f02b80b0020 con 0x55a100b0b880 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 realm 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b0e860 con 0x55a100b0b880 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f02b80b0020 con 0x55a100b0b880 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b0f0e0 con 0x55a100b0b880 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f02b80b0020 con 0x55a100b0b880 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b0f440 con 0x55a100b0b880 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f02b80b0020 con 0x55a100b0b880 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b0fc40 con 0x55a100b0b880 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f02b80b0020 con 0x55a100b0b880 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 20 searching for the correct realm 2024-02-15T23:29:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a100b11ad0 0x55a100b13f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c78ff640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a100b11ad0 0x55a100b13f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c78ff640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a100b11ad0 0x55a100b13f40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc02d070 con 0x55a100b11ad0 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c78ff640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f02bc027060 0x7f02bc0308a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02bc027060 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8901640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f02bc027060 0x7f02bc0308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8901640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f02bc027060 0x7f02bc0308a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02c000a4d0 con 0x7f02bc027060 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8901640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f02c00141d0 0x7f02c0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.459+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f02c00141d0 0x7f02c0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f02c00141d0 0x7f02c0015940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80b0020 con 0x7f02c00141d0 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b0b880 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f02b80ed080 con 0x55a100b0b880 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b0b880 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ed080 con 0x55a100b0b880 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ed080 con 0x7f02c00141d0 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ed080 con 0x7f02c00141d0 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02bc027060 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02c000a4d0 con 0x7f02bc027060 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc02d070 con 0x55a100b11ad0 2024-02-15T23:29:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.463+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b0b880 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f02b80ed080 con 0x55a100b0b880 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ed080 con 0x7f02c00141d0 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b0b880 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ed080 con 0x55a100b0b880 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02bc027060 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc02d070 con 0x55a100b11ad0 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ed080 con 0x7f02c00141d0 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b0b880 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ed080 con 0x55a100b0b880 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b0b880 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f02b80ed080 con 0x55a100b0b880 2024-02-15T23:29:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.467+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02bc027060 2024-02-15T23:29:56.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b0b880 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02bc027060 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b11ad0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.471+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02c00141d0 2024-02-15T23:29:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x55a100b0b880 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b14610 con 0x7f02bc027060 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b10540 con 0x55a100b0b880 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b10d90 con 0x55a100b0b880 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b10d90 con 0x55a100b0b880 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 zone default found 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 4 Realm: () 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 zonegroup default 2024-02-15T23:29:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b10d90 con 0x7f02c00141d0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b16480 con 0x55a100b11ad0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b167e0 con 0x55a100b11ad0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 started sync module instance, tier type = 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.475+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b15d60 con 0x7f02bc027060 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.479+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.479+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94149989718208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b16110 con 0x7f02bc027060 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.479+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b174f0 con 0x55a100b0b880 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.479+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94149989718208] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.479+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.479+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94149989723056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b174b0 con 0x55a100b0b880 2024-02-15T23:29:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.479+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b17f30 con 0x55a100b11ad0 2024-02-15T23:29:56.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.483+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94149989723056] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.483+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.483+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94149989726768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b182e0 con 0x55a100b11ad0 2024-02-15T23:29:56.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.483+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b18c50 con 0x7f02bc027060 2024-02-15T23:29:56.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.483+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.483+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94149989730528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b194a0 con 0x7f02bc027060 2024-02-15T23:29:56.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.483+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b19ea0 con 0x55a100b0b880 2024-02-15T23:29:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.487+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94149989726768] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.487+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94149989730528] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.487+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.487+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94149989734816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b19000 con 0x55a100b0b880 2024-02-15T23:29:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.487+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1a6f0 con 0x7f02c00141d0 2024-02-15T23:29:56.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.487+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.487+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94149989736576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1a940 con 0x7f02c00141d0 2024-02-15T23:29:56.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.487+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1b140 con 0x7f02c00141d0 2024-02-15T23:29:56.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94149989734816] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94149989738816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1b200 con 0x7f02c00141d0 2024-02-15T23:29:56.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1ba40 con 0x7f02c00141d0 2024-02-15T23:29:56.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94149989736576] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94149989737632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1b6a0 con 0x7f02c00141d0 2024-02-15T23:29:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 20 add_watcher() i=0 2024-02-15T23:29:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 20 add_watcher() i=1 2024-02-15T23:29:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 20 add_watcher() i=2 2024-02-15T23:29:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 20 add_watcher() i=3 2024-02-15T23:29:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 20 add_watcher() i=4 2024-02-15T23:29:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 20 add_watcher() i=5 2024-02-15T23:29:56.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94149989738816] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.491+0000 7f02ca5e5980 20 add_watcher() i=6 2024-02-15T23:29:56.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94149989737632] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02ca5e5980 20 add_watcher() i=7 2024-02-15T23:29:56.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02ca5e5980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:56.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1b200 con 0x55a100b0b880 2024-02-15T23:29:56.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94149989739872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1b1f0 con 0x55a100b0b880 2024-02-15T23:29:56.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94149989739872] v31'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f017e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:56.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02ca5e5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:56.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02ca5e5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:56.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.495+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b26f50 con 0x55a100b0b880 2024-02-15T23:29:56.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.499+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.499+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b27370 con 0x7f02c00141d0 2024-02-15T23:29:56.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.499+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.499+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b27810 con 0x55a100b11ad0 2024-02-15T23:29:56.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.503+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.503+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b28010 con 0x55a100b0b880 2024-02-15T23:29:56.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.503+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'135 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.503+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b25060 con 0x7f02bc027060 2024-02-15T23:29:56.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.507+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.507+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b25060 con 0x55a100b11ad0 2024-02-15T23:29:56.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.507+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.507+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b291f0 con 0x55a100b0b880 2024-02-15T23:29:56.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.507+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.507+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b291f0 con 0x7f02c00141d0 2024-02-15T23:29:56.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.511+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.511+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b291f0 con 0x7f02bc027060 2024-02-15T23:29:56.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.511+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.511+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b29740 con 0x55a100b11ad0 2024-02-15T23:29:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.515+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.515+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b29be0 con 0x7f02bc027060 2024-02-15T23:29:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.515+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.515+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23f60 con 0x7f02c00141d0 2024-02-15T23:29:56.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.519+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.519+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b24570 con 0x7f02bc027060 2024-02-15T23:29:56.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.519+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.519+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b24570 con 0x7f02c00141d0 2024-02-15T23:29:56.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.519+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'31 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.519+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b0b880 2024-02-15T23:29:56.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.523+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'136 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.523+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.523+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.523+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x7f02bc027060 2024-02-15T23:29:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.527+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'40 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.527+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.527+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.527+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b0b880 2024-02-15T23:29:56.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.527+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.527+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b0b880 2024-02-15T23:29:56.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.531+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'137 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.531+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.531+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.531+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x7f02bc027060 2024-02-15T23:29:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.535+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.535+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.535+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.535+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.535+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.535+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.539+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.539+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.539+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.539+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x7f02c00141d0 2024-02-15T23:29:56.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.539+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.539+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.543+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.543+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x7f02c00141d0 2024-02-15T23:29:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.543+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.543+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x55a100b11ad0 2024-02-15T23:29:56.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.547+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'34 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.547+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x7f02c00141d0 2024-02-15T23:29:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'32 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23d90 con 0x7f02bc027060 2024-02-15T23:29:56.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f017d7e2640 20 reqs_thread_entry: start 2024-02-15T23:29:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f02ca5e5980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f02ca5e5980 20 Filter name: none 2024-02-15T23:29:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f02ca5e5980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-15T23:29:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f00eeffd640 20 reqs_thread_entry: start 2024-02-15T23:29:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f02ca5e5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.551+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23a90 con 0x7f02c00141d0 2024-02-15T23:29:56.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 20 rados_obj.operate() r=0 bl.length=386 2024-02-15T23:29:56.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-15T23:29:56.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T23:29:56.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:56.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23470 con 0x55a100b0b880 2024-02-15T23:29:56.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-15T23:29:56.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T23:29:56.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94149989776016 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23490 con 0x55a100b11ad0 2024-02-15T23:29:56.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== watch-notify(notify (1) cookie 94149989726768 notify 133143986181 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55a100b00e60 con 0x55a100b11ad0 2024-02-15T23:29:56.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f01a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94149989726768 notifier 4563 bl.length()=170 2024-02-15T23:29:56.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f01a77fe640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f018c003d60 con 0x55a100b11ad0 2024-02-15T23:29:56.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(96 notify.2 [notify cookie 94149989776016 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== watch-notify(notify_complete (2) cookie 94149989776016 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a100b009d0 con 0x55a100b11ad0 2024-02-15T23:29:56.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.555+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23a90 con 0x7f02c00141d0 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v31'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 10 removing email index: 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 10 removing user buckets index 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 94149989776016 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b46ca0 con 0x55a100b0b880 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== watch-notify(notify (1) cookie 94149989734816 notify 133143986194 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x7f02b8107040 con 0x55a100b0b880 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f01a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94149989734816 notifier 4563 bl.length()=175 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(99 notify.4 [notify cookie 94149989776016 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f01a6ffd640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f00fc0032c0 con 0x55a100b0b880 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== watch-notify(notify_complete (2) cookie 94149989776016 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a100ad5980 con 0x55a100b0b880 2024-02-15T23:29:56.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b46ca0 con 0x55a100b0b880 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v31'10 uv10 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 10 removing user index: testx$tenanteduser 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 94149989775984 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b45c20 con 0x7f02bc027060 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== watch-notify(notify (1) cookie 94149989730528 notify 133143986191 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x7f02c00269c0 con 0x7f02bc027060 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f01a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94149989730528 notifier 4563 bl.length()=167 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f01a6ffd640 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f00fc0032f0 con 0x7f02bc027060 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(102 notify.3 [notify cookie 94149989775984 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== watch-notify(notify_complete (2) cookie 94149989775984 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f02c0026b50 con 0x7f02bc027060 2024-02-15T23:29:56.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.559+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23a70 con 0x7f02c00141d0 2024-02-15T23:29:56.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.563+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v31'10 uv10 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.563+0000 7f017e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:56.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.563+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94149989739872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23a70 con 0x55a100b0b880 2024-02-15T23:29:56.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.563+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94149989739872] v31'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.563+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94149989718208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23a70 con 0x7f02bc027060 2024-02-15T23:29:56.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.567+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94149989718208] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.567+0000 7f02ca5e5980 20 remove_watcher() i=0 2024-02-15T23:29:56.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.567+0000 7f02ca5e5980 2 removed watcher, disabling cache 2024-02-15T23:29:56.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.567+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94149989723056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b158c0 con 0x55a100b0b880 2024-02-15T23:29:56.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.567+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94149989723056] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.567+0000 7f02ca5e5980 20 remove_watcher() i=1 2024-02-15T23:29:56.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.567+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94149989726768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23a70 con 0x55a100b11ad0 2024-02-15T23:29:56.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.571+0000 7f02c78ff640 1 -- 172.21.15.133:0/3253618473 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94149989726768] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02bc05f040 con 0x55a100b11ad0 2024-02-15T23:29:56.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.571+0000 7f02ca5e5980 20 remove_watcher() i=2 2024-02-15T23:29:56.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.571+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94149989730528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b16bb0 con 0x7f02bc027060 2024-02-15T23:29:56.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.571+0000 7f02c8901640 1 -- 172.21.15.133:0/3253618473 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94149989730528] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02c003a040 con 0x7f02bc027060 2024-02-15T23:29:56.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.571+0000 7f02ca5e5980 20 remove_watcher() i=3 2024-02-15T23:29:56.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.571+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94149989734816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b158c0 con 0x55a100b0b880 2024-02-15T23:29:56.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.575+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94149989734816] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x55a100b0b880 2024-02-15T23:29:56.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.575+0000 7f02ca5e5980 20 remove_watcher() i=4 2024-02-15T23:29:56.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.575+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94149989736576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b17a30 con 0x7f02c00141d0 2024-02-15T23:29:56.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.575+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94149989736576] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.575+0000 7f02ca5e5980 20 remove_watcher() i=5 2024-02-15T23:29:56.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.575+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94149989738816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b23a70 con 0x7f02c00141d0 2024-02-15T23:29:56.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94149989738816] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 20 remove_watcher() i=6 2024-02-15T23:29:56.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94149989737632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a100b1adc0 con 0x7f02c00141d0 2024-02-15T23:29:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94149989737632] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02b80ff040 con 0x7f02c00141d0 2024-02-15T23:29:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 20 remove_watcher() i=7 2024-02-15T23:29:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f02c00141d0 msgr2=0x7f02c0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f02c00141d0 0x7f02c0015940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a100b0b880 msgr2=0x55a100b0dd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a100b0b880 0x55a100b0dd40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f02bc027060 msgr2=0x7f02bc0308a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f02bc027060 0x7f02bc0308a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a100b11ad0 msgr2=0x55a100b13f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.579+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55a100b11ad0 0x55a100b13f40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01980342b0 msgr2=0x7f0198036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01980342b0 0x7f0198036770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f02c0011010 tx=0x7f02c0020000 comp rx=0 tx=0).stop 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02c8100640 1 -- 172.21.15.133:0/3253618473 reap_dead start 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 msgr2=0x55a100b00290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100b00290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f02bc047bf0 tx=0x7f02bc048c10 comp rx=0 tx=0).stop 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 shutdown_connections 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/3253618473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100af93a0 0x55a100b00290 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 >> 172.21.15.133:0/3253618473 conn(0x55a100af5730 msgr2=0x55a100af2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 shutdown_connections 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/3253618473 wait complete. 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/699548813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01a00342b0 msgr2=0x7f01a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/699548813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01a00342b0 0x7f01a0036770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55a100add4f0 tx=0x7f02c0005850 comp rx=0 tx=0).stop 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/699548813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100aec420 msgr2=0x55a100aec840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/699548813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100aec420 0x55a100aec840 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00e640 tx=0x7f02bc00ea40 comp rx=0 tx=0).stop 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/699548813 shutdown_connections 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/699548813 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01a00342b0 0x7f01a0036770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/699548813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100aec420 0x55a100aec840 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/699548813 >> 172.21.15.133:0/699548813 conn(0x55a100ae1230 msgr2=0x55a100ae1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/699548813 shutdown_connections 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/699548813 wait complete. 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a1009e5350 msgr2=0x55a100adbbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a1009e5350 0x55a100adbbc0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01b00342b0 msgr2=0x7f01b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01b00342b0 0x7f01b0036770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001e50 tx=0x7f02bc0013b0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 msgr2=0x55a100ad4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a100ad4ff0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f02b8005940 tx=0x7f02b80180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 shutdown_connections 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55a1009e5350 0x55a100adbbc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f01b00342b0 0x7f01b0036770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 --2- 172.21.15.133:0/832960787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a100956090 0x55a100ad4ff0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 >> 172.21.15.133:0/832960787 conn(0x55a1009dc8f0 msgr2=0x55a1009e0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 shutdown_connections 2024-02-15T23:29:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.583+0000 7f02ca5e5980 1 -- 172.21.15.133:0/832960787 wait complete. 2024-02-15T23:29:56.612 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-15T23:29:56.616 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-02-15T23:29:56.619 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:29:56.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-15T23:29:56.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-15T23:29:56.620 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-02-15T23:29:56.684 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:56.684 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:56.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.675+0000 7facbe1c2980 1 Processor -- start 2024-02-15T23:29:56.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.675+0000 7facbe1c2980 1 -- start start 2024-02-15T23:29:56.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.675+0000 7facbe1c2980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f5cb711860 0x55f5cb713c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.675+0000 7facbe1c2980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f5cb6574d0 con 0x55f5cb70d360 2024-02-15T23:29:56.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.675+0000 7facbe1c2980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f5cb61e180 con 0x55f5cb711860 2024-02-15T23:29:56.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbb4dc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f5cb711860 0x55f5cb713c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbbcdd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55f5cb70d360 0x55f5cb70d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:41612/0 (socket says 172.21.15.133:41612) 2024-02-15T23:29:56.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbbcdd640 1 -- 172.21.15.133:0/325017550 learned_addr learned my addr 172.21.15.133:0/325017550 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:56.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbb4dc640 1 -- 172.21.15.133:0/325017550 >> v1:172.21.15.131:6789/0 conn(0x55f5cb70d360 legacy=0x55f5cb70d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbb4dc640 1 -- 172.21.15.133:0/325017550 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5cb7151a0 con 0x55f5cb711860 2024-02-15T23:29:56.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbb4dc640 1 --2- 172.21.15.133:0/325017550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb711860 0x55f5cb713c50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7facb000a480 tx=0x7facb001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def0f6d0bff7c096 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbacdb640 1 -- 172.21.15.133:0/325017550 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb00ab540 con 0x55f5cb711860 2024-02-15T23:29:56.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbacdb640 1 -- 172.21.15.133:0/325017550 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb00ab6a0 con 0x55f5cb711860 2024-02-15T23:29:56.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbacdb640 1 -- 172.21.15.133:0/325017550 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb00ab960 con 0x55f5cb711860 2024-02-15T23:29:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbe1c2980 1 -- 172.21.15.133:0/325017550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb711860 msgr2=0x55f5cb713c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbe1c2980 1 --2- 172.21.15.133:0/325017550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb711860 0x55f5cb713c50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7facb000a480 tx=0x7facb001b280 comp rx=0 tx=0).stop 2024-02-15T23:29:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbe1c2980 1 -- 172.21.15.133:0/325017550 shutdown_connections 2024-02-15T23:29:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbe1c2980 1 --2- 172.21.15.133:0/325017550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb711860 0x55f5cb713c50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbe1c2980 1 -- 172.21.15.133:0/325017550 >> 172.21.15.133:0/325017550 conn(0x55f5cb680a50 msgr2=0x55f5cb680e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbe1c2980 1 -- 172.21.15.133:0/325017550 shutdown_connections 2024-02-15T23:29:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.679+0000 7facbe1c2980 1 -- 172.21.15.133:0/325017550 wait complete. 2024-02-15T23:29:56.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.695+0000 7facbe1c2980 1 Processor -- start 2024-02-15T23:29:56.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.695+0000 7facbe1c2980 1 -- start start 2024-02-15T23:29:56.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.695+0000 7facbe1c2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7f7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.695+0000 7facbe1c2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5cb61b6b0 con 0x55f5cb70d360 2024-02-15T23:29:56.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7f7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40386/0 (socket says 172.21.15.133:40386) 2024-02-15T23:29:56.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 -- 172.21.15.133:0/17858081 learned_addr learned my addr 172.21.15.133:0/17858081 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 -- 172.21.15.133:0/17858081 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0005d30 con 0x55f5cb70d360 2024-02-15T23:29:56.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 --2- 172.21.15.133:0/17858081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7f7260 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7facac001c00 tx=0x7facac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3a724a6762df45 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7faba9e0b640 1 -- 172.21.15.133:0/17858081 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facac00e690 con 0x55f5cb70d360 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7faba9e0b640 1 -- 172.21.15.133:0/17858081 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac00e810 con 0x55f5cb70d360 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7faba9e0b640 1 -- 172.21.15.133:0/17858081 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facac00eb30 con 0x55f5cb70d360 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 -- 172.21.15.133:0/17858081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 msgr2=0x55f5cb7f7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 --2- 172.21.15.133:0/17858081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7f7260 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7facac001c00 tx=0x7facac00b6d0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 -- 172.21.15.133:0/17858081 shutdown_connections 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 --2- 172.21.15.133:0/17858081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7f7260 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 -- 172.21.15.133:0/17858081 >> 172.21.15.133:0/17858081 conn(0x55f5cb680a50 msgr2=0x55f5cb7f2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 -- 172.21.15.133:0/17858081 shutdown_connections 2024-02-15T23:29:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 -- 172.21.15.133:0/17858081 wait complete. 2024-02-15T23:29:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 Processor -- start 2024-02-15T23:29:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 -- start start 2024-02-15T23:29:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbe1c2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5cb616e90 con 0x55f5cb70d360 2024-02-15T23:29:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7fe0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40398/0 (socket says 172.21.15.133:40398) 2024-02-15T23:29:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 -- 172.21.15.133:0/2630497428 learned_addr learned my addr 172.21.15.133:0/2630497428 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 -- 172.21.15.133:0/2630497428 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5cb6574d0 con 0x55f5cb70d360 2024-02-15T23:29:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.699+0000 7facbbcdd640 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7fe0b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7facac00b710 tx=0x7facac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7faba3fff640 1 -- 172.21.15.133:0/2630497428 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facac01f070 con 0x55f5cb70d360 2024-02-15T23:29:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7faba3fff640 1 -- 172.21.15.133:0/2630497428 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac01a910 con 0x55f5cb70d360 2024-02-15T23:29:56.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f5cb7fe5f0 con 0x55f5cb70d360 2024-02-15T23:29:56.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7faba3fff640 1 -- 172.21.15.133:0/2630497428 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facac01abf0 con 0x55f5cb70d360 2024-02-15T23:29:56.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5cb7fea40 con 0x55f5cb70d360 2024-02-15T23:29:56.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7faba3fff640 1 -- 172.21.15.133:0/2630497428 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7facac00a040 con 0x55f5cb70d360 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7faba3fff640 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faba40342b0 0x7faba4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7faba3fff640 1 -- 172.21.15.133:0/2630497428 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7facac049fa0 con 0x55f5cb70d360 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbb4dc640 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faba40342b0 0x7faba4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbe1c2980 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb711860 0x55f5cb804d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb805280 con 0x55f5cb711860 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbc4de640 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb711860 0x55f5cb804d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbb4dc640 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faba40342b0 0x7faba4036770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7facb00ad000 tx=0x7facb00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbc4de640 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb711860 0x55f5cb804d40 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbc4de640 1 -- 172.21.15.133:0/2630497428 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facb400a4d0 con 0x55f5cb711860 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb805670 con 0x55f5cb711860 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbc4de640 1 -- 172.21.15.133:0/2630497428 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7facb400a4d0 con 0x55f5cb711860 2024-02-15T23:29:56.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb806f20 con 0x55f5cb711860 2024-02-15T23:29:56.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbc4de640 1 -- 172.21.15.133:0/2630497428 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7facb400a4d0 con 0x55f5cb711860 2024-02-15T23:29:56.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb806120 con 0x55f5cb711860 2024-02-15T23:29:56.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbc4de640 1 -- 172.21.15.133:0/2630497428 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7facb400a4d0 con 0x55f5cb711860 2024-02-15T23:29:56.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.703+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb806530 con 0x55f5cb711860 2024-02-15T23:29:56.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbc4de640 1 -- 172.21.15.133:0/2630497428 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7facb400a4d0 con 0x55f5cb711860 2024-02-15T23:29:56.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbe1c2980 1 Processor -- start 2024-02-15T23:29:56.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbe1c2980 1 -- start start 2024-02-15T23:29:56.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbe1c2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb8155c0 0x55f5cb8159e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbe1c2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5cb5aff20 con 0x55f5cb8155c0 2024-02-15T23:29:56.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbb4dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb8155c0 0x55f5cb8159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbb4dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb8155c0 0x55f5cb8159e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40414/0 (socket says 172.21.15.133:40414) 2024-02-15T23:29:56.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbb4dc640 1 -- 172.21.15.133:0/83046870 learned_addr learned my addr 172.21.15.133:0/83046870 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbb4dc640 1 -- 172.21.15.133:0/83046870 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5cb815f20 con 0x55f5cb8155c0 2024-02-15T23:29:56.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbb4dc640 1 --2- 172.21.15.133:0/83046870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb8155c0 0x55f5cb8159e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7facb0096e80 tx=0x7facb0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7faba17fa640 1 -- 172.21.15.133:0/83046870 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb00bd8a0 con 0x55f5cb8155c0 2024-02-15T23:29:56.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbe1c2980 1 -- 172.21.15.133:0/83046870 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f5cb816110 con 0x55f5cb8155c0 2024-02-15T23:29:56.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbe1c2980 1 -- 172.21.15.133:0/83046870 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5cb816c60 con 0x55f5cb8155c0 2024-02-15T23:29:56.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7faba17fa640 1 -- 172.21.15.133:0/83046870 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb00bda00 con 0x55f5cb8155c0 2024-02-15T23:29:56.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7faba17fa640 1 -- 172.21.15.133:0/83046870 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb00bdca0 con 0x55f5cb8155c0 2024-02-15T23:29:56.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7faba17fa640 1 -- 172.21.15.133:0/83046870 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7facb00be480 con 0x55f5cb8155c0 2024-02-15T23:29:56.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7faba17fa640 1 --2- 172.21.15.133:0/83046870 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab94034300 0x7fab940367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7faba17fa640 1 -- 172.21.15.133:0/83046870 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7facb00e6740 con 0x55f5cb8155c0 2024-02-15T23:29:56.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.707+0000 7facbc4de640 1 --2- 172.21.15.133:0/83046870 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab94034300 0x7fab940367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 Processor -- start 2024-02-15T23:29:56.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- start start 2024-02-15T23:29:56.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbc4de640 1 --2- 172.21.15.133:0/83046870 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab94034300 0x7fab940367c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55f5cb805b60 tx=0x7facb4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb822990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5cb5a3790 con 0x55f5cb822570 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb822990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb822990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40422/0 (socket says 172.21.15.133:40422) 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 -- 172.21.15.133:0/3022767539 learned_addr learned my addr 172.21.15.133:0/3022767539 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 -- 172.21.15.133:0/3022767539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5cb822f60 con 0x55f5cb822570 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 --2- 172.21.15.133:0/3022767539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb822990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7facb00e4ab0 tx=0x7facb00be8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de21b0ccf3397699 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7fab9affd640 1 -- 172.21.15.133:0/3022767539 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb00c7c00 con 0x55f5cb822570 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7fab9affd640 1 -- 172.21.15.133:0/3022767539 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb00c7d60 con 0x55f5cb822570 2024-02-15T23:29:56.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7fab9affd640 1 -- 172.21.15.133:0/3022767539 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb00e61a0 con 0x55f5cb822570 2024-02-15T23:29:56.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- 172.21.15.133:0/3022767539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 msgr2=0x55f5cb822990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 --2- 172.21.15.133:0/3022767539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb822990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7facb00e4ab0 tx=0x7facb00be8a0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- 172.21.15.133:0/3022767539 shutdown_connections 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 --2- 172.21.15.133:0/3022767539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb822990 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- 172.21.15.133:0/3022767539 >> 172.21.15.133:0/3022767539 conn(0x55f5cb81e900 msgr2=0x55f5cb81c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- 172.21.15.133:0/3022767539 shutdown_connections 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- 172.21.15.133:0/3022767539 wait complete. 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 Processor -- start 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- start start 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb829480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbe1c2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5cb8299c0 con 0x55f5cb822570 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb829480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb829480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40438/0 (socket says 172.21.15.133:40438) 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 learned_addr learned my addr 172.21.15.133:0/1917064738 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.711+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5cb816c60 con 0x55f5cb822570 2024-02-15T23:29:56.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbb4dc640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb829480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7facb00b4c80 tx=0x7facb00bef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7fab997fa640 1 -- 172.21.15.133:0/1917064738 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb00e3570 con 0x55f5cb822570 2024-02-15T23:29:56.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7fab997fa640 1 -- 172.21.15.133:0/1917064738 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb00e36d0 con 0x55f5cb822570 2024-02-15T23:29:56.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f5cb829bc0 con 0x55f5cb822570 2024-02-15T23:29:56.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7fab997fa640 1 -- 172.21.15.133:0/1917064738 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb00e6ad0 con 0x55f5cb822570 2024-02-15T23:29:56.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5cb829ff0 con 0x55f5cb822570 2024-02-15T23:29:56.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7fab997fa640 1 -- 172.21.15.133:0/1917064738 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7facb00e6c30 con 0x55f5cb822570 2024-02-15T23:29:56.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7fab997fa640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab84034300 0x7fab840367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7fab997fa640 1 -- 172.21.15.133:0/1917064738 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7facb00df070 con 0x55f5cb822570 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbc4de640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab84034300 0x7fab840367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb834a20 0x55f5cb836ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb837630 con 0x55f5cb834a20 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbbcdd640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb834a20 0x55f5cb836ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbc4de640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab84034300 0x7fab840367c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7facb4011010 tx=0x7facb4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbbcdd640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb834a20 0x55f5cb836ee0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 realm 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb837a00 con 0x55f5cb834a20 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb838280 con 0x55f5cb834a20 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8385e0 con 0x55f5cb834a20 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.715+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb838de0 con 0x55f5cb834a20 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbe1c2980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbe1c2980 20 searching for the correct realm 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbe1c2980 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f5cb83ac70 0x55f5cb83d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbb4dc640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f5cb83ac70 0x55f5cb83d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbb4dc640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f5cb83ac70 0x55f5cb83d0e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbb4dc640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7facb00ef020 0x7facb00da3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb00ef020 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbc4de640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7facb00ef020 0x7facb00da3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbc4de640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7facb00ef020 0x7facb00da3f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb400a4d0 con 0x7facb00ef020 2024-02-15T23:29:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbc4de640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7facb40141d0 0x7facb4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbbcdd640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7facb40141d0 0x7facb4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbbcdd640 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7facb40141d0 0x7facb4015940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.719+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb834a20 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb834a20 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb00ef020 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb400a4d0 con 0x7facb00ef020 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb834a20 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb834a20 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb00ef020 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.723+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb834a20 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb834a20 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb00ef020 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb834a20 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.727+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb00ef020 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb40141d0 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x55f5cb834a20 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83d7b0 con 0x7facb00ef020 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:56.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8396e0 con 0x55f5cb834a20 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.731+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb839f30 con 0x55f5cb834a20 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83dbf0 con 0x55f5cb834a20 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 zone default found 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 4 Realm: () 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:56.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 zonegroup default 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83dbf0 con 0x7facb40141d0 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83fa70 con 0x55f5cb83ac70 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83fdd0 con 0x55f5cb83ac70 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 started sync module instance, tier type = 2024-02-15T23:29:56.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:56.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83f040 con 0x7facb00ef020 2024-02-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94514169771040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb83f040 con 0x7facb00ef020 2024-02-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.735+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb840740 con 0x55f5cb834a20 2024-02-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.739+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94514169771040] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.739+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.739+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94514169769136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb840740 con 0x55f5cb834a20 2024-02-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.739+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8410b0 con 0x55f5cb83ac70 2024-02-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.739+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94514169769136] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.739+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.739+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94514169774752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8406c0 con 0x55f5cb83ac70 2024-02-15T23:29:56.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.739+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb841da0 con 0x7facb00ef020 2024-02-15T23:29:56.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.743+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.743+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94514169780784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8425f0 con 0x7facb00ef020 2024-02-15T23:29:56.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.743+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb842fe0 con 0x55f5cb834a20 2024-02-15T23:29:56.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.743+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94514169774752] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.743+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94514169780784] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.743+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.743+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94514169785024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb842150 con 0x55f5cb834a20 2024-02-15T23:29:56.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.743+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb843830 con 0x7facb40141d0 2024-02-15T23:29:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.747+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94514169785024] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.747+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.747+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94514169779296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb842150 con 0x7facb40141d0 2024-02-15T23:29:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.747+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb843d40 con 0x7facb40141d0 2024-02-15T23:29:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.747+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94514169779296] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.747+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94514169788448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb843d00 con 0x7facb40141d0 2024-02-15T23:29:56.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb844670 con 0x7facb40141d0 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(58 notify.7 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94514169790928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb844a90 con 0x7facb40141d0 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 20 add_watcher() i=0 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 20 add_watcher() i=1 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 20 add_watcher() i=2 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 20 add_watcher() i=3 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 20 add_watcher() i=4 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 20 add_watcher() i=5 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94514169788448] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.751+0000 7facbe1c2980 20 add_watcher() i=6 2024-02-15T23:29:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94514169790928] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbe1c2980 20 add_watcher() i=7 2024-02-15T23:29:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbe1c2980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8431e0 con 0x55f5cb834a20 2024-02-15T23:29:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94514169791984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8431e0 con 0x55f5cb834a20 2024-02-15T23:29:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94514169791984] v31'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7fab71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbe1c2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbe1c2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.755+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb850060 con 0x55f5cb834a20 2024-02-15T23:29:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.759+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.759+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8504a0 con 0x7facb40141d0 2024-02-15T23:29:56.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.759+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.759+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb850940 con 0x55f5cb83ac70 2024-02-15T23:29:56.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.759+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.759+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb851140 con 0x55f5cb834a20 2024-02-15T23:29:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.763+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'140 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.763+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb84e110 con 0x7facb00ef020 2024-02-15T23:29:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.763+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.763+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb84e110 con 0x55f5cb83ac70 2024-02-15T23:29:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.763+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'27 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.763+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb852320 con 0x55f5cb834a20 2024-02-15T23:29:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.767+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.767+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb852320 con 0x7facb40141d0 2024-02-15T23:29:56.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.767+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.771+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb852320 con 0x7facb00ef020 2024-02-15T23:29:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.771+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.771+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb852850 con 0x55f5cb83ac70 2024-02-15T23:29:56.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.771+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.771+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853220 con 0x7facb00ef020 2024-02-15T23:29:56.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.775+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.775+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb84d1b0 con 0x7facb40141d0 2024-02-15T23:29:56.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.775+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.775+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb84d1b0 con 0x7facb00ef020 2024-02-15T23:29:56.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.779+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.779+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb84d1b0 con 0x7facb40141d0 2024-02-15T23:29:56.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.779+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'33 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.779+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb84d380 con 0x55f5cb834a20 2024-02-15T23:29:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.783+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'141 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.783+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb84d380 con 0x55f5cb83ac70 2024-02-15T23:29:56.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.783+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.783+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x7facb00ef020 2024-02-15T23:29:56.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.783+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.783+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb83ac70 2024-02-15T23:29:56.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.787+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.787+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb834a20 2024-02-15T23:29:56.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.787+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.787+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb834a20 2024-02-15T23:29:56.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.791+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'142 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.791+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb83ac70 2024-02-15T23:29:56.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.791+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.791+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x7facb00ef020 2024-02-15T23:29:56.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.795+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.795+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb83ac70 2024-02-15T23:29:56.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.795+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.795+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb83ac70 2024-02-15T23:29:56.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.795+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.795+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb83ac70 2024-02-15T23:29:56.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.799+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.799+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb83ac70 2024-02-15T23:29:56.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.799+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.799+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x7facb40141d0 2024-02-15T23:29:56.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.803+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.803+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb83ac70 2024-02-15T23:29:56.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.803+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.803+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x7facb40141d0 2024-02-15T23:29:56.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.807+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.807+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x55f5cb83ac70 2024-02-15T23:29:56.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.807+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'37 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.807+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x7facb40141d0 2024-02-15T23:29:56.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.811+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'34 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.811+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb853bc0 con 0x7facb00ef020 2024-02-15T23:29:56.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7fab70fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:56.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 Filter name: none 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7faaea7fc640 20 reqs_thread_entry: start 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb8539a0 con 0x7facb00ef020 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb86f4f0 con 0x55f5cb834a20 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(95 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv9 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 get_obj_state: octx=0x7facac02deb0 obj=myfoo:four state=0x55f5cb86ff88 s->prefetch_data=0 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 3.1as0 3:59c49246:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb871040 con 0x55f5cb834a20 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(96 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+865 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 10 manifest: total_size = 4 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 get_obj_state: setting s->obj_tag to cd69b486-4810-48ae-b5d4-5bce307169d4.4227.3499677665411559792 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 get_obj_state: octx=0x7facac02deb0 obj=myfoo:four state=0x55f5cb86ff88 s->prefetch_data=0 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 prepare_atomic_modification: state is not atomic. state=0x55f5cb86ff88 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6 2024-02-15T23:29:56.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.815+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:97 4.f 4:f19f4e25:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875a90 con 0x55f5cb834a20 2024-02-15T23:29:56.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.819+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(97 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6 [stat,call,call] v31'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.819+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:98 3.1as0 3:59c49246:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875a90 con 0x55f5cb834a20 2024-02-15T23:29:56.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.819+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(98 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1_four [call] v31'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.819+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 4.f 4:f19f4e25:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875ed0 con 0x55f5cb834a20 2024-02-15T23:29:56.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(99 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6 [stat,call,call] v31'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7fab71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:56.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7fab9affd640 20 handle_completion(): completion ok for obj=four 2024-02-15T23:29:56.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94514169791984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x55f5cb834a20 2024-02-15T23:29:56.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94514169791984] v31'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94514169771040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x7facb00ef020 2024-02-15T23:29:56.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94514169771040] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7facbe1c2980 20 remove_watcher() i=0 2024-02-15T23:29:56.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7facbe1c2980 2 removed watcher, disabling cache 2024-02-15T23:29:56.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.823+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94514169769136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x55f5cb834a20 2024-02-15T23:29:56.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.827+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94514169769136] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.827+0000 7facbe1c2980 20 remove_watcher() i=1 2024-02-15T23:29:56.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.827+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94514169774752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x55f5cb83ac70 2024-02-15T23:29:56.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.827+0000 7facbb4dc640 1 -- 172.21.15.133:0/1917064738 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94514169774752] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb00ec070 con 0x55f5cb83ac70 2024-02-15T23:29:56.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.827+0000 7facbe1c2980 20 remove_watcher() i=2 2024-02-15T23:29:56.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.827+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94514169780784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x7facb00ef020 2024-02-15T23:29:56.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.831+0000 7facbc4de640 1 -- 172.21.15.133:0/1917064738 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94514169780784] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facb403a040 con 0x7facb00ef020 2024-02-15T23:29:56.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.831+0000 7facbe1c2980 20 remove_watcher() i=3 2024-02-15T23:29:56.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.831+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94514169785024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x55f5cb834a20 2024-02-15T23:29:56.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.831+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94514169785024] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x55f5cb834a20 2024-02-15T23:29:56.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.831+0000 7facbe1c2980 20 remove_watcher() i=4 2024-02-15T23:29:56.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.831+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94514169779296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x7facb40141d0 2024-02-15T23:29:56.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.835+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94514169779296] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.835+0000 7facbe1c2980 20 remove_watcher() i=5 2024-02-15T23:29:56.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.835+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94514169788448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x7facb40141d0 2024-02-15T23:29:56.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.835+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94514169788448] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.835+0000 7facbe1c2980 20 remove_watcher() i=6 2024-02-15T23:29:56.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.835+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94514169790928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5cb875e90 con 0x7facb40141d0 2024-02-15T23:29:56.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94514169790928] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facac017900 con 0x7facb40141d0 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 20 remove_watcher() i=7 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7facb40141d0 msgr2=0x7facb4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7facb40141d0 0x7facb4015940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb834a20 msgr2=0x55f5cb836ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb834a20 0x55f5cb836ee0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7facb00ef020 msgr2=0x7facb00da3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7facb00ef020 0x7facb00da3f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f5cb83ac70 msgr2=0x55f5cb83d0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55f5cb83ac70 0x55f5cb83d0e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab84034300 msgr2=0x7fab840367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab84034300 0x7fab840367c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7facb4011010 tx=0x7facb4020000 comp rx=0 tx=0).stop 2024-02-15T23:29:56.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 msgr2=0x55f5cb829480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/1917064738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb822570 0x55f5cb829480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7facb00b4c80 tx=0x7facb00bef50 comp rx=0 tx=0).stop 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 reap_dead start 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbbcdd640 1 -- 172.21.15.133:0/1917064738 reap_dead start 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 shutdown_connections 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 >> 172.21.15.133:0/1917064738 conn(0x55f5cb81e900 msgr2=0x55f5cb81bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 shutdown_connections 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/1917064738 wait complete. 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/83046870 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab94034300 msgr2=0x7fab940367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/83046870 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab94034300 0x7fab940367c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55f5cb805b60 tx=0x7facb4005850 comp rx=0 tx=0).stop 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/83046870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb8155c0 msgr2=0x55f5cb8159e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/83046870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb8155c0 0x55f5cb8159e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7facb0096e80 tx=0x7facb0018020 comp rx=0 tx=0).stop 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/83046870 shutdown_connections 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/83046870 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fab94034300 0x7fab940367c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/83046870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb8155c0 0x55f5cb8159e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/83046870 >> 172.21.15.133:0/83046870 conn(0x55f5cb80a3d0 msgr2=0x55f5cb80aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/83046870 shutdown_connections 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/83046870 wait complete. 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb711860 msgr2=0x55f5cb804d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb711860 0x55f5cb804d40 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faba40342b0 msgr2=0x7faba4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faba40342b0 0x7faba4036770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7facb00ad000 tx=0x7facb00a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 msgr2=0x55f5cb7fe0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7fe0b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7facac00b710 tx=0x7facac000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 shutdown_connections 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f5cb711860 0x55f5cb804d40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faba40342b0 0x7faba4036770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 --2- 172.21.15.133:0/2630497428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5cb70d360 0x55f5cb7fe0b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 >> 172.21.15.133:0/2630497428 conn(0x55f5cb680a50 msgr2=0x55f5cb7f1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 shutdown_connections 2024-02-15T23:29:56.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.839+0000 7facbe1c2980 1 -- 172.21.15.133:0/2630497428 wait complete. 2024-02-15T23:29:56.861 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T23:29:56.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T23:29:56.861 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-15T23:29:56.933 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:56.934 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:56.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03dcfb5980 1 Processor -- start 2024-02-15T23:29:56.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03dcfb5980 1 -- start start 2024-02-15T23:29:56.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03dcfb5980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55fca0c994e0 0x55fca0c9b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03dcfb5980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fca0be14c0 con 0x55fca0c090c0 2024-02-15T23:29:56.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03dcfb5980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fca0ba8180 con 0x55fca0c994e0 2024-02-15T23:29:56.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03da2cf640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55fca0c994e0 0x55fca0c9b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03da2cf640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55fca0c994e0 0x55fca0c9b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40446/0 (socket says 172.21.15.133:40446) 2024-02-15T23:29:56.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03da2cf640 1 -- 172.21.15.133:0/2675884828 learned_addr learned my addr 172.21.15.133:0/2675884828 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03da2cf640 1 -- 172.21.15.133:0/2675884828 >> v1:172.21.15.131:6789/0 conn(0x55fca0c090c0 legacy=0x55fca0c97dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.927+0000 7f03da2cf640 1 -- 172.21.15.133:0/2675884828 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca0c9cee0 con 0x55fca0c994e0 2024-02-15T23:29:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03da2cf640 1 --2- 172.21.15.133:0/2675884828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c994e0 0x55fca0c9b8d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f03c400a5c0 tx=0x7f03c401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5d01429e8a76d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03d9ace640 1 -- 172.21.15.133:0/2675884828 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c40aa470 con 0x55fca0c994e0 2024-02-15T23:29:56.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03d9ace640 1 -- 172.21.15.133:0/2675884828 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40aa5d0 con 0x55fca0c994e0 2024-02-15T23:29:56.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03d9ace640 1 -- 172.21.15.133:0/2675884828 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c40aa890 con 0x55fca0c994e0 2024-02-15T23:29:56.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2675884828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c994e0 msgr2=0x55fca0c9b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/2675884828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c994e0 0x55fca0c9b8d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f03c400a5c0 tx=0x7f03c401b340 comp rx=0 tx=0).stop 2024-02-15T23:29:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2675884828 shutdown_connections 2024-02-15T23:29:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/2675884828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c994e0 0x55fca0c9b8d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2675884828 >> 172.21.15.133:0/2675884828 conn(0x55fca0c8f8e0 msgr2=0x55fca0c91d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2675884828 shutdown_connections 2024-02-15T23:29:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.931+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2675884828 wait complete. 2024-02-15T23:29:56.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03dcfb5980 1 Processor -- start 2024-02-15T23:29:56.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03dcfb5980 1 -- start start 2024-02-15T23:29:56.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03dcfb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d7f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03dcfb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0ba56b0 con 0x55fca0c090c0 2024-02-15T23:29:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03daad0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d7f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03daad0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d7f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40460/0 (socket says 172.21.15.133:40460) 2024-02-15T23:29:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03daad0640 1 -- 172.21.15.133:0/2543822592 learned_addr learned my addr 172.21.15.133:0/2543822592 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03daad0640 1 -- 172.21.15.133:0/2543822592 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4005df0 con 0x55fca0c090c0 2024-02-15T23:29:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f03daad0640 1 --2- 172.21.15.133:0/2543822592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d7f0e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f03cc006f60 tx=0x7f03cc006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ff3ca8bfd27095 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f02c8e09640 1 -- 172.21.15.133:0/2543822592 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03cc00f640 con 0x55fca0c090c0 2024-02-15T23:29:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f02c8e09640 1 -- 172.21.15.133:0/2543822592 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc00f7a0 con 0x55fca0c090c0 2024-02-15T23:29:56.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.947+0000 7f02c8e09640 1 -- 172.21.15.133:0/2543822592 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03cc00fac0 con 0x55fca0c090c0 2024-02-15T23:29:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2543822592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 msgr2=0x55fca0d7f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/2543822592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d7f0e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f03cc006f60 tx=0x7f03cc006f90 comp rx=0 tx=0).stop 2024-02-15T23:29:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2543822592 shutdown_connections 2024-02-15T23:29:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/2543822592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d7f0e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2543822592 >> 172.21.15.133:0/2543822592 conn(0x55fca0c8f8e0 msgr2=0x55fca0d7ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2543822592 shutdown_connections 2024-02-15T23:29:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- 172.21.15.133:0/2543822592 wait complete. 2024-02-15T23:29:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 Processor -- start 2024-02-15T23:29:56.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- start start 2024-02-15T23:29:56.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d85f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0ba0e90 con 0x55fca0c090c0 2024-02-15T23:29:56.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03daad0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d85f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03daad0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d85f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40464/0 (socket says 172.21.15.133:40464) 2024-02-15T23:29:56.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03daad0640 1 -- 172.21.15.133:0/1506529845 learned_addr learned my addr 172.21.15.133:0/1506529845 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03daad0640 1 -- 172.21.15.133:0/1506529845 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca0be14c0 con 0x55fca0c090c0 2024-02-15T23:29:56.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03daad0640 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d85f30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f03cc001e70 tx=0x7f03cc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f02c7606640 1 -- 172.21.15.133:0/1506529845 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03cc006160 con 0x55fca0c090c0 2024-02-15T23:29:56.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f02c7606640 1 -- 172.21.15.133:0/1506529845 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc0062c0 con 0x55fca0c090c0 2024-02-15T23:29:56.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f02c7606640 1 -- 172.21.15.133:0/1506529845 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03cc01e7c0 con 0x55fca0c090c0 2024-02-15T23:29:56.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fca0d86470 con 0x55fca0c090c0 2024-02-15T23:29:56.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.951+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fca0d86920 con 0x55fca0c090c0 2024-02-15T23:29:56.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f02c7606640 1 -- 172.21.15.133:0/1506529845 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f03cc01e920 con 0x55fca0c090c0 2024-02-15T23:29:56.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f02c7606640 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02c0034300 0x7f02c00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f02c7606640 1 -- 172.21.15.133:0/1506529845 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f03cc049bf0 con 0x55fca0c090c0 2024-02-15T23:29:56.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03da2cf640 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02c0034300 0x7f02c00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0c994e0 0x55fca0d8cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0d8d100 con 0x55fca0c994e0 2024-02-15T23:29:56.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0c994e0 0x55fca0d8cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03da2cf640 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02c0034300 0x7f02c00367c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03c40ae000 tx=0x7f03c40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0c994e0 0x55fca0d8cbc0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03db2d1640 1 -- 172.21.15.133:0/1506529845 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03d40083f0 con 0x55fca0c994e0 2024-02-15T23:29:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0d8d460 con 0x55fca0c994e0 2024-02-15T23:29:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03db2d1640 1 -- 172.21.15.133:0/1506529845 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f03d40083f0 con 0x55fca0c994e0 2024-02-15T23:29:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0d8ece0 con 0x55fca0c994e0 2024-02-15T23:29:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03db2d1640 1 -- 172.21.15.133:0/1506529845 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f03d40083f0 con 0x55fca0c994e0 2024-02-15T23:29:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0d8dee0 con 0x55fca0c994e0 2024-02-15T23:29:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03db2d1640 1 -- 172.21.15.133:0/1506529845 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f03d40083f0 con 0x55fca0c994e0 2024-02-15T23:29:56.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0d8e2f0 con 0x55fca0c994e0 2024-02-15T23:29:56.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03db2d1640 1 -- 172.21.15.133:0/1506529845 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f03d4012040 con 0x55fca0c994e0 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.955+0000 7f03dcfb5980 1 Processor -- start 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 -- start start 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c95920 0x55fca0c93dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0b39f20 con 0x55fca0c95920 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03da2cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c95920 0x55fca0c93dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03da2cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c95920 0x55fca0c93dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40474/0 (socket says 172.21.15.133:40474) 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03da2cf640 1 -- 172.21.15.133:0/1274700414 learned_addr learned my addr 172.21.15.133:0/1274700414 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03da2cf640 1 -- 172.21.15.133:0/1274700414 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca0c94300 con 0x55fca0c95920 2024-02-15T23:29:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03da2cf640 1 --2- 172.21.15.133:0/1274700414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c95920 0x55fca0c93dc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f03c401b380 tx=0x7f03c40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f02c4e01640 1 -- 172.21.15.133:0/1274700414 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c40b3ca0 con 0x55fca0c95920 2024-02-15T23:29:56.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f02c4e01640 1 -- 172.21.15.133:0/1274700414 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40c3070 con 0x55fca0c95920 2024-02-15T23:29:56.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1274700414 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fca0c944f0 con 0x55fca0c95920 2024-02-15T23:29:56.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f02c4e01640 1 -- 172.21.15.133:0/1274700414 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c40c8430 con 0x55fca0c95920 2024-02-15T23:29:56.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1274700414 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fca0c94920 con 0x55fca0c95920 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f02c4e01640 1 -- 172.21.15.133:0/1274700414 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f03c40c5030 con 0x55fca0c95920 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f02c4e01640 1 --2- 172.21.15.133:0/1274700414 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02b40342b0 0x7f02b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f02c4e01640 1 -- 172.21.15.133:0/1274700414 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f03c40e68b0 con 0x55fca0c95920 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1274700414 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02b40342b0 0x7f02b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 Processor -- start 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1274700414 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02b40342b0 0x7f02b4036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55fca0d8d920 tx=0x7f03d4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 -- start start 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0dac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.959+0000 7f03dcfb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0b2d790 con 0x55fca0dac5a0 2024-02-15T23:29:56.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0dac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0dac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40486/0 (socket says 172.21.15.133:40486) 2024-02-15T23:29:56.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 -- 172.21.15.133:0/3213981331 learned_addr learned my addr 172.21.15.133:0/3213981331 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 -- 172.21.15.133:0/3213981331 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca0dacf90 con 0x55fca0dac5a0 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 --2- 172.21.15.133:0/3213981331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0dac9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f03c40e4be0 tx=0x7f03c40bd630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b748864697afad12 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f02be7fc640 1 -- 172.21.15.133:0/3213981331 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c40d6040 con 0x55fca0dac5a0 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f02be7fc640 1 -- 172.21.15.133:0/3213981331 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40b4260 con 0x55fca0dac5a0 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f02be7fc640 1 -- 172.21.15.133:0/3213981331 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c40064e0 con 0x55fca0dac5a0 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- 172.21.15.133:0/3213981331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 msgr2=0x55fca0dac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/3213981331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0dac9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f03c40e4be0 tx=0x7f03c40bd630 comp rx=0 tx=0).stop 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- 172.21.15.133:0/3213981331 shutdown_connections 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/3213981331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0dac9c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- 172.21.15.133:0/3213981331 >> 172.21.15.133:0/3213981331 conn(0x55fca0da8930 msgr2=0x55fca0da6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- 172.21.15.133:0/3213981331 shutdown_connections 2024-02-15T23:29:56.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- 172.21.15.133:0/3213981331 wait complete. 2024-02-15T23:29:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 Processor -- start 2024-02-15T23:29:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- start start 2024-02-15T23:29:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0db3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca0db3ab0 con 0x55fca0dac5a0 2024-02-15T23:29:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0db3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0db3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40502/0 (socket says 172.21.15.133:40502) 2024-02-15T23:29:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 learned_addr learned my addr 172.21.15.133:0/1300182817 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca0c94920 con 0x55fca0dac5a0 2024-02-15T23:29:56.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03da2cf640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0db3570 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f03c40e3b00 tx=0x7f03c40e4b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f02bcff9640 1 -- 172.21.15.133:0/1300182817 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c40d6040 con 0x55fca0dac5a0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fca0db3cb0 con 0x55fca0dac5a0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f02bcff9640 1 -- 172.21.15.133:0/1300182817 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40e6c70 con 0x55fca0dac5a0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f02bcff9640 1 -- 172.21.15.133:0/1300182817 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c40e3390 con 0x55fca0dac5a0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.963+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fca0db3cb0 con 0x55fca0dac5a0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f02bcff9640 1 -- 172.21.15.133:0/1300182817 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f03c40e2040 con 0x55fca0dac5a0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f02bcff9640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02a40342b0 0x7f02a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f02bcff9640 1 -- 172.21.15.133:0/1300182817 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f03c40d4150 con 0x55fca0dac5a0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02a40342b0 0x7f02a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0dbe920 0x55fca0dc0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc1500 con 0x55fca0dbe920 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03daad0640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0dbe920 0x55fca0dc0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02a40342b0 0x7f02a4036770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03d4008fd0 tx=0x7f03d401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03daad0640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0dbe920 0x55fca0dc0db0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03cc018070 con 0x55fca0dbe920 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 realm 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc18d0 con 0x55fca0dbe920 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03cc018070 con 0x55fca0dbe920 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc2150 con 0x55fca0dbe920 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03cc018070 con 0x55fca0dbe920 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc24b0 con 0x55fca0dbe920 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f03cc018070 con 0x55fca0dbe920 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc1db0 con 0x55fca0dbe920 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f03cc018070 con 0x55fca0dbe920 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 20 searching for the correct realm 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fca0dc4710 0x55fca0dc6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.967+0000 7f03da2cf640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fca0dc4710 0x55fca0dc6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03da2cf640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fca0dc4710 0x55fca0dc6b00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c40b0020 con 0x55fca0dc4710 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03da2cf640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f03c40f2070 0x7f03c40067f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03c40f2070 2024-02-15T23:29:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f03c40f2070 0x7f03c40067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f03c40f2070 0x7f03c40067f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03d402c040 con 0x7f03c40f2070 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03db2d1640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f03d4027940 0x7f03d40333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03daad0640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f03d4027940 0x7f03d40333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03daad0640 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f03d4027940 0x7f03d40333c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc018070 con 0x7f03d4027940 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dbe920 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dbe920 2024-02-15T23:29:56.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.971+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03c40f2070 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03d402c040 con 0x7f03c40f2070 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c40b0020 con 0x55fca0dc4710 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dbe920 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dbe920 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03c40f2070 2024-02-15T23:29:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f03d402c040 con 0x7f03c40f2070 2024-02-15T23:29:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.975+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dbe920 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dbe920 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03c40f2070 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03d402c040 con 0x7f03c40f2070 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dbe920 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.979+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03c40f2070 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03d402c040 con 0x7f03c40f2070 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dc4710 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03d4027940 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x55fca0dbe920 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc71b0 con 0x7f03c40f2070 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03d402c040 con 0x7f03c40f2070 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:56.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc32d0 con 0x55fca0dbe920 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc2f20 con 0x55fca0dbe920 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc3bb0 con 0x55fca0dbe920 2024-02-15T23:29:56.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 zone default found 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 4 Realm: () 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 zonegroup default 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.983+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc75f0 con 0x7f03d4027940 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc9470 con 0x55fca0dc4710 2024-02-15T23:29:56.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc97d0 con 0x55fca0dc4710 2024-02-15T23:29:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 20 started sync module instance, tier type = 2024-02-15T23:29:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:56.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc8a40 con 0x7f03c40f2070 2024-02-15T23:29:57.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94543518928368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc8a40 con 0x7f03c40f2070 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dca140 con 0x55fca0dbe920 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.987+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94543518928368] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.991+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.991+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94543518932400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc8a40 con 0x55fca0dbe920 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.991+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcab40 con 0x55fca0dc4710 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.991+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94543518932400] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.991+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.991+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94543518926240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dc89c0 con 0x55fca0dc4710 2024-02-15T23:29:57.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.991+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcb830 con 0x7f03c40f2070 2024-02-15T23:29:57.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.995+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.995+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94543518938272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcc080 con 0x7f03c40f2070 2024-02-15T23:29:57.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.995+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcca80 con 0x55fca0dbe920 2024-02-15T23:29:57.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.995+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94543518926240] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:57.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.995+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94543518938272] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.995+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.995+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94543518942592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcbbe0 con 0x55fca0dbe920 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.995+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcd2d0 con 0x7f03d4027940 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.999+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94543518942592] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.999+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.999+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94543518936816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcbbe0 con 0x7f03d4027940 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.999+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcd750 con 0x7f03d4027940 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.999+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94543518936816] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.999+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.999+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94543518944352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcd710 con 0x7f03d4027940 2024-02-15T23:29:57.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:56.999+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dce120 con 0x7f03d4027940 2024-02-15T23:29:57.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94543518944352] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94543518945904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dcd690 con 0x7f03d4027940 2024-02-15T23:29:57.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 20 add_watcher() i=0 2024-02-15T23:29:57.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 20 add_watcher() i=1 2024-02-15T23:29:57.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 20 add_watcher() i=2 2024-02-15T23:29:57.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 20 add_watcher() i=3 2024-02-15T23:29:57.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 20 add_watcher() i=4 2024-02-15T23:29:57.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 20 add_watcher() i=5 2024-02-15T23:29:57.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 20 add_watcher() i=6 2024-02-15T23:29:57.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94543518945904] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 20 add_watcher() i=7 2024-02-15T23:29:57.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:57.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dd15f0 con 0x55fca0dbe920 2024-02-15T23:29:57.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.003+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94543518949664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dceab0 con 0x55fca0dbe920 2024-02-15T23:29:57.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94543518949664] v31'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f02917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 5 note: GC not initialized 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f020bfff640 20 reqs_thread_entry: start 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 Filter name: none 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f0209ffb640 20 reqs_thread_entry: start 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0df3530 con 0x7f03c40f2070 2024-02-15T23:29:57.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:57.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0df3b00 con 0x55fca0dbe920 2024-02-15T23:29:57.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(63 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv9 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:57.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0df2bb0 con 0x7f03c40f2070 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0df3500 con 0x55fca0dbe920 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv9 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 4.4 4:225d0aa6:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0df4b60 con 0x7f03d4027940 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.007+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 4.7 4:e26d1279:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0df9bf0 con 0x7f03d4027940 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 4.10 4:089e7450:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0df9bf0 con 0x55fca0dc4710 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 4.1b 4:d8953915:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0dfe950 con 0x7f03c40f2070 2024-02-15T23:29:57.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 4.26 4:6757ac19:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0e01680 con 0x7f03d4027940 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 4.2d 4:b6243017:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0e01680 con 0x7f03d4027940 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 4.f 4:f19f4e25:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0e06ac0 con 0x55fca0dbe920 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 4.18 4:184ef1b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0e09930 con 0x7f03c40f2070 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:74 4.5 4:a039e12f:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0e0c7a0 con 0x55fca0dc4710 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 4.6 4:636a0651:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0e0f5e0 con 0x55fca0dc4710 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 4.4 4:227d7df5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0e12360 con 0x7f03d4027940 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(72 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(68 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(67 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(75 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(66 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(70 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(74 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:57.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(69 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(73 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(76 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(71 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 6.1d 6:ba7aa448:::pubsub..bucket.myfoo%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0e01600 con 0x7f03d4027940 2024-02-15T23:29:57.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(77 pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x7f03d4027940 2024-02-15T23:29:57.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f02917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:57.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.011+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94543518949664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x55fca0dbe920 2024-02-15T23:29:57.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94543518949664] v31'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94543518928368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x7f03c40f2070 2024-02-15T23:29:57.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94543518928368] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03dcfb5980 20 remove_watcher() i=0 2024-02-15T23:29:57.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03dcfb5980 2 removed watcher, disabling cache 2024-02-15T23:29:57.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94543518932400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x55fca0dbe920 2024-02-15T23:29:57.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94543518932400] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03dcfb5980 20 remove_watcher() i=1 2024-02-15T23:29:57.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.015+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94543518926240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x55fca0dc4710 2024-02-15T23:29:57.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.019+0000 7f03da2cf640 1 -- 172.21.15.133:0/1300182817 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94543518926240] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c4106040 con 0x55fca0dc4710 2024-02-15T23:29:57.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.019+0000 7f03dcfb5980 20 remove_watcher() i=2 2024-02-15T23:29:57.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.019+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94543518938272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x7f03c40f2070 2024-02-15T23:29:57.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.019+0000 7f03db2d1640 1 -- 172.21.15.133:0/1300182817 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94543518938272] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03d403f040 con 0x7f03c40f2070 2024-02-15T23:29:57.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.019+0000 7f03dcfb5980 20 remove_watcher() i=3 2024-02-15T23:29:57.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.019+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94543518942592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x55fca0dbe920 2024-02-15T23:29:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.023+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94543518942592] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc041040 con 0x55fca0dbe920 2024-02-15T23:29:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.023+0000 7f03dcfb5980 20 remove_watcher() i=4 2024-02-15T23:29:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.023+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94543518936816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x7f03d4027940 2024-02-15T23:29:57.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.023+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94543518936816] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc06e040 con 0x7f03d4027940 2024-02-15T23:29:57.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.023+0000 7f03dcfb5980 20 remove_watcher() i=5 2024-02-15T23:29:57.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.023+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94543518944352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x7f03d4027940 2024-02-15T23:29:57.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94543518944352] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc06e040 con 0x7f03d4027940 2024-02-15T23:29:57.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 20 remove_watcher() i=6 2024-02-15T23:29:57.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94543518945904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fca0de5280 con 0x7f03d4027940 2024-02-15T23:29:57.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94543518945904] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03cc06e040 con 0x7f03d4027940 2024-02-15T23:29:57.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 20 remove_watcher() i=7 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f03d4027940 msgr2=0x7f03d40333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f03d4027940 0x7f03d40333c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0dbe920 msgr2=0x55fca0dc0db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0dbe920 0x55fca0dc0db0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f03c40f2070 msgr2=0x7f03c40067f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f03c40f2070 0x7f03c40067f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fca0dc4710 msgr2=0x55fca0dc6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55fca0dc4710 0x55fca0dc6b00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02a40342b0 msgr2=0x7f02a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02a40342b0 0x7f02a4036770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03d4008fd0 tx=0x7f03d401c070 comp rx=0 tx=0).stop 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 msgr2=0x55fca0db3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03daad0640 1 -- 172.21.15.133:0/1300182817 reap_dead start 2024-02-15T23:29:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0db3570 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f03c40e3b00 tx=0x7f03c40e4b70 comp rx=0 tx=0).stop 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 shutdown_connections 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1300182817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0dac5a0 0x55fca0db3570 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.027+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 >> 172.21.15.133:0/1300182817 conn(0x55fca0da8930 msgr2=0x55fca0da5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 shutdown_connections 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1300182817 wait complete. 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1274700414 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02b40342b0 msgr2=0x7f02b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1274700414 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02b40342b0 0x7f02b4036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55fca0d8d920 tx=0x7f03d4003070 comp rx=0 tx=0).stop 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1274700414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c95920 msgr2=0x55fca0c93dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1274700414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c95920 0x55fca0c93dc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f03c401b380 tx=0x7f03c40180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1274700414 shutdown_connections 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1274700414 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02b40342b0 0x7f02b4036770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1274700414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c95920 0x55fca0c93dc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1274700414 >> 172.21.15.133:0/1274700414 conn(0x55fca0d921f0 msgr2=0x55fca0d92d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1274700414 shutdown_connections 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1274700414 wait complete. 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0c994e0 msgr2=0x55fca0d8cbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0c994e0 0x55fca0d8cbc0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02c0034300 msgr2=0x7f02c00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02c0034300 0x7f02c00367c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03c40ae000 tx=0x7f03c40a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 msgr2=0x55fca0d85f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d85f30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f03cc001e70 tx=0x7f03cc001260 comp rx=0 tx=0).stop 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 shutdown_connections 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55fca0c994e0 0x55fca0d8cbc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f02c0034300 0x7f02c00367c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 --2- 172.21.15.133:0/1506529845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fca0c090c0 0x55fca0d85f30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 >> 172.21.15.133:0/1506529845 conn(0x55fca0c8f8e0 msgr2=0x55fca0d79780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 shutdown_connections 2024-02-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.031+0000 7f03dcfb5980 1 -- 172.21.15.133:0/1506529845 wait complete. 2024-02-15T23:29:57.050 INFO:teuthology.orchestra.run.smithi133.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"deea0f97-f899-4036-a460-801d53f243a7","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","marker":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-15T23:29:56.298857Z","creation_time":"2024-02-15T23:29:52.491594Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-15T23:29:57.050 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'deea0f97-f899-4036-a460-801d53f243a7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'marker': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-15T23:29:56.298857Z', 'creation_time': '2024-02-15T23:29:52.491594Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-15T23:29:57.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-02-15T23:29:57.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-02-15T23:29:57.051 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-02-15T23:29:57.123 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:57.123 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:57.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cf538980 1 Processor -- start 2024-02-15T23:29:57.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cf538980 1 -- start start 2024-02-15T23:29:57.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cf538980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x564f32a66840 0x564f32a68c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cf538980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564f329ac4b0 con 0x564f32a62340 2024-02-15T23:29:57.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cf538980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x564f32973180 con 0x564f32a66840 2024-02-15T23:29:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cc852640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x564f32a66840 0x564f32a68c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cc852640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x564f32a66840 0x564f32a68c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40510/0 (socket says 172.21.15.133:40510) 2024-02-15T23:29:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cc852640 1 -- 172.21.15.133:0/1152438288 learned_addr learned my addr 172.21.15.133:0/1152438288 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cd053640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x564f32a62340 0x564f32a62720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:41628/0 (socket says 172.21.15.133:41628) 2024-02-15T23:29:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cc852640 1 -- 172.21.15.133:0/1152438288 >> v1:172.21.15.131:6789/0 conn(0x564f32a62340 legacy=0x564f32a62720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.115+0000 7f99cc852640 1 -- 172.21.15.133:0/1152438288 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f32a6a180 con 0x564f32a66840 2024-02-15T23:29:57.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99cc852640 1 --2- 172.21.15.133:0/1152438288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a66840 0x564f32a68c30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f99c400a5c0 tx=0x7f99c401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f6bbf87b83cdb2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99bffff640 1 -- 172.21.15.133:0/1152438288 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40aa470 con 0x564f32a66840 2024-02-15T23:29:57.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99bffff640 1 -- 172.21.15.133:0/1152438288 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c40aa5d0 con 0x564f32a66840 2024-02-15T23:29:57.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99bffff640 1 -- 172.21.15.133:0/1152438288 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40aa890 con 0x564f32a66840 2024-02-15T23:29:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99cf538980 1 -- 172.21.15.133:0/1152438288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a66840 msgr2=0x564f32a68c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99cf538980 1 --2- 172.21.15.133:0/1152438288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a66840 0x564f32a68c30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f99c400a5c0 tx=0x7f99c401b340 comp rx=0 tx=0).stop 2024-02-15T23:29:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99cf538980 1 -- 172.21.15.133:0/1152438288 shutdown_connections 2024-02-15T23:29:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99cf538980 1 --2- 172.21.15.133:0/1152438288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a66840 0x564f32a68c30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99cf538980 1 -- 172.21.15.133:0/1152438288 >> 172.21.15.133:0/1152438288 conn(0x564f329d5a30 msgr2=0x564f329d5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99cf538980 1 -- 172.21.15.133:0/1152438288 shutdown_connections 2024-02-15T23:29:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.119+0000 7f99cf538980 1 -- 172.21.15.133:0/1152438288 wait complete. 2024-02-15T23:29:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.135+0000 7f99cf538980 1 Processor -- start 2024-02-15T23:29:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.135+0000 7f99cf538980 1 -- start start 2024-02-15T23:29:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.135+0000 7f99cf538980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b4c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.135+0000 7f99cf538980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f329706b0 con 0x564f32a62340 2024-02-15T23:29:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.135+0000 7f99cd053640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b4c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.135+0000 7f99cd053640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b4c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40520/0 (socket says 172.21.15.133:40520) 2024-02-15T23:29:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.135+0000 7f99cd053640 1 -- 172.21.15.133:0/2275894072 learned_addr learned my addr 172.21.15.133:0/2275894072 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.135+0000 7f99cd053640 1 -- 172.21.15.133:0/2275894072 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4005df0 con 0x564f32a62340 2024-02-15T23:29:57.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cd053640 1 --2- 172.21.15.133:0/2275894072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b4c290 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f99c0001cc0 tx=0x7f99c000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5ef5577eff64a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f98bb606640 1 -- 172.21.15.133:0/2275894072 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c0014070 con 0x564f32a62340 2024-02-15T23:29:57.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f98bb606640 1 -- 172.21.15.133:0/2275894072 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c000f590 con 0x564f32a62340 2024-02-15T23:29:57.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f98bb606640 1 -- 172.21.15.133:0/2275894072 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c0007040 con 0x564f32a62340 2024-02-15T23:29:57.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 -- 172.21.15.133:0/2275894072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 msgr2=0x564f32b4c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 --2- 172.21.15.133:0/2275894072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b4c290 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f99c0001cc0 tx=0x7f99c000b610 comp rx=0 tx=0).stop 2024-02-15T23:29:57.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 -- 172.21.15.133:0/2275894072 shutdown_connections 2024-02-15T23:29:57.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 --2- 172.21.15.133:0/2275894072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b4c290 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 -- 172.21.15.133:0/2275894072 >> 172.21.15.133:0/2275894072 conn(0x564f329d5a30 msgr2=0x564f32b47e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 -- 172.21.15.133:0/2275894072 shutdown_connections 2024-02-15T23:29:57.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 -- 172.21.15.133:0/2275894072 wait complete. 2024-02-15T23:29:57.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 Processor -- start 2024-02-15T23:29:57.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 -- start start 2024-02-15T23:29:57.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cf538980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3296be90 con 0x564f32a62340 2024-02-15T23:29:57.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cd053640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cd053640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40524/0 (socket says 172.21.15.133:40524) 2024-02-15T23:29:57.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cd053640 1 -- 172.21.15.133:0/571421554 learned_addr learned my addr 172.21.15.133:0/571421554 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cd053640 1 -- 172.21.15.133:0/571421554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f329ac4b0 con 0x564f32a62340 2024-02-15T23:29:57.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f99cd053640 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b531d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x564f32b4d120 tx=0x7f99c0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f98b9e03640 1 -- 172.21.15.133:0/571421554 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c0014030 con 0x564f32a62340 2024-02-15T23:29:57.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.139+0000 7f98b9e03640 1 -- 172.21.15.133:0/571421554 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c001c650 con 0x564f32a62340 2024-02-15T23:29:57.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f32b53710 con 0x564f32a62340 2024-02-15T23:29:57.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f98b9e03640 1 -- 172.21.15.133:0/571421554 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c001c8f0 con 0x564f32a62340 2024-02-15T23:29:57.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f32b53b60 con 0x564f32a62340 2024-02-15T23:29:57.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f98b9e03640 1 -- 172.21.15.133:0/571421554 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f99c001cb60 con 0x564f32a62340 2024-02-15T23:29:57.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f98b9e03640 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98b4034300 0x7f98b40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f98b9e03640 1 -- 172.21.15.133:0/571421554 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f99c0006070 con 0x564f32a62340 2024-02-15T23:29:57.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cc852640 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98b4034300 0x7f98b40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cf538980 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32a66840 0x564f32b59dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b5a300 con 0x564f32a66840 2024-02-15T23:29:57.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cd854640 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32a66840 0x564f32b59dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cc852640 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98b4034300 0x7f98b40367c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f99c40ae000 tx=0x7f99c40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cd854640 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32a66840 0x564f32b59dc0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cd854640 1 -- 172.21.15.133:0/571421554 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c800a4d0 con 0x564f32a66840 2024-02-15T23:29:57.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b5a6f0 con 0x564f32a66840 2024-02-15T23:29:57.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cd854640 1 -- 172.21.15.133:0/571421554 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f99c800a4d0 con 0x564f32a66840 2024-02-15T23:29:57.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b5bfa0 con 0x564f32a66840 2024-02-15T23:29:57.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cd854640 1 -- 172.21.15.133:0/571421554 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f99c800a4d0 con 0x564f32a66840 2024-02-15T23:29:57.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b5b1a0 con 0x564f32a66840 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cd854640 1 -- 172.21.15.133:0/571421554 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f99c800a4d0 con 0x564f32a66840 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.143+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b5b5b0 con 0x564f32a66840 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cd854640 1 -- 172.21.15.133:0/571421554 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f99c800a4d0 con 0x564f32a66840 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cf538980 1 Processor -- start 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cf538980 1 -- start start 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cf538980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b6a660 0x564f32b6aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cf538980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f32904f20 con 0x564f32b6a660 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cc852640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b6a660 0x564f32b6aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cc852640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b6a660 0x564f32b6aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40528/0 (socket says 172.21.15.133:40528) 2024-02-15T23:29:57.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cc852640 1 -- 172.21.15.133:0/3524729269 learned_addr learned my addr 172.21.15.133:0/3524729269 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cc852640 1 -- 172.21.15.133:0/3524729269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f32b6afc0 con 0x564f32b6a660 2024-02-15T23:29:57.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cc852640 1 --2- 172.21.15.133:0/3524729269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b6a660 0x564f32b6aa80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f99c401b380 tx=0x7f99c40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f98b2ffd640 1 -- 172.21.15.133:0/3524729269 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40b3dc0 con 0x564f32b6a660 2024-02-15T23:29:57.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cf538980 1 -- 172.21.15.133:0/3524729269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f32b6b1b0 con 0x564f32b6a660 2024-02-15T23:29:57.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f98b2ffd640 1 -- 172.21.15.133:0/3524729269 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c40c3070 con 0x564f32b6a660 2024-02-15T23:29:57.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f98b2ffd640 1 -- 172.21.15.133:0/3524729269 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40c8560 con 0x564f32b6a660 2024-02-15T23:29:57.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cf538980 1 -- 172.21.15.133:0/3524729269 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f32b6bca0 con 0x564f32b6a660 2024-02-15T23:29:57.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f98b2ffd640 1 -- 172.21.15.133:0/3524729269 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f99c40c5030 con 0x564f32b6a660 2024-02-15T23:29:57.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f98b2ffd640 1 --2- 172.21.15.133:0/3524729269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98a40342b0 0x7f98a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f98b2ffd640 1 -- 172.21.15.133:0/3524729269 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f99c40e6810 con 0x564f32b6a660 2024-02-15T23:29:57.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.147+0000 7f99cd854640 1 --2- 172.21.15.133:0/3524729269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98a40342b0 0x7f98a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 Processor -- start 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- start start 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cd854640 1 --2- 172.21.15.133:0/3524729269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98a40342b0 0x7f98a4036770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x564f32b5abe0 tx=0x7f99c8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b77a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f328f8790 con 0x564f32b77660 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b77a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b77a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40542/0 (socket says 172.21.15.133:40542) 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 -- 172.21.15.133:0/900605278 learned_addr learned my addr 172.21.15.133:0/900605278 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 -- 172.21.15.133:0/900605278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f32b78050 con 0x564f32b77660 2024-02-15T23:29:57.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 --2- 172.21.15.133:0/900605278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b77a80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f99c40befd0 tx=0x7f99c40bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61646297057970cb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f98b0ff9640 1 -- 172.21.15.133:0/900605278 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40d6040 con 0x564f32b77660 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f98b0ff9640 1 -- 172.21.15.133:0/900605278 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c40b4180 con 0x564f32b77660 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f98b0ff9640 1 -- 172.21.15.133:0/900605278 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40c7c50 con 0x564f32b77660 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- 172.21.15.133:0/900605278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 msgr2=0x564f32b77a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 --2- 172.21.15.133:0/900605278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b77a80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f99c40befd0 tx=0x7f99c40bd450 comp rx=0 tx=0).stop 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- 172.21.15.133:0/900605278 shutdown_connections 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 --2- 172.21.15.133:0/900605278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b77a80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- 172.21.15.133:0/900605278 >> 172.21.15.133:0/900605278 conn(0x564f32b739f0 msgr2=0x564f32b71a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- 172.21.15.133:0/900605278 shutdown_connections 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- 172.21.15.133:0/900605278 wait complete. 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 Processor -- start 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- start start 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b7e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cf538980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f32b7ead0 con 0x564f32b77660 2024-02-15T23:29:57.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b7e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b7e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40544/0 (socket says 172.21.15.133:40544) 2024-02-15T23:29:57.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 learned_addr learned my addr 172.21.15.133:0/973431948 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.151+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f32b6bca0 con 0x564f32b77660 2024-02-15T23:29:57.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cc852640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b7e590 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f99c40befd0 tx=0x7f99c40e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f98a2ffd640 1 -- 172.21.15.133:0/973431948 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40c7e20 con 0x564f32b77660 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f32b7ecd0 con 0x564f32b77660 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f98a2ffd640 1 -- 172.21.15.133:0/973431948 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c40ea070 con 0x564f32b77660 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f98a2ffd640 1 -- 172.21.15.133:0/973431948 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40bde20 con 0x564f32b77660 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f32b7ecd0 con 0x564f32b77660 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f98a2ffd640 1 -- 172.21.15.133:0/973431948 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f99c40ec030 con 0x564f32b77660 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f98a2ffd640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98980342b0 0x7f9898036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f98a2ffd640 1 -- 172.21.15.133:0/973431948 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f99c40f0c90 con 0x564f32b77660 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cd854640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98980342b0 0x7f9898036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32b89770 0x564f32b8bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8c360 con 0x564f32b89770 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cd053640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32b89770 0x564f32b8bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cd854640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98980342b0 0x7f9898036770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99c8011010 tx=0x7f99c8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cd053640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32b89770 0x564f32b8bc10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c0016070 con 0x564f32b89770 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 20 realm 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8c730 con 0x564f32b89770 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c0016070 con 0x564f32b89770 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8cf80 con 0x564f32b89770 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c0016070 con 0x564f32b89770 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.155+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8d2e0 con 0x564f32b89770 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f99c0016070 con 0x564f32b89770 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cf538980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8cc20 con 0x564f32b89770 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f99c0016070 con 0x564f32b89770 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cf538980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cf538980 20 searching for the correct realm 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f32b8f530 0x564f32b91980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cc852640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f32b8f530 0x564f32b91980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cc852640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f32b8f530 0x564f32b91980 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cc852640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f99c40bc3b0 0x7f99c40e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd854640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f99c40bc3b0 0x7f99c40e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd854640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f99c40bc3b0 0x7f99c40e34a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a4d0 con 0x7f99c40bc3b0 2024-02-15T23:29:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd854640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f99c80141d0 0x7f99c8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd053640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f99c80141d0 0x7f99c8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd053640 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f99c80141d0 0x7f99c8015940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0016070 con 0x7f99c80141d0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.159+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f99c0016070 con 0x564f32b89770 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0016070 con 0x564f32b89770 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0016070 con 0x7f99c80141d0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0016070 con 0x7f99c80141d0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a4d0 con 0x7f99c40bc3b0 2024-02-15T23:29:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f99c0052080 con 0x564f32b89770 2024-02-15T23:29:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0052080 con 0x7f99c80141d0 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0052080 con 0x564f32b89770 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.163+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0052080 con 0x7f99c80141d0 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0052080 con 0x564f32b89770 2024-02-15T23:29:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f99c0052080 con 0x564f32b89770 2024-02-15T23:29:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.167+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cf538980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cf538980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cf538980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cf538980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cf538980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cf538980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.171+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8e180 con 0x564f32b89770 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8de00 con 0x564f32b89770 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8eb10 con 0x564f32b89770 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 zone default found 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 4 Realm: () 2024-02-15T23:29:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 zonegroup default 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92490 con 0x7f99c80141d0 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b94220 con 0x564f32b8f530 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b94580 con 0x564f32b8f530 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 started sync module instance, tier type = 2024-02-15T23:29:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b93b00 con 0x7f99c40bc3b0 2024-02-15T23:29:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94898153404000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b93eb0 con 0x7f99c40bc3b0 2024-02-15T23:29:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.175+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b952c0 con 0x564f32b89770 2024-02-15T23:29:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.179+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94898153404000] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.179+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.179+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94898153408896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b95240 con 0x564f32b89770 2024-02-15T23:29:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.179+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b95cb0 con 0x564f32b8f530 2024-02-15T23:29:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.179+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94898153408896] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94898153409952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b951c0 con 0x564f32b8f530 2024-02-15T23:29:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b969a0 con 0x7f99c40bc3b0 2024-02-15T23:29:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94898153416272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b971f0 con 0x7f99c40bc3b0 2024-02-15T23:29:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b97c90 con 0x564f32b89770 2024-02-15T23:29:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94898153409952] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94898153416272] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94898153420656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b96d50 con 0x564f32b89770 2024-02-15T23:29:57.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.183+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b984e0 con 0x7f99c80141d0 2024-02-15T23:29:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.187+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.187+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94898153422448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b98730 con 0x7f99c80141d0 2024-02-15T23:29:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.187+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b98f30 con 0x7f99c80141d0 2024-02-15T23:29:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.187+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94898153420656] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(56 notify.6 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94898153422448] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94898153424688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b98ff0 con 0x7f99c80141d0 2024-02-15T23:29:57.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b994c0 con 0x7f99c80141d0 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94898153424688] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94898153425744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b98f70 con 0x7f99c80141d0 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 20 add_watcher() i=0 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 20 add_watcher() i=1 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 20 add_watcher() i=2 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 20 add_watcher() i=3 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 20 add_watcher() i=4 2024-02-15T23:29:57.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 20 add_watcher() i=5 2024-02-15T23:29:57.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 20 add_watcher() i=6 2024-02-15T23:29:57.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94898153425744] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 20 add_watcher() i=7 2024-02-15T23:29:57.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.191+0000 7f99cf538980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:57.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b9c990 con 0x564f32b89770 2024-02-15T23:29:57.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94898153428160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b99d80 con 0x564f32b89770 2024-02-15T23:29:57.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94898153428160] v31'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f9883fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:57.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cf538980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:57.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cf538980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:57.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cf538980 5 note: GC not initialized 2024-02-15T23:29:57.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f9882fe5640 20 reqs_thread_entry: start 2024-02-15T23:29:57.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cf538980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:57.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cf538980 20 Filter name: none 2024-02-15T23:29:57.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f9880fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:57.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32bbddd0 con 0x7f99c80141d0 2024-02-15T23:29:57.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(62 [pgnls start_epoch 31 out=254b] v31'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.195+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8de00 con 0x7f99c80141d0 2024-02-15T23:29:57.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(63 [pgnls start_epoch 31 out=131b] v31'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8de00 con 0x564f32b8f530 2024-02-15T23:29:57.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 [pgnls start_epoch 31 out=295b] v31'24 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8de00 con 0x7f99c80141d0 2024-02-15T23:29:57.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(65 [pgnls start_epoch 31 out=172b] v31'18 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8de00 con 0x564f32b89770 2024-02-15T23:29:57.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(66 [pgnls start_epoch 31 out=335b] v31'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b8de00 con 0x7f99c40bc3b0 2024-02-15T23:29:57.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(67 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(68 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(69 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.199+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(71 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(72 [pgnls start_epoch 31 out=336b] v31'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=131b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(74 [pgnls start_epoch 31 out=254b] v31'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(75 [pgnls start_epoch 31 out=90b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(76 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(77 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(78 [pgnls start_epoch 31 out=254b] v31'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(79 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(80 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(81 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.203+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(82 [pgnls start_epoch 31 out=276b] v31'15 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(83 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(84 [pgnls start_epoch 31 out=295b] v31'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(85 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(86 [pgnls start_epoch 31 out=213b] v31'43 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(87 [pgnls start_epoch 31 out=172b] v31'20 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(88 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(89 [pgnls start_epoch 31 out=90b] v31'13 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.207+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b8f530 2024-02-15T23:29:57.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(90 [pgnls start_epoch 31 out=90b] v31'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x564f32b89770 2024-02-15T23:29:57.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(91 [pgnls start_epoch 31 out=131b] v31'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c40bc3b0 2024-02-15T23:29:57.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(92 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b92050 con 0x7f99c80141d0 2024-02-15T23:29:57.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(93 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.220 INFO:teuthology.orchestra.run.smithi133.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-02-15T23:29:57.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f9883fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:57.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.211+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94898153428160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32bbdd90 con 0x564f32b89770 2024-02-15T23:29:57.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.215+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94898153428160] v31'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.215+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94898153404000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32bbdd90 con 0x7f99c40bc3b0 2024-02-15T23:29:57.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.215+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94898153404000] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.215+0000 7f99cf538980 20 remove_watcher() i=0 2024-02-15T23:29:57.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.215+0000 7f99cf538980 2 removed watcher, disabling cache 2024-02-15T23:29:57.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.215+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94898153408896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b93660 con 0x564f32b89770 2024-02-15T23:29:57.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.219+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94898153408896] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.219+0000 7f99cf538980 20 remove_watcher() i=1 2024-02-15T23:29:57.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.219+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94898153409952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b94980 con 0x564f32b8f530 2024-02-15T23:29:57.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.219+0000 7f99cc852640 1 -- 172.21.15.133:0/973431948 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94898153409952] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c40b0020 con 0x564f32b8f530 2024-02-15T23:29:57.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.219+0000 7f99cf538980 20 remove_watcher() i=2 2024-02-15T23:29:57.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.219+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94898153416272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b93660 con 0x7f99c40bc3b0 2024-02-15T23:29:57.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.223+0000 7f99cd854640 1 -- 172.21.15.133:0/973431948 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94898153416272] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c803a040 con 0x7f99c40bc3b0 2024-02-15T23:29:57.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.223+0000 7f99cf538980 20 remove_watcher() i=3 2024-02-15T23:29:57.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.223+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94898153420656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b93660 con 0x564f32b89770 2024-02-15T23:29:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.223+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94898153420656] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x564f32b89770 2024-02-15T23:29:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.223+0000 7f99cf538980 20 remove_watcher() i=4 2024-02-15T23:29:57.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.223+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94898153422448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b97770 con 0x7f99c80141d0 2024-02-15T23:29:57.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.227+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94898153422448] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.227+0000 7f99cf538980 20 remove_watcher() i=5 2024-02-15T23:29:57.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.227+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94898153424688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b93660 con 0x7f99c80141d0 2024-02-15T23:29:57.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.227+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94898153424688] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.227+0000 7f99cf538980 20 remove_watcher() i=6 2024-02-15T23:29:57.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.227+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94898153425744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564f32b97e70 con 0x7f99c80141d0 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.227+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94898153425744] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c005b040 con 0x7f99c80141d0 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.227+0000 7f99cf538980 20 remove_watcher() i=7 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f99c80141d0 msgr2=0x7f99c8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f99c80141d0 0x7f99c8015940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32b89770 msgr2=0x564f32b8bc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32b89770 0x564f32b8bc10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f99c40bc3b0 msgr2=0x7f99c40e34a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f99c40bc3b0 0x7f99c40e34a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f32b8f530 msgr2=0x564f32b91980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f32b8f530 0x564f32b91980 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98980342b0 msgr2=0x7f9898036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98980342b0 0x7f9898036770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99c8011010 tx=0x7f99c8020000 comp rx=0 tx=0).stop 2024-02-15T23:29:57.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 msgr2=0x564f32b7e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cd053640 1 -- 172.21.15.133:0/973431948 reap_dead start 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b7e590 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f99c40befd0 tx=0x7f99c40e4b90 comp rx=0 tx=0).stop 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 shutdown_connections 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/973431948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b77660 0x564f32b7e590 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 >> 172.21.15.133:0/973431948 conn(0x564f32b739f0 msgr2=0x564f32b71050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 shutdown_connections 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/973431948 wait complete. 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/3524729269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98a40342b0 msgr2=0x7f98a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/3524729269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98a40342b0 0x7f98a4036770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x564f32b5abe0 tx=0x7f99c8005850 comp rx=0 tx=0).stop 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/3524729269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b6a660 msgr2=0x564f32b6aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/3524729269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b6a660 0x564f32b6aa80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f99c401b380 tx=0x7f99c40180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/3524729269 shutdown_connections 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/3524729269 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98a40342b0 0x7f98a4036770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/3524729269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32b6a660 0x564f32b6aa80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/3524729269 >> 172.21.15.133:0/3524729269 conn(0x564f32b5f470 msgr2=0x564f32b5ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/3524729269 shutdown_connections 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/3524729269 wait complete. 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32a66840 msgr2=0x564f32b59dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32a66840 0x564f32b59dc0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98b4034300 msgr2=0x7f98b40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98b4034300 0x7f98b40367c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f99c40ae000 tx=0x7f99c40a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 msgr2=0x564f32b531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b531d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x564f32b4d120 tx=0x7f99c0000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 shutdown_connections 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f32a66840 0x564f32b59dc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f98b4034300 0x7f98b40367c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 --2- 172.21.15.133:0/571421554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f32a62340 0x564f32b531d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 >> 172.21.15.133:0/571421554 conn(0x564f329d5a30 msgr2=0x564f32b46930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 shutdown_connections 2024-02-15T23:29:57.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.231+0000 7f99cf538980 1 -- 172.21.15.133:0/571421554 wait complete. 2024-02-15T23:29:57.251 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-02-15T23:29:57.251 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-15T23:29:57.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-15T23:29:57.251 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-15T23:29:57.326 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:57.326 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:57.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff3a6c1980 1 Processor -- start 2024-02-15T23:29:57.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff3a6c1980 1 -- start start 2024-02-15T23:29:57.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff3a6c1980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55e4f3445080 0x55e4f3445490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff3a6c1980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e4f34184c0 con 0x55e4f3442b80 2024-02-15T23:29:57.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff3a6c1980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e4f33df180 con 0x55e4f3445080 2024-02-15T23:29:57.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff379db640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55e4f3445080 0x55e4f3445490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff379db640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55e4f3445080 0x55e4f3445490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40554/0 (socket says 172.21.15.133:40554) 2024-02-15T23:29:57.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff379db640 1 -- 172.21.15.133:0/426957552 learned_addr learned my addr 172.21.15.133:0/426957552 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff381dc640 1 --1- 172.21.15.133:0/426957552 >> v1:172.21.15.131:6789/0 conn(0x55e4f3442b80 0x55e4f3442f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:41632/0 (socket says 172.21.15.133:41632) 2024-02-15T23:29:57.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff379db640 1 -- 172.21.15.133:0/426957552 >> v1:172.21.15.131:6789/0 conn(0x55e4f3442b80 legacy=0x55e4f3442f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.319+0000 7eff379db640 1 -- 172.21.15.133:0/426957552 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f34469e0 con 0x55e4f3445080 2024-02-15T23:29:57.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff379db640 1 --2- 172.21.15.133:0/426957552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f3445490 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00a5c0 tx=0x7eff2c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5f97a3923bd6c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff371da640 1 -- 172.21.15.133:0/426957552 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0aa470 con 0x55e4f3445080 2024-02-15T23:29:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff371da640 1 -- 172.21.15.133:0/426957552 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0aa5d0 con 0x55e4f3445080 2024-02-15T23:29:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff371da640 1 -- 172.21.15.133:0/426957552 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0aa890 con 0x55e4f3445080 2024-02-15T23:29:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff3a6c1980 1 -- 172.21.15.133:0/426957552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 msgr2=0x55e4f3445490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/426957552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f3445490 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00a5c0 tx=0x7eff2c01b340 comp rx=0 tx=0).stop 2024-02-15T23:29:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff3a6c1980 1 -- 172.21.15.133:0/426957552 shutdown_connections 2024-02-15T23:29:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/426957552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f3445490 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff3a6c1980 1 -- 172.21.15.133:0/426957552 >> 172.21.15.133:0/426957552 conn(0x55e4f3441a40 msgr2=0x55e4f3441e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff3a6c1980 1 -- 172.21.15.133:0/426957552 shutdown_connections 2024-02-15T23:29:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.323+0000 7eff3a6c1980 1 -- 172.21.15.133:0/426957552 wait complete. 2024-02-15T23:29:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff3a6c1980 1 Processor -- start 2024-02-15T23:29:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff3a6c1980 1 -- start start 2024-02-15T23:29:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff3a6c1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3442b80 0x55e4f35bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff3a6c1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f33dc6b0 con 0x55e4f3442b80 2024-02-15T23:29:57.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff381dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3442b80 0x55e4f35bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff381dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3442b80 0x55e4f35bc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40568/0 (socket says 172.21.15.133:40568) 2024-02-15T23:29:57.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff381dc640 1 -- 172.21.15.133:0/1904726375 learned_addr learned my addr 172.21.15.133:0/1904726375 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff381dc640 1 -- 172.21.15.133:0/1904726375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c005df0 con 0x55e4f3442b80 2024-02-15T23:29:57.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.339+0000 7eff381dc640 1 --2- 172.21.15.133:0/1904726375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3442b80 0x55e4f35bc6d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7eff28001cc0 tx=0x7eff2800b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c507dd6e7a98e809 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7efe2660c640 1 -- 172.21.15.133:0/1904726375 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff28014070 con 0x55e4f3442b80 2024-02-15T23:29:57.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7efe2660c640 1 -- 172.21.15.133:0/1904726375 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2800f590 con 0x55e4f3442b80 2024-02-15T23:29:57.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7efe2660c640 1 -- 172.21.15.133:0/1904726375 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff28007040 con 0x55e4f3442b80 2024-02-15T23:29:57.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1904726375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3442b80 msgr2=0x55e4f35bc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/1904726375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3442b80 0x55e4f35bc6d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7eff28001cc0 tx=0x7eff2800b610 comp rx=0 tx=0).stop 2024-02-15T23:29:57.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1904726375 shutdown_connections 2024-02-15T23:29:57.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/1904726375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3442b80 0x55e4f35bc6d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1904726375 >> 172.21.15.133:0/1904726375 conn(0x55e4f3441a40 msgr2=0x55e4f35b8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1904726375 shutdown_connections 2024-02-15T23:29:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1904726375 wait complete. 2024-02-15T23:29:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 Processor -- start 2024-02-15T23:29:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- start start 2024-02-15T23:29:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f35c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f33d7e90 con 0x55e4f3445080 2024-02-15T23:29:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff381dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f35c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff381dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f35c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40574/0 (socket says 172.21.15.133:40574) 2024-02-15T23:29:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff381dc640 1 -- 172.21.15.133:0/4216786304 learned_addr learned my addr 172.21.15.133:0/4216786304 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff381dc640 1 -- 172.21.15.133:0/4216786304 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f34184c0 con 0x55e4f3445080 2024-02-15T23:29:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff381dc640 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f35c3810 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7eff28004000 tx=0x7eff28000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7efe24e09640 1 -- 172.21.15.133:0/4216786304 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff28014030 con 0x55e4f3445080 2024-02-15T23:29:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7efe24e09640 1 -- 172.21.15.133:0/4216786304 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2801c780 con 0x55e4f3445080 2024-02-15T23:29:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4f35c3d50 con 0x55e4f3445080 2024-02-15T23:29:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7efe24e09640 1 -- 172.21.15.133:0/4216786304 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2801ca80 con 0x55e4f3445080 2024-02-15T23:29:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.343+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4f35c4180 con 0x55e4f3445080 2024-02-15T23:29:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7efe24e09640 1 -- 172.21.15.133:0/4216786304 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7eff2801ccf0 con 0x55e4f3445080 2024-02-15T23:29:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7efe24e09640 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe200342b0 0x7efe20036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7efe24e09640 1 -- 172.21.15.133:0/4216786304 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7eff28006070 con 0x55e4f3445080 2024-02-15T23:29:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff379db640 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe200342b0 0x7efe20036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35c8440 0x55e4f35ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35cad70 con 0x55e4f35c8440 2024-02-15T23:29:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff389dd640 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35c8440 0x55e4f35ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff379db640 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe200342b0 0x7efe20036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0ae000 tx=0x7eff2c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff389dd640 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35c8440 0x55e4f35ca830 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff389dd640 1 -- 172.21.15.133:0/4216786304 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff3000a4d0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35cb0f0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff389dd640 1 -- 172.21.15.133:0/4216786304 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff3000a4d0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35cc9a0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff389dd640 1 -- 172.21.15.133:0/4216786304 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7eff3000a4d0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35cbba0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff389dd640 1 -- 172.21.15.133:0/4216786304 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff3000a4d0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35cbfb0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff389dd640 1 -- 172.21.15.133:0/4216786304 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7eff3000a4d0 con 0x55e4f35c8440 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff3a6c1980 1 Processor -- start 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.347+0000 7eff3a6c1980 1 -- start start 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff3a6c1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35db040 0x55e4f35db460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff3a6c1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f3370f20 con 0x55e4f35db040 2024-02-15T23:29:57.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff379db640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35db040 0x55e4f35db460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff379db640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35db040 0x55e4f35db460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40576/0 (socket says 172.21.15.133:40576) 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff379db640 1 -- 172.21.15.133:0/1736203226 learned_addr learned my addr 172.21.15.133:0/1736203226 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff379db640 1 -- 172.21.15.133:0/1736203226 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f35db9a0 con 0x55e4f35db040 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff379db640 1 --2- 172.21.15.133:0/1736203226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35db040 0x55e4f35db460 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0ac040 tx=0x7eff2c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7efe1dffb640 1 -- 172.21.15.133:0/1736203226 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0b3cd0 con 0x55e4f35db040 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1736203226 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4f35dbb90 con 0x55e4f35db040 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7efe1dffb640 1 -- 172.21.15.133:0/1736203226 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0c3070 con 0x55e4f35db040 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7efe1dffb640 1 -- 172.21.15.133:0/1736203226 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0c8430 con 0x55e4f35db040 2024-02-15T23:29:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1736203226 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4f35dc680 con 0x55e4f35db040 2024-02-15T23:29:57.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7efe1dffb640 1 -- 172.21.15.133:0/1736203226 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7eff2c0c5030 con 0x55e4f35db040 2024-02-15T23:29:57.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7efe1dffb640 1 --2- 172.21.15.133:0/1736203226 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe100342b0 0x7efe10036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7efe1dffb640 1 -- 172.21.15.133:0/1736203226 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7eff2c0e6890 con 0x55e4f35db040 2024-02-15T23:29:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff389dd640 1 --2- 172.21.15.133:0/1736203226 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe100342b0 0x7efe10036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff3a6c1980 1 Processor -- start 2024-02-15T23:29:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff3a6c1980 1 -- start start 2024-02-15T23:29:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff389dd640 1 --2- 172.21.15.133:0/1736203226 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe100342b0 0x7efe10036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55e4f35cb5e0 tx=0x7eff30005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff3a6c1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35e8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.351+0000 7eff3a6c1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f3364790 con 0x55e4f35e8020 2024-02-15T23:29:57.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35e8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40586/0 (socket says 172.21.15.133:40586) 2024-02-15T23:29:57.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 -- 172.21.15.133:0/1382348675 learned_addr learned my addr 172.21.15.133:0/1382348675 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 -- 172.21.15.133:0/1382348675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f35e8a10 con 0x55e4f35e8020 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 --2- 172.21.15.133:0/1382348675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35e8440 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0befd0 tx=0x7eff2c0bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5031b31b9d06314e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7efe177fe640 1 -- 172.21.15.133:0/1382348675 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0d6040 con 0x55e4f35e8020 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7efe177fe640 1 -- 172.21.15.133:0/1382348675 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0c7b20 con 0x55e4f35e8020 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7efe177fe640 1 -- 172.21.15.133:0/1382348675 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0c7dc0 con 0x55e4f35e8020 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1382348675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 msgr2=0x55e4f35e8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/1382348675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35e8440 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0befd0 tx=0x7eff2c0bd450 comp rx=0 tx=0).stop 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1382348675 shutdown_connections 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/1382348675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35e8440 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1382348675 >> 172.21.15.133:0/1382348675 conn(0x55e4f35e43b0 msgr2=0x55e4f35e2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1382348675 shutdown_connections 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1382348675 wait complete. 2024-02-15T23:29:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 Processor -- start 2024-02-15T23:29:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 -- start start 2024-02-15T23:29:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f35ef490 con 0x55e4f35e8020 2024-02-15T23:29:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35eef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40590/0 (socket says 172.21.15.133:40590) 2024-02-15T23:29:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 learned_addr learned my addr 172.21.15.133:0/2965197676 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f35dc680 con 0x55e4f35e8020 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff379db640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35eef50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0bd960 tx=0x7eff2c0e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7efe15ffb640 1 -- 172.21.15.133:0/2965197676 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0d6040 con 0x55e4f35e8020 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4f35ef690 con 0x55e4f35e8020 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7efe15ffb640 1 -- 172.21.15.133:0/2965197676 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0e6b70 con 0x55e4f35e8020 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.355+0000 7efe15ffb640 1 -- 172.21.15.133:0/2965197676 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff2c0e6e10 con 0x55e4f35e8020 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4f35efac0 con 0x55e4f35e8020 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7efe15ffb640 1 -- 172.21.15.133:0/2965197676 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7eff2c0bdbe0 con 0x55e4f35e8020 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7efe15ffb640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe08034260 0x7efe08036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7efe15ffb640 1 -- 172.21.15.133:0/2965197676 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7eff2c0f1c50 con 0x55e4f35e8020 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff389dd640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe08034260 0x7efe08036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35fa220 0x55e4f35fc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35fce10 con 0x55e4f35fa220 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff381dc640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35fa220 0x55e4f35fc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff389dd640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe08034260 0x7efe08036720 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff30011010 tx=0x7eff30020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff381dc640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35fa220 0x55e4f35fc6c0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 realm 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35fd1e0 con 0x55e4f35fa220 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35fda60 con 0x55e4f35fa220 2024-02-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35fddc0 con 0x55e4f35fa220 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35fe5c0 con 0x55e4f35fa220 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 20 searching for the correct realm 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e4f3600450 0x55e4f36028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.359+0000 7eff379db640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e4f3600450 0x55e4f36028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff379db640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e4f3600450 0x55e4f36028c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff379db640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7eff2c009040 0x7eff2c006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff2c009040 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff389dd640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7eff2c009040 0x7eff2c006aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff389dd640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7eff2c009040 0x7eff2c006aa0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff3000a4d0 con 0x7eff2c009040 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff389dd640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7eff300141d0 0x7eff30015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff381dc640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7eff300141d0 0x7eff30015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff381dc640 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7eff300141d0 0x7eff30015940 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f35fa220 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f35fa220 2024-02-15T23:29:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.363+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff2c009040 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff3000a4d0 con 0x7eff2c009040 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f35fa220 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f35fa220 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff2c009040 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.367+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f35fa220 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f35fa220 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff2c009040 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f35fa220 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.371+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff2c009040 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f3600450 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff300141d0 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x55e4f35fa220 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3602f90 con 0x7eff2c009040 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35fef20 con 0x55e4f35fa220 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35ff770 con 0x55e4f35fa220 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f36033d0 con 0x55e4f35fa220 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 zone default found 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 4 Realm: () 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 zonegroup default 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f36033d0 con 0x7eff300141d0 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.375+0000 7eff3a6c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3605160 con 0x55e4f3600450 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f36054f0 con 0x55e4f3600450 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 20 started sync module instance, tier type = 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3604a40 con 0x7eff2c009040 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94441824077216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3604df0 con 0x7eff2c009040 2024-02-15T23:29:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3606230 con 0x55e4f35fa220 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94441824077216] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94441824082160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f36061f0 con 0x55e4f35fa220 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.379+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3606c40 con 0x55e4f3600450 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.383+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.383+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94441824085824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3607490 con 0x55e4f3600450 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.383+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3607e80 con 0x7eff2c009040 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.383+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94441824082160] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.383+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.383+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94441824090464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3608230 con 0x7eff2c009040 2024-02-15T23:29:57.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.383+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3608be0 con 0x55e4f35fa220 2024-02-15T23:29:57.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94441824085824] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94441824090464] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94441824083216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3608700 con 0x55e4f35fa220 2024-02-15T23:29:57.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3609430 con 0x7eff300141d0 2024-02-15T23:29:57.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94441824083216] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94441824088048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3609150 con 0x7eff300141d0 2024-02-15T23:29:57.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.387+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3609950 con 0x7eff300141d0 2024-02-15T23:29:57.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.391+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94441824088048] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.391+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.391+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94441824095680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3609780 con 0x7eff300141d0 2024-02-15T23:29:57.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.391+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f360a250 con 0x7eff300141d0 2024-02-15T23:29:57.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.391+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94441824095680] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94441824099632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f360a210 con 0x7eff300141d0 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 add_watcher() i=0 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 add_watcher() i=1 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 add_watcher() i=2 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 add_watcher() i=3 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 add_watcher() i=4 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 add_watcher() i=5 2024-02-15T23:29:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 add_watcher() i=6 2024-02-15T23:29:57.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94441824099632] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 add_watcher() i=7 2024-02-15T23:29:57.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:57.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f360d750 con 0x55e4f35fa220 2024-02-15T23:29:57.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94441824096800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f360ab00 con 0x55e4f35fa220 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94441824096800] v31'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7efdee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7eff3a6c1980 5 note: GC not initialized 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.395+0000 7efded7e2640 20 reqs_thread_entry: start 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 Filter name: none 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7efd5effd640 20 reqs_thread_entry: start 2024-02-15T23:29:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:57.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f362f5a0 con 0x55e4f35fa220 2024-02-15T23:29:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3631960 con 0x7eff2c009040 2024-02-15T23:29:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 disabling bucket name=myfoo 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f362f940 con 0x7eff2c009040 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f36321b0 con 0x55e4f35fa220 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv9 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f36399e0 con 0x55e4f35fa220 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'11 uv11 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1, ofs0, ns] 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94441824265744 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3633ff0 con 0x55e4f35fa220 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== watch-notify(notify (1) cookie 94441824083216 notify 133143986195 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55e4f35c4180 con 0x55e4f35fa220 2024-02-15T23:29:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7efe177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94441824083216 notifier 4591 bl.length()=725 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7efe177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7efe177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7efe177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7efe177fe640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7efdfc003ea0 con 0x55e4f35fa220 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(67 notify.4 [notify cookie 94441824265744 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.399+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== watch-notify(notify_complete (2) cookie 94441824265744 notify 133143986195 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e4f35c3d50 con 0x55e4f35fa220 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_sources= new_sources= 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential sources added=[] removed=[] 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_dests= new_dests= 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential dests added=[] removed=[] 2024-02-15T23:29:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3634ab0 con 0x55e4f35fa220 2024-02-15T23:29:57.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v31'12 uv12 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94441824247328 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f362e6e0 con 0x55e4f35fa220 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== watch-notify(notify (1) cookie 94441824083216 notify 133143986196 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55e4f35c3d50 con 0x55e4f35fa220 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7efe16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 94441824083216 notifier 4591 bl.length()=534 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7efe16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7efe16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(70 notify.4 [notify cookie 94441824247328 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7efe16ffd640 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7efd6c003430 con 0x55e4f35fa220 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== watch-notify(notify_complete (2) cookie 94441824247328 notify 133143986196 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e4f34184c0 con 0x55e4f35fa220 2024-02-15T23:29:57.416 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7efdee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.403+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94441824096800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3637680 con 0x55e4f35fa220 2024-02-15T23:29:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94441824096800] v31'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94441824077216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3609220 con 0x7eff2c009040 2024-02-15T23:29:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94441824077216] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff3a6c1980 20 remove_watcher() i=0 2024-02-15T23:29:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff3a6c1980 2 removed watcher, disabling cache 2024-02-15T23:29:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94441824082160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35ff770 con 0x55e4f35fa220 2024-02-15T23:29:57.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94441824082160] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff3a6c1980 20 remove_watcher() i=1 2024-02-15T23:29:57.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.407+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94441824085824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f35ff770 con 0x55e4f3600450 2024-02-15T23:29:57.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.411+0000 7eff379db640 1 -- 172.21.15.133:0/2965197676 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94441824085824] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2c0b0020 con 0x55e4f3600450 2024-02-15T23:29:57.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.411+0000 7eff3a6c1980 20 remove_watcher() i=2 2024-02-15T23:29:57.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.411+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94441824090464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f36058f0 con 0x7eff2c009040 2024-02-15T23:29:57.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.411+0000 7eff389dd640 1 -- 172.21.15.133:0/2965197676 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94441824090464] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff3003a040 con 0x7eff2c009040 2024-02-15T23:29:57.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.411+0000 7eff3a6c1980 20 remove_watcher() i=3 2024-02-15T23:29:57.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.411+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94441824083216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3606740 con 0x55e4f35fa220 2024-02-15T23:29:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.415+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94441824083216] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x55e4f35fa220 2024-02-15T23:29:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.415+0000 7eff3a6c1980 20 remove_watcher() i=4 2024-02-15T23:29:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.415+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94441824088048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3605d90 con 0x7eff300141d0 2024-02-15T23:29:57.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.415+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94441824088048] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.415+0000 7eff3a6c1980 20 remove_watcher() i=5 2024-02-15T23:29:57.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.415+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94441824095680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3605d90 con 0x7eff300141d0 2024-02-15T23:29:57.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94441824095680] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 20 remove_watcher() i=6 2024-02-15T23:29:57.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94441824099632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e4f3607960 con 0x7eff300141d0 2024-02-15T23:29:57.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94441824099632] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff28016070 con 0x7eff300141d0 2024-02-15T23:29:57.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 20 remove_watcher() i=7 2024-02-15T23:29:57.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7eff300141d0 msgr2=0x7eff30015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7eff300141d0 0x7eff30015940 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35fa220 msgr2=0x55e4f35fc6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35fa220 0x55e4f35fc6c0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7eff2c009040 msgr2=0x7eff2c006aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7eff2c009040 0x7eff2c006aa0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e4f3600450 msgr2=0x55e4f36028c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55e4f3600450 0x55e4f36028c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe08034260 msgr2=0x7efe08036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe08034260 0x7efe08036720 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff30011010 tx=0x7eff30020000 comp rx=0 tx=0).stop 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 msgr2=0x55e4f35eef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff381dc640 1 -- 172.21.15.133:0/2965197676 reap_dead start 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35eef50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0bd960 tx=0x7eff2c0e4b90 comp rx=0 tx=0).stop 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 shutdown_connections 2024-02-15T23:29:57.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/2965197676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35e8020 0x55e4f35eef50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 >> 172.21.15.133:0/2965197676 conn(0x55e4f35e43b0 msgr2=0x55e4f35e1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 shutdown_connections 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/2965197676 wait complete. 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1736203226 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe100342b0 msgr2=0x7efe10036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/1736203226 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe100342b0 0x7efe10036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55e4f35cb5e0 tx=0x7eff30005850 comp rx=0 tx=0).stop 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1736203226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35db040 msgr2=0x55e4f35db460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/1736203226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35db040 0x55e4f35db460 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0ac040 tx=0x7eff2c0180e0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1736203226 shutdown_connections 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/1736203226 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe100342b0 0x7efe10036770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/1736203226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f35db040 0x55e4f35db460 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1736203226 >> 172.21.15.133:0/1736203226 conn(0x55e4f35cfe50 msgr2=0x55e4f35d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1736203226 shutdown_connections 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/1736203226 wait complete. 2024-02-15T23:29:57.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35c8440 msgr2=0x55e4f35ca830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.419+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35c8440 0x55e4f35ca830 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe200342b0 msgr2=0x7efe20036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe200342b0 0x7efe20036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0ae000 tx=0x7eff2c0a6000 comp rx=0 tx=0).stop 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 msgr2=0x55e4f35c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f35c3810 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7eff28004000 tx=0x7eff28000bd0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 shutdown_connections 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55e4f35c8440 0x55e4f35ca830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efe200342b0 0x7efe20036770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 --2- 172.21.15.133:0/4216786304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4f3445080 0x55e4f35c3810 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 >> 172.21.15.133:0/4216786304 conn(0x55e4f3441a40 msgr2=0x55e4f35b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 shutdown_connections 2024-02-15T23:29:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.423+0000 7eff3a6c1980 1 -- 172.21.15.133:0/4216786304 wait complete. 2024-02-15T23:29:57.439 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:57.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-15T23:29:57.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-15T23:29:57.442 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-15T23:29:57.509 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:29:57.509 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:29:57.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa51ffc980 1 Processor -- start 2024-02-15T23:29:57.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa51ffc980 1 -- start start 2024-02-15T23:29:57.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa51ffc980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ad98932680 0x55ad98934a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa51ffc980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ad9887a4c0 con 0x55ad9892e170 2024-02-15T23:29:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa51ffc980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ad98841180 con 0x55ad98932680 2024-02-15T23:29:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa4f316640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55ad98932680 0x55ad98934a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa4fb17640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55ad9892e170 0x55ad9892e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:41640/0 (socket says 172.21.15.133:41640) 2024-02-15T23:29:57.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa4fb17640 1 -- 172.21.15.133:0/857117675 learned_addr learned my addr 172.21.15.133:0/857117675 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:29:57.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa4f316640 1 -- 172.21.15.133:0/857117675 >> v1:172.21.15.131:6789/0 conn(0x55ad9892e170 legacy=0x55ad9892e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.503+0000 7faa4f316640 1 -- 172.21.15.133:0/857117675 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad98935fc0 con 0x55ad98932680 2024-02-15T23:29:57.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa4f316640 1 --2- 172.21.15.133:0/857117675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98932680 0x55ad98934a70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faa4400a480 tx=0x7faa4401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a359a3a418e655 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa4eb15640 1 -- 172.21.15.133:0/857117675 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440ab540 con 0x55ad98932680 2024-02-15T23:29:57.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa4eb15640 1 -- 172.21.15.133:0/857117675 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440ab6a0 con 0x55ad98932680 2024-02-15T23:29:57.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa4eb15640 1 -- 172.21.15.133:0/857117675 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440ab960 con 0x55ad98932680 2024-02-15T23:29:57.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa51ffc980 1 -- 172.21.15.133:0/857117675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98932680 msgr2=0x55ad98934a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa51ffc980 1 --2- 172.21.15.133:0/857117675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98932680 0x55ad98934a70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faa4400a480 tx=0x7faa4401b280 comp rx=0 tx=0).stop 2024-02-15T23:29:57.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa51ffc980 1 -- 172.21.15.133:0/857117675 shutdown_connections 2024-02-15T23:29:57.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa51ffc980 1 --2- 172.21.15.133:0/857117675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98932680 0x55ad98934a70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa51ffc980 1 -- 172.21.15.133:0/857117675 >> 172.21.15.133:0/857117675 conn(0x55ad98929a40 msgr2=0x55ad9892be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa51ffc980 1 -- 172.21.15.133:0/857117675 shutdown_connections 2024-02-15T23:29:57.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.507+0000 7faa51ffc980 1 -- 172.21.15.133:0/857117675 wait complete. 2024-02-15T23:29:57.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.519+0000 7faa51ffc980 1 Processor -- start 2024-02-15T23:29:57.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.519+0000 7faa51ffc980 1 -- start start 2024-02-15T23:29:57.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.519+0000 7faa51ffc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad98a181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.519+0000 7faa51ffc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad9883e6b0 con 0x55ad9892e170 2024-02-15T23:29:57.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.519+0000 7faa4fb17640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad98a181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.519+0000 7faa4fb17640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad98a181d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40614/0 (socket says 172.21.15.133:40614) 2024-02-15T23:29:57.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.519+0000 7faa4fb17640 1 -- 172.21.15.133:0/2479406434 learned_addr learned my addr 172.21.15.133:0/2479406434 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa4fb17640 1 -- 172.21.15.133:0/2479406434 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44005d30 con 0x55ad9892e170 2024-02-15T23:29:57.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa4fb17640 1 --2- 172.21.15.133:0/2479406434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad98a181d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faa40001c90 tx=0x7faa4000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7809178f59b4153 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7fa93de0b640 1 -- 172.21.15.133:0/2479406434 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa4000e690 con 0x55ad9892e170 2024-02-15T23:29:57.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7fa93de0b640 1 -- 172.21.15.133:0/2479406434 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4000e7f0 con 0x55ad9892e170 2024-02-15T23:29:57.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7fa93de0b640 1 -- 172.21.15.133:0/2479406434 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa4000eaf0 con 0x55ad9892e170 2024-02-15T23:29:57.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- 172.21.15.133:0/2479406434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 msgr2=0x55ad98a181d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 --2- 172.21.15.133:0/2479406434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad98a181d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faa40001c90 tx=0x7faa4000b6d0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- 172.21.15.133:0/2479406434 shutdown_connections 2024-02-15T23:29:57.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 --2- 172.21.15.133:0/2479406434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad98a181d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- 172.21.15.133:0/2479406434 >> 172.21.15.133:0/2479406434 conn(0x55ad98929a40 msgr2=0x55ad98a13cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- 172.21.15.133:0/2479406434 shutdown_connections 2024-02-15T23:29:57.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- 172.21.15.133:0/2479406434 wait complete. 2024-02-15T23:29:57.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 Processor -- start 2024-02-15T23:29:57.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- start start 2024-02-15T23:29:57.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad988a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad98839e90 con 0x55ad9892e170 2024-02-15T23:29:57.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa4fb17640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad988a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa4fb17640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad988a3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40620/0 (socket says 172.21.15.133:40620) 2024-02-15T23:29:57.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa4fb17640 1 -- 172.21.15.133:0/3992075819 learned_addr learned my addr 172.21.15.133:0/3992075819 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa4fb17640 1 -- 172.21.15.133:0/3992075819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad9887a4c0 con 0x55ad9892e170 2024-02-15T23:29:57.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa4fb17640 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad988a3f90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faa40001ee0 tx=0x7faa40000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7fa937fff640 1 -- 172.21.15.133:0/3992075819 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa4001f070 con 0x55ad9892e170 2024-02-15T23:29:57.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ad988a44d0 con 0x55ad9892e170 2024-02-15T23:29:57.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7fa937fff640 1 -- 172.21.15.133:0/3992075819 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4001a4d0 con 0x55ad9892e170 2024-02-15T23:29:57.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7fa937fff640 1 -- 172.21.15.133:0/3992075819 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa4001a770 con 0x55ad9892e170 2024-02-15T23:29:57.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.523+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad988a2960 con 0x55ad9892e170 2024-02-15T23:29:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7fa937fff640 1 -- 172.21.15.133:0/3992075819 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa4000a040 con 0x55ad9892e170 2024-02-15T23:29:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7fa937fff640 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa938034300 0x7fa9380367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7fa937fff640 1 -- 172.21.15.133:0/3992075819 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7faa400498e0 con 0x55ad9892e170 2024-02-15T23:29:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa4f316640 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa938034300 0x7fa9380367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a25f60 0x55ad98a28350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a28890 con 0x55ad98a25f60 2024-02-15T23:29:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa50318640 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a25f60 0x55ad98a28350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa4f316640 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa938034300 0x7fa9380367c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faa440ad000 tx=0x7faa440a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa50318640 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a25f60 0x55ad98a28350 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa50318640 1 -- 172.21.15.133:0/3992075819 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa4800a4d0 con 0x55ad98a25f60 2024-02-15T23:29:57.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a28c80 con 0x55ad98a25f60 2024-02-15T23:29:57.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa50318640 1 -- 172.21.15.133:0/3992075819 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faa4800a4d0 con 0x55ad98a25f60 2024-02-15T23:29:57.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a2a530 con 0x55ad98a25f60 2024-02-15T23:29:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa50318640 1 -- 172.21.15.133:0/3992075819 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7faa4800a4d0 con 0x55ad98a25f60 2024-02-15T23:29:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a29730 con 0x55ad98a25f60 2024-02-15T23:29:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa50318640 1 -- 172.21.15.133:0/3992075819 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faa4800a4d0 con 0x55ad98a25f60 2024-02-15T23:29:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a29b40 con 0x55ad98a25f60 2024-02-15T23:29:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa50318640 1 -- 172.21.15.133:0/3992075819 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7faa4800a4d0 con 0x55ad98a25f60 2024-02-15T23:29:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 Processor -- start 2024-02-15T23:29:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 -- start start 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a38bf0 0x55ad98a39010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.527+0000 7faa51ffc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad987d2f20 con 0x55ad98a38bf0 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa4f316640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a38bf0 0x55ad98a39010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa4f316640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a38bf0 0x55ad98a39010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40626/0 (socket says 172.21.15.133:40626) 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa4f316640 1 -- 172.21.15.133:0/2524753971 learned_addr learned my addr 172.21.15.133:0/2524753971 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa4f316640 1 -- 172.21.15.133:0/2524753971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad98a39550 con 0x55ad98a38bf0 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa4f316640 1 --2- 172.21.15.133:0/2524753971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a38bf0 0x55ad98a39010 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7faa44018eb0 tx=0x7faa44018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7fa9357fa640 1 -- 172.21.15.133:0/2524753971 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440be880 con 0x55ad98a38bf0 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa51ffc980 1 -- 172.21.15.133:0/2524753971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ad98a39740 con 0x55ad98a38bf0 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7fa9357fa640 1 -- 172.21.15.133:0/2524753971 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440be9e0 con 0x55ad98a38bf0 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7fa9357fa640 1 -- 172.21.15.133:0/2524753971 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440becc0 con 0x55ad98a38bf0 2024-02-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa51ffc980 1 -- 172.21.15.133:0/2524753971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad98a3a290 con 0x55ad98a38bf0 2024-02-15T23:29:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7fa9357fa640 1 -- 172.21.15.133:0/2524753971 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa440bd3e0 con 0x55ad98a38bf0 2024-02-15T23:29:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7fa9357fa640 1 --2- 172.21.15.133:0/2524753971 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9280342b0 0x7fa928036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7fa9357fa640 1 -- 172.21.15.133:0/2524753971 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7faa440e6250 con 0x55ad98a38bf0 2024-02-15T23:29:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa50318640 1 --2- 172.21.15.133:0/2524753971 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9280342b0 0x7fa928036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa51ffc980 1 Processor -- start 2024-02-15T23:29:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa51ffc980 1 -- start start 2024-02-15T23:29:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa50318640 1 --2- 172.21.15.133:0/2524753971 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9280342b0 0x7fa928036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ad98a29170 tx=0x7faa48005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa51ffc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a46020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa51ffc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad987c6790 con 0x55ad98a45c00 2024-02-15T23:29:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa4f316640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a46020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa4f316640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a46020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40628/0 (socket says 172.21.15.133:40628) 2024-02-15T23:29:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.531+0000 7faa4f316640 1 -- 172.21.15.133:0/3073923830 learned_addr learned my addr 172.21.15.133:0/3073923830 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa4f316640 1 -- 172.21.15.133:0/3073923830 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad98a465f0 con 0x55ad98a45c00 2024-02-15T23:29:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa4f316640 1 --2- 172.21.15.133:0/3073923830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a46020 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faa440e4640 tx=0x7faa440bcef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40e2875eacf2c0e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7fa92effd640 1 -- 172.21.15.133:0/3073923830 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440b4c40 con 0x55ad98a45c00 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7fa92effd640 1 -- 172.21.15.133:0/3073923830 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440b4da0 con 0x55ad98a45c00 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7fa92effd640 1 -- 172.21.15.133:0/3073923830 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440adaa0 con 0x55ad98a45c00 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- 172.21.15.133:0/3073923830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 msgr2=0x55ad98a46020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3073923830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a46020 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faa440e4640 tx=0x7faa440bcef0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- 172.21.15.133:0/3073923830 shutdown_connections 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3073923830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a46020 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- 172.21.15.133:0/3073923830 >> 172.21.15.133:0/3073923830 conn(0x55ad98a41f90 msgr2=0x55ad98a3fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- 172.21.15.133:0/3073923830 shutdown_connections 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- 172.21.15.133:0/3073923830 wait complete. 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 Processor -- start 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- start start 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a4cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad98a4d050 con 0x55ad98a45c00 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa4f316640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a4cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa4f316640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a4cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:40636/0 (socket says 172.21.15.133:40636) 2024-02-15T23:29:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 learned_addr learned my addr 172.21.15.133:0/1365929992 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:29:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad98a3a290 con 0x55ad98a45c00 2024-02-15T23:29:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa4f316640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a4cb10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faa4401b0b0 tx=0x7faa440e45d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7fa92d7fa640 1 -- 172.21.15.133:0/1365929992 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440b4c40 con 0x55ad98a45c00 2024-02-15T23:29:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ad98a4d250 con 0x55ad98a45c00 2024-02-15T23:29:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7fa92d7fa640 1 -- 172.21.15.133:0/1365929992 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440d7040 con 0x55ad98a45c00 2024-02-15T23:29:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7fa92d7fa640 1 -- 172.21.15.133:0/1365929992 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440c5770 con 0x55ad98a45c00 2024-02-15T23:29:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.535+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad98a4d680 con 0x55ad98a45c00 2024-02-15T23:29:57.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7fa92d7fa640 1 -- 172.21.15.133:0/1365929992 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa440e4990 con 0x55ad98a45c00 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7fa92d7fa640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9180342b0 0x7fa918036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7fa92d7fa640 1 -- 172.21.15.133:0/1365929992 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7faa440e7dc0 con 0x55ad98a45c00 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa50318640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9180342b0 0x7fa918036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a58090 0x55ad98a5a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5aca0 con 0x55ad98a58090 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4fb17640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a58090 0x55ad98a5a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa50318640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9180342b0 0x7fa918036770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faa48011010 tx=0x7faa48020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4fb17640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a58090 0x55ad98a5a550 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 realm 2024-02-15T23:29:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5b070 con 0x55ad98a58090 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5b8c0 con 0x55ad98a58090 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5bc20 con 0x55ad98a58090 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5c420 con 0x55ad98a58090 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 20 searching for the correct realm 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ad98a5e370 0x55ad98a607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4f316640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ad98a5e370 0x55ad98a607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4f316640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ad98a5e370 0x55ad98a607a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4f316640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7faa440bc360 0x7faa440ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa440bc360 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.539+0000 7faa50318640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7faa440bc360 0x7faa440ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa50318640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7faa440bc360 0x7faa440ad370 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa4800a4d0 con 0x7faa440bc360 2024-02-15T23:29:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa50318640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7faa480141d0 0x7faa48015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:29:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7faa480141d0 0x7faa48015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:29:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7faa480141d0 0x7faa48015940 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:29:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a58090 2024-02-15T23:29:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a58090 2024-02-15T23:29:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.543+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa440bc360 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa4800a4d0 con 0x7faa440bc360 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a58090 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a58090 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa440bc360 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a58090 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a58090 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.547+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa440bc360 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a58090 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa440bc360 2024-02-15T23:29:57.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a5e370 2024-02-15T23:29:57.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.551+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa480141d0 2024-02-15T23:29:57.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x55ad98a58090 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a60e20 con 0x7faa440bc360 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5ce10 con 0x55ad98a58090 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5d660 con 0x55ad98a58090 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a61260 con 0x55ad98a58090 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 zone default found 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 4 Realm: () 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 zonegroup default 2024-02-15T23:29:57.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a61260 con 0x7faa480141d0 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a630e0 con 0x55ad98a5e370 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a63440 con 0x55ad98a5e370 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 started sync module instance, tier type = 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.555+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a626b0 con 0x7faa440bc360 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.559+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(44 notify.0 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.559+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94204078729872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a626b0 con 0x7faa440bc360 2024-02-15T23:29:57.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.559+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a63db0 con 0x55ad98a58090 2024-02-15T23:29:57.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.559+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94204078729872] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.559+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.559+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94204078727968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a63db0 con 0x55ad98a58090 2024-02-15T23:29:57.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.559+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a64720 con 0x55ad98a5e370 2024-02-15T23:29:57.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94204078736000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a64f70 con 0x55ad98a5e370 2024-02-15T23:29:57.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a65920 con 0x7faa440bc360 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94204078727968] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(50 notify.3 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94204078733584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a65cd0 con 0x7faa440bc360 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a66680 con 0x55ad98a58090 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94204078736000] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94204078733584] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94204078740544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a661a0 con 0x55ad98a58090 2024-02-15T23:29:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.563+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a66ed0 con 0x7faa480141d0 2024-02-15T23:29:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.567+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94204078740544] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.567+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(54 notify.5 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.567+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94204078738128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a66bf0 con 0x7faa480141d0 2024-02-15T23:29:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.567+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a673f0 con 0x7faa480141d0 2024-02-15T23:29:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.567+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94204078738128] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(56 notify.6 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94204078745696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a67220 con 0x7faa480141d0 2024-02-15T23:29:57.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a67cf0 con 0x7faa480141d0 2024-02-15T23:29:57.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94204078745696] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(58 notify.7 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94204078749648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a67cb0 con 0x7faa480141d0 2024-02-15T23:29:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 20 add_watcher() i=0 2024-02-15T23:29:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 20 add_watcher() i=1 2024-02-15T23:29:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 20 add_watcher() i=2 2024-02-15T23:29:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 20 add_watcher() i=3 2024-02-15T23:29:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 20 add_watcher() i=4 2024-02-15T23:29:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 20 add_watcher() i=5 2024-02-15T23:29:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.571+0000 7faa51ffc980 20 add_watcher() i=6 2024-02-15T23:29:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94204078749648] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 add_watcher() i=7 2024-02-15T23:29:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 2 all 8 watchers are set, enabling cache 2024-02-15T23:29:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a6b1f0 con 0x55ad98a58090 2024-02-15T23:29:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94204078746816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a685a0 con 0x55ad98a58090 2024-02-15T23:29:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94204078746816] v31'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7fa905fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 5 note: GC not initialized 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7fa904fe1640 20 reqs_thread_entry: start 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 init_complete bucket index max shards: 11 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 Filter name: none 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7fa87e7fc640 20 reqs_thread_entry: start 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a8d040 con 0x55ad98a58090 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a8f400 con 0x7faa440bc360 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 enabling bucket name=myfoo 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.575+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a8d3e0 con 0x7faa440bc360 2024-02-15T23:29:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 : miss 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 20 rados->read ofs=0 len=0 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a8fc50 con 0x55ad98a58090 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv11 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 2024-02-15T23:29:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 8.c 8:32ecd58b:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a97430 con 0x55ad98a58090 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'12 uv12 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1, ofs0, ns] 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94204078915776 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a94cc0 con 0x55ad98a58090 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== watch-notify(notify (1) cookie 94204078740544 notify 133143986197 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7faa400591f0 con 0x55ad98a58090 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7fa92effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 94204078740544 notifier 4597 bl.length()=725 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7fa92effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 info.flags=0x17 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7fa92effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1 to cache LRU end 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7fa92effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7fa92effd640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa914003ea0 con 0x55ad98a58090 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(67 notify.4 [notify cookie 94204078915776 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== watch-notify(notify_complete (2) cookie 94204078915776 notify 133143986197 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ad988a2960 con 0x55ad98a58090 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_sources= new_sources= 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential sources added=[] removed=[] 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): orig_dests= new_dests= 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 20 handle_bi_update(): bucket=:myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1]): potential dests added=[] removed=[] 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a92520 con 0x55ad98a58090 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v31'13 uv13 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.579+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94204078934048 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a94c40 con 0x55ad98a58090 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== watch-notify(notify (1) cookie 94204078740544 notify 133143986198 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55ad988a2960 con 0x55ad98a58090 2024-02-15T23:29:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7fa92e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986198 cookie 94204078740544 notifier 4597 bl.length()=534 2024-02-15T23:29:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7fa92e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:29:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7fa92e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:29:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(70 notify.4 [notify cookie 94204078934048 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7fa92e7fc640 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa884003430 con 0x55ad98a58090 2024-02-15T23:29:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== watch-notify(notify_complete (2) cookie 94204078934048 notify 133143986198 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ad988a44d0 con 0x55ad98a58090 2024-02-15T23:29:57.593 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:29:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7fa905fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:29:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94204078746816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a8c170 con 0x55ad98a58090 2024-02-15T23:29:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94204078746816] v31'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94204078729872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a66cc0 con 0x7faa440bc360 2024-02-15T23:29:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94204078729872] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa51ffc980 20 remove_watcher() i=0 2024-02-15T23:29:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa51ffc980 2 removed watcher, disabling cache 2024-02-15T23:29:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.583+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94204078727968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5d660 con 0x55ad98a58090 2024-02-15T23:29:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.587+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94204078727968] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.587+0000 7faa51ffc980 20 remove_watcher() i=1 2024-02-15T23:29:57.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.587+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94204078736000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a5d640 con 0x55ad98a5e370 2024-02-15T23:29:57.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.587+0000 7faa4f316640 1 -- 172.21.15.133:0/1365929992 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94204078736000] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa440d1a70 con 0x55ad98a5e370 2024-02-15T23:29:57.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.587+0000 7faa51ffc980 20 remove_watcher() i=2 2024-02-15T23:29:57.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.587+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94204078733584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a62320 con 0x7faa440bc360 2024-02-15T23:29:57.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.591+0000 7faa50318640 1 -- 172.21.15.133:0/1365929992 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94204078733584] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa4803a040 con 0x7faa440bc360 2024-02-15T23:29:57.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.591+0000 7faa51ffc980 20 remove_watcher() i=3 2024-02-15T23:29:57.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.591+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94204078740544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a64280 con 0x55ad98a58090 2024-02-15T23:29:57.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.591+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94204078740544] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x55ad98a58090 2024-02-15T23:29:57.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.591+0000 7faa51ffc980 20 remove_watcher() i=4 2024-02-15T23:29:57.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.591+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94204078738128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a63910 con 0x7faa480141d0 2024-02-15T23:29:57.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.595+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94204078738128] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.595+0000 7faa51ffc980 20 remove_watcher() i=5 2024-02-15T23:29:57.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.595+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94204078745696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a62320 con 0x7faa480141d0 2024-02-15T23:29:57.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.595+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94204078745696] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.595+0000 7faa51ffc980 20 remove_watcher() i=6 2024-02-15T23:29:57.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.595+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94204078749648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ad98a65440 con 0x7faa480141d0 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94204078749648] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa40014070 con 0x7faa480141d0 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 20 remove_watcher() i=7 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7faa480141d0 msgr2=0x7faa48015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7faa480141d0 0x7faa48015940 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a58090 msgr2=0x55ad98a5a550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a58090 0x55ad98a5a550 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7faa440bc360 msgr2=0x7faa440ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7faa440bc360 0x7faa440ad370 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ad98a5e370 msgr2=0x55ad98a607a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55ad98a5e370 0x55ad98a607a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9180342b0 msgr2=0x7fa918036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9180342b0 0x7fa918036770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faa48011010 tx=0x7faa48020000 comp rx=0 tx=0).stop 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 msgr2=0x55ad98a4cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa4fb17640 1 -- 172.21.15.133:0/1365929992 reap_dead start 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a4cb10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faa4401b0b0 tx=0x7faa440e45d0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 shutdown_connections 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/1365929992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a45c00 0x55ad98a4cb10 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 >> 172.21.15.133:0/1365929992 conn(0x55ad98a41f90 msgr2=0x55ad98a3f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 shutdown_connections 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/1365929992 wait complete. 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/2524753971 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9280342b0 msgr2=0x7fa928036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/2524753971 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9280342b0 0x7fa928036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ad98a29170 tx=0x7faa48005850 comp rx=0 tx=0).stop 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/2524753971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a38bf0 msgr2=0x55ad98a39010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/2524753971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a38bf0 0x55ad98a39010 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7faa44018eb0 tx=0x7faa44018020 comp rx=0 tx=0).stop 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/2524753971 shutdown_connections 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/2524753971 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa9280342b0 0x7fa928036770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/2524753971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad98a38bf0 0x55ad98a39010 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/2524753971 >> 172.21.15.133:0/2524753971 conn(0x55ad98a2da00 msgr2=0x55ad98a2e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/2524753971 shutdown_connections 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/2524753971 wait complete. 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a25f60 msgr2=0x55ad98a28350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a25f60 0x55ad98a28350 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa938034300 msgr2=0x7fa9380367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa938034300 0x7fa9380367c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faa440ad000 tx=0x7faa440a5040 comp rx=0 tx=0).stop 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 msgr2=0x55ad988a3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad988a3f90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faa40001ee0 tx=0x7faa40000ee0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 shutdown_connections 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55ad98a25f60 0x55ad98a28350 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa938034300 0x7fa9380367c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 --2- 172.21.15.133:0/3992075819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad9892e170 0x55ad988a3f90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 >> 172.21.15.133:0/3992075819 conn(0x55ad98929a40 msgr2=0x55ad98a127d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 shutdown_connections 2024-02-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:29:57.599+0000 7faa51ffc980 1 -- 172.21.15.133:0/3992075819 wait complete. 2024-02-15T23:29:57.617 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:29:57.626 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-15T23:29:57.904 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-02-15T23:29:57.917 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:12.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-15T23:30:12.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-15T23:30:12.918 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-15T23:30:12.956 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:12.956 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:12.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.947+0000 7f275b9f3980 1 Processor -- start 2024-02-15T23:30:12.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f275b9f3980 1 -- start start 2024-02-15T23:30:12.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f275b9f3980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x564f9856be10 0x564f98600180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f275b9f3980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564f985434c0 con 0x564f9856d150 2024-02-15T23:30:12.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f275b9f3980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x564f9850a180 con 0x564f9856be10 2024-02-15T23:30:12.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f2758d0d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x564f9856be10 0x564f98600180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f275950e640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x564f9856d150 0x564f9856b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:60320/0 (socket says 172.21.15.133:60320) 2024-02-15T23:30:12.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f275950e640 1 -- 172.21.15.133:0/2529361942 learned_addr learned my addr 172.21.15.133:0/2529361942 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:12.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f2758d0d640 1 -- 172.21.15.133:0/2529361942 >> v1:172.21.15.131:6789/0 conn(0x564f9856d150 legacy=0x564f9856b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:12.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f2758d0d640 1 -- 172.21.15.133:0/2529361942 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f9856c220 con 0x564f9856be10 2024-02-15T23:30:12.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f2758d0d640 1 --2- 172.21.15.133:0/2529361942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f98600180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f275000a480 tx=0x7f275001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1febfc14fc73ccc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.951+0000 7f274bfff640 1 -- 172.21.15.133:0/2529361942 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500aa530 con 0x564f9856be10 2024-02-15T23:30:12.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f274bfff640 1 -- 172.21.15.133:0/2529361942 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500a6050 con 0x564f9856be10 2024-02-15T23:30:12.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f274bfff640 1 -- 172.21.15.133:0/2529361942 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500aa7e0 con 0x564f9856be10 2024-02-15T23:30:12.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f275b9f3980 1 -- 172.21.15.133:0/2529361942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 msgr2=0x564f98600180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:12.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2529361942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f98600180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f275000a480 tx=0x7f275001b280 comp rx=0 tx=0).stop 2024-02-15T23:30:12.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f275b9f3980 1 -- 172.21.15.133:0/2529361942 shutdown_connections 2024-02-15T23:30:12.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2529361942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f98600180 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:12.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f275b9f3980 1 -- 172.21.15.133:0/2529361942 >> 172.21.15.133:0/2529361942 conn(0x564f985f2a40 msgr2=0x564f985f4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:12.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f275b9f3980 1 -- 172.21.15.133:0/2529361942 shutdown_connections 2024-02-15T23:30:12.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.955+0000 7f275b9f3980 1 -- 172.21.15.133:0/2529361942 wait complete. 2024-02-15T23:30:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 Processor -- start 2024-02-15T23:30:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 -- start start 2024-02-15T23:30:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986e35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f985076b0 con 0x564f9856be10 2024-02-15T23:30:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275950e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986e35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275950e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986e35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35644/0 (socket says 172.21.15.133:35644) 2024-02-15T23:30:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275950e640 1 -- 172.21.15.133:0/1859611276 learned_addr learned my addr 172.21.15.133:0/1859611276 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275950e640 1 -- 172.21.15.133:0/1859611276 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750005d30 con 0x564f9856be10 2024-02-15T23:30:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275950e640 1 --2- 172.21.15.133:0/1859611276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986e35b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f274c001c90 tx=0x7f274c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4092666394e52fe server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f2647606640 1 -- 172.21.15.133:0/1859611276 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f274c00e690 con 0x564f9856be10 2024-02-15T23:30:12.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f2647606640 1 -- 172.21.15.133:0/1859611276 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c00e7f0 con 0x564f9856be10 2024-02-15T23:30:12.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f2647606640 1 -- 172.21.15.133:0/1859611276 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f274c00eaf0 con 0x564f9856be10 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 -- 172.21.15.133:0/1859611276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 msgr2=0x564f986e35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1859611276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986e35b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f274c001c90 tx=0x7f274c00b6d0 comp rx=0 tx=0).stop 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 -- 172.21.15.133:0/1859611276 shutdown_connections 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1859611276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986e35b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 -- 172.21.15.133:0/1859611276 >> 172.21.15.133:0/1859611276 conn(0x564f985f2a40 msgr2=0x564f986df140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 -- 172.21.15.133:0/1859611276 shutdown_connections 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 -- 172.21.15.133:0/1859611276 wait complete. 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.971+0000 7f275b9f3980 1 Processor -- start 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275b9f3980 1 -- start start 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275b9f3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275b9f3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f98502e90 con 0x564f9856be10 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275950e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275950e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986ea420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35658/0 (socket says 172.21.15.133:35658) 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275950e640 1 -- 172.21.15.133:0/2346514362 learned_addr learned my addr 172.21.15.133:0/2346514362 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275950e640 1 -- 172.21.15.133:0/2346514362 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f985434c0 con 0x564f9856be10 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275950e640 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986ea420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f274c001ee0 tx=0x7f274c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2645e03640 1 -- 172.21.15.133:0/2346514362 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f274c01f070 con 0x564f9856be10 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2645e03640 1 -- 172.21.15.133:0/2346514362 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c01a4d0 con 0x564f9856be10 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f986ea960 con 0x564f9856be10 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2645e03640 1 -- 172.21.15.133:0/2346514362 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f274c01a770 con 0x564f9856be10 2024-02-15T23:30:12.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f986eadb0 con 0x564f9856be10 2024-02-15T23:30:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2645e03640 1 -- 172.21.15.133:0/2346514362 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f274c00a040 con 0x564f9856be10 2024-02-15T23:30:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2645e03640 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2640034300 0x7f26400367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2645e03640 1 -- 172.21.15.133:0/2346514362 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f274c0497c0 con 0x564f9856be10 2024-02-15T23:30:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2758d0d640 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2640034300 0x7f26400367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f9856d150 0x564f986f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f986f15d0 con 0x564f9856d150 2024-02-15T23:30:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2759d0f640 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f9856d150 0x564f986f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.975+0000 7f2758d0d640 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2640034300 0x7f26400367c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27500ac000 tx=0x7f27500a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2759d0f640 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f9856d150 0x564f986f1090 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2759d0f640 1 -- 172.21.15.133:0/2346514362 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f275400a4d0 con 0x564f9856d150 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f986f19e0 con 0x564f9856d150 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2759d0f640 1 -- 172.21.15.133:0/2346514362 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f275400a4d0 con 0x564f9856d150 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f986f3290 con 0x564f9856d150 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2759d0f640 1 -- 172.21.15.133:0/2346514362 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f275400a4d0 con 0x564f9856d150 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f986f2490 con 0x564f9856d150 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2759d0f640 1 -- 172.21.15.133:0/2346514362 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f275400a4d0 con 0x564f9856d150 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f986f28a0 con 0x564f9856d150 2024-02-15T23:30:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2759d0f640 1 -- 172.21.15.133:0/2346514362 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f275400a4d0 con 0x564f9856d150 2024-02-15T23:30:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f275b9f3980 1 Processor -- start 2024-02-15T23:30:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f275b9f3980 1 -- start start 2024-02-15T23:30:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f275b9f3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f98701930 0x564f98701d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f275b9f3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f9849bf20 con 0x564f98701930 2024-02-15T23:30:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2758d0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f98701930 0x564f98701d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2758d0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f98701930 0x564f98701d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35672/0 (socket says 172.21.15.133:35672) 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2758d0d640 1 -- 172.21.15.133:0/478082024 learned_addr learned my addr 172.21.15.133:0/478082024 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.979+0000 7f2758d0d640 1 -- 172.21.15.133:0/478082024 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f98702290 con 0x564f98701930 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f2758d0d640 1 --2- 172.21.15.133:0/478082024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f98701930 0x564f98701d50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f27500ad040 tx=0x7f2750018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f263effd640 1 -- 172.21.15.133:0/478082024 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500b4c40 con 0x564f98701930 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f263effd640 1 -- 172.21.15.133:0/478082024 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500b4da0 con 0x564f98701930 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f263effd640 1 -- 172.21.15.133:0/478082024 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500bd5b0 con 0x564f98701930 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f275b9f3980 1 -- 172.21.15.133:0/478082024 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f98702480 con 0x564f98701930 2024-02-15T23:30:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f275b9f3980 1 -- 172.21.15.133:0/478082024 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f98702fd0 con 0x564f98701930 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f263effd640 1 -- 172.21.15.133:0/478082024 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f27500bd760 con 0x564f98701930 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f263effd640 1 --2- 172.21.15.133:0/478082024 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26300342b0 0x7f2630036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f263effd640 1 -- 172.21.15.133:0/478082024 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f27500e5bb0 con 0x564f98701930 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f2759d0f640 1 --2- 172.21.15.133:0/478082024 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26300342b0 0x7f2630036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f275b9f3980 1 Processor -- start 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f2759d0f640 1 --2- 172.21.15.133:0/478082024 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26300342b0 0x7f2630036770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564f986f1ed0 tx=0x7f2754005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f275b9f3980 1 -- start start 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f275b9f3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f9870ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f275b9f3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f9848f790 con 0x564f9870e940 2024-02-15T23:30:12.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f2758d0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f9870ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f2758d0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f9870ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35676/0 (socket says 172.21.15.133:35676) 2024-02-15T23:30:12.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.983+0000 7f2758d0d640 1 -- 172.21.15.133:0/2152094303 learned_addr learned my addr 172.21.15.133:0/2152094303 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:12.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f2758d0d640 1 -- 172.21.15.133:0/2152094303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f9870f330 con 0x564f9870e940 2024-02-15T23:30:12.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f2758d0d640 1 --2- 172.21.15.133:0/2152094303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f9870ed60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f27500b4f30 tx=0x7f27500bb420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a329a5e4f9f0d7c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f263cff9640 1 -- 172.21.15.133:0/2152094303 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500b3590 con 0x564f9870e940 2024-02-15T23:30:12.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f263cff9640 1 -- 172.21.15.133:0/2152094303 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500b36f0 con 0x564f9870e940 2024-02-15T23:30:12.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f263cff9640 1 -- 172.21.15.133:0/2152094303 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500b3990 con 0x564f9870e940 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- 172.21.15.133:0/2152094303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 msgr2=0x564f9870ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2152094303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f9870ed60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f27500b4f30 tx=0x7f27500bb420 comp rx=0 tx=0).stop 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- 172.21.15.133:0/2152094303 shutdown_connections 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2152094303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f9870ed60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- 172.21.15.133:0/2152094303 >> 172.21.15.133:0/2152094303 conn(0x564f9870acd0 msgr2=0x564f98708d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- 172.21.15.133:0/2152094303 shutdown_connections 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- 172.21.15.133:0/2152094303 wait complete. 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 Processor -- start 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- start start 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f98715840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f98715d80 con 0x564f9870e940 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f2758d0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f98715840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f2758d0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f98715840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35692/0 (socket says 172.21.15.133:35692) 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 learned_addr learned my addr 172.21.15.133:0/1886200676 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f98702fd0 con 0x564f9870e940 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f2758d0d640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f98715840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f27500b4800 tx=0x7f27500e3e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f262effd640 1 -- 172.21.15.133:0/1886200676 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500b3590 con 0x564f9870e940 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f98715f80 con 0x564f9870e940 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f262effd640 1 -- 172.21.15.133:0/1886200676 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500df040 con 0x564f9870e940 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f262effd640 1 -- 172.21.15.133:0/1886200676 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500bbdd0 con 0x564f9870e940 2024-02-15T23:30:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.987+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f98716410 con 0x564f9870e940 2024-02-15T23:30:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f262effd640 1 -- 172.21.15.133:0/1886200676 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f27500e2350 con 0x564f9870e940 2024-02-15T23:30:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f262effd640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26240342b0 0x7f2624036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f262effd640 1 -- 172.21.15.133:0/1886200676 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f27500efd20 con 0x564f9870e940 2024-02-15T23:30:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f2759d0f640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26240342b0 0x7f2624036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f98720df0 0x564f98723290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987239e0 con 0x564f98720df0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275950e640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f98720df0 0x564f98723290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f2759d0f640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26240342b0 0x7f2624036770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2754011010 tx=0x7f2754020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275950e640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f98720df0 0x564f98723290 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 realm 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98723db0 con 0x564f98720df0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98724600 con 0x564f98720df0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98724960 con 0x564f98720df0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987242a0 con 0x564f98720df0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 20 searching for the correct realm 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f98726bb0 0x564f98728fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.991+0000 7f2758d0d640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f98726bb0 0x564f98728fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2758d0d640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f98726bb0 0x564f98728fe0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2758d0d640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f27500ee020 0x7f27500d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f27500ee020 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2759d0f640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f27500ee020 0x7f27500d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2759d0f640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f27500ee020 0x7f27500d06e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f275400a4d0 con 0x7f27500ee020 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f27500ee020 2024-02-15T23:30:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f275400a4d0 con 0x7f27500ee020 2024-02-15T23:30:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98720df0 2024-02-15T23:30:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98720df0 2024-02-15T23:30:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f274c017050 0x7f274c042a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f274c017050 2024-02-15T23:30:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f274c017050 0x7f274c042a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f274c017050 0x7f274c042a90 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.995+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f274c017050 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f27500ee020 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f275400a4d0 con 0x7f27500ee020 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98720df0 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f274c017050 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98720df0 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f27500ee020 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:12.999+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f274c017050 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98720df0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98720df0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f274c017050 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f27500ee020 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98720df0 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f27500ee020 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.003+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f274c017050 2024-02-15T23:30:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f27500ee020 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98726bb0 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f274c017050 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x564f98720df0 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987296b0 con 0x7f27500ee020 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987257d0 con 0x564f98720df0 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98725420 con 0x564f98720df0 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987260a0 con 0x564f98720df0 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 zone default found 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 4 Realm: () 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 zonegroup default 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98729af0 con 0x7f27500ee020 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872b970 con 0x564f98726bb0 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.007+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872bcd0 con 0x564f98726bb0 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 20 started sync module instance, tier type = 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872aef0 con 0x7f27500ee020 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94899860058784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872aef0 con 0x7f27500ee020 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872c680 con 0x564f98720df0 2024-02-15T23:30:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94899860058784] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94899860062624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872aef0 con 0x564f98720df0 2024-02-15T23:30:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.011+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872d080 con 0x564f98726bb0 2024-02-15T23:30:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.015+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94899860062624] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.015+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.015+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94899860056656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872ae70 con 0x564f98726bb0 2024-02-15T23:30:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.015+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872dd70 con 0x7f27500ee020 2024-02-15T23:30:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.015+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.015+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94899860068864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872e5c0 con 0x7f27500ee020 2024-02-15T23:30:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.015+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872efb0 con 0x564f98720df0 2024-02-15T23:30:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.019+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94899860056656] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.019+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94899860068864] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.019+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.019+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94899860073104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872e120 con 0x564f98720df0 2024-02-15T23:30:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.019+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872f800 con 0x7f274c017050 2024-02-15T23:30:13.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.019+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94899860073104] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.023+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.023+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94899860067376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872e120 con 0x7f274c017050 2024-02-15T23:30:13.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.023+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872fcc0 con 0x7f274c017050 2024-02-15T23:30:13.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.023+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(56 notify.6 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.023+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94899860076480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98730120 con 0x7f274c017050 2024-02-15T23:30:13.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.023+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98730bf0 con 0x7f274c017050 2024-02-15T23:30:13.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.023+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94899860067376] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94899860080336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98730bb0 con 0x7f274c017050 2024-02-15T23:30:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 20 add_watcher() i=0 2024-02-15T23:30:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 20 add_watcher() i=1 2024-02-15T23:30:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 20 add_watcher() i=2 2024-02-15T23:30:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 20 add_watcher() i=3 2024-02-15T23:30:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 20 add_watcher() i=4 2024-02-15T23:30:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 20 add_watcher() i=5 2024-02-15T23:30:13.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94899860076480] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 20 add_watcher() i=6 2024-02-15T23:30:13.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94899860080336] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 20 add_watcher() i=7 2024-02-15T23:30:13.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:13.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872fc80 con 0x564f98720df0 2024-02-15T23:30:13.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.027+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94899860074848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9872fc80 con 0x564f98720df0 2024-02-15T23:30:13.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.031+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94899860074848] v33'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.031+0000 7f260f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:13.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.031+0000 7f275b9f3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:13.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.031+0000 7f275b9f3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:13.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.031+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873bfe0 con 0x564f98720df0 2024-02-15T23:30:13.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.031+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.031+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873bfe0 con 0x7f274c017050 2024-02-15T23:30:13.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.035+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'20 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.035+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873c510 con 0x564f98726bb0 2024-02-15T23:30:13.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.035+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.035+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873cee0 con 0x564f98720df0 2024-02-15T23:30:13.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.035+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'153 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.035+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873a190 con 0x7f27500ee020 2024-02-15T23:30:13.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.035+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'44 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.035+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873a190 con 0x564f98726bb0 2024-02-15T23:30:13.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.039+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'29 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.039+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873e0c0 con 0x564f98720df0 2024-02-15T23:30:13.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.039+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.039+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873e0c0 con 0x7f274c017050 2024-02-15T23:30:13.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.043+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.043+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873e0c0 con 0x7f27500ee020 2024-02-15T23:30:13.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.043+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.043+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873e5f0 con 0x564f98726bb0 2024-02-15T23:30:13.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.047+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.047+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873efc0 con 0x7f27500ee020 2024-02-15T23:30:13.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.047+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'45 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.047+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98739270 con 0x7f274c017050 2024-02-15T23:30:13.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.051+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.051+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98739270 con 0x7f27500ee020 2024-02-15T23:30:13.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.051+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.051+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98739210 con 0x7f274c017050 2024-02-15T23:30:13.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.051+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'35 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.055+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987393e0 con 0x564f98720df0 2024-02-15T23:30:13.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.055+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'154 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.055+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987393e0 con 0x564f98726bb0 2024-02-15T23:30:13.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.055+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.055+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x7f27500ee020 2024-02-15T23:30:13.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.059+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'46 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.059+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98726bb0 2024-02-15T23:30:13.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.059+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.059+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98720df0 2024-02-15T23:30:13.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.063+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.063+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98720df0 2024-02-15T23:30:13.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.063+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'155 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.063+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98726bb0 2024-02-15T23:30:13.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.063+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.063+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x7f27500ee020 2024-02-15T23:30:13.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.067+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.067+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98726bb0 2024-02-15T23:30:13.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.067+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.067+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98726bb0 2024-02-15T23:30:13.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.067+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.067+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98726bb0 2024-02-15T23:30:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.071+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.071+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98726bb0 2024-02-15T23:30:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.071+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.071+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x7f274c017050 2024-02-15T23:30:13.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.075+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.075+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98726bb0 2024-02-15T23:30:13.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.075+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.075+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x7f274c017050 2024-02-15T23:30:13.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.079+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.079+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x564f98726bb0 2024-02-15T23:30:13.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.079+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'40 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.079+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x7f274c017050 2024-02-15T23:30:13.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'36 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9873f960 con 0x7f27500ee020 2024-02-15T23:30:13.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f260e7e4640 20 reqs_thread_entry: start 2024-02-15T23:30:13.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275b9f3980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:13.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275b9f3980 20 Filter name: none 2024-02-15T23:30:13.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f257ffff640 20 reqs_thread_entry: start 2024-02-15T23:30:13.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987384b0 con 0x564f98720df0 2024-02-15T23:30:13.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738010 con 0x564f98720df0 2024-02-15T23:30:13.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.083+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987384b0 con 0x564f98720df0 2024-02-15T23:30:13.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738010 con 0x7f274c017050 2024-02-15T23:30:13.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738010 con 0x7f274c017050 2024-02-15T23:30:13.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv19 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f987384b0 con 0x7f274c017050 2024-02-15T23:30:13.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(99 gc.1 [call out=1702b] v0'0 uv19 ondisk = 0) v8 ==== 148+0+1702 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.087+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98720df0 2024-02-15T23:30:13.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f27500ee020 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98720df0 2024-02-15T23:30:13.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.091+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f274c017050 2024-02-15T23:30:13.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f27500ee020 2024-02-15T23:30:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.095+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f27500ee020 2024-02-15T23:30:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f274c017050 2024-02-15T23:30:13.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.099+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f27500ee020 2024-02-15T23:30:13.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f274c017050 2024-02-15T23:30:13.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98720df0 2024-02-15T23:30:13.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.103+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f27500ee020 2024-02-15T23:30:13.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.107+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98720df0 2024-02-15T23:30:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98720df0 2024-02-15T23:30:13.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98720df0 2024-02-15T23:30:13.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.111+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f27500ee020 2024-02-15T23:30:13.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.115+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f274c017050 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.119+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f274c017050 2024-02-15T23:30:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x564f98726bb0 2024-02-15T23:30:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.123+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x564f98726bb0 2024-02-15T23:30:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f274c017050 2024-02-15T23:30:13.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 40 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f274c017050 2024-02-15T23:30:13.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 41 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98759980 con 0x7f27500ee020 2024-02-15T23:30:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f9875a990 con 0x7f27500ee020 2024-02-15T23:30:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.127+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.131+0000 7f260f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:13.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.131+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94899860074848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738400 con 0x564f98720df0 2024-02-15T23:30:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.131+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94899860074848] v33'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.131+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94899860058784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738a90 con 0x7f27500ee020 2024-02-15T23:30:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.135+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94899860058784] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.135+0000 7f275b9f3980 20 remove_watcher() i=0 2024-02-15T23:30:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.135+0000 7f275b9f3980 2 removed watcher, disabling cache 2024-02-15T23:30:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.135+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94899860062624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738a90 con 0x564f98720df0 2024-02-15T23:30:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.135+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94899860062624] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.135+0000 7f275b9f3980 20 remove_watcher() i=1 2024-02-15T23:30:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.135+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94899860056656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738a90 con 0x564f98726bb0 2024-02-15T23:30:13.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.139+0000 7f2758d0d640 1 -- 172.21.15.133:0/1886200676 <== osd.3 v2:172.21.15.133:6816/1056376173 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94899860056656] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27500eb070 con 0x564f98726bb0 2024-02-15T23:30:13.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.139+0000 7f275b9f3980 20 remove_watcher() i=2 2024-02-15T23:30:13.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.139+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94899860068864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738a90 con 0x7f27500ee020 2024-02-15T23:30:13.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.139+0000 7f2759d0f640 1 -- 172.21.15.133:0/1886200676 <== osd.2 v2:172.21.15.133:6808/3615800201 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94899860068864] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2754039060 con 0x7f27500ee020 2024-02-15T23:30:13.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.139+0000 7f275b9f3980 20 remove_watcher() i=3 2024-02-15T23:30:13.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.139+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94899860073104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738a90 con 0x564f98720df0 2024-02-15T23:30:13.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.143+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.1 v2:172.21.15.133:6800/2918336019 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94899860073104] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x564f98720df0 2024-02-15T23:30:13.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.143+0000 7f275b9f3980 20 remove_watcher() i=4 2024-02-15T23:30:13.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.143+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94899860067376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738a90 con 0x7f274c017050 2024-02-15T23:30:13.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.143+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 42 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94899860067376] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.143+0000 7f275b9f3980 20 remove_watcher() i=5 2024-02-15T23:30:13.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.143+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94899860076480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738a90 con 0x7f274c017050 2024-02-15T23:30:13.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.147+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 43 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94899860076480] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.147+0000 7f275b9f3980 20 remove_watcher() i=6 2024-02-15T23:30:13.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.147+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94899860080336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f98738a90 con 0x7f274c017050 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 <== osd.0 v2:172.21.15.131:6800/31994139 44 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94899860080336] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f274c014070 con 0x7f274c017050 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 20 remove_watcher() i=7 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f274c017050 msgr2=0x7f274c042a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f274c017050 0x7f274c042a90 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f98720df0 msgr2=0x564f98723290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f98720df0 0x564f98723290 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f27500ee020 msgr2=0x7f27500d06e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f27500ee020 0x7f27500d06e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f98726bb0 msgr2=0x564f98728fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x564f98726bb0 0x564f98728fe0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26240342b0 msgr2=0x7f2624036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26240342b0 0x7f2624036770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2754011010 tx=0x7f2754020000 comp rx=0 tx=0).stop 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 msgr2=0x564f98715840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275950e640 1 -- 172.21.15.133:0/1886200676 reap_dead start 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f98715840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f27500b4800 tx=0x7f27500e3e90 comp rx=0 tx=0).stop 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 shutdown_connections 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/1886200676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9870e940 0x564f98715840 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 >> 172.21.15.133:0/1886200676 conn(0x564f9870acd0 msgr2=0x564f98708d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 shutdown_connections 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/1886200676 wait complete. 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/478082024 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26300342b0 msgr2=0x7f2630036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/478082024 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26300342b0 0x7f2630036770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564f986f1ed0 tx=0x7f2754005850 comp rx=0 tx=0).stop 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/478082024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f98701930 msgr2=0x564f98701d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/478082024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f98701930 0x564f98701d50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f27500ad040 tx=0x7f2750018020 comp rx=0 tx=0).stop 2024-02-15T23:30:13.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/478082024 shutdown_connections 2024-02-15T23:30:13.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/478082024 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f26300342b0 0x7f2630036770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/478082024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f98701930 0x564f98701d50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/478082024 >> 172.21.15.133:0/478082024 conn(0x564f986f6740 msgr2=0x564f986f7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/478082024 shutdown_connections 2024-02-15T23:30:13.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/478082024 wait complete. 2024-02-15T23:30:13.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f9856d150 msgr2=0x564f986f1090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f9856d150 0x564f986f1090 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2640034300 msgr2=0x7f26400367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2640034300 0x7f26400367c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27500ac000 tx=0x7f27500a5000 comp rx=0 tx=0).stop 2024-02-15T23:30:13.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 msgr2=0x564f986ea420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986ea420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f274c001ee0 tx=0x7f274c000ee0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 shutdown_connections 2024-02-15T23:30:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x564f9856d150 0x564f986f1090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2640034300 0x7f26400367c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 --2- 172.21.15.133:0/2346514362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f9856be10 0x564f986ea420 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 >> 172.21.15.133:0/2346514362 conn(0x564f985f2a40 msgr2=0x564f986ddc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 shutdown_connections 2024-02-15T23:30:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.151+0000 7f275b9f3980 1 -- 172.21.15.133:0/2346514362 wait complete. 2024-02-15T23:30:13.176 INFO:teuthology.orchestra.run.smithi133.stdout:[{"tag":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.13888963804196711838\u0000","time":"2024-02-15T23:30:12.912939+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_7","key":"","instance":""}]}] 2024-02-15T23:30:13.176 DEBUG:tasks.util.rgw: json result: [{'tag': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.13888963804196711838\x00', 'time': '2024-02-15T23:30:12.912939+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_7', 'key': '', 'instance': ''}]}] 2024-02-15T23:30:13.176 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-02-15T23:30:13.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-02-15T23:30:13.176 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-02-15T23:30:13.255 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:13.255 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:13.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb41cf980 1 Processor -- start 2024-02-15T23:30:13.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb41cf980 1 -- start start 2024-02-15T23:30:13.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb41cf980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5587b612d8b0 0x5587b61bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb41cf980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5587b61054b0 con 0x5587b61bc360 2024-02-15T23:30:13.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb41cf980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5587b60cc180 con 0x5587b612d8b0 2024-02-15T23:30:13.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb1cea640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5587b612d8b0 0x5587b61bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb1cea640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5587b612d8b0 0x5587b61bbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35700/0 (socket says 172.21.15.133:35700) 2024-02-15T23:30:13.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb1cea640 1 -- 172.21.15.133:0/1757395633 learned_addr learned my addr 172.21.15.133:0/1757395633 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb1cea640 1 -- 172.21.15.133:0/1757395633 >> v1:172.21.15.131:6789/0 conn(0x5587b61bc360 legacy=0x5587b61be750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.247+0000 7f0fb1cea640 1 -- 172.21.15.133:0/1757395633 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b61c0eb0 con 0x5587b612d8b0 2024-02-15T23:30:13.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb1cea640 1 --2- 172.21.15.133:0/1757395633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b61bbe20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400a5c0 tx=0x7f0fa401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9c569d59854b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb0ce8640 1 -- 172.21.15.133:0/1757395633 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa40aa470 con 0x5587b612d8b0 2024-02-15T23:30:13.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb0ce8640 1 -- 172.21.15.133:0/1757395633 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40aa5d0 con 0x5587b612d8b0 2024-02-15T23:30:13.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb0ce8640 1 -- 172.21.15.133:0/1757395633 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa40aa890 con 0x5587b612d8b0 2024-02-15T23:30:13.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1757395633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 msgr2=0x5587b61bbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/1757395633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b61bbe20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400a5c0 tx=0x7f0fa401b340 comp rx=0 tx=0).stop 2024-02-15T23:30:13.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1757395633 shutdown_connections 2024-02-15T23:30:13.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/1757395633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b61bbe20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1757395633 >> 172.21.15.133:0/1757395633 conn(0x5587b61b3900 msgr2=0x5587b61b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1757395633 shutdown_connections 2024-02-15T23:30:13.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.251+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1757395633 wait complete. 2024-02-15T23:30:13.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.267+0000 7f0fb41cf980 1 Processor -- start 2024-02-15T23:30:13.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.267+0000 7f0fb41cf980 1 -- start start 2024-02-15T23:30:13.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.267+0000 7f0fb41cf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.267+0000 7f0fb41cf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b60c96b0 con 0x5587b612d8b0 2024-02-15T23:30:13.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35704/0 (socket says 172.21.15.133:35704) 2024-02-15T23:30:13.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 -- 172.21.15.133:0/398252612 learned_addr learned my addr 172.21.15.133:0/398252612 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 -- 172.21.15.133:0/398252612 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4005df0 con 0x5587b612d8b0 2024-02-15T23:30:13.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 --2- 172.21.15.133:0/398252612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a30a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ac040 tx=0x7f0fa4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a85f30c56195ca0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0e9fe07640 1 -- 172.21.15.133:0/398252612 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa40aa9b0 con 0x5587b612d8b0 2024-02-15T23:30:13.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0e9fe07640 1 -- 172.21.15.133:0/398252612 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40aab30 con 0x5587b612d8b0 2024-02-15T23:30:13.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0e9fe07640 1 -- 172.21.15.133:0/398252612 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa40aae10 con 0x5587b612d8b0 2024-02-15T23:30:13.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 -- 172.21.15.133:0/398252612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 msgr2=0x5587b62a30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/398252612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a30a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ac040 tx=0x7f0fa4003030 comp rx=0 tx=0).stop 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 -- 172.21.15.133:0/398252612 shutdown_connections 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/398252612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a30a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 -- 172.21.15.133:0/398252612 >> 172.21.15.133:0/398252612 conn(0x5587b61b3900 msgr2=0x5587b629ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 -- 172.21.15.133:0/398252612 shutdown_connections 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 -- 172.21.15.133:0/398252612 wait complete. 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 Processor -- start 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 -- start start 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb41cf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b60c4e90 con 0x5587b612d8b0 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35714/0 (socket says 172.21.15.133:35714) 2024-02-15T23:30:13.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 -- 172.21.15.133:0/965655181 learned_addr learned my addr 172.21.15.133:0/965655181 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.271+0000 7f0fb1cea640 1 -- 172.21.15.133:0/965655181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b61c0eb0 con 0x5587b612d8b0 2024-02-15T23:30:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb1cea640 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a9d80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4005940 tx=0x7f0fa40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0e9e604640 1 -- 172.21.15.133:0/965655181 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa40c6750 con 0x5587b612d8b0 2024-02-15T23:30:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5587b62aa2c0 con 0x5587b612d8b0 2024-02-15T23:30:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0e9e604640 1 -- 172.21.15.133:0/965655181 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40c68b0 con 0x5587b612d8b0 2024-02-15T23:30:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0e9e604640 1 -- 172.21.15.133:0/965655181 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa40c6b70 con 0x5587b612d8b0 2024-02-15T23:30:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587b62aa6f0 con 0x5587b612d8b0 2024-02-15T23:30:13.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0e9e604640 1 -- 172.21.15.133:0/965655181 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0fa40c6cd0 con 0x5587b612d8b0 2024-02-15T23:30:13.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0e9e604640 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e98034300 0x7f0e980367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0e9e604640 1 -- 172.21.15.133:0/965655181 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0fa40e4380 con 0x5587b612d8b0 2024-02-15T23:30:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb14e9640 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e98034300 0x7f0e980367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b61bc360 0x5587b62b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62b0f50 con 0x5587b61bc360 2024-02-15T23:30:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb24eb640 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b61bc360 0x5587b62b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb14e9640 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e98034300 0x7f0e980367c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8001570 tx=0x7f0fa80066d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb24eb640 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b61bc360 0x5587b62b0a10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb24eb640 1 -- 172.21.15.133:0/965655181 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0fac0083f0 con 0x5587b61bc360 2024-02-15T23:30:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62b12f0 con 0x5587b61bc360 2024-02-15T23:30:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb24eb640 1 -- 172.21.15.133:0/965655181 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0fac0083f0 con 0x5587b61bc360 2024-02-15T23:30:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62b2b70 con 0x5587b61bc360 2024-02-15T23:30:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb24eb640 1 -- 172.21.15.133:0/965655181 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0fac0083f0 con 0x5587b61bc360 2024-02-15T23:30:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.275+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62b1d70 con 0x5587b61bc360 2024-02-15T23:30:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb24eb640 1 -- 172.21.15.133:0/965655181 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0fac0083f0 con 0x5587b61bc360 2024-02-15T23:30:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62b2180 con 0x5587b61bc360 2024-02-15T23:30:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb24eb640 1 -- 172.21.15.133:0/965655181 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0fac012040 con 0x5587b61bc360 2024-02-15T23:30:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb41cf980 1 Processor -- start 2024-02-15T23:30:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb41cf980 1 -- start start 2024-02-15T23:30:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb41cf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62c1250 0x5587b62c1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb41cf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b605df20 con 0x5587b62c1250 2024-02-15T23:30:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb14e9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62c1250 0x5587b62c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb14e9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62c1250 0x5587b62c1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35716/0 (socket says 172.21.15.133:35716) 2024-02-15T23:30:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb14e9640 1 -- 172.21.15.133:0/1412179850 learned_addr learned my addr 172.21.15.133:0/1412179850 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb14e9640 1 -- 172.21.15.133:0/1412179850 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b62c1bb0 con 0x5587b62c1250 2024-02-15T23:30:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb14e9640 1 --2- 172.21.15.133:0/1412179850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62c1250 0x5587b62c1670 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8012630 tx=0x7f0fa8015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0e977fe640 1 -- 172.21.15.133:0/1412179850 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa801a070 con 0x5587b62c1250 2024-02-15T23:30:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1412179850 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5587b62c1e00 con 0x5587b62c1250 2024-02-15T23:30:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0e977fe640 1 -- 172.21.15.133:0/1412179850 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8020560 con 0x5587b62c1250 2024-02-15T23:30:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0e977fe640 1 -- 172.21.15.133:0/1412179850 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa8020840 con 0x5587b62c1250 2024-02-15T23:30:13.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.279+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1412179850 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587b62c2950 con 0x5587b62c1250 2024-02-15T23:30:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0e977fe640 1 -- 172.21.15.133:0/1412179850 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0fa8013420 con 0x5587b62c1250 2024-02-15T23:30:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0e977fe640 1 --2- 172.21.15.133:0/1412179850 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e8c034300 0x7f0e8c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0e977fe640 1 -- 172.21.15.133:0/1412179850 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0fa804b310 con 0x5587b62c1250 2024-02-15T23:30:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb24eb640 1 --2- 172.21.15.133:0/1412179850 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e8c034300 0x7f0e8c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 Processor -- start 2024-02-15T23:30:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- start start 2024-02-15T23:30:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb24eb640 1 --2- 172.21.15.133:0/1412179850 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e8c034300 0x7f0e8c0367c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5587b62b17b0 tx=0x7f0fac003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b6051790 con 0x5587b62ce220 2024-02-15T23:30:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb14e9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb14e9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35724/0 (socket says 172.21.15.133:35724) 2024-02-15T23:30:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb14e9640 1 -- 172.21.15.133:0/574122117 learned_addr learned my addr 172.21.15.133:0/574122117 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb14e9640 1 -- 172.21.15.133:0/574122117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b62cec10 con 0x5587b62ce220 2024-02-15T23:30:13.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb14e9640 1 --2- 172.21.15.133:0/574122117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62ce640 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8049690 tx=0x7f0fa801d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7713ab957edc0f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0e957fa640 1 -- 172.21.15.133:0/574122117 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa8048070 con 0x5587b62ce220 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0e957fa640 1 -- 172.21.15.133:0/574122117 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa801e7e0 con 0x5587b62ce220 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0e957fa640 1 -- 172.21.15.133:0/574122117 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa803b270 con 0x5587b62ce220 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- 172.21.15.133:0/574122117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 msgr2=0x5587b62ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/574122117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62ce640 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8049690 tx=0x7f0fa801d430 comp rx=0 tx=0).stop 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- 172.21.15.133:0/574122117 shutdown_connections 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/574122117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62ce640 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- 172.21.15.133:0/574122117 >> 172.21.15.133:0/574122117 conn(0x5587b62ca5b0 msgr2=0x5587b62c8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- 172.21.15.133:0/574122117 shutdown_connections 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- 172.21.15.133:0/574122117 wait complete. 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 Processor -- start 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- start start 2024-02-15T23:30:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62d51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.283+0000 7f0fb41cf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b62d56e0 con 0x5587b62ce220 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb14e9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62d51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb14e9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62d51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35734/0 (socket says 172.21.15.133:35734) 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 learned_addr learned my addr 172.21.15.133:0/612767516 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b62c2950 con 0x5587b62ce220 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb14e9640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62d51a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0fa801d470 tx=0x7f0fa80495f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0e837fe640 1 -- 172.21.15.133:0/612767516 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa8036070 con 0x5587b62ce220 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5587b62d58e0 con 0x5587b62ce220 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587b62d5d10 con 0x5587b62ce220 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0e837fe640 1 -- 172.21.15.133:0/612767516 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8028cb0 con 0x5587b62ce220 2024-02-15T23:30:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0e837fe640 1 -- 172.21.15.133:0/612767516 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa80285a0 con 0x5587b62ce220 2024-02-15T23:30:13.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0e837fe640 1 -- 172.21.15.133:0/612767516 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0fa801eaa0 con 0x5587b62ce220 2024-02-15T23:30:13.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0e837fe640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e7c0342b0 0x7f0e7c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0e837fe640 1 -- 172.21.15.133:0/612767516 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0fa8008050 con 0x5587b62ce220 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb24eb640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e7c0342b0 0x7f0e7c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b62e05a0 0x5587b62e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e31b0 con 0x5587b62e05a0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb1cea640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b62e05a0 0x5587b62e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb24eb640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e7c0342b0 0x7f0e7c036770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0fac008fd0 tx=0x7f0fac01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb1cea640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b62e05a0 0x5587b62e2a60 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 20 realm 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.287+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e3580 con 0x5587b62e05a0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e3e00 con 0x5587b62e05a0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e4160 con 0x5587b62e05a0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e4960 con 0x5587b62e05a0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 20 searching for the correct realm 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5587b62e67f0 0x5587b62e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb14e9640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5587b62e67f0 0x5587b62e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb14e9640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5587b62e67f0 0x5587b62e8c80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb14e9640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0fa801db90 0x7f0fa8049940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa801db90 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb24eb640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0fa801db90 0x7f0fa8049940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb24eb640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0fa801db90 0x7f0fa8049940 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fac02c040 con 0x7f0fa801db90 2024-02-15T23:30:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa801db90 2024-02-15T23:30:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fac02c040 con 0x7f0fa801db90 2024-02-15T23:30:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e05a0 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e05a0 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.291+0000 7f0fb1cea640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0fa40d0060 0x7f0fa40aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa40d0060 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0fa40d0060 0x7f0fa40aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0fa40d0060 0x7f0fa40aca80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa40d0060 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa801db90 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fac02c040 con 0x7f0fa801db90 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e05a0 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa40d0060 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.295+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e05a0 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa801db90 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0fac02c040 con 0x7f0fa801db90 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa40d0060 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e05a0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e05a0 2024-02-15T23:30:13.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa40d0060 2024-02-15T23:30:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa801db90 2024-02-15T23:30:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fac02c040 con 0x7f0fa801db90 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.299+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e05a0 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa801db90 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fac02c040 con 0x7f0fa801db90 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa40d0060 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa801db90 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e67f0 2024-02-15T23:30:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa40d0060 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x5587b62e05a0 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e9350 con 0x7f0fa801db90 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e5260 con 0x5587b62e05a0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e5a60 con 0x5587b62e05a0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.303+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e5a60 con 0x5587b62e05a0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 zone default found 2024-02-15T23:30:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 4 Realm: () 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 zonegroup default 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62e5a60 con 0x7f0fa801db90 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62eb170 con 0x5587b62e67f0 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62eb520 con 0x5587b62e67f0 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 started sync module instance, tier type = 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62eaa50 con 0x7f0fa801db90 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94041365456304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62eae00 con 0x7f0fa801db90 2024-02-15T23:30:13.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62ec280 con 0x5587b62e05a0 2024-02-15T23:30:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.307+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94041365456304] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.311+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.311+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94041365461312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62ec200 con 0x5587b62e05a0 2024-02-15T23:30:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.311+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62ecc30 con 0x5587b62e67f0 2024-02-15T23:30:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.311+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94041365461312] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.311+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.311+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94041365462368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62ec180 con 0x5587b62e67f0 2024-02-15T23:30:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.311+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62ed950 con 0x7f0fa801db90 2024-02-15T23:30:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.315+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.315+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94041365468640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62ee1a0 con 0x7f0fa801db90 2024-02-15T23:30:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.315+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62eebd0 con 0x5587b62e05a0 2024-02-15T23:30:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.315+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94041365462368] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.315+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94041365468640] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.315+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.315+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94041365473008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62edd00 con 0x5587b62e05a0 2024-02-15T23:30:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.315+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62ef450 con 0x7f0fa40d0060 2024-02-15T23:30:13.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.319+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.319+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94041365473008] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.319+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94041365475248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62edd00 con 0x7f0fa40d0060 2024-02-15T23:30:13.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.319+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62ed030 con 0x7f0fa40d0060 2024-02-15T23:30:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.319+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94041365475248] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.319+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.319+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94041365467184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62efa40 con 0x7f0fa40d0060 2024-02-15T23:30:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.319+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f03b0 con 0x7f0fa40d0060 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94041365467184] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94041365479184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f07d0 con 0x7f0fa40d0060 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 20 add_watcher() i=0 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 20 add_watcher() i=1 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 20 add_watcher() i=2 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 20 add_watcher() i=3 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 20 add_watcher() i=4 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 20 add_watcher() i=5 2024-02-15T23:30:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 20 add_watcher() i=6 2024-02-15T23:30:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94041365479184] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 20 add_watcher() i=7 2024-02-15T23:30:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f07d0 con 0x5587b62e05a0 2024-02-15T23:30:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.323+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94041365480240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f0750 con 0x5587b62e05a0 2024-02-15T23:30:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.327+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94041365480240] v33'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.327+0000 7f0e637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.327+0000 7f0fb41cf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.327+0000 7f0fb41cf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.327+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fbdd0 con 0x5587b62e05a0 2024-02-15T23:30:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.327+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.327+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fc210 con 0x7f0fa40d0060 2024-02-15T23:30:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.331+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'21 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.331+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fc6b0 con 0x5587b62e67f0 2024-02-15T23:30:13.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.331+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.331+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fceb0 con 0x5587b62e05a0 2024-02-15T23:30:13.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.331+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'158 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.335+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f9ed0 con 0x7f0fa801db90 2024-02-15T23:30:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.335+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'47 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.335+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f9ea0 con 0x5587b62e67f0 2024-02-15T23:30:13.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.335+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'31 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.335+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fe090 con 0x5587b62e05a0 2024-02-15T23:30:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.339+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.339+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fe090 con 0x7f0fa40d0060 2024-02-15T23:30:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.339+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.339+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fe090 con 0x7f0fa801db90 2024-02-15T23:30:13.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.343+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.343+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fe5c0 con 0x5587b62e67f0 2024-02-15T23:30:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.343+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.343+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62feaf0 con 0x7f0fa801db90 2024-02-15T23:30:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.347+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'48 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.347+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fdf90 con 0x7f0fa40d0060 2024-02-15T23:30:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.347+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.347+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fdf90 con 0x7f0fa801db90 2024-02-15T23:30:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.351+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.351+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fdf90 con 0x7f0fa40d0060 2024-02-15T23:30:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.351+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'37 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.351+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fdf90 con 0x5587b62e05a0 2024-02-15T23:30:13.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.351+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'159 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.351+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fdf90 con 0x5587b62e67f0 2024-02-15T23:30:13.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.355+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.355+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fed50 con 0x7f0fa801db90 2024-02-15T23:30:13.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.355+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'49 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.355+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fed50 con 0x5587b62e67f0 2024-02-15T23:30:13.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.359+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.359+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fed50 con 0x5587b62e05a0 2024-02-15T23:30:13.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.359+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.359+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x5587b62e05a0 2024-02-15T23:30:13.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.363+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'160 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.363+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x5587b62e67f0 2024-02-15T23:30:13.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.363+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.363+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x7f0fa801db90 2024-02-15T23:30:13.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.367+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.367+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x5587b62e67f0 2024-02-15T23:30:13.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.367+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.367+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x5587b62e67f0 2024-02-15T23:30:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.371+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'26 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.371+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x5587b62e67f0 2024-02-15T23:30:13.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.371+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.371+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x5587b62e67f0 2024-02-15T23:30:13.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.375+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.375+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x7f0fa40d0060 2024-02-15T23:30:13.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.375+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.375+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x5587b62e67f0 2024-02-15T23:30:13.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.379+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.379+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x7f0fa40d0060 2024-02-15T23:30:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.383+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.383+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x5587b62e67f0 2024-02-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.383+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'43 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.383+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x7f0fa40d0060 2024-02-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.387+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'38 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.387+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62fecc0 con 0x7f0fa801db90 2024-02-15T23:30:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.387+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0e627fc640 20 reqs_thread_entry: start 2024-02-15T23:30:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 20 Filter name: none 2024-02-15T23:30:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0dd3fff640 20 reqs_thread_entry: start 2024-02-15T23:30:13.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-02-15T23:30:13.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:94 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(94 gc.17 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:95 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(95 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:96 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e67f0 2024-02-15T23:30:13.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(96 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== osd_op_reply(97 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.391+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:98 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.395+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(98 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.395+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.395+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:99 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.395+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 31 ==== osd_op_reply(99 gc.17 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.395+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-02-15T23:30:13.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.395+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:100 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(100 gc.18 [call] v33'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:101 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(101 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:102 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e05a0 2024-02-15T23:30:13.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(102 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:103 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(103 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:104 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(104 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.399+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:105 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(105 gc.18 [call] v33'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-02-15T23:30:13.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:106 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(106 gc.19 [call] v33'161 uv161 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:107 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(107 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:108 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e05a0 2024-02-15T23:30:13.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(108 gc.19 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:109 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 38 ==== osd_op_reply(109 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:110 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 39 ==== osd_op_reply(110 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.403+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:111 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 40 ==== osd_op_reply(111 gc.19 [call] v33'162 uv162 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-02-15T23:30:13.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:112 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 32 ==== osd_op_reply(112 gc.20 [call] v33'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:113 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 33 ==== osd_op_reply(113 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:114 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e67f0 2024-02-15T23:30:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 34 ==== osd_op_reply(114 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.407+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:115 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 35 ==== osd_op_reply(115 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:116 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 36 ==== osd_op_reply(116 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:117 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 37 ==== osd_op_reply(117 gc.20 [call] v33'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-02-15T23:30:13.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:118 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(118 gc.21 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.411+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:119 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(119 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:120 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x7f0fa801db90 2024-02-15T23:30:13.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(120 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:121 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 24 ==== osd_op_reply(121 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:122 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 25 ==== osd_op_reply(122 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:123 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 26 ==== osd_op_reply(123 gc.21 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-02-15T23:30:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.415+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:124 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 38 ==== osd_op_reply(124 gc.22 [call] v33'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:125 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 39 ==== osd_op_reply(125 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:126 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e67f0 2024-02-15T23:30:13.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 40 ==== osd_op_reply(126 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:127 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 41 ==== osd_op_reply(127 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:128 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 42 ==== osd_op_reply(128 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:129 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 43 ==== osd_op_reply(129 gc.22 [call] v33'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-02-15T23:30:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.419+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:130 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 44 ==== osd_op_reply(130 gc.23 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:131 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 45 ==== osd_op_reply(131 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:132 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e67f0 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 46 ==== osd_op_reply(132 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:133 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 47 ==== osd_op_reply(133 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:134 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 48 ==== osd_op_reply(134 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:135 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 49 ==== osd_op_reply(135 gc.23 [call] v33'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-02-15T23:30:13.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.423+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:136 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 50 ==== osd_op_reply(136 gc.24 [call] v33'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:137 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 51 ==== osd_op_reply(137 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:138 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e67f0 2024-02-15T23:30:13.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 52 ==== osd_op_reply(138 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:139 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 53 ==== osd_op_reply(139 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:140 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 54 ==== osd_op_reply(140 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.427+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:141 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 55 ==== osd_op_reply(141 gc.24 [call] v33'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-02-15T23:30:13.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:142 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 56 ==== osd_op_reply(142 gc.25 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:143 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 57 ==== osd_op_reply(143 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:144 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e67f0 2024-02-15T23:30:13.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 58 ==== osd_op_reply(144 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:145 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 59 ==== osd_op_reply(145 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:146 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 60 ==== osd_op_reply(146 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.431+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:147 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.435+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 61 ==== osd_op_reply(147 gc.25 [call] v33'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.435+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-02-15T23:30:13.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.435+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:148 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.435+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(148 gc.26 [call] v33'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.435+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:149 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(149 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:150 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x7f0fa40d0060 2024-02-15T23:30:13.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(150 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:151 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(151 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:152 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(152 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.439+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:153 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.443+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(153 gc.26 [call] v33'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.443+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-02-15T23:30:13.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.443+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:154 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 62 ==== osd_op_reply(154 gc.27 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:155 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 63 ==== osd_op_reply(155 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:156 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e67f0 2024-02-15T23:30:13.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 64 ==== osd_op_reply(156 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:157 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 65 ==== osd_op_reply(157 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:158 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 66 ==== osd_op_reply(158 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:159 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 67 ==== osd_op_reply(159 gc.27 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-02-15T23:30:13.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.447+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:160 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.451+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(160 gc.28 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.451+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:161 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.451+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(161 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.451+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.451+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:162 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x7f0fa40d0060 2024-02-15T23:30:13.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.451+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(162 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.451+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:163 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.455+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== osd_op_reply(163 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.455+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.455+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:164 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.455+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(164 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.455+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.455+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:165 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.459+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== osd_op_reply(165 gc.28 [call] v33'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.459+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-02-15T23:30:13.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.459+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:166 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.459+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 68 ==== osd_op_reply(166 gc.29 [call] v33'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.459+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:167 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 69 ==== osd_op_reply(167 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:168 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e67f0 2024-02-15T23:30:13.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 70 ==== osd_op_reply(168 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:169 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 71 ==== osd_op_reply(169 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:170 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 72 ==== osd_op_reply(170 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:171 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 73 ==== osd_op_reply(171 gc.29 [call] v33'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-02-15T23:30:13.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.463+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:172 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.467+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(172 gc.30 [call] v33'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.467+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:173 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.467+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(173 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.467+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.467+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:174 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x7f0fa40d0060 2024-02-15T23:30:13.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.471+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== osd_op_reply(174 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.471+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:175 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.471+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(175 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.471+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.471+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:176 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.471+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(176 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.471+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.471+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:177 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.475+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== osd_op_reply(177 gc.30 [call] v33'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.475+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-02-15T23:30:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.475+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:178 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 27 ==== osd_op_reply(178 gc.31 [call] v33'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:179 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 28 ==== osd_op_reply(179 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:180 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x7f0fa801db90 2024-02-15T23:30:13.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 29 ==== osd_op_reply(180 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:181 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 30 ==== osd_op_reply(181 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:182 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 31 ==== osd_op_reply(182 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.479+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:183 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa801db90 2024-02-15T23:30:13.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.483+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 32 ==== osd_op_reply(183 gc.31 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.483+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-02-15T23:30:13.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.483+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:184 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.483+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 41 ==== osd_op_reply(184 gc.0 [call] v33'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.483+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:185 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 42 ==== osd_op_reply(185 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:186 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x5587b62e05a0 2024-02-15T23:30:13.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 43 ==== osd_op_reply(186 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:187 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 44 ==== osd_op_reply(187 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:188 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 45 ==== osd_op_reply(188 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:189 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e05a0 2024-02-15T23:30:13.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 46 ==== osd_op_reply(189 gc.0 [call] v33'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-02-15T23:30:13.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.487+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:190 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.491+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== osd_op_reply(190 gc.1 [call] v33'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.491+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:191 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.491+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 40 ==== osd_op_reply(191 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.491+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.491+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:192 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8740 con 0x7f0fa40d0060 2024-02-15T23:30:13.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 41 ==== osd_op_reply(192 gc.1 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:193 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 42 ==== osd_op_reply(193 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:194 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 43 ==== osd_op_reply(194 gc.1 [call out=1702b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+1702 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-02-15T23:30:13.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 20 garbage collection: RGWGC::process iterating over entry tag='cd69b486-4810-48ae-b5d4-5bce307169d4.4227.13888963804196711838', time=2024-02-15T23:30:12.912939+0000, chain.objs.size()=7 2024-02-15T23:30:13.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_1 2024-02-15T23:30:13.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:195 3.17s0 3:e8bab9d6:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a8a0 con 0x5587b62e05a0 2024-02-15T23:30:13.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_2 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:196 3.1bs0 3:dad984af:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d160 con 0x5587b62e67f0 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_3 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:197 3.5s0 3:a080168c:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631faa0 con 0x7f0fa801db90 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_4 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:198 3.39s0 3:9d8ee2e0:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b63223c0 con 0x5587b62e67f0 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_5 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:199 3.10s0 3:099750ea:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631faa0 con 0x5587b62e05a0 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_6 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:200 3.33s0 3:cf2eaac4:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6327150 con 0x7f0fa40d0060 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_7 2024-02-15T23:30:13.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.495+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:201 3.es0 3:710b70ad:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6327150 con 0x7f0fa801db90 2024-02-15T23:30:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.503+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 47 ==== osd_op_reply(195 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_1 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.507+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 48 ==== osd_op_reply(199 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_5 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.507+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 44 ==== osd_op_reply(200 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_6 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.507+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 74 ==== osd_op_reply(196 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_2 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.507+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 75 ==== osd_op_reply(198 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_4 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.507+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 33 ==== osd_op_reply(197 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_3 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.507+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 34 ==== osd_op_reply(201 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.1__shadow_.HhHBITN_IhFYMlwCejC2qhypBzsWrdN_7 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.507+0000 7f0fb41cf980 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-15T23:30:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.507+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:202 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.515+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 45 ==== osd_op_reply(202 gc.1 [call] v33'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.515+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:203 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x7f0fa40d0060 2024-02-15T23:30:13.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.515+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 46 ==== osd_op_reply(203 gc.1 [call] v33'24 uv24 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.515+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-02-15T23:30:13.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.515+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:204 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631a400 con 0x5587b62e67f0 2024-02-15T23:30:13.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 76 ==== osd_op_reply(204 gc.2 [call] v33'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:205 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d5e0 con 0x5587b62e67f0 2024-02-15T23:30:13.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 77 ==== osd_op_reply(205 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:206 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 78 ==== osd_op_reply(206 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:207 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d5e0 con 0x5587b62e67f0 2024-02-15T23:30:13.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 79 ==== osd_op_reply(207 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.519+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:208 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d5e0 con 0x5587b62e67f0 2024-02-15T23:30:13.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.523+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 80 ==== osd_op_reply(208 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.523+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.523+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:209 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d5e0 con 0x5587b62e67f0 2024-02-15T23:30:13.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.523+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 81 ==== osd_op_reply(209 gc.2 [call] v33'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.523+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-02-15T23:30:13.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.523+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:210 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 49 ==== osd_op_reply(210 gc.3 [call] v33'163 uv163 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:211 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 50 ==== osd_op_reply(211 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:212 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 51 ==== osd_op_reply(212 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:213 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 52 ==== osd_op_reply(213 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:214 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 53 ==== osd_op_reply(214 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.527+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:215 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 54 ==== osd_op_reply(215 gc.3 [call] v33'164 uv164 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-02-15T23:30:13.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:216 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 35 ==== osd_op_reply(216 gc.4 [call] v33'50 uv50 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:217 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 36 ==== osd_op_reply(217 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:218 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 37 ==== osd_op_reply(218 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.531+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:219 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 38 ==== osd_op_reply(219 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:220 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 39 ==== osd_op_reply(220 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:221 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 40 ==== osd_op_reply(221 gc.4 [call] v33'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-02-15T23:30:13.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.535+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:222 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e67f0 2024-02-15T23:30:13.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 82 ==== osd_op_reply(222 gc.5 [call] v33'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:223 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e67f0 2024-02-15T23:30:13.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 83 ==== osd_op_reply(223 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:224 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 84 ==== osd_op_reply(224 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:225 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 85 ==== osd_op_reply(225 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:226 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 86 ==== osd_op_reply(226 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.539+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:227 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e67f0 2024-02-15T23:30:13.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.543+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 87 ==== osd_op_reply(227 gc.5 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.543+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-02-15T23:30:13.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.543+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:228 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.543+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 55 ==== osd_op_reply(228 gc.6 [call] v33'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.543+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:229 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 56 ==== osd_op_reply(229 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:230 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 57 ==== osd_op_reply(230 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:231 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 58 ==== osd_op_reply(231 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:232 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 59 ==== osd_op_reply(232 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:233 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e05a0 2024-02-15T23:30:13.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 60 ==== osd_op_reply(233 gc.6 [call] v33'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-02-15T23:30:13.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.547+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:234 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa40d0060 2024-02-15T23:30:13.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.551+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 47 ==== osd_op_reply(234 gc.7 [call] v33'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.551+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:235 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa40d0060 2024-02-15T23:30:13.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.551+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 48 ==== osd_op_reply(235 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.551+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.551+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:236 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa40d0060 2024-02-15T23:30:13.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.555+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 49 ==== osd_op_reply(236 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.555+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:237 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa40d0060 2024-02-15T23:30:13.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.555+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 50 ==== osd_op_reply(237 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.555+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.555+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:238 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa40d0060 2024-02-15T23:30:13.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.555+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 51 ==== osd_op_reply(238 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.555+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.555+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:239 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa40d0060 2024-02-15T23:30:13.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.559+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 52 ==== osd_op_reply(239 gc.7 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.559+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-02-15T23:30:13.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.559+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:240 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.559+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 41 ==== osd_op_reply(240 gc.8 [call] v33'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.559+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:241 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 42 ==== osd_op_reply(241 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:242 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 43 ==== osd_op_reply(242 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:243 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 44 ==== osd_op_reply(243 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:244 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 45 ==== osd_op_reply(244 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:245 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x7f0fa801db90 2024-02-15T23:30:13.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 46 ==== osd_op_reply(245 gc.8 [call] v33'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-02-15T23:30:13.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.563+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:246 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e67f0 2024-02-15T23:30:13.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 88 ==== osd_op_reply(246 gc.9 [call] v33'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:247 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b6322720 con 0x5587b62e67f0 2024-02-15T23:30:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 89 ==== osd_op_reply(247 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:248 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 90 ==== osd_op_reply(248 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:249 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 91 ==== osd_op_reply(249 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.567+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:250 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.571+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 92 ==== osd_op_reply(250 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.571+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.571+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:251 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e67f0 2024-02-15T23:30:13.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.571+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 93 ==== osd_op_reply(251 gc.9 [call] v33'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.571+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-02-15T23:30:13.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.571+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:252 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 47 ==== osd_op_reply(252 gc.10 [call] v33'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:253 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 48 ==== osd_op_reply(253 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:254 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 49 ==== osd_op_reply(254 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:255 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 50 ==== osd_op_reply(255 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:256 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 51 ==== osd_op_reply(256 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.575+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:257 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.579+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 52 ==== osd_op_reply(257 gc.10 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.579+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-02-15T23:30:13.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.579+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:258 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.579+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 53 ==== osd_op_reply(258 gc.11 [call] v33'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.579+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:259 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 54 ==== osd_op_reply(259 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:260 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 55 ==== osd_op_reply(260 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:261 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 56 ==== osd_op_reply(261 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:262 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 57 ==== osd_op_reply(262 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.583+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:263 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.587+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 58 ==== osd_op_reply(263 gc.11 [call] v33'25 uv25 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.587+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-02-15T23:30:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.587+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:264 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 53 ==== osd_op_reply(264 gc.12 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:265 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 54 ==== osd_op_reply(265 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:266 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 55 ==== osd_op_reply(266 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:267 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 56 ==== osd_op_reply(267 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:268 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 57 ==== osd_op_reply(268 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.591+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:269 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.595+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 58 ==== osd_op_reply(269 gc.12 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.595+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-02-15T23:30:13.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.595+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:270 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.599+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 59 ==== osd_op_reply(270 gc.13 [call] v33'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.599+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:271 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.599+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 60 ==== osd_op_reply(271 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.599+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.599+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:272 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.599+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 61 ==== osd_op_reply(272 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.599+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:273 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.603+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 62 ==== osd_op_reply(273 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.603+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.603+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:274 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.603+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 63 ==== osd_op_reply(274 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.603+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.603+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:275 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.607+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 64 ==== osd_op_reply(275 gc.13 [call] v33'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.607+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-02-15T23:30:13.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.607+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:276 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 61 ==== osd_op_reply(276 gc.14 [call] v33'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:277 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 62 ==== osd_op_reply(277 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:278 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 63 ==== osd_op_reply(278 gc.14 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:279 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 64 ==== osd_op_reply(279 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:280 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 65 ==== osd_op_reply(280 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.611+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:281 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.615+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 66 ==== osd_op_reply(281 gc.14 [call] v33'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.615+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-02-15T23:30:13.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.615+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:282 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e67f0 2024-02-15T23:30:13.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 94 ==== osd_op_reply(282 gc.15 [call] v33'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:283 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e67f0 2024-02-15T23:30:13.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 95 ==== osd_op_reply(283 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:284 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 96 ==== osd_op_reply(284 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:285 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 97 ==== osd_op_reply(285 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:286 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b62f8410 con 0x5587b62e67f0 2024-02-15T23:30:13.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 98 ==== osd_op_reply(286 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.619+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:287 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e67f0 2024-02-15T23:30:13.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.623+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 99 ==== osd_op_reply(287 gc.15 [call] v33'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.623+0000 7f0fb41cf980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-02-15T23:30:13.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.623+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:288 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.623+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 59 ==== osd_op_reply(288 gc.16 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.623+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:289 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 60 ==== osd_op_reply(289 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:290 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 61 ==== osd_op_reply(290 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:291 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 62 ==== osd_op_reply(291 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:30:13.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:292 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 63 ==== osd_op_reply(292 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb41cf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:30:13.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.627+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:293 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.631+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 64 ==== osd_op_reply(293 gc.16 [call] v33'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.631+0000 7f0e637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:13.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.631+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94041365480240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.631+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 67 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94041365480240] v33'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.631+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94041365456304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.635+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94041365456304] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.635+0000 7f0fb41cf980 20 remove_watcher() i=0 2024-02-15T23:30:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.635+0000 7f0fb41cf980 2 removed watcher, disabling cache 2024-02-15T23:30:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.635+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94041365461312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.639+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 68 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94041365461312] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.639+0000 7f0fb41cf980 20 remove_watcher() i=1 2024-02-15T23:30:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.639+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94041365462368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e67f0 2024-02-15T23:30:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.639+0000 7f0fb14e9640 1 -- 172.21.15.133:0/612767516 <== osd.3 v2:172.21.15.133:6816/1056376173 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94041365462368] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa8038070 con 0x5587b62e67f0 2024-02-15T23:30:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.639+0000 7f0fb41cf980 20 remove_watcher() i=2 2024-02-15T23:30:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.639+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94041365468640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa801db90 2024-02-15T23:30:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.643+0000 7f0fb24eb640 1 -- 172.21.15.133:0/612767516 <== osd.2 v2:172.21.15.133:6808/3615800201 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94041365468640] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fac03c040 con 0x7f0fa801db90 2024-02-15T23:30:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.643+0000 7f0fb41cf980 20 remove_watcher() i=3 2024-02-15T23:30:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.643+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94041365473008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x5587b62e05a0 2024-02-15T23:30:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.643+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.1 v2:172.21.15.133:6800/2918336019 69 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94041365473008] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x5587b62e05a0 2024-02-15T23:30:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.643+0000 7f0fb41cf980 20 remove_watcher() i=4 2024-02-15T23:30:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.643+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94041365475248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.647+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94041365475248] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.647+0000 7f0fb41cf980 20 remove_watcher() i=5 2024-02-15T23:30:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.647+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94041365467184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.647+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94041365467184] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.647+0000 7f0fb41cf980 20 remove_watcher() i=6 2024-02-15T23:30:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.647+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94041365479184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5587b631d570 con 0x7f0fa40d0060 2024-02-15T23:30:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 <== osd.0 v2:172.21.15.131:6800/31994139 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94041365479184] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fa40b0020 con 0x7f0fa40d0060 2024-02-15T23:30:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 20 remove_watcher() i=7 2024-02-15T23:30:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0fa40d0060 msgr2=0x7f0fa40aca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0fa40d0060 0x7f0fa40aca80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b62e05a0 msgr2=0x5587b62e2a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b62e05a0 0x5587b62e2a60 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0fa801db90 msgr2=0x7f0fa8049940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0fa801db90 0x7f0fa8049940 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5587b62e67f0 msgr2=0x5587b62e8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5587b62e67f0 0x5587b62e8c80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e7c0342b0 msgr2=0x7f0e7c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e7c0342b0 0x7f0e7c036770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0fac008fd0 tx=0x7f0fac01c070 comp rx=0 tx=0).stop 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb1cea640 1 -- 172.21.15.133:0/612767516 reap_dead start 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 msgr2=0x5587b62d51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62d51a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0fa801d470 tx=0x7f0fa80495f0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 shutdown_connections 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/612767516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62ce220 0x5587b62d51a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 >> 172.21.15.133:0/612767516 conn(0x5587b62ca5b0 msgr2=0x5587b62c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 shutdown_connections 2024-02-15T23:30:13.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.651+0000 7f0fb41cf980 1 -- 172.21.15.133:0/612767516 wait complete. 2024-02-15T23:30:13.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1412179850 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e8c034300 msgr2=0x7f0e8c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/1412179850 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e8c034300 0x7f0e8c0367c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5587b62b17b0 tx=0x7f0fac003070 comp rx=0 tx=0).stop 2024-02-15T23:30:13.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1412179850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62c1250 msgr2=0x5587b62c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/1412179850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62c1250 0x5587b62c1670 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8012630 tx=0x7f0fa8015f90 comp rx=0 tx=0).stop 2024-02-15T23:30:13.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1412179850 shutdown_connections 2024-02-15T23:30:13.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/1412179850 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e8c034300 0x7f0e8c0367c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/1412179850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b62c1250 0x5587b62c1670 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1412179850 >> 172.21.15.133:0/1412179850 conn(0x5587b62b6060 msgr2=0x5587b62b6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1412179850 shutdown_connections 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/1412179850 wait complete. 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b61bc360 msgr2=0x5587b62b0a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b61bc360 0x5587b62b0a10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e98034300 msgr2=0x7f0e980367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e98034300 0x7f0e980367c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8001570 tx=0x7f0fa80066d0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 msgr2=0x5587b62a9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a9d80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4005940 tx=0x7f0fa40180e0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 shutdown_connections 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5587b61bc360 0x5587b62b0a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0e98034300 0x7f0e980367c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 --2- 172.21.15.133:0/965655181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587b612d8b0 0x5587b62a9d80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 >> 172.21.15.133:0/965655181 conn(0x5587b61b3900 msgr2=0x5587b629d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 shutdown_connections 2024-02-15T23:30:13.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.655+0000 7f0fb41cf980 1 -- 172.21.15.133:0/965655181 wait complete. 2024-02-15T23:30:13.679 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-15T23:30:13.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-15T23:30:13.680 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-15T23:30:13.757 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:13.757 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd5862bc980 1 Processor -- start 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd5862bc980 1 -- start start 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd5862bc980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55d982946950 0x55d982948d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd5862bc980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d98288c4c0 con 0x55d9828b48c0 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd5862bc980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d982853180 con 0x55d982946950 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd5835d6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55d982946950 0x55d982948d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd583dd7640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55d9828b48c0 0x55d982945230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:60348/0 (socket says 172.21.15.133:60348) 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd583dd7640 1 -- 172.21.15.133:0/1857700376 learned_addr learned my addr 172.21.15.133:0/1857700376 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd5835d6640 1 -- 172.21.15.133:0/1857700376 >> v1:172.21.15.131:6789/0 conn(0x55d9828b48c0 legacy=0x55d982945230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.751+0000 7fd5835d6640 1 -- 172.21.15.133:0/1857700376 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d982940c50 con 0x55d982946950 2024-02-15T23:30:13.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd5835d6640 1 --2- 172.21.15.133:0/1857700376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982946950 0x55d982948d40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00a480 tx=0x7fd56c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df32e9859254b05 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd582dd5640 1 -- 172.21.15.133:0/1857700376 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0ab540 con 0x55d982946950 2024-02-15T23:30:13.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd582dd5640 1 -- 172.21.15.133:0/1857700376 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c0ab6a0 con 0x55d982946950 2024-02-15T23:30:13.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd582dd5640 1 -- 172.21.15.133:0/1857700376 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0ab960 con 0x55d982946950 2024-02-15T23:30:13.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd5862bc980 1 -- 172.21.15.133:0/1857700376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982946950 msgr2=0x55d982948d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1857700376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982946950 0x55d982948d40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00a480 tx=0x7fd56c01b280 comp rx=0 tx=0).stop 2024-02-15T23:30:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd5862bc980 1 -- 172.21.15.133:0/1857700376 shutdown_connections 2024-02-15T23:30:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1857700376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982946950 0x55d982948d40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd5862bc980 1 -- 172.21.15.133:0/1857700376 >> 172.21.15.133:0/1857700376 conn(0x55d98293a910 msgr2=0x55d98293cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd5862bc980 1 -- 172.21.15.133:0/1857700376 shutdown_connections 2024-02-15T23:30:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.755+0000 7fd5862bc980 1 -- 172.21.15.133:0/1857700376 wait complete. 2024-02-15T23:30:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd5862bc980 1 Processor -- start 2024-02-15T23:30:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd5862bc980 1 -- start start 2024-02-15T23:30:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd5862bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a2c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd5862bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9828506b0 con 0x55d9828b48c0 2024-02-15T23:30:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd583dd7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a2c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd583dd7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a2c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35760/0 (socket says 172.21.15.133:35760) 2024-02-15T23:30:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd583dd7640 1 -- 172.21.15.133:0/3994485193 learned_addr learned my addr 172.21.15.133:0/3994485193 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd583dd7640 1 -- 172.21.15.133:0/3994485193 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c005d30 con 0x55d9828b48c0 2024-02-15T23:30:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd583dd7640 1 --2- 172.21.15.133:0/3994485193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a2c280 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd574006fb0 tx=0x7fd574001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0b816e2890096c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.771+0000 7fd471e0b640 1 -- 172.21.15.133:0/3994485193 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd574004530 con 0x55d9828b48c0 2024-02-15T23:30:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd471e0b640 1 -- 172.21.15.133:0/3994485193 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd574004690 con 0x55d9828b48c0 2024-02-15T23:30:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd471e0b640 1 -- 172.21.15.133:0/3994485193 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5740049b0 con 0x55d9828b48c0 2024-02-15T23:30:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- 172.21.15.133:0/3994485193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 msgr2=0x55d982a2c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 --2- 172.21.15.133:0/3994485193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a2c280 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd574006fb0 tx=0x7fd574001940 comp rx=0 tx=0).stop 2024-02-15T23:30:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- 172.21.15.133:0/3994485193 shutdown_connections 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 --2- 172.21.15.133:0/3994485193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a2c280 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- 172.21.15.133:0/3994485193 >> 172.21.15.133:0/3994485193 conn(0x55d98293a910 msgr2=0x55d982a27e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- 172.21.15.133:0/3994485193 shutdown_connections 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- 172.21.15.133:0/3994485193 wait complete. 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 Processor -- start 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- start start 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a330d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d98284be90 con 0x55d9828b48c0 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd583dd7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a330d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd583dd7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a330d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35772/0 (socket says 172.21.15.133:35772) 2024-02-15T23:30:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd583dd7640 1 -- 172.21.15.133:0/2657797054 learned_addr learned my addr 172.21.15.133:0/2657797054 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd583dd7640 1 -- 172.21.15.133:0/2657797054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d98288c4c0 con 0x55d9828b48c0 2024-02-15T23:30:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd583dd7640 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a330d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55d982a2d110 tx=0x7fd574000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd46bfff640 1 -- 172.21.15.133:0/2657797054 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd574013760 con 0x55d9828b48c0 2024-02-15T23:30:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd46bfff640 1 -- 172.21.15.133:0/2657797054 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5740138c0 con 0x55d9828b48c0 2024-02-15T23:30:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd46bfff640 1 -- 172.21.15.133:0/2657797054 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd574013b60 con 0x55d9828b48c0 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d982a33610 con 0x55d9828b48c0 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.775+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d982a33a60 con 0x55d9828b48c0 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd46bfff640 1 -- 172.21.15.133:0/2657797054 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd574028460 con 0x55d9828b48c0 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd46bfff640 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd46c0342b0 0x7fd46c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd46bfff640 1 -- 172.21.15.133:0/2657797054 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd5740495e0 con 0x55d9828b48c0 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5835d6640 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd46c0342b0 0x7fd46c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982946950 0x55d982a39d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a3a2a0 con 0x55d982946950 2024-02-15T23:30:13.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5845d8640 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982946950 0x55d982a39d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5835d6640 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd46c0342b0 0x7fd46c036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0ad000 tx=0x7fd56c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5845d8640 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982946950 0x55d982a39d60 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5845d8640 1 -- 172.21.15.133:0/2657797054 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd57c0083f0 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a3a690 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5845d8640 1 -- 172.21.15.133:0/2657797054 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd57c0083f0 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a3bf40 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5845d8640 1 -- 172.21.15.133:0/2657797054 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd57c0083f0 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a3b140 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5845d8640 1 -- 172.21.15.133:0/2657797054 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd57c0083f0 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a3b550 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5845d8640 1 -- 172.21.15.133:0/2657797054 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd57c012040 con 0x55d982946950 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 Processor -- start 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 -- start start 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a4a5e0 0x55d982a4aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.779+0000 7fd5862bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9827e4f20 con 0x55d982a4a5e0 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5835d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a4a5e0 0x55d982a4aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5835d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a4a5e0 0x55d982a4aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35776/0 (socket says 172.21.15.133:35776) 2024-02-15T23:30:13.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5835d6640 1 -- 172.21.15.133:0/1681583200 learned_addr learned my addr 172.21.15.133:0/1681583200 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5835d6640 1 -- 172.21.15.133:0/1681583200 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d982a4af40 con 0x55d982a4a5e0 2024-02-15T23:30:13.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5835d6640 1 --2- 172.21.15.133:0/1681583200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a4a5e0 0x55d982a4aa00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd56c096e80 tx=0x7fd56c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd4697fa640 1 -- 172.21.15.133:0/1681583200 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0bd8a0 con 0x55d982a4a5e0 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd4697fa640 1 -- 172.21.15.133:0/1681583200 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c0bda00 con 0x55d982a4a5e0 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5862bc980 1 -- 172.21.15.133:0/1681583200 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d982a4b130 con 0x55d982a4a5e0 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd4697fa640 1 -- 172.21.15.133:0/1681583200 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0bdca0 con 0x55d982a4a5e0 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5862bc980 1 -- 172.21.15.133:0/1681583200 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d982a4bc80 con 0x55d982a4a5e0 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd4697fa640 1 -- 172.21.15.133:0/1681583200 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd56c0be480 con 0x55d982a4a5e0 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd4697fa640 1 --2- 172.21.15.133:0/1681583200 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd45c0342b0 0x7fd45c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd4697fa640 1 -- 172.21.15.133:0/1681583200 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd56c0e6400 con 0x55d982a4a5e0 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5845d8640 1 --2- 172.21.15.133:0/1681583200 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd45c0342b0 0x7fd45c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5862bc980 1 Processor -- start 2024-02-15T23:30:13.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5862bc980 1 -- start start 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5845d8640 1 --2- 172.21.15.133:0/1681583200 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd45c0342b0 0x7fd45c036770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55d982a3ab80 tx=0x7fd57c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5862bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5862bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9827d8790 con 0x55d982a57610 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5835d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5835d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35784/0 (socket says 172.21.15.133:35784) 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.783+0000 7fd5835d6640 1 -- 172.21.15.133:0/2266197604 learned_addr learned my addr 172.21.15.133:0/2266197604 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5835d6640 1 -- 172.21.15.133:0/2266197604 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d982a57fc0 con 0x55d982a57610 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5835d6640 1 --2- 172.21.15.133:0/2266197604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a579f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0e4780 tx=0x7fd56c0aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e35509163c7f5a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd462ffd640 1 -- 172.21.15.133:0/2266197604 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0064c0 con 0x55d982a57610 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd462ffd640 1 -- 172.21.15.133:0/2266197604 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c0be730 con 0x55d982a57610 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd462ffd640 1 -- 172.21.15.133:0/2266197604 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0b4c50 con 0x55d982a57610 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- 172.21.15.133:0/2266197604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 msgr2=0x55d982a579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2266197604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a579f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0e4780 tx=0x7fd56c0aae30 comp rx=0 tx=0).stop 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- 172.21.15.133:0/2266197604 shutdown_connections 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2266197604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a579f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- 172.21.15.133:0/2266197604 >> 172.21.15.133:0/2266197604 conn(0x55d982a53950 msgr2=0x55d982a519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- 172.21.15.133:0/2266197604 shutdown_connections 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- 172.21.15.133:0/2266197604 wait complete. 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 Processor -- start 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- start start 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a5e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d982a5e9f0 con 0x55d982a57610 2024-02-15T23:30:13.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5835d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a5e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5835d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a5e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35800/0 (socket says 172.21.15.133:35800) 2024-02-15T23:30:13.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 learned_addr learned my addr 172.21.15.133:0/1906414397 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:13.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d982a4bc80 con 0x55d982a57610 2024-02-15T23:30:13.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5835d6640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a5e4b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd56c007000 tx=0x7fd56c0e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd4617fa640 1 -- 172.21.15.133:0/1906414397 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0d5050 con 0x55d982a57610 2024-02-15T23:30:13.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d982a5ebf0 con 0x55d982a57610 2024-02-15T23:30:13.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd4617fa640 1 -- 172.21.15.133:0/1906414397 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c0d6040 con 0x55d982a57610 2024-02-15T23:30:13.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd4617fa640 1 -- 172.21.15.133:0/1906414397 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0068e0 con 0x55d982a57610 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.787+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d982a5efc0 con 0x55d982a57610 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd4617fa640 1 -- 172.21.15.133:0/1906414397 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd56c0b4c50 con 0x55d982a57610 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd4617fa640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd44c034260 0x7fd44c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd4617fa640 1 -- 172.21.15.133:0/1906414397 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd56c0ddd30 con 0x55d982a57610 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5845d8640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd44c034260 0x7fd44c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982a69aa0 0x55d982a6bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a6c6b0 con 0x55d982a69aa0 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd583dd7640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982a69aa0 0x55d982a6bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5845d8640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd44c034260 0x7fd44c036720 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd57c008fd0 tx=0x7fd57c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd583dd7640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982a69aa0 0x55d982a6bf60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 realm 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a6ca80 con 0x55d982a69aa0 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a6d2d0 con 0x55d982a69aa0 2024-02-15T23:30:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a6d630 con 0x55d982a69aa0 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a6cf70 con 0x55d982a69aa0 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 20 searching for the correct realm 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d982a6f880 0x55d982a71cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5835d6640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d982a6f880 0x55d982a71cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.791+0000 7fd5835d6640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d982a6f880 0x55d982a71cb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5835d6640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd56c0ef070 0x7fd56c0bc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd56c0ef070 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5845d8640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd56c0ef070 0x7fd56c0bc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5845d8640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd56c0ef070 0x7fd56c0bc530 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd57c02c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd56c0ef070 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd57c02c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a69aa0 2024-02-15T23:30:13.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a69aa0 2024-02-15T23:30:13.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd574049050 0x7fd574007a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:13.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd574049050 2024-02-15T23:30:13.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd574049050 0x7fd574007a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd574049050 0x7fd574007a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.795+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd574049050 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd56c0ef070 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd57c02c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a69aa0 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd574049050 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a69aa0 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd56c0ef070 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd57c02c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.799+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd574049050 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a69aa0 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a69aa0 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd574049050 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd56c0ef070 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd57c02c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a69aa0 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd56c0ef070 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd57c02c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.803+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd574049050 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd56c0ef070 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a6f880 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd574049050 2024-02-15T23:30:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x55d982a69aa0 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a72380 con 0x7fd56c0ef070 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a6e4a0 con 0x55d982a69aa0 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a6e120 con 0x55d982a69aa0 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a6ede0 con 0x55d982a69aa0 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 zone default found 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 4 Realm: () 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 zonegroup default 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.807+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a727c0 con 0x7fd56c0ef070 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a74640 con 0x55d982a6f880 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a749a0 con 0x55d982a6f880 2024-02-15T23:30:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 20 started sync module instance, tier type = 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73c10 con 0x7fd56c0ef070 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94392688263104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73c10 con 0x7fd56c0ef070 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a75310 con 0x55d982a69aa0 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.811+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94392688263104] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.815+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.815+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94392688267168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73c10 con 0x55d982a69aa0 2024-02-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.815+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a75cd0 con 0x55d982a6f880 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.815+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94392688267168] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.815+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.815+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94392688260976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73b90 con 0x55d982a6f880 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.815+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a76a00 con 0x7fd56c0ef070 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.819+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.819+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94392688272672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a77250 con 0x7fd56c0ef070 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.819+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a77c20 con 0x55d982a69aa0 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.819+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94392688260976] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.819+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94392688272672] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.819+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.819+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94392688277280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a76db0 con 0x55d982a69aa0 2024-02-15T23:30:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.819+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a78470 con 0x7fd574049050 2024-02-15T23:30:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.823+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94392688277280] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.823+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.823+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94392688271488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a76db0 con 0x7fd574049050 2024-02-15T23:30:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.823+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a78a80 con 0x7fd574049050 2024-02-15T23:30:13.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.823+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94392688271488] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.823+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94392688279504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a78a80 con 0x7fd574049050 2024-02-15T23:30:13.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a793f0 con 0x7fd574049050 2024-02-15T23:30:13.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94392688279504] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94392688281568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a793f0 con 0x7fd574049050 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 20 add_watcher() i=0 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 20 add_watcher() i=1 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 20 add_watcher() i=2 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 20 add_watcher() i=3 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 20 add_watcher() i=4 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 20 add_watcher() i=5 2024-02-15T23:30:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.827+0000 7fd5862bc980 20 add_watcher() i=6 2024-02-15T23:30:13.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94392688281568] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd5862bc980 20 add_watcher() i=7 2024-02-15T23:30:13.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd5862bc980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:13.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a7c810 con 0x55d982a69aa0 2024-02-15T23:30:13.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94392688283936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a79c50 con 0x55d982a69aa0 2024-02-15T23:30:13.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94392688283936] v33'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:13.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd5862bc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:13.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd5862bc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:13.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a84cd0 con 0x55d982a69aa0 2024-02-15T23:30:13.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.831+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a84cd0 con 0x7fd574049050 2024-02-15T23:30:13.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.835+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.835+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a85200 con 0x55d982a6f880 2024-02-15T23:30:13.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.835+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.835+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a85bd0 con 0x55d982a69aa0 2024-02-15T23:30:13.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.839+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'169 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.839+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a82e80 con 0x7fd56c0ef070 2024-02-15T23:30:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.839+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'56 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.839+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a82e80 con 0x55d982a6f880 2024-02-15T23:30:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.839+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'37 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.839+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a86db0 con 0x55d982a69aa0 2024-02-15T23:30:13.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.843+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.843+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a86db0 con 0x7fd574049050 2024-02-15T23:30:13.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.843+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'37 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.843+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a86db0 con 0x7fd56c0ef070 2024-02-15T23:30:13.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.847+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.847+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a872e0 con 0x55d982a6f880 2024-02-15T23:30:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.847+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.847+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a87cb0 con 0x7fd56c0ef070 2024-02-15T23:30:13.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.847+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'57 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.847+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a87cb0 con 0x7fd574049050 2024-02-15T23:30:13.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.851+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'26 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.851+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a87d90 con 0x7fd56c0ef070 2024-02-15T23:30:13.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.851+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.851+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a87d90 con 0x7fd574049050 2024-02-15T23:30:13.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.855+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'43 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.855+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a87d90 con 0x55d982a69aa0 2024-02-15T23:30:13.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.855+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'170 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.855+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a87d90 con 0x55d982a6f880 2024-02-15T23:30:13.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.859+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'50 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.859+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x7fd56c0ef070 2024-02-15T23:30:13.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.859+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'58 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.859+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a6f880 2024-02-15T23:30:13.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.863+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.863+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a69aa0 2024-02-15T23:30:13.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.863+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.863+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a69aa0 2024-02-15T23:30:13.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.863+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'171 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.863+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a6f880 2024-02-15T23:30:13.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.867+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'51 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.867+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x7fd56c0ef070 2024-02-15T23:30:13.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.867+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.867+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a6f880 2024-02-15T23:30:13.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.871+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.871+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a6f880 2024-02-15T23:30:13.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.871+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'29 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.871+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a6f880 2024-02-15T23:30:13.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.871+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'18 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.871+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a6f880 2024-02-15T23:30:13.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.875+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'38 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.875+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x7fd574049050 2024-02-15T23:30:13.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.875+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.875+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a6f880 2024-02-15T23:30:13.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.879+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.879+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x7fd574049050 2024-02-15T23:30:13.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.879+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'38 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.879+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x55d982a6f880 2024-02-15T23:30:13.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.883+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'52 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.883+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x7fd574049050 2024-02-15T23:30:13.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.883+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'44 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.883+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a88280 con 0x7fd56c0ef070 2024-02-15T23:30:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd438fe1640 20 reqs_thread_entry: start 2024-02-15T23:30:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd5862bc980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd5862bc980 20 Filter name: none 2024-02-15T23:30:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd3b27fc640 20 reqs_thread_entry: start 2024-02-15T23:30:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a69aa0 2024-02-15T23:30:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.887+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd574049050 2024-02-15T23:30:13.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.891+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a69aa0 2024-02-15T23:30:13.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd56c0ef070 2024-02-15T23:30:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a69aa0 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.895+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd574049050 2024-02-15T23:30:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd56c0ef070 2024-02-15T23:30:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.899+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd56c0ef070 2024-02-15T23:30:13.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.903+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd574049050 2024-02-15T23:30:13.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd56c0ef070 2024-02-15T23:30:13.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.907+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd574049050 2024-02-15T23:30:13.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a69aa0 2024-02-15T23:30:13.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.911+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd56c0ef070 2024-02-15T23:30:13.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.915+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a69aa0 2024-02-15T23:30:13.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a69aa0 2024-02-15T23:30:13.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a69aa0 2024-02-15T23:30:13.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.919+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd56c0ef070 2024-02-15T23:30:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.923+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd574049050 2024-02-15T23:30:13.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.927+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd574049050 2024-02-15T23:30:13.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.931+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x55d982a6f880 2024-02-15T23:30:13.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x55d982a6f880 2024-02-15T23:30:13.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd574049050 2024-02-15T23:30:13.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 40 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.935+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd574049050 2024-02-15T23:30:13.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 41 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a811a0 con 0x7fd56c0ef070 2024-02-15T23:30:13.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a821b0 con 0x7fd56c0ef070 2024-02-15T23:30:13.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:13.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.939+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94392688283936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a7ec70 con 0x55d982a69aa0 2024-02-15T23:30:13.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.943+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94392688283936] v33'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.943+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94392688263104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a7e7d0 con 0x7fd56c0ef070 2024-02-15T23:30:13.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.943+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94392688263104] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.943+0000 7fd5862bc980 20 remove_watcher() i=0 2024-02-15T23:30:13.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.943+0000 7fd5862bc980 2 removed watcher, disabling cache 2024-02-15T23:30:13.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.943+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94392688267168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73fc0 con 0x55d982a69aa0 2024-02-15T23:30:13.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.947+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94392688267168] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.947+0000 7fd5862bc980 20 remove_watcher() i=1 2024-02-15T23:30:13.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.947+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94392688260976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a74f80 con 0x55d982a6f880 2024-02-15T23:30:13.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.947+0000 7fd5835d6640 1 -- 172.21.15.133:0/1906414397 <== osd.3 v2:172.21.15.133:6816/1056376173 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94392688260976] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd56c0ec070 con 0x55d982a6f880 2024-02-15T23:30:13.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.947+0000 7fd5862bc980 20 remove_watcher() i=2 2024-02-15T23:30:13.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.947+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94392688272672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73770 con 0x7fd56c0ef070 2024-02-15T23:30:13.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.951+0000 7fd5845d8640 1 -- 172.21.15.133:0/1906414397 <== osd.2 v2:172.21.15.133:6808/3615800201 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94392688272672] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd57c03c040 con 0x7fd56c0ef070 2024-02-15T23:30:13.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.951+0000 7fd5862bc980 20 remove_watcher() i=3 2024-02-15T23:30:13.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.951+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94392688277280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73770 con 0x55d982a69aa0 2024-02-15T23:30:13.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.951+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.1 v2:172.21.15.133:6800/2918336019 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94392688277280] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x55d982a69aa0 2024-02-15T23:30:13.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.951+0000 7fd5862bc980 20 remove_watcher() i=4 2024-02-15T23:30:13.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.951+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94392688271488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73770 con 0x7fd574049050 2024-02-15T23:30:13.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.955+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 42 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94392688271488] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.955+0000 7fd5862bc980 20 remove_watcher() i=5 2024-02-15T23:30:13.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.955+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94392688279504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a76080 con 0x7fd574049050 2024-02-15T23:30:13.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.955+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 43 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94392688279504] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.955+0000 7fd5862bc980 20 remove_watcher() i=6 2024-02-15T23:30:13.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.955+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94392688281568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d982a73770 con 0x7fd574049050 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 <== osd.0 v2:172.21.15.131:6800/31994139 44 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94392688281568] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd574024020 con 0x7fd574049050 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 20 remove_watcher() i=7 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd574049050 msgr2=0x7fd574007a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd574049050 0x7fd574007a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982a69aa0 msgr2=0x55d982a6bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982a69aa0 0x55d982a6bf60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd56c0ef070 msgr2=0x7fd56c0bc530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd56c0ef070 0x7fd56c0bc530 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d982a6f880 msgr2=0x55d982a71cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55d982a6f880 0x55d982a71cb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd44c034260 msgr2=0x7fd44c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd44c034260 0x7fd44c036720 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd57c008fd0 tx=0x7fd57c01c070 comp rx=0 tx=0).stop 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd583dd7640 1 -- 172.21.15.133:0/1906414397 reap_dead start 2024-02-15T23:30:13.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 msgr2=0x55d982a5e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a5e4b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd56c007000 tx=0x7fd56c0e46e0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 shutdown_connections 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1906414397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a57610 0x55d982a5e4b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 >> 172.21.15.133:0/1906414397 conn(0x55d982a53950 msgr2=0x55d982a50fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 shutdown_connections 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1906414397 wait complete. 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1681583200 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd45c0342b0 msgr2=0x7fd45c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1681583200 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd45c0342b0 0x7fd45c036770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55d982a3ab80 tx=0x7fd57c003070 comp rx=0 tx=0).stop 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1681583200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a4a5e0 msgr2=0x55d982a4aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1681583200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a4a5e0 0x55d982a4aa00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd56c096e80 tx=0x7fd56c018020 comp rx=0 tx=0).stop 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1681583200 shutdown_connections 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1681583200 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd45c0342b0 0x7fd45c036770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/1681583200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d982a4a5e0 0x55d982a4aa00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1681583200 >> 172.21.15.133:0/1681583200 conn(0x55d982a3f3f0 msgr2=0x55d982a3ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1681583200 shutdown_connections 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/1681583200 wait complete. 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982946950 msgr2=0x55d982a39d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982946950 0x55d982a39d60 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd46c0342b0 msgr2=0x7fd46c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd46c0342b0 0x7fd46c036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0ad000 tx=0x7fd56c0a5040 comp rx=0 tx=0).stop 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 msgr2=0x55d982a330d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a330d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55d982a2d110 tx=0x7fd574000f50 comp rx=0 tx=0).stop 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 shutdown_connections 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55d982946950 0x55d982a39d60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd46c0342b0 0x7fd46c036770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 --2- 172.21.15.133:0/2657797054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9828b48c0 0x55d982a330d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.959+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 >> 172.21.15.133:0/2657797054 conn(0x55d98293a910 msgr2=0x55d982a26920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.963+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 shutdown_connections 2024-02-15T23:30:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:13.963+0000 7fd5862bc980 1 -- 172.21.15.133:0/2657797054 wait complete. 2024-02-15T23:30:13.981 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-02-15T23:30:13.981 DEBUG:tasks.util.rgw: json result: [] 2024-02-15T23:30:13.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-15T23:30:13.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-15T23:30:13.982 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-15T23:30:14.062 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:14.062 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:14.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f2921ab2980 1 Processor -- start 2024-02-15T23:30:14.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f2921ab2980 1 -- start start 2024-02-15T23:30:14.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f2921ab2980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x558d52ff22d0 0x558d52ff46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f2921ab2980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558d52f3c4c0 con 0x558d52f640c0 2024-02-15T23:30:14.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f2921ab2980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x558d52f03180 con 0x558d52ff22d0 2024-02-15T23:30:14.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f291edcc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x558d52ff22d0 0x558d52ff46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f291edcc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x558d52ff22d0 0x558d52ff46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35810/0 (socket says 172.21.15.133:35810) 2024-02-15T23:30:14.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f291f5cd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x558d52f640c0 0x558d52ff0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:60350/0 (socket says 172.21.15.133:60350) 2024-02-15T23:30:14.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f291edcc640 1 -- 172.21.15.133:0/698449218 learned_addr learned my addr 172.21.15.133:0/698449218 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f291edcc640 1 -- 172.21.15.133:0/698449218 >> v1:172.21.15.131:6789/0 conn(0x558d52f640c0 legacy=0x558d52ff0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.055+0000 7f291edcc640 1 -- 172.21.15.133:0/698449218 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d52ff4cc0 con 0x558d52ff22d0 2024-02-15T23:30:14.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f291edcc640 1 --2- 172.21.15.133:0/698449218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52ff22d0 0x558d52ff46f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f291400a5c0 tx=0x7f291401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9f70b650c75cb0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f291e5cb640 1 -- 172.21.15.133:0/698449218 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29140aa470 con 0x558d52ff22d0 2024-02-15T23:30:14.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f291e5cb640 1 -- 172.21.15.133:0/698449218 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140aa5d0 con 0x558d52ff22d0 2024-02-15T23:30:14.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f291e5cb640 1 -- 172.21.15.133:0/698449218 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29140aa890 con 0x558d52ff22d0 2024-02-15T23:30:14.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f2921ab2980 1 -- 172.21.15.133:0/698449218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52ff22d0 msgr2=0x558d52ff46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f2921ab2980 1 --2- 172.21.15.133:0/698449218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52ff22d0 0x558d52ff46f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f291400a5c0 tx=0x7f291401b340 comp rx=0 tx=0).stop 2024-02-15T23:30:14.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f2921ab2980 1 -- 172.21.15.133:0/698449218 shutdown_connections 2024-02-15T23:30:14.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f2921ab2980 1 --2- 172.21.15.133:0/698449218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52ff22d0 0x558d52ff46f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f2921ab2980 1 -- 172.21.15.133:0/698449218 >> 172.21.15.133:0/698449218 conn(0x558d52fea8e0 msgr2=0x558d52fecd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f2921ab2980 1 -- 172.21.15.133:0/698449218 shutdown_connections 2024-02-15T23:30:14.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.059+0000 7f2921ab2980 1 -- 172.21.15.133:0/698449218 wait complete. 2024-02-15T23:30:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f2921ab2980 1 Processor -- start 2024-02-15T23:30:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f2921ab2980 1 -- start start 2024-02-15T23:30:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f2921ab2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f2921ab2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d52f006b0 con 0x558d52f640c0 2024-02-15T23:30:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f291f5cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f291f5cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35822/0 (socket says 172.21.15.133:35822) 2024-02-15T23:30:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f291f5cd640 1 -- 172.21.15.133:0/3967917960 learned_addr learned my addr 172.21.15.133:0/3967917960 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f291f5cd640 1 -- 172.21.15.133:0/3967917960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914005df0 con 0x558d52f640c0 2024-02-15T23:30:14.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f291f5cd640 1 --2- 172.21.15.133:0/3967917960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e0990 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2910001d40 tx=0x7f291000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbbf0c77a8d2313 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f280d60a640 1 -- 172.21.15.133:0/3967917960 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2910014070 con 0x558d52f640c0 2024-02-15T23:30:14.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f280d60a640 1 -- 172.21.15.133:0/3967917960 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291000f590 con 0x558d52f640c0 2024-02-15T23:30:14.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.075+0000 7f280d60a640 1 -- 172.21.15.133:0/3967917960 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2910007040 con 0x558d52f640c0 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- 172.21.15.133:0/3967917960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 msgr2=0x558d530e0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 --2- 172.21.15.133:0/3967917960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e0990 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2910001d40 tx=0x7f291000b610 comp rx=0 tx=0).stop 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- 172.21.15.133:0/3967917960 shutdown_connections 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 --2- 172.21.15.133:0/3967917960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e0990 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- 172.21.15.133:0/3967917960 >> 172.21.15.133:0/3967917960 conn(0x558d52fea8e0 msgr2=0x558d530dc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- 172.21.15.133:0/3967917960 shutdown_connections 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- 172.21.15.133:0/3967917960 wait complete. 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 Processor -- start 2024-02-15T23:30:14.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- start start 2024-02-15T23:30:14.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d52efbe90 con 0x558d52f640c0 2024-02-15T23:30:14.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f291f5cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f291f5cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35836/0 (socket says 172.21.15.133:35836) 2024-02-15T23:30:14.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f291f5cd640 1 -- 172.21.15.133:0/2738426343 learned_addr learned my addr 172.21.15.133:0/2738426343 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f291f5cd640 1 -- 172.21.15.133:0/2738426343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d52f3c4c0 con 0x558d52f640c0 2024-02-15T23:30:14.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f291f5cd640 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e77e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f291000b650 tx=0x7f2910000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f280be07640 1 -- 172.21.15.133:0/2738426343 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2910014030 con 0x558d52f640c0 2024-02-15T23:30:14.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d530e7d20 con 0x558d52f640c0 2024-02-15T23:30:14.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f280be07640 1 -- 172.21.15.133:0/2738426343 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910001530 con 0x558d52f640c0 2024-02-15T23:30:14.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d530e8150 con 0x558d52f640c0 2024-02-15T23:30:14.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.079+0000 7f280be07640 1 -- 172.21.15.133:0/2738426343 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291000eb10 con 0x558d52f640c0 2024-02-15T23:30:14.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f280be07640 1 -- 172.21.15.133:0/2738426343 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f291000ed00 con 0x558d52f640c0 2024-02-15T23:30:14.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f280be07640 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28040342b0 0x7f2804036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f280be07640 1 -- 172.21.15.133:0/2738426343 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2910006070 con 0x558d52f640c0 2024-02-15T23:30:14.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291edcc640 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28040342b0 0x7f2804036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d52ff22d0 0x558d530ee470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d530ee9b0 con 0x558d52ff22d0 2024-02-15T23:30:14.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291fdce640 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d52ff22d0 0x558d530ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291edcc640 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28040342b0 0x7f2804036770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f29140ae000 tx=0x7f29140a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291fdce640 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d52ff22d0 0x558d530ee470 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291fdce640 1 -- 172.21.15.133:0/2738426343 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x558d52ff22d0 2024-02-15T23:30:14.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d530eed50 con 0x558d52ff22d0 2024-02-15T23:30:14.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291fdce640 1 -- 172.21.15.133:0/2738426343 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f291800a4d0 con 0x558d52ff22d0 2024-02-15T23:30:14.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d530f05d0 con 0x558d52ff22d0 2024-02-15T23:30:14.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291fdce640 1 -- 172.21.15.133:0/2738426343 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f291800a4d0 con 0x558d52ff22d0 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d530ef7d0 con 0x558d52ff22d0 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291fdce640 1 -- 172.21.15.133:0/2738426343 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f291800a4d0 con 0x558d52ff22d0 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d530efbe0 con 0x558d52ff22d0 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291fdce640 1 -- 172.21.15.133:0/2738426343 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f291800a4d0 con 0x558d52ff22d0 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 Processor -- start 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 -- start start 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d530fecd0 0x558d530ff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f2921ab2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d52e94f20 con 0x558d530fecd0 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291edcc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d530fecd0 0x558d530ff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291edcc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d530fecd0 0x558d530ff0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35842/0 (socket says 172.21.15.133:35842) 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.083+0000 7f291edcc640 1 -- 172.21.15.133:0/1404085698 learned_addr learned my addr 172.21.15.133:0/1404085698 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f291edcc640 1 -- 172.21.15.133:0/1404085698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d530ff630 con 0x558d530fecd0 2024-02-15T23:30:14.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f291edcc640 1 --2- 172.21.15.133:0/1404085698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d530fecd0 0x558d530ff0f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f291401b380 tx=0x7f29140180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2809602640 1 -- 172.21.15.133:0/1404085698 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29140b3ad0 con 0x558d530fecd0 2024-02-15T23:30:14.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2809602640 1 -- 172.21.15.133:0/1404085698 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140c3070 con 0x558d530fecd0 2024-02-15T23:30:14.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2921ab2980 1 -- 172.21.15.133:0/1404085698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d530ff820 con 0x558d530fecd0 2024-02-15T23:30:14.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2809602640 1 -- 172.21.15.133:0/1404085698 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29140b3d60 con 0x558d530fecd0 2024-02-15T23:30:14.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2921ab2980 1 -- 172.21.15.133:0/1404085698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d53100310 con 0x558d530fecd0 2024-02-15T23:30:14.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2809602640 1 -- 172.21.15.133:0/1404085698 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f29140c5030 con 0x558d530fecd0 2024-02-15T23:30:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2809602640 1 --2- 172.21.15.133:0/1404085698 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27f80342b0 0x7f27f8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2809602640 1 -- 172.21.15.133:0/1404085698 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f29140e6640 con 0x558d530fecd0 2024-02-15T23:30:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f291fdce640 1 --2- 172.21.15.133:0/1404085698 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27f80342b0 0x7f27f8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2921ab2980 1 Processor -- start 2024-02-15T23:30:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2921ab2980 1 -- start start 2024-02-15T23:30:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f291fdce640 1 --2- 172.21.15.133:0/1404085698 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27f80342b0 0x7f27f8036770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x558d530ef210 tx=0x7f2918005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2921ab2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d5310c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f2921ab2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d52e88790 con 0x558d5310bce0 2024-02-15T23:30:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f291edcc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d5310c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f291edcc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d5310c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35854/0 (socket says 172.21.15.133:35854) 2024-02-15T23:30:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.087+0000 7f291edcc640 1 -- 172.21.15.133:0/1488412731 learned_addr learned my addr 172.21.15.133:0/1488412731 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f291edcc640 1 -- 172.21.15.133:0/1488412731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d5310c6b0 con 0x558d5310bce0 2024-02-15T23:30:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f291edcc640 1 --2- 172.21.15.133:0/1488412731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d5310c0e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f29140e49d0 tx=0x7f29140bd630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c74c634bb2f2ba2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2802ffd640 1 -- 172.21.15.133:0/1488412731 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29140d6040 con 0x558d5310bce0 2024-02-15T23:30:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2802ffd640 1 -- 172.21.15.133:0/1488412731 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140d1e00 con 0x558d5310bce0 2024-02-15T23:30:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2802ffd640 1 -- 172.21.15.133:0/1488412731 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29140c7c30 con 0x558d5310bce0 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- 172.21.15.133:0/1488412731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 msgr2=0x558d5310c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1488412731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d5310c0e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f29140e49d0 tx=0x7f29140bd630 comp rx=0 tx=0).stop 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- 172.21.15.133:0/1488412731 shutdown_connections 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1488412731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d5310c0e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- 172.21.15.133:0/1488412731 >> 172.21.15.133:0/1488412731 conn(0x558d53108020 msgr2=0x558d53106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- 172.21.15.133:0/1488412731 shutdown_connections 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- 172.21.15.133:0/1488412731 wait complete. 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 Processor -- start 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- start start 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d53112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d531130f0 con 0x558d5310bce0 2024-02-15T23:30:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f291edcc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d53112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f291edcc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d53112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35860/0 (socket says 172.21.15.133:35860) 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 learned_addr learned my addr 172.21.15.133:0/1407103618 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d53100310 con 0x558d5310bce0 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f291edcc640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d53112bb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f29140e49d0 tx=0x7f29140e4960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f28017fa640 1 -- 172.21.15.133:0/1407103618 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29140d6040 con 0x558d5310bce0 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f28017fa640 1 -- 172.21.15.133:0/1407103618 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140e3320 con 0x558d5310bce0 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d531132f0 con 0x558d5310bce0 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f28017fa640 1 -- 172.21.15.133:0/1407103618 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29140e35e0 con 0x558d5310bce0 2024-02-15T23:30:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.091+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d531132f0 con 0x558d5310bce0 2024-02-15T23:30:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f28017fa640 1 -- 172.21.15.133:0/1407103618 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f29140e6070 con 0x558d5310bce0 2024-02-15T23:30:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f28017fa640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27e80342b0 0x7f27e8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f28017fa640 1 -- 172.21.15.133:0/1407103618 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f29140f1d30 con 0x558d5310bce0 2024-02-15T23:30:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d5311dec0 0x558d53120380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53120ad0 con 0x558d5311dec0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291f5cd640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d5311dec0 0x558d53120380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291f5cd640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d5311dec0 0x558d53120380 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2910016070 con 0x558d5311dec0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 realm 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53120ea0 con 0x558d5311dec0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2910016070 con 0x558d5311dec0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53121720 con 0x558d5311dec0 2024-02-15T23:30:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2910016070 con 0x558d5311dec0 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53121a80 con 0x558d5311dec0 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2910016070 con 0x558d5311dec0 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53122280 con 0x558d5311dec0 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2910016070 con 0x558d5311dec0 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 20 searching for the correct realm 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x558d53124130 0x558d531265f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d53124130 2024-02-15T23:30:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291edcc640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x558d53124130 0x558d531265f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.095+0000 7f291edcc640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x558d53124130 0x558d531265f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291edcc640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2914009040 0x7f29140d5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f2914009040 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291fdce640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2914009040 0x7f29140d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291fdce640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2914009040 0x7f29140d5130 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f2914009040 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d5311dec0 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2910016070 con 0x558d5311dec0 2024-02-15T23:30:14.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d5311dec0 2024-02-15T23:30:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910016070 con 0x558d5311dec0 2024-02-15T23:30:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f291001b3d0 0x7f291001c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f291001b3d0 2024-02-15T23:30:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f291001b3d0 0x7f291001c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f291001b3d0 0x7f291001c440 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910016070 con 0x7f291001b3d0 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.099+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f291001b3d0 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910049db0 con 0x7f291001b3d0 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f2914009040 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d53124130 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d5311dec0 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2910049db0 con 0x558d5311dec0 2024-02-15T23:30:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f291001b3d0 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910049db0 con 0x7f291001b3d0 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d5311dec0 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910049db0 con 0x558d5311dec0 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f2914009040 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d53124130 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d53124130 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f291001b3d0 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.103+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910049db0 con 0x7f291001b3d0 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d53124130 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d53124130 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d5311dec0 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910049db0 con 0x558d5311dec0 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d5311dec0 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2910049db0 con 0x558d5311dec0 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f291001b3d0 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910049db0 con 0x7f291001b3d0 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d53124130 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f2914009040 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x558d5311dec0 2024-02-15T23:30:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910049db0 con 0x558d5311dec0 2024-02-15T23:30:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53126cc0 con 0x7f2914009040 2024-02-15T23:30:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2918035040 con 0x558d53124130 2024-02-15T23:30:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.107+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2918035040 con 0x7f291001b3d0 2024-02-15T23:30:14.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2918035040 con 0x7f2914009040 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2918035040 con 0x558d53124130 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2918035040 con 0x7f291001b3d0 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2918035040 con 0x558d5311dec0 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2918035040 con 0x7f2914009040 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53122a80 con 0x558d5311dec0 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53122de0 con 0x558d5311dec0 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d531231c0 con 0x558d5311dec0 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 zone default found 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 4 Realm: () 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 zonegroup default 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d531235b0 con 0x7f2914009040 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.111+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53128ae0 con 0x558d53124130 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53128e40 con 0x558d53124130 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 20 started sync module instance, tier type = 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d531283c0 con 0x7f2914009040 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94065472470816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53128340 con 0x7f2914009040 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53129b70 con 0x558d5311dec0 2024-02-15T23:30:14.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.115+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94065472470816] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.119+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.119+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94065472475696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53128340 con 0x558d5311dec0 2024-02-15T23:30:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.119+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312a210 con 0x558d53124130 2024-02-15T23:30:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.119+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.119+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94065472478480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312aa10 con 0x558d53124130 2024-02-15T23:30:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.119+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312b460 con 0x7f2914009040 2024-02-15T23:30:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.119+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94065472475696] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.123+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.123+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94065472483168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312b840 con 0x7f2914009040 2024-02-15T23:30:14.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.123+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312c1b0 con 0x558d5311dec0 2024-02-15T23:30:14.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.123+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94065472478480] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.123+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94065472483168] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.123+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.123+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94065472476752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312bd10 con 0x558d5311dec0 2024-02-15T23:30:14.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.123+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312ca00 con 0x7f291001b3d0 2024-02-15T23:30:14.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94065472476752] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94065472480624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312bd10 con 0x7f291001b3d0 2024-02-15T23:30:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312d010 con 0x7f291001b3d0 2024-02-15T23:30:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(56 notify.6 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94065472490352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312d430 con 0x7f291001b3d0 2024-02-15T23:30:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312de50 con 0x7f291001b3d0 2024-02-15T23:30:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94065472480624] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.127+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94065472490352] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94065472493872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312cf90 con 0x7f291001b3d0 2024-02-15T23:30:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 20 add_watcher() i=0 2024-02-15T23:30:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 20 add_watcher() i=1 2024-02-15T23:30:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 20 add_watcher() i=2 2024-02-15T23:30:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 20 add_watcher() i=3 2024-02-15T23:30:14.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 20 add_watcher() i=4 2024-02-15T23:30:14.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 20 add_watcher() i=5 2024-02-15T23:30:14.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 20 add_watcher() i=6 2024-02-15T23:30:14.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94065472493872] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 20 add_watcher() i=7 2024-02-15T23:30:14.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:14.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53131060 con 0x558d5311dec0 2024-02-15T23:30:14.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.131+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94065472488800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312e4d0 con 0x558d5311dec0 2024-02-15T23:30:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.135+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94065472488800] v33'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.135+0000 7f27d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.135+0000 7f2921ab2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.135+0000 7f2921ab2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.135+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53139330 con 0x558d5311dec0 2024-02-15T23:30:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.135+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.135+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53139750 con 0x7f291001b3d0 2024-02-15T23:30:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.139+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.139+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53139bf0 con 0x558d53124130 2024-02-15T23:30:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.139+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.139+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313a3f0 con 0x558d5311dec0 2024-02-15T23:30:14.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.139+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'174 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.139+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d531373e0 con 0x7f2914009040 2024-02-15T23:30:14.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.143+0000 7f291fdce640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27e80342b0 0x7f27e8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.143+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'59 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.143+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d531373e0 con 0x558d53124130 2024-02-15T23:30:14.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.143+0000 7f291fdce640 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27e80342b0 0x7f27e8036770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x558d53126f40 tx=0x7f2918017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.143+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'39 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.143+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313b5d0 con 0x558d5311dec0 2024-02-15T23:30:14.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.143+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.143+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313b5d0 con 0x7f291001b3d0 2024-02-15T23:30:14.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.147+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'39 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.147+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313b5d0 con 0x7f2914009040 2024-02-15T23:30:14.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.151+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.151+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d531364d0 con 0x558d53124130 2024-02-15T23:30:14.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.151+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.151+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53136590 con 0x7f2914009040 2024-02-15T23:30:14.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.151+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'60 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.151+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c140 con 0x7f291001b3d0 2024-02-15T23:30:14.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.155+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'27 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.155+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c140 con 0x7f2914009040 2024-02-15T23:30:14.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.155+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.155+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c1d0 con 0x7f291001b3d0 2024-02-15T23:30:14.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.159+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'45 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.159+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c1d0 con 0x558d5311dec0 2024-02-15T23:30:14.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.159+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'175 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.159+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c1d0 con 0x558d53124130 2024-02-15T23:30:14.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.159+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'53 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.159+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c740 con 0x7f2914009040 2024-02-15T23:30:14.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.163+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'61 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.163+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d53124130 2024-02-15T23:30:14.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.163+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.163+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d5311dec0 2024-02-15T23:30:14.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.167+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.167+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d5311dec0 2024-02-15T23:30:14.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.167+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'176 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.167+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d53124130 2024-02-15T23:30:14.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.171+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'54 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.171+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x7f2914009040 2024-02-15T23:30:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.171+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.171+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d53124130 2024-02-15T23:30:14.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.171+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.171+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d53124130 2024-02-15T23:30:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.175+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'30 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.175+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d53124130 2024-02-15T23:30:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.175+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'19 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.175+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d53124130 2024-02-15T23:30:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.175+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'40 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.175+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x7f291001b3d0 2024-02-15T23:30:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.179+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.179+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d53124130 2024-02-15T23:30:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.179+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.179+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x7f291001b3d0 2024-02-15T23:30:14.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.183+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'40 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.183+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x558d53124130 2024-02-15T23:30:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.187+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'55 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.187+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x7f291001b3d0 2024-02-15T23:30:14.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.187+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'46 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.187+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5313c720 con 0x7f2914009040 2024-02-15T23:30:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f27d4fe1640 20 reqs_thread_entry: start 2024-02-15T23:30:14.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:14.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 20 Filter name: none 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f274e7fc640 20 reqs_thread_entry: start 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53134840 con 0x558d5311dec0 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:30:14.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:14.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.191+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53158760 con 0x7f2914009040 2024-02-15T23:30:14.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.195+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.203 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-15T23:30:14.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.195+0000 7f27d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:14.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.195+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94065472488800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d531343d0 con 0x558d5311dec0 2024-02-15T23:30:14.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.195+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94065472488800] v33'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.195+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94065472470816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d531343d0 con 0x7f2914009040 2024-02-15T23:30:14.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.199+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94065472470816] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.199+0000 7f2921ab2980 20 remove_watcher() i=0 2024-02-15T23:30:14.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.199+0000 7f2921ab2980 2 removed watcher, disabling cache 2024-02-15T23:30:14.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.199+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94065472475696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53127f20 con 0x558d5311dec0 2024-02-15T23:30:14.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.199+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94065472475696] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.199+0000 7f2921ab2980 20 remove_watcher() i=1 2024-02-15T23:30:14.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.199+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94065472478480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53127f20 con 0x558d53124130 2024-02-15T23:30:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f291edcc640 1 -- 172.21.15.133:0/1407103618 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94065472478480] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29140ed070 con 0x558d53124130 2024-02-15T23:30:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f2921ab2980 20 remove_watcher() i=2 2024-02-15T23:30:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94065472483168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d53127f20 con 0x7f2914009040 2024-02-15T23:30:14.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f291fdce640 1 -- 172.21.15.133:0/1407103618 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94065472483168] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291800a4d0 con 0x7f2914009040 2024-02-15T23:30:14.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f2921ab2980 20 remove_watcher() i=3 2024-02-15T23:30:14.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94065472476752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312af60 con 0x558d5311dec0 2024-02-15T23:30:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94065472476752] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x558d5311dec0 2024-02-15T23:30:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f2921ab2980 20 remove_watcher() i=4 2024-02-15T23:30:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.203+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94065472480624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312af60 con 0x7f291001b3d0 2024-02-15T23:30:14.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.207+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94065472480624] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.207+0000 7f2921ab2980 20 remove_watcher() i=5 2024-02-15T23:30:14.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.207+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94065472490352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312af60 con 0x7f291001b3d0 2024-02-15T23:30:14.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.207+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94065472490352] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.207+0000 7f2921ab2980 20 remove_watcher() i=6 2024-02-15T23:30:14.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.207+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94065472493872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d5312cb70 con 0x7f291001b3d0 2024-02-15T23:30:14.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94065472493872] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2910058040 con 0x7f291001b3d0 2024-02-15T23:30:14.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 20 remove_watcher() i=7 2024-02-15T23:30:14.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f291001b3d0 msgr2=0x7f291001c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f291001b3d0 0x7f291001c440 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d5311dec0 msgr2=0x558d53120380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d5311dec0 0x558d53120380 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2914009040 msgr2=0x7f29140d5130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f2914009040 0x7f29140d5130 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x558d53124130 msgr2=0x558d531265f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x558d53124130 0x558d531265f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27e80342b0 msgr2=0x7f27e8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27e80342b0 0x7f27e8036770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x558d53126f40 tx=0x7f2918017000 comp rx=0 tx=0).stop 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 msgr2=0x558d53112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f291f5cd640 1 -- 172.21.15.133:0/1407103618 reap_dead start 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d53112bb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f29140e49d0 tx=0x7f29140e4960 comp rx=0 tx=0).stop 2024-02-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 shutdown_connections 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1407103618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d5310bce0 0x558d53112bb0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 >> 172.21.15.133:0/1407103618 conn(0x558d53108020 msgr2=0x558d53105680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 shutdown_connections 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1407103618 wait complete. 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1404085698 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27f80342b0 msgr2=0x7f27f8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1404085698 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27f80342b0 0x7f27f8036770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x558d530ef210 tx=0x7f2918005850 comp rx=0 tx=0).stop 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1404085698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d530fecd0 msgr2=0x558d530ff0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1404085698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d530fecd0 0x558d530ff0f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f291401b380 tx=0x7f29140180e0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1404085698 shutdown_connections 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1404085698 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f27f80342b0 0x7f27f8036770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 --2- 172.21.15.133:0/1404085698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d530fecd0 0x558d530ff0f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1404085698 >> 172.21.15.133:0/1404085698 conn(0x558d530f3ae0 msgr2=0x558d530f45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1404085698 shutdown_connections 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.211+0000 7f2921ab2980 1 -- 172.21.15.133:0/1404085698 wait complete. 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d52ff22d0 msgr2=0x558d530ee470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d52ff22d0 0x558d530ee470 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28040342b0 msgr2=0x7f2804036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28040342b0 0x7f2804036770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f29140ae000 tx=0x7f29140a6000 comp rx=0 tx=0).stop 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 msgr2=0x558d530e77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e77e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f291000b650 tx=0x7f2910000ee0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 shutdown_connections 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d52ff22d0 0x558d530ee470 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28040342b0 0x7f2804036770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 --2- 172.21.15.133:0/2738426343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d52f640c0 0x558d530e77e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 >> 172.21.15.133:0/2738426343 conn(0x558d52fea8e0 msgr2=0x558d530db030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 shutdown_connections 2024-02-15T23:30:14.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.215+0000 7f2921ab2980 1 -- 172.21.15.133:0/2738426343 wait complete. 2024-02-15T23:30:14.235 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-15T23:30:14.251 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-02-15T23:30:14.259 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:14.322 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:14.347 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:14.392 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-15T23:30:14.403 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:14.403 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-15T23:30:14.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-15T23:30:14.404 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-15T23:30:14.442 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:14.442 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:14.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a33d92980 1 Processor -- start 2024-02-15T23:30:14.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a33d92980 1 -- start start 2024-02-15T23:30:14.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a33d92980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5581c6e5be20 0x5581c6ef0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a33d92980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5581c6e334d0 con 0x5581c6e5d160 2024-02-15T23:30:14.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a33d92980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5581c6dfa180 con 0x5581c6e5be20 2024-02-15T23:30:14.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a310ac640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5581c6e5be20 0x5581c6ef0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a318ad640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5581c6e5d160 0x5581c6e5b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:60352/0 (socket says 172.21.15.133:60352) 2024-02-15T23:30:14.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a318ad640 1 -- 172.21.15.133:0/2566299347 learned_addr learned my addr 172.21.15.133:0/2566299347 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:14.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a310ac640 1 -- 172.21.15.133:0/2566299347 >> v1:172.21.15.131:6789/0 conn(0x5581c6e5d160 legacy=0x5581c6e5b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.435+0000 7f4a310ac640 1 -- 172.21.15.133:0/2566299347 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581c6e5c230 con 0x5581c6e5be20 2024-02-15T23:30:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a310ac640 1 --2- 172.21.15.133:0/2566299347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6ef0190 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00a480 tx=0x7f4a1c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9711e7ebd513d3e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a308ab640 1 -- 172.21.15.133:0/2566299347 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0aa530 con 0x5581c6e5be20 2024-02-15T23:30:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a308ab640 1 -- 172.21.15.133:0/2566299347 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0a6050 con 0x5581c6e5be20 2024-02-15T23:30:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a308ab640 1 -- 172.21.15.133:0/2566299347 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0aa7e0 con 0x5581c6e5be20 2024-02-15T23:30:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a33d92980 1 -- 172.21.15.133:0/2566299347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 msgr2=0x5581c6ef0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a33d92980 1 --2- 172.21.15.133:0/2566299347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6ef0190 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00a480 tx=0x7f4a1c01b280 comp rx=0 tx=0).stop 2024-02-15T23:30:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a33d92980 1 -- 172.21.15.133:0/2566299347 shutdown_connections 2024-02-15T23:30:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a33d92980 1 --2- 172.21.15.133:0/2566299347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6ef0190 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a33d92980 1 -- 172.21.15.133:0/2566299347 >> 172.21.15.133:0/2566299347 conn(0x5581c6ee2a50 msgr2=0x5581c6ee4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a33d92980 1 -- 172.21.15.133:0/2566299347 shutdown_connections 2024-02-15T23:30:14.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.439+0000 7f4a33d92980 1 -- 172.21.15.133:0/2566299347 wait complete. 2024-02-15T23:30:14.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.455+0000 7f4a33d92980 1 Processor -- start 2024-02-15T23:30:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.455+0000 7f4a33d92980 1 -- start start 2024-02-15T23:30:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.455+0000 7f4a33d92980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fd35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.455+0000 7f4a33d92980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581c6df76b0 con 0x5581c6e5be20 2024-02-15T23:30:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.455+0000 7f4a318ad640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fd35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.455+0000 7f4a318ad640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fd35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35870/0 (socket says 172.21.15.133:35870) 2024-02-15T23:30:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.455+0000 7f4a318ad640 1 -- 172.21.15.133:0/2675086785 learned_addr learned my addr 172.21.15.133:0/2675086785 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.455+0000 7f4a318ad640 1 -- 172.21.15.133:0/2675086785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c005d30 con 0x5581c6e5be20 2024-02-15T23:30:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a318ad640 1 --2- 172.21.15.133:0/2675086785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fd35b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c006fb0 tx=0x7f4a2c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224704c73ff9dcfb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f491fe07640 1 -- 172.21.15.133:0/2675086785 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a2c004530 con 0x5581c6e5be20 2024-02-15T23:30:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f491fe07640 1 -- 172.21.15.133:0/2675086785 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c004690 con 0x5581c6e5be20 2024-02-15T23:30:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f491fe07640 1 -- 172.21.15.133:0/2675086785 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a2c0049b0 con 0x5581c6e5be20 2024-02-15T23:30:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- 172.21.15.133:0/2675086785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 msgr2=0x5581c6fd35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 --2- 172.21.15.133:0/2675086785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fd35b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c006fb0 tx=0x7f4a2c001940 comp rx=0 tx=0).stop 2024-02-15T23:30:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- 172.21.15.133:0/2675086785 shutdown_connections 2024-02-15T23:30:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 --2- 172.21.15.133:0/2675086785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fd35b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- 172.21.15.133:0/2675086785 >> 172.21.15.133:0/2675086785 conn(0x5581c6ee2a50 msgr2=0x5581c6fcf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- 172.21.15.133:0/2675086785 shutdown_connections 2024-02-15T23:30:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- 172.21.15.133:0/2675086785 wait complete. 2024-02-15T23:30:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 Processor -- start 2024-02-15T23:30:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- start start 2024-02-15T23:30:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fda440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581c6df2e90 con 0x5581c6e5be20 2024-02-15T23:30:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a318ad640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fda440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a318ad640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fda440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35884/0 (socket says 172.21.15.133:35884) 2024-02-15T23:30:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a318ad640 1 -- 172.21.15.133:0/3748477264 learned_addr learned my addr 172.21.15.133:0/3748477264 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a318ad640 1 -- 172.21.15.133:0/3748477264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581c6e334d0 con 0x5581c6e5be20 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a318ad640 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fda440 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x5581c6fd4440 tx=0x7f4a2c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f491e604640 1 -- 172.21.15.133:0/3748477264 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a2c013760 con 0x5581c6e5be20 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f491e604640 1 -- 172.21.15.133:0/3748477264 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0138c0 con 0x5581c6e5be20 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5581c6fda980 con 0x5581c6e5be20 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f491e604640 1 -- 172.21.15.133:0/3748477264 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a2c013b60 con 0x5581c6e5be20 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.459+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581c6fdadd0 con 0x5581c6e5be20 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f491e604640 1 -- 172.21.15.133:0/3748477264 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4a2c028460 con 0x5581c6e5be20 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f491e604640 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4918034300 0x7f49180367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f491e604640 1 -- 172.21.15.133:0/3748477264 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4a2c0496a0 con 0x5581c6e5be20 2024-02-15T23:30:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a310ac640 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4918034300 0x7f49180367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c6e5d160 0x5581c6fe1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c6fe15d0 con 0x5581c6e5d160 2024-02-15T23:30:14.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a320ae640 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c6e5d160 0x5581c6fe1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a310ac640 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4918034300 0x7f49180367c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0ac000 tx=0x7f4a1c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a320ae640 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c6e5d160 0x5581c6fe1090 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a320ae640 1 -- 172.21.15.133:0/3748477264 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a240083f0 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c6fde790 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a320ae640 1 -- 172.21.15.133:0/3748477264 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4a240083f0 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c6fe32d0 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a320ae640 1 -- 172.21.15.133:0/3748477264 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4a240083f0 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c6fe24d0 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a320ae640 1 -- 172.21.15.133:0/3748477264 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4a240083f0 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c6fe28e0 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a320ae640 1 -- 172.21.15.133:0/3748477264 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4a24012040 con 0x5581c6e5d160 2024-02-15T23:30:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a33d92980 1 Processor -- start 2024-02-15T23:30:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.463+0000 7f4a33d92980 1 -- start start 2024-02-15T23:30:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a33d92980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ff1a40 0x5581c6ff1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a33d92980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581c6d8bf20 con 0x5581c6ff1a40 2024-02-15T23:30:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a310ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ff1a40 0x5581c6ff1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a310ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ff1a40 0x5581c6ff1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35900/0 (socket says 172.21.15.133:35900) 2024-02-15T23:30:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a310ac640 1 -- 172.21.15.133:0/3256099264 learned_addr learned my addr 172.21.15.133:0/3256099264 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a310ac640 1 -- 172.21.15.133:0/3256099264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581c6ff23a0 con 0x5581c6ff1a40 2024-02-15T23:30:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a310ac640 1 --2- 172.21.15.133:0/3256099264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ff1a40 0x5581c6ff1e60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c096d70 tx=0x7f4a1c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f49177fe640 1 -- 172.21.15.133:0/3256099264 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0b4bf0 con 0x5581c6ff1a40 2024-02-15T23:30:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a33d92980 1 -- 172.21.15.133:0/3256099264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5581c6ff2590 con 0x5581c6ff1a40 2024-02-15T23:30:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f49177fe640 1 -- 172.21.15.133:0/3256099264 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0b4d50 con 0x5581c6ff1a40 2024-02-15T23:30:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f49177fe640 1 -- 172.21.15.133:0/3256099264 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0bd480 con 0x5581c6ff1a40 2024-02-15T23:30:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a33d92980 1 -- 172.21.15.133:0/3256099264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581c6ff30e0 con 0x5581c6ff1a40 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f49177fe640 1 -- 172.21.15.133:0/3256099264 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4a1c0bd6b0 con 0x5581c6ff1a40 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f49177fe640 1 --2- 172.21.15.133:0/3256099264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f490c0342b0 0x7f490c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f49177fe640 1 -- 172.21.15.133:0/3256099264 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4a1c0e5c10 con 0x5581c6ff1a40 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a320ae640 1 --2- 172.21.15.133:0/3256099264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f490c0342b0 0x7f490c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a33d92980 1 Processor -- start 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a33d92980 1 -- start start 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a33d92980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c6ffee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a33d92980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581c6d7f790 con 0x5581c6ffea80 2024-02-15T23:30:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.467+0000 7f4a320ae640 1 --2- 172.21.15.133:0/3256099264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f490c0342b0 0x7f490c036770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5581c6fe1e50 tx=0x7f4a24003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c6ffee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c6ffee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35902/0 (socket says 172.21.15.133:35902) 2024-02-15T23:30:14.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 -- 172.21.15.133:0/2495530652 learned_addr learned my addr 172.21.15.133:0/2495530652 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 -- 172.21.15.133:0/2495530652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581c6fff430 con 0x5581c6ffea80 2024-02-15T23:30:14.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 --2- 172.21.15.133:0/2495530652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c6ffee60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0e3f90 tx=0x7f4a1c0b3710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc042eb37d1e286f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f49157fa640 1 -- 172.21.15.133:0/2495530652 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c006990 con 0x5581c6ffea80 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f49157fa640 1 -- 172.21.15.133:0/2495530652 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c006af0 con 0x5581c6ffea80 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f49157fa640 1 -- 172.21.15.133:0/2495530652 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c006d90 con 0x5581c6ffea80 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- 172.21.15.133:0/2495530652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 msgr2=0x5581c6ffee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 --2- 172.21.15.133:0/2495530652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c6ffee60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0e3f90 tx=0x7f4a1c0b3710 comp rx=0 tx=0).stop 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- 172.21.15.133:0/2495530652 shutdown_connections 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 --2- 172.21.15.133:0/2495530652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c6ffee60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- 172.21.15.133:0/2495530652 >> 172.21.15.133:0/2495530652 conn(0x5581c6ffadc0 msgr2=0x5581c6ff8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- 172.21.15.133:0/2495530652 shutdown_connections 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- 172.21.15.133:0/2495530652 wait complete. 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 Processor -- start 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- start start 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c7005930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581c7005e70 con 0x5581c6ffea80 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c7005930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c7005930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35914/0 (socket says 172.21.15.133:35914) 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 learned_addr learned my addr 172.21.15.133:0/86721401 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581c6ff30e0 con 0x5581c6ffea80 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a310ac640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c7005930 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0bcfd0 tx=0x7f4a1c0bcf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f49037fe640 1 -- 172.21.15.133:0/86721401 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0de040 con 0x5581c6ffea80 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5581c7006070 con 0x5581c6ffea80 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f49037fe640 1 -- 172.21.15.133:0/86721401 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0b3d30 con 0x5581c6ffea80 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f49037fe640 1 -- 172.21.15.133:0/86721401 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0a93a0 con 0x5581c6ffea80 2024-02-15T23:30:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.471+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581c70064a0 con 0x5581c6ffea80 2024-02-15T23:30:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f49037fe640 1 -- 172.21.15.133:0/86721401 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4a1c0a9610 con 0x5581c6ffea80 2024-02-15T23:30:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f49037fe640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48fc0342b0 0x7f48fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f49037fe640 1 -- 172.21.15.133:0/86721401 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4a1c0efd20 con 0x5581c6ffea80 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a320ae640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48fc0342b0 0x7f48fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c7010f40 0x5581c7013400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7013b50 con 0x5581c7010f40 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a318ad640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c7010f40 0x5581c7013400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a320ae640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48fc0342b0 0x7f48fc036770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a24008fd0 tx=0x7f4a2401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a318ad640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c7010f40 0x5581c7013400 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 realm 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7013f20 con 0x5581c7010f40 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c70147a0 con 0x5581c7010f40 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7014b00 con 0x5581c7010f40 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7015300 con 0x5581c7010f40 2024-02-15T23:30:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 20 searching for the correct realm 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5581c7017190 0x5581c7019580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.475+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a310ac640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5581c7017190 0x5581c7019580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a310ac640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5581c7017190 0x5581c7019580 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a310ac640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4a1c0ee020 0x7f4a1c0db8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a1c0ee020 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a320ae640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4a1c0ee020 0x7f4a1c0db8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a320ae640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4a1c0ee020 0x7f4a1c0db8c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2402c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a1c0ee020 2024-02-15T23:30:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2402c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7010f40 2024-02-15T23:30:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7010f40 2024-02-15T23:30:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a318ad640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4a2c007a70 0x7f4a2c046130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a2c007a70 2024-02-15T23:30:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a318ad640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4a2c007a70 0x7f4a2c046130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.479+0000 7f4a318ad640 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4a2c007a70 0x7f4a2c046130 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a2c007a70 2024-02-15T23:30:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a1c0ee020 2024-02-15T23:30:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2402c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7010f40 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a2c007a70 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7010f40 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a1c0ee020 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4a2402c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.483+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a2c007a70 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7010f40 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7010f40 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a2c007a70 2024-02-15T23:30:14.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a1c0ee020 2024-02-15T23:30:14.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2402c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7010f40 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a1c0ee020 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2402c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.487+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a2c007a70 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a1c0ee020 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7017190 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a2c007a70 2024-02-15T23:30:14.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x5581c7010f40 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7019c30 con 0x7f4a1c0ee020 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7015c30 con 0x5581c7010f40 2024-02-15T23:30:14.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7016430 con 0x5581c7010f40 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701a070 con 0x5581c7010f40 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 zone default found 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 4 Realm: () 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 zonegroup default 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701a070 con 0x7f4a1c0ee020 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.491+0000 7f4a33d92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701bef0 con 0x5581c7017190 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701c250 con 0x5581c7017190 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 20 started sync module instance, tier type = 2024-02-15T23:30:14.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:14.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701b4c0 con 0x7f4a1c0ee020 2024-02-15T23:30:14.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94015877920928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701b4c0 con 0x7f4a1c0ee020 2024-02-15T23:30:14.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701cbc0 con 0x5581c7010f40 2024-02-15T23:30:14.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.495+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94015877920928] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.499+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.499+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94015877924944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701b4c0 con 0x5581c7010f40 2024-02-15T23:30:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.499+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701d580 con 0x5581c7017190 2024-02-15T23:30:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.499+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.499+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94015877927136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701de00 con 0x5581c7017190 2024-02-15T23:30:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.499+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701e7f0 con 0x7f4a1c0ee020 2024-02-15T23:30:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.499+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94015877924944] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.503+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.503+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94015877931728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701eba0 con 0x7f4a1c0ee020 2024-02-15T23:30:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.503+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701f510 con 0x5581c7010f40 2024-02-15T23:30:14.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.503+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94015877927136] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.503+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94015877931728] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.503+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.503+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94015877918752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701f070 con 0x5581c7010f40 2024-02-15T23:30:14.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.503+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701fd60 con 0x7f4a2c007a70 2024-02-15T23:30:14.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.507+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94015877918752] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.507+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.507+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94015877929312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701f070 con 0x7f4a2c007a70 2024-02-15T23:30:14.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.507+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7020370 con 0x7f4a2c007a70 2024-02-15T23:30:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.507+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(56 notify.6 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.507+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94015877938896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7020790 con 0x7f4a2c007a70 2024-02-15T23:30:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.507+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7021140 con 0x7f4a2c007a70 2024-02-15T23:30:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.507+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94015877929312] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94015877937344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7021100 con 0x7f4a2c007a70 2024-02-15T23:30:14.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 20 add_watcher() i=0 2024-02-15T23:30:14.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 20 add_watcher() i=1 2024-02-15T23:30:14.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 20 add_watcher() i=2 2024-02-15T23:30:14.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 20 add_watcher() i=3 2024-02-15T23:30:14.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 20 add_watcher() i=4 2024-02-15T23:30:14.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 20 add_watcher() i=5 2024-02-15T23:30:14.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94015877938896] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 20 add_watcher() i=6 2024-02-15T23:30:14.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94015877937344] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 20 add_watcher() i=7 2024-02-15T23:30:14.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:14.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c70202f0 con 0x5581c7010f40 2024-02-15T23:30:14.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.511+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94015877942368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c70202f0 con 0x5581c7010f40 2024-02-15T23:30:14.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94015877942368] v33'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f48e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:14.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:14.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:14.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 5 note: GC not initialized 2024-02-15T23:30:14.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f48e27fc640 20 reqs_thread_entry: start 2024-02-15T23:30:14.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:14.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 Filter name: none 2024-02-15T23:30:14.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4853fff640 20 reqs_thread_entry: start 2024-02-15T23:30:14.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7046540 con 0x7f4a1c0ee020 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 : miss 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:63 8.14 8:292a4b40:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7047e10 con 0x5581c7017190 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(63 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 info.flags=0x17 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 to cache LRU end 2024-02-15T23:30:14.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:14.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:30:14.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 2024-02-15T23:30:14.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 get_obj_state: octx=0x7f4a2c012600 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5581c704a178 s->prefetch_data=0 2024-02-15T23:30:14.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 3.2fs0 3:f6667cc5:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c704b2e0 con 0x5581c7017190 2024-02-15T23:30:14.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(64 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+865 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 10 manifest: total_size = 5 2024-02-15T23:30:14.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.515+0000 7f4a33d92980 20 get_obj_state: setting s->obj_tag to _Du0rrXeT5NVkZ8n4hHjxepCWj39CLkl 2024-02-15T23:30:14.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.519+0000 7f48e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:14.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.519+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94015877942368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7038110 con 0x5581c7010f40 2024-02-15T23:30:14.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.519+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94015877942368] v33'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.519+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94015877920928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7020c60 con 0x7f4a1c0ee020 2024-02-15T23:30:14.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.519+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94015877920928] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.519+0000 7f4a33d92980 20 remove_watcher() i=0 2024-02-15T23:30:14.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.519+0000 7f4a33d92980 2 removed watcher, disabling cache 2024-02-15T23:30:14.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.519+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94015877924944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7020c60 con 0x5581c7010f40 2024-02-15T23:30:14.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.523+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94015877924944] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.523+0000 7f4a33d92980 20 remove_watcher() i=1 2024-02-15T23:30:14.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.523+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94015877927136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c7020c60 con 0x5581c7017190 2024-02-15T23:30:14.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.523+0000 7f4a310ac640 1 -- 172.21.15.133:0/86721401 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94015877927136] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c0eb070 con 0x5581c7017190 2024-02-15T23:30:14.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.523+0000 7f4a33d92980 20 remove_watcher() i=2 2024-02-15T23:30:14.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.523+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94015877931728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701c830 con 0x7f4a1c0ee020 2024-02-15T23:30:14.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.527+0000 7f4a320ae640 1 -- 172.21.15.133:0/86721401 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94015877931728] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2403c040 con 0x7f4a1c0ee020 2024-02-15T23:30:14.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.527+0000 7f4a33d92980 20 remove_watcher() i=3 2024-02-15T23:30:14.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.527+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94015877918752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701c830 con 0x5581c7010f40 2024-02-15T23:30:14.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.527+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94015877918752] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x5581c7010f40 2024-02-15T23:30:14.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.527+0000 7f4a33d92980 20 remove_watcher() i=4 2024-02-15T23:30:14.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.527+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94015877929312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701b020 con 0x7f4a2c007a70 2024-02-15T23:30:14.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.531+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94015877929312] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.531+0000 7f4a33d92980 20 remove_watcher() i=5 2024-02-15T23:30:14.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.531+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94015877938896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701b020 con 0x7f4a2c007a70 2024-02-15T23:30:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.531+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94015877938896] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.531+0000 7f4a33d92980 20 remove_watcher() i=6 2024-02-15T23:30:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.531+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94015877937344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5581c701b020 con 0x7f4a2c007a70 2024-02-15T23:30:14.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94015877937344] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c024020 con 0x7f4a2c007a70 2024-02-15T23:30:14.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 20 remove_watcher() i=7 2024-02-15T23:30:14.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4a2c007a70 msgr2=0x7f4a2c046130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4a2c007a70 0x7f4a2c046130 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c7010f40 msgr2=0x5581c7013400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c7010f40 0x5581c7013400 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4a1c0ee020 msgr2=0x7f4a1c0db8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4a1c0ee020 0x7f4a1c0db8c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5581c7017190 msgr2=0x5581c7019580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5581c7017190 0x5581c7019580 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48fc0342b0 msgr2=0x7f48fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48fc0342b0 0x7f48fc036770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a24008fd0 tx=0x7f4a2401c070 comp rx=0 tx=0).stop 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a318ad640 1 -- 172.21.15.133:0/86721401 reap_dead start 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 msgr2=0x5581c7005930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c7005930 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0bcfd0 tx=0x7f4a1c0bcf40 comp rx=0 tx=0).stop 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 shutdown_connections 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/86721401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ffea80 0x5581c7005930 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 >> 172.21.15.133:0/86721401 conn(0x5581c6ffadc0 msgr2=0x5581c6ff8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 shutdown_connections 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/86721401 wait complete. 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3256099264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f490c0342b0 msgr2=0x7f490c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3256099264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f490c0342b0 0x7f490c036770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5581c6fe1e50 tx=0x7f4a24003070 comp rx=0 tx=0).stop 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3256099264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ff1a40 msgr2=0x5581c6ff1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3256099264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ff1a40 0x5581c6ff1e60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c096d70 tx=0x7f4a1c018020 comp rx=0 tx=0).stop 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3256099264 shutdown_connections 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3256099264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f490c0342b0 0x7f490c036770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3256099264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6ff1a40 0x5581c6ff1e60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3256099264 >> 172.21.15.133:0/3256099264 conn(0x5581c6fe6850 msgr2=0x5581c6fe7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3256099264 shutdown_connections 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3256099264 wait complete. 2024-02-15T23:30:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c6e5d160 msgr2=0x5581c6fe1090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c6e5d160 0x5581c6fe1090 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4918034300 msgr2=0x7f49180367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4918034300 0x7f49180367c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0ac000 tx=0x7f4a1c0a5000 comp rx=0 tx=0).stop 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 msgr2=0x5581c6fda440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fda440 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x5581c6fd4440 tx=0x7f4a2c000f50 comp rx=0 tx=0).stop 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 shutdown_connections 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5581c6e5d160 0x5581c6fe1090 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4918034300 0x7f49180367c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 --2- 172.21.15.133:0/3748477264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581c6e5be20 0x5581c6fda440 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 >> 172.21.15.133:0/3748477264 conn(0x5581c6ee2a50 msgr2=0x5581c6fcdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 shutdown_connections 2024-02-15T23:30:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.535+0000 7f4a33d92980 1 -- 172.21.15.133:0/3748477264 wait complete. 2024-02-15T23:30:14.554 INFO:teuthology.orchestra.run.smithi133.stdout:fooFoofooFooFULL_CONTROL 2024-02-15T23:30:14.555 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-02-15T23:30:14.557 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-02-15T23:30:14.565 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:14.565 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-15T23:30:14.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-15T23:30:14.565 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-15T23:30:14.635 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:14.635 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:14.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.627+0000 7fb985fa5980 1 Processor -- start 2024-02-15T23:30:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.627+0000 7fb985fa5980 1 -- start start 2024-02-15T23:30:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.627+0000 7fb985fa5980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55942abc8860 0x55942abcac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.627+0000 7fb985fa5980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55942ab0e4d0 con 0x55942abc4360 2024-02-15T23:30:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.627+0000 7fb985fa5980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55942aad5180 con 0x55942abc8860 2024-02-15T23:30:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.627+0000 7fb9832bf640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55942abc8860 0x55942abcac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.627+0000 7fb9832bf640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55942abc8860 0x55942abcac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35926/0 (socket says 172.21.15.133:35926) 2024-02-15T23:30:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.627+0000 7fb9832bf640 1 -- 172.21.15.133:0/233751689 learned_addr learned my addr 172.21.15.133:0/233751689 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb9832bf640 1 -- 172.21.15.133:0/233751689 >> v1:172.21.15.131:6789/0 conn(0x55942abc4360 legacy=0x55942abc4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb9832bf640 1 -- 172.21.15.133:0/233751689 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942abcc1a0 con 0x55942abc8860 2024-02-15T23:30:14.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb9832bf640 1 --2- 172.21.15.133:0/233751689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc8860 0x55942abcac50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00a5c0 tx=0x7fb96c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63d048026f4393e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb982abe640 1 -- 172.21.15.133:0/233751689 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96c0aa470 con 0x55942abc8860 2024-02-15T23:30:14.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb982abe640 1 -- 172.21.15.133:0/233751689 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c0aa5d0 con 0x55942abc8860 2024-02-15T23:30:14.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb982abe640 1 -- 172.21.15.133:0/233751689 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96c0aa890 con 0x55942abc8860 2024-02-15T23:30:14.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb985fa5980 1 -- 172.21.15.133:0/233751689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc8860 msgr2=0x55942abcac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb985fa5980 1 --2- 172.21.15.133:0/233751689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc8860 0x55942abcac50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00a5c0 tx=0x7fb96c01b340 comp rx=0 tx=0).stop 2024-02-15T23:30:14.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb985fa5980 1 -- 172.21.15.133:0/233751689 shutdown_connections 2024-02-15T23:30:14.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb985fa5980 1 --2- 172.21.15.133:0/233751689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc8860 0x55942abcac50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb985fa5980 1 -- 172.21.15.133:0/233751689 >> 172.21.15.133:0/233751689 conn(0x55942ab37a50 msgr2=0x55942ab37e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb985fa5980 1 -- 172.21.15.133:0/233751689 shutdown_connections 2024-02-15T23:30:14.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.631+0000 7fb985fa5980 1 -- 172.21.15.133:0/233751689 wait complete. 2024-02-15T23:30:14.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.647+0000 7fb985fa5980 1 Processor -- start 2024-02-15T23:30:14.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.647+0000 7fb985fa5980 1 -- start start 2024-02-15T23:30:14.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.647+0000 7fb985fa5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.647+0000 7fb985fa5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942aad26b0 con 0x55942abc4360 2024-02-15T23:30:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35930/0 (socket says 172.21.15.133:35930) 2024-02-15T23:30:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 -- 172.21.15.133:0/2708591433 learned_addr learned my addr 172.21.15.133:0/2708591433 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 -- 172.21.15.133:0/2708591433 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c005df0 con 0x55942abc4360 2024-02-15T23:30:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 --2- 172.21.15.133:0/2708591433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acae2c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb974006fb0 tx=0x7fb974001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60859986c42fdfa1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb871e0b640 1 -- 172.21.15.133:0/2708591433 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb97400f640 con 0x55942abc4360 2024-02-15T23:30:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb871e0b640 1 -- 172.21.15.133:0/2708591433 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97400f7c0 con 0x55942abc4360 2024-02-15T23:30:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb871e0b640 1 -- 172.21.15.133:0/2708591433 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb97400fae0 con 0x55942abc4360 2024-02-15T23:30:14.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 -- 172.21.15.133:0/2708591433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 msgr2=0x55942acae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2708591433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acae2c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb974006fb0 tx=0x7fb974001940 comp rx=0 tx=0).stop 2024-02-15T23:30:14.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 -- 172.21.15.133:0/2708591433 shutdown_connections 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2708591433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acae2c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 -- 172.21.15.133:0/2708591433 >> 172.21.15.133:0/2708591433 conn(0x55942ab37a50 msgr2=0x55942aca9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 -- 172.21.15.133:0/2708591433 shutdown_connections 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 -- 172.21.15.133:0/2708591433 wait complete. 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 Processor -- start 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 -- start start 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acb5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb985fa5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942aacde90 con 0x55942abc4360 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acb5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acb5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35940/0 (socket says 172.21.15.133:35940) 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 -- 172.21.15.133:0/819971926 learned_addr learned my addr 172.21.15.133:0/819971926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 -- 172.21.15.133:0/819971926 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942ab0e4d0 con 0x55942abc4360 2024-02-15T23:30:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb983ac0640 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acb5130 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55942acaf150 tx=0x7fb974000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.651+0000 7fb86bfff640 1 -- 172.21.15.133:0/819971926 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb974005450 con 0x55942abc4360 2024-02-15T23:30:14.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55942acb5670 con 0x55942abc4360 2024-02-15T23:30:14.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb86bfff640 1 -- 172.21.15.133:0/819971926 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9740055b0 con 0x55942abc4360 2024-02-15T23:30:14.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb86bfff640 1 -- 172.21.15.133:0/819971926 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9740058b0 con 0x55942abc4360 2024-02-15T23:30:14.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55942acb5ac0 con 0x55942abc4360 2024-02-15T23:30:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb86bfff640 1 -- 172.21.15.133:0/819971926 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb974005b20 con 0x55942abc4360 2024-02-15T23:30:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb86bfff640 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb86c034300 0x7fb86c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb86bfff640 1 -- 172.21.15.133:0/819971926 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb974049290 con 0x55942abc4360 2024-02-15T23:30:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb9832bf640 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb86c034300 0x7fb86c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb985fa5980 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942abc8860 0x55942acbbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acbc2e0 con 0x55942abc8860 2024-02-15T23:30:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb9842c1640 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942abc8860 0x55942acbbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb9832bf640 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb86c034300 0x7fb86c0367c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ae000 tx=0x7fb96c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb9842c1640 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942abc8860 0x55942acbbda0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb9842c1640 1 -- 172.21.15.133:0/819971926 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb97c0083f0 con 0x55942abc8860 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acb94c0 con 0x55942abc8860 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb9842c1640 1 -- 172.21.15.133:0/819971926 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb97c0083f0 con 0x55942abc8860 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acbe010 con 0x55942abc8860 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb9842c1640 1 -- 172.21.15.133:0/819971926 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb97c0083f0 con 0x55942abc8860 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acbd210 con 0x55942abc8860 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb9842c1640 1 -- 172.21.15.133:0/819971926 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb97c0083f0 con 0x55942abc8860 2024-02-15T23:30:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.655+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acbd620 con 0x55942abc8860 2024-02-15T23:30:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb9842c1640 1 -- 172.21.15.133:0/819971926 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb97c012040 con 0x55942abc8860 2024-02-15T23:30:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb985fa5980 1 Processor -- start 2024-02-15T23:30:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb985fa5980 1 -- start start 2024-02-15T23:30:14.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb985fa5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942accc690 0x55942acccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb985fa5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942aa66f20 con 0x55942accc690 2024-02-15T23:30:14.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb9832bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942accc690 0x55942acccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb9832bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942accc690 0x55942acccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35946/0 (socket says 172.21.15.133:35946) 2024-02-15T23:30:14.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb9832bf640 1 -- 172.21.15.133:0/3249664073 learned_addr learned my addr 172.21.15.133:0/3249664073 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb9832bf640 1 -- 172.21.15.133:0/3249664073 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942acccff0 con 0x55942accc690 2024-02-15T23:30:14.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb9832bf640 1 --2- 172.21.15.133:0/3249664073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942accc690 0x55942acccab0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ac040 tx=0x7fb96c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb8697fa640 1 -- 172.21.15.133:0/3249664073 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96c0b3cd0 con 0x55942accc690 2024-02-15T23:30:14.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb8697fa640 1 -- 172.21.15.133:0/3249664073 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c0c3070 con 0x55942accc690 2024-02-15T23:30:14.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb985fa5980 1 -- 172.21.15.133:0/3249664073 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55942accd1e0 con 0x55942accc690 2024-02-15T23:30:14.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb8697fa640 1 -- 172.21.15.133:0/3249664073 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96c0c8430 con 0x55942accc690 2024-02-15T23:30:14.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.659+0000 7fb985fa5980 1 -- 172.21.15.133:0/3249664073 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55942accdcd0 con 0x55942accc690 2024-02-15T23:30:14.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb8697fa640 1 -- 172.21.15.133:0/3249664073 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb96c0c5030 con 0x55942accc690 2024-02-15T23:30:14.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb8697fa640 1 --2- 172.21.15.133:0/3249664073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb85c034300 0x7fb85c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb8697fa640 1 -- 172.21.15.133:0/3249664073 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb96c0e68f0 con 0x55942accc690 2024-02-15T23:30:14.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb9842c1640 1 --2- 172.21.15.133:0/3249664073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb85c034300 0x7fb85c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 Processor -- start 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- start start 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb9842c1640 1 --2- 172.21.15.133:0/3249664073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb85c034300 0x7fb85c0367c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55942acbcc50 tx=0x7fb97c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942acd9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942aa5a790 con 0x55942acd96c0 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb9832bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942acd9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb9832bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942acd9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35952/0 (socket says 172.21.15.133:35952) 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb9832bf640 1 -- 172.21.15.133:0/4192125081 learned_addr learned my addr 172.21.15.133:0/4192125081 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb9832bf640 1 -- 172.21.15.133:0/4192125081 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942acda070 con 0x55942acd96c0 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb9832bf640 1 --2- 172.21.15.133:0/4192125081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942acd9aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0befd0 tx=0x7fb96c0bd630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0721d8c06338b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb862ffd640 1 -- 172.21.15.133:0/4192125081 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96c0d6040 con 0x55942acd96c0 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb862ffd640 1 -- 172.21.15.133:0/4192125081 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c0d1e10 con 0x55942acd96c0 2024-02-15T23:30:14.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb862ffd640 1 -- 172.21.15.133:0/4192125081 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96c0c7e40 con 0x55942acd96c0 2024-02-15T23:30:14.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- 172.21.15.133:0/4192125081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 msgr2=0x55942acd9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 --2- 172.21.15.133:0/4192125081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942acd9aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0befd0 tx=0x7fb96c0bd630 comp rx=0 tx=0).stop 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- 172.21.15.133:0/4192125081 shutdown_connections 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 --2- 172.21.15.133:0/4192125081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942acd9aa0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- 172.21.15.133:0/4192125081 >> 172.21.15.133:0/4192125081 conn(0x55942acd5a00 msgr2=0x55942acd3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- 172.21.15.133:0/4192125081 shutdown_connections 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- 172.21.15.133:0/4192125081 wait complete. 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 Processor -- start 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- start start 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942ace0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb985fa5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942ace0a50 con 0x55942acd96c0 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.663+0000 7fb9832bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942ace0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb9832bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942ace0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35954/0 (socket says 172.21.15.133:35954) 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 learned_addr learned my addr 172.21.15.133:0/2490151551 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942accdcd0 con 0x55942acd96c0 2024-02-15T23:30:14.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb9832bf640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942ace0510 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0de040 tx=0x7fb96c0e4b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb8617fa640 1 -- 172.21.15.133:0/2490151551 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96c0bc5c0 con 0x55942acd96c0 2024-02-15T23:30:14.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55942ace0c50 con 0x55942acd96c0 2024-02-15T23:30:14.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb8617fa640 1 -- 172.21.15.133:0/2490151551 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c0bdbb0 con 0x55942acd96c0 2024-02-15T23:30:14.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb8617fa640 1 -- 172.21.15.133:0/2490151551 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96c0bde90 con 0x55942acd96c0 2024-02-15T23:30:14.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55942ace10e0 con 0x55942acd96c0 2024-02-15T23:30:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb8617fa640 1 -- 172.21.15.133:0/2490151551 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb96c0e6b50 con 0x55942acd96c0 2024-02-15T23:30:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb8617fa640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb84c034210 0x7fb84c0366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb8617fa640 1 -- 172.21.15.133:0/2490151551 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb96c0f9d60 con 0x55942acd96c0 2024-02-15T23:30:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb9842c1640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb84c034210 0x7fb84c0366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942aceb7c0 0x55942acedc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acee3d0 con 0x55942aceb7c0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb983ac0640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942aceb7c0 0x55942acedc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb9842c1640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb84c034210 0x7fb84c0366d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb97c008fd0 tx=0x7fb97c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb983ac0640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942aceb7c0 0x55942acedc80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 20 realm 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.667+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acee7a0 con 0x55942aceb7c0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acef020 con 0x55942aceb7c0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acef380 con 0x55942aceb7c0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acefb80 con 0x55942aceb7c0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 20 searching for the correct realm 2024-02-15T23:30:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55942acf1a10 0x55942acf3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9832bf640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55942acf1a10 0x55942acf3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9832bf640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55942acf1a10 0x55942acf3ea0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9832bf640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb96c0f8060 0x7fb96c0bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb96c0f8060 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9842c1640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb96c0f8060 0x7fb96c0bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9842c1640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb96c0f8060 0x7fb96c0bf940 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb97c02c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb96c0f8060 2024-02-15T23:30:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb97c02c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942aceb7c0 2024-02-15T23:30:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942aceb7c0 2024-02-15T23:30:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb974026020 0x7fb974040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.671+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb974026020 2024-02-15T23:30:14.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb974026020 0x7fb974040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb974026020 0x7fb974040df0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb974026020 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb96c0f8060 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb97c02c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942aceb7c0 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb974026020 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942aceb7c0 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.675+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb96c0f8060 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb97c02c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb974026020 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942aceb7c0 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942aceb7c0 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb974026020 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb96c0f8060 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb97c02c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.679+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942aceb7c0 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb96c0f8060 2024-02-15T23:30:14.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb97c02c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb974026020 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb96c0f8060 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942acf1a10 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb974026020 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x55942aceb7c0 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf4570 con 0x7fb96c0f8060 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf0480 con 0x55942aceb7c0 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.683+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf0c80 con 0x55942aceb7c0 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf49b0 con 0x55942aceb7c0 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 zone default found 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 4 Realm: () 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 zonegroup default 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf49b0 con 0x7fb96c0f8060 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf6830 con 0x55942acf1a10 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf6b90 con 0x55942acf1a10 2024-02-15T23:30:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 started sync module instance, tier type = 2024-02-15T23:30:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf5e00 con 0x7fb96c0f8060 2024-02-15T23:30:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94094861754848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf5e00 con 0x7fb96c0f8060 2024-02-15T23:30:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.687+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf7500 con 0x55942aceb7c0 2024-02-15T23:30:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.691+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94094861754848] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.691+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.691+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94094861752944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf7500 con 0x55942aceb7c0 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.691+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf7e70 con 0x55942acf1a10 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.691+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.691+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94094861760976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf86c0 con 0x55942acf1a10 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.691+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf90c0 con 0x7fb96c0f8060 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94094861752944] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94094861765568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf9470 con 0x7fb96c0f8060 2024-02-15T23:30:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf9e20 con 0x55942aceb7c0 2024-02-15T23:30:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94094861760976] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94094861765568] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94094861758560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf9940 con 0x55942aceb7c0 2024-02-15T23:30:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.695+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfa670 con 0x7fb974026020 2024-02-15T23:30:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.699+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.699+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94094861771216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf9940 con 0x7fb974026020 2024-02-15T23:30:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.699+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94094861758560] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.699+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf8260 con 0x7fb974026020 2024-02-15T23:30:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.699+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94094861771216] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.699+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.699+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94094861763168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfac30 con 0x7fb974026020 2024-02-15T23:30:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.699+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfb5a0 con 0x7fb974026020 2024-02-15T23:30:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94094861763168] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94094861772272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfb5a0 con 0x7fb974026020 2024-02-15T23:30:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 20 add_watcher() i=0 2024-02-15T23:30:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 20 add_watcher() i=1 2024-02-15T23:30:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 20 add_watcher() i=2 2024-02-15T23:30:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 20 add_watcher() i=3 2024-02-15T23:30:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 20 add_watcher() i=4 2024-02-15T23:30:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 20 add_watcher() i=5 2024-02-15T23:30:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 20 add_watcher() i=6 2024-02-15T23:30:14.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94094861772272] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 20 add_watcher() i=7 2024-02-15T23:30:14.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:14.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfe9d0 con 0x55942aceb7c0 2024-02-15T23:30:14.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.703+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94094861787984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfb710 con 0x55942aceb7c0 2024-02-15T23:30:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94094861787984] v33'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb839fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 5 note: GC not initialized 2024-02-15T23:30:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb838fe1640 20 reqs_thread_entry: start 2024-02-15T23:30:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 Filter name: none 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb7b27fc640 20 reqs_thread_entry: start 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942ad20df0 con 0x7fb96c0f8060 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 : miss 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:63 8.14 8:292a4b40:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942ad226c0 con 0x55942acf1a10 2024-02-15T23:30:14.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(63 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:30:14.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 info.flags=0x17 2024-02-15T23:30:14.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 to cache LRU end 2024-02-15T23:30:14.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:14.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:30:14.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 2024-02-15T23:30:14.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 get_obj_state: octx=0x7fb974018c60 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55942ad24b28 s->prefetch_data=0 2024-02-15T23:30:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 3.2fs0 3:f6667cc5:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942ad25c90 con 0x55942acf1a10 2024-02-15T23:30:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(64 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 10 manifest: total_size = 5 2024-02-15T23:30:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 20 get_obj_state: setting s->obj_tag to _kcjoO3sk-VnK9rwuHkeK2KNIiOWMJw- 2024-02-15T23:30:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb839fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.707+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94094861787984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfde30 con 0x55942aceb7c0 2024-02-15T23:30:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.711+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94094861787984] v33'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.711+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94094861754848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfe350 con 0x7fb96c0f8060 2024-02-15T23:30:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.711+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94094861754848] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.711+0000 7fb985fa5980 20 remove_watcher() i=0 2024-02-15T23:30:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.711+0000 7fb985fa5980 2 removed watcher, disabling cache 2024-02-15T23:30:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.711+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94094861752944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf61e0 con 0x55942aceb7c0 2024-02-15T23:30:14.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94094861752944] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb985fa5980 20 remove_watcher() i=1 2024-02-15T23:30:14.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94094861760976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf5a70 con 0x55942acf1a10 2024-02-15T23:30:14.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb9832bf640 1 -- 172.21.15.133:0/2490151551 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94094861760976] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96c0e2040 con 0x55942acf1a10 2024-02-15T23:30:14.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb985fa5980 20 remove_watcher() i=2 2024-02-15T23:30:14.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94094861765568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf5a70 con 0x7fb96c0f8060 2024-02-15T23:30:14.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb9842c1640 1 -- 172.21.15.133:0/2490151551 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94094861765568] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb97c03c040 con 0x7fb96c0f8060 2024-02-15T23:30:14.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb985fa5980 20 remove_watcher() i=3 2024-02-15T23:30:14.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.715+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94094861758560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf8bc0 con 0x55942aceb7c0 2024-02-15T23:30:14.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.719+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94094861758560] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x55942aceb7c0 2024-02-15T23:30:14.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.719+0000 7fb985fa5980 20 remove_watcher() i=4 2024-02-15T23:30:14.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.719+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94094861771216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acf8bc0 con 0x7fb974026020 2024-02-15T23:30:14.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.723+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94094861771216] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.723+0000 7fb985fa5980 20 remove_watcher() i=5 2024-02-15T23:30:14.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.723+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94094861763168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfa1d0 con 0x7fb974026020 2024-02-15T23:30:14.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.723+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94094861763168] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.723+0000 7fb985fa5980 20 remove_watcher() i=6 2024-02-15T23:30:14.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.723+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94094861772272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55942acfa1d0 con 0x7fb974026020 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94094861772272] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb974023070 con 0x7fb974026020 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 20 remove_watcher() i=7 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb974026020 msgr2=0x7fb974040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fb974026020 0x7fb974040df0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942aceb7c0 msgr2=0x55942acedc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942aceb7c0 0x55942acedc80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb96c0f8060 msgr2=0x7fb96c0bf940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fb96c0f8060 0x7fb96c0bf940 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55942acf1a10 msgr2=0x55942acf3ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55942acf1a10 0x55942acf3ea0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb84c034210 msgr2=0x7fb84c0366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb84c034210 0x7fb84c0366d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb97c008fd0 tx=0x7fb97c01c070 comp rx=0 tx=0).stop 2024-02-15T23:30:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 msgr2=0x55942ace0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942ace0510 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0de040 tx=0x7fb96c0e4b10 comp rx=0 tx=0).stop 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb983ac0640 1 -- 172.21.15.133:0/2490151551 reap_dead start 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 shutdown_connections 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/2490151551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942acd96c0 0x55942ace0510 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 >> 172.21.15.133:0/2490151551 conn(0x55942acd5a00 msgr2=0x55942acd3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 shutdown_connections 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/2490151551 wait complete. 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/3249664073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb85c034300 msgr2=0x7fb85c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/3249664073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb85c034300 0x7fb85c0367c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55942acbcc50 tx=0x7fb97c003070 comp rx=0 tx=0).stop 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/3249664073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942accc690 msgr2=0x55942acccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/3249664073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942accc690 0x55942acccab0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ac040 tx=0x7fb96c0180e0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/3249664073 shutdown_connections 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/3249664073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb85c034300 0x7fb85c0367c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/3249664073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942accc690 0x55942acccab0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/3249664073 >> 172.21.15.133:0/3249664073 conn(0x55942acc14a0 msgr2=0x55942acc1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/3249664073 shutdown_connections 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/3249664073 wait complete. 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942abc8860 msgr2=0x55942acbbda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942abc8860 0x55942acbbda0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb86c034300 msgr2=0x7fb86c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb86c034300 0x7fb86c0367c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ae000 tx=0x7fb96c0a6000 comp rx=0 tx=0).stop 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 msgr2=0x55942acb5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acb5130 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55942acaf150 tx=0x7fb974000f50 comp rx=0 tx=0).stop 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 shutdown_connections 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55942abc8860 0x55942acbbda0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb86c034300 0x7fb86c0367c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 --2- 172.21.15.133:0/819971926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942abc4360 0x55942acb5130 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 >> 172.21.15.133:0/819971926 conn(0x55942ab37a50 msgr2=0x55942aca8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 shutdown_connections 2024-02-15T23:30:14.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.727+0000 7fb985fa5980 1 -- 172.21.15.133:0/819971926 wait complete. 2024-02-15T23:30:14.747 INFO:teuthology.orchestra.run.smithi133.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-15T23:30:14.747 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-15T23:30:14.750 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-02-15T23:30:14.773 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:14.876 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-15T23:30:14.876 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-15T23:30:14.877 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-15T23:30:14.877 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-15T23:30:14.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-15T23:30:14.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-15T23:30:14.877 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-02-15T23:30:14.916 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:14.916 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:14.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.907+0000 7f1fda6bc980 1 Processor -- start 2024-02-15T23:30:14.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.907+0000 7f1fda6bc980 1 -- start start 2024-02-15T23:30:14.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fda6bc980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5606ef3f6520 0x5606ef3f8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fda6bc980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5606ef33e4d0 con 0x5606ef366910 2024-02-15T23:30:14.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fda6bc980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5606ef305180 con 0x5606ef3f6520 2024-02-15T23:30:14.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd79d6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5606ef3f6520 0x5606ef3f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd81d7640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5606ef366910 0x5606ef3f4e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:60368/0 (socket says 172.21.15.133:60368) 2024-02-15T23:30:14.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd79d6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5606ef3f6520 0x5606ef3f8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35960/0 (socket says 172.21.15.133:35960) 2024-02-15T23:30:14.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd81d7640 1 -- 172.21.15.133:0/2367798626 learned_addr learned my addr 172.21.15.133:0/2367798626 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:14.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd79d6640 1 -- 172.21.15.133:0/2367798626 >> v1:172.21.15.131:6789/0 conn(0x5606ef366910 legacy=0x5606ef3f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd79d6640 1 -- 172.21.15.133:0/2367798626 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ef3f9ef0 con 0x5606ef3f6520 2024-02-15T23:30:14.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/2367798626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f6520 0x5606ef3f8910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00a480 tx=0x7f1fcc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff6899465ad320d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd71d5640 1 -- 172.21.15.133:0/2367798626 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0ab540 con 0x5606ef3f6520 2024-02-15T23:30:14.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd71d5640 1 -- 172.21.15.133:0/2367798626 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0ab6a0 con 0x5606ef3f6520 2024-02-15T23:30:14.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.911+0000 7f1fd71d5640 1 -- 172.21.15.133:0/2367798626 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0ab960 con 0x5606ef3f6520 2024-02-15T23:30:14.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.915+0000 7f1fda6bc980 1 -- 172.21.15.133:0/2367798626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f6520 msgr2=0x5606ef3f8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.915+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/2367798626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f6520 0x5606ef3f8910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00a480 tx=0x7f1fcc01b280 comp rx=0 tx=0).stop 2024-02-15T23:30:14.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.915+0000 7f1fda6bc980 1 -- 172.21.15.133:0/2367798626 shutdown_connections 2024-02-15T23:30:14.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.915+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/2367798626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f6520 0x5606ef3f8910 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.915+0000 7f1fda6bc980 1 -- 172.21.15.133:0/2367798626 >> 172.21.15.133:0/2367798626 conn(0x5606ef3ec920 msgr2=0x5606ef3eed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.915+0000 7f1fda6bc980 1 -- 172.21.15.133:0/2367798626 shutdown_connections 2024-02-15T23:30:14.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.915+0000 7f1fda6bc980 1 -- 172.21.15.133:0/2367798626 wait complete. 2024-02-15T23:30:14.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 Processor -- start 2024-02-15T23:30:14.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 -- start start 2024-02-15T23:30:14.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ef3026b0 con 0x5606ef366910 2024-02-15T23:30:14.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fd81d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fd81d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35964/0 (socket says 172.21.15.133:35964) 2024-02-15T23:30:14.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fd81d7640 1 -- 172.21.15.133:0/864254207 learned_addr learned my addr 172.21.15.133:0/864254207 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fd81d7640 1 -- 172.21.15.133:0/864254207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc005d30 con 0x5606ef366910 2024-02-15T23:30:14.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fd81d7640 1 --2- 172.21.15.133:0/864254207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4dc0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8001c00 tx=0x7f1fc800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1961b588564e405 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1ec660c640 1 -- 172.21.15.133:0/864254207 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc800e690 con 0x5606ef366910 2024-02-15T23:30:14.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1ec660c640 1 -- 172.21.15.133:0/864254207 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc800e810 con 0x5606ef366910 2024-02-15T23:30:14.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1ec660c640 1 -- 172.21.15.133:0/864254207 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc800eb30 con 0x5606ef366910 2024-02-15T23:30:14.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 -- 172.21.15.133:0/864254207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 msgr2=0x5606ef4dc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/864254207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4dc0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8001c00 tx=0x7f1fc800b6d0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 -- 172.21.15.133:0/864254207 shutdown_connections 2024-02-15T23:30:14.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/864254207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4dc0a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 -- 172.21.15.133:0/864254207 >> 172.21.15.133:0/864254207 conn(0x5606ef3ec920 msgr2=0x5606ef4d7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 -- 172.21.15.133:0/864254207 shutdown_connections 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 -- 172.21.15.133:0/864254207 wait complete. 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.931+0000 7f1fda6bc980 1 Processor -- start 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fda6bc980 1 -- start start 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fda6bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fda6bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ef2fde90 con 0x5606ef366910 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fd81d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fd81d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4e2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35970/0 (socket says 172.21.15.133:35970) 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fd81d7640 1 -- 172.21.15.133:0/10771796 learned_addr learned my addr 172.21.15.133:0/10771796 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fd81d7640 1 -- 172.21.15.133:0/10771796 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ef33e4d0 con 0x5606ef366910 2024-02-15T23:30:14.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fd81d7640 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4e2ef0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800b710 tx=0x7f1fc8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1ec4e09640 1 -- 172.21.15.133:0/10771796 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc801f070 con 0x5606ef366910 2024-02-15T23:30:14.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ef4e3430 con 0x5606ef366910 2024-02-15T23:30:14.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1ec4e09640 1 -- 172.21.15.133:0/10771796 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc801a910 con 0x5606ef366910 2024-02-15T23:30:14.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1ec4e09640 1 -- 172.21.15.133:0/10771796 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc801abf0 con 0x5606ef366910 2024-02-15T23:30:14.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ef4e3880 con 0x5606ef366910 2024-02-15T23:30:14.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1ec4e09640 1 -- 172.21.15.133:0/10771796 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fc800a040 con 0x5606ef366910 2024-02-15T23:30:14.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1ec4e09640 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec00342b0 0x7f1ec0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1ec4e09640 1 -- 172.21.15.133:0/10771796 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1fc804a000 con 0x5606ef366910 2024-02-15T23:30:14.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec00342b0 0x7f1ec0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef3f6520 0x5606ef4e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef4ea0c0 con 0x5606ef3f6520 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fd89d8640 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef3f6520 0x5606ef4e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.935+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec00342b0 0x7f1ec0036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0ad000 tx=0x7f1fcc0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd89d8640 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef3f6520 0x5606ef4e9b80 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd89d8640 1 -- 172.21.15.133:0/10771796 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fd000a4d0 con 0x5606ef3f6520 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef4ea460 con 0x5606ef3f6520 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd89d8640 1 -- 172.21.15.133:0/10771796 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1fd000a4d0 con 0x5606ef3f6520 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef4ebce0 con 0x5606ef3f6520 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd89d8640 1 -- 172.21.15.133:0/10771796 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1fd000a4d0 con 0x5606ef3f6520 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef4eaee0 con 0x5606ef3f6520 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd89d8640 1 -- 172.21.15.133:0/10771796 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fd000a4d0 con 0x5606ef3f6520 2024-02-15T23:30:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef4eb2f0 con 0x5606ef3f6520 2024-02-15T23:30:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd89d8640 1 -- 172.21.15.133:0/10771796 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1fd000a4d0 con 0x5606ef3f6520 2024-02-15T23:30:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fda6bc980 1 Processor -- start 2024-02-15T23:30:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fda6bc980 1 -- start start 2024-02-15T23:30:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fda6bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef4fa3e0 0x5606ef4fa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fda6bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ef296f20 con 0x5606ef4fa3e0 2024-02-15T23:30:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd79d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef4fa3e0 0x5606ef4fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd79d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef4fa3e0 0x5606ef4fa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35972/0 (socket says 172.21.15.133:35972) 2024-02-15T23:30:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd79d6640 1 -- 172.21.15.133:0/3503821110 learned_addr learned my addr 172.21.15.133:0/3503821110 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd79d6640 1 -- 172.21.15.133:0/3503821110 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ef4fad40 con 0x5606ef4fa3e0 2024-02-15T23:30:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/3503821110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef4fa3e0 0x5606ef4fa800 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc096e80 tx=0x7f1fcc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.939+0000 7f1ebdffb640 1 -- 172.21.15.133:0/3503821110 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0bd8a0 con 0x5606ef4fa3e0 2024-02-15T23:30:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1ebdffb640 1 -- 172.21.15.133:0/3503821110 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0bda00 con 0x5606ef4fa3e0 2024-02-15T23:30:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- 172.21.15.133:0/3503821110 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ef4faf30 con 0x5606ef4fa3e0 2024-02-15T23:30:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1ebdffb640 1 -- 172.21.15.133:0/3503821110 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0bdca0 con 0x5606ef4fa3e0 2024-02-15T23:30:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- 172.21.15.133:0/3503821110 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ef4fba80 con 0x5606ef4fa3e0 2024-02-15T23:30:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1ebdffb640 1 -- 172.21.15.133:0/3503821110 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fcc0be480 con 0x5606ef4fa3e0 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1ebdffb640 1 --2- 172.21.15.133:0/3503821110 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb00342b0 0x7f1eb0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1ebdffb640 1 -- 172.21.15.133:0/3503821110 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1fcc0e6400 con 0x5606ef4fa3e0 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fd89d8640 1 --2- 172.21.15.133:0/3503821110 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb00342b0 0x7f1eb0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 Processor -- start 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- start start 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fd89d8640 1 --2- 172.21.15.133:0/3503821110 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb00342b0 0x7f1eb0036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5606ef4ea920 tx=0x7f1fd0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef3f2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ef28a790 con 0x5606ef3f23b0 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fd79d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef3f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fd79d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef3f2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35976/0 (socket says 172.21.15.133:35976) 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1006081053 learned_addr learned my addr 172.21.15.133:0/1006081053 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1006081053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ef3f0be0 con 0x5606ef3f23b0 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/1006081053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef3f2790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0e4780 tx=0x7f1fcc0aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ba784cd179fe87 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1eb77fe640 1 -- 172.21.15.133:0/1006081053 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0064c0 con 0x5606ef3f23b0 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1eb77fe640 1 -- 172.21.15.133:0/1006081053 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0be730 con 0x5606ef3f23b0 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1eb77fe640 1 -- 172.21.15.133:0/1006081053 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0b4c50 con 0x5606ef3f23b0 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1006081053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 msgr2=0x5606ef3f2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1006081053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef3f2790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0e4780 tx=0x7f1fcc0aae30 comp rx=0 tx=0).stop 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1006081053 shutdown_connections 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1006081053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef3f2790 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:14.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1006081053 >> 172.21.15.133:0/1006081053 conn(0x5606ef503750 msgr2=0x5606ef5017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1006081053 shutdown_connections 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.943+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1006081053 wait complete. 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fda6bc980 1 Processor -- start 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fda6bc980 1 -- start start 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fda6bc980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef5104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fda6bc980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ef510a30 con 0x5606ef3f23b0 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fd79d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef5104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fd79d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef5104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35980/0 (socket says 172.21.15.133:35980) 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 learned_addr learned my addr 172.21.15.133:0/1633794575 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ef4fba80 con 0x5606ef3f23b0 2024-02-15T23:30:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef5104f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0aae70 tx=0x7f1fcc0e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1eb5ffb640 1 -- 172.21.15.133:0/1633794575 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0d5050 con 0x5606ef3f23b0 2024-02-15T23:30:14.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1eb5ffb640 1 -- 172.21.15.133:0/1633794575 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0d6040 con 0x5606ef3f23b0 2024-02-15T23:30:14.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ef510c30 con 0x5606ef3f23b0 2024-02-15T23:30:14.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1eb5ffb640 1 -- 172.21.15.133:0/1633794575 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0068e0 con 0x5606ef3f23b0 2024-02-15T23:30:14.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ef511060 con 0x5606ef3f23b0 2024-02-15T23:30:14.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1eb5ffb640 1 -- 172.21.15.133:0/1633794575 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fcc0b4c50 con 0x5606ef3f23b0 2024-02-15T23:30:14.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1eb5ffb640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 0x7f1ea8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1eb5ffb640 1 -- 172.21.15.133:0/1633794575 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1fcc0ac050 con 0x5606ef3f23b0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fd89d8640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 0x7f1ea8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.947+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef51bae0 0x5606ef51dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef51e6f0 con 0x5606ef51bae0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd81d7640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef51bae0 0x5606ef51dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd89d8640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 0x7f1ea8036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0011010 tx=0x7f1fd0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd81d7640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef51bae0 0x5606ef51dfa0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 realm 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef51eac0 con 0x5606ef51bae0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef51f340 con 0x5606ef51bae0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef51f6a0 con 0x5606ef51bae0 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef51fea0 con 0x5606ef51bae0 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 20 searching for the correct realm 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5606ef521d30 0x5606ef5241a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5606ef521d30 0x5606ef5241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5606ef521d30 0x5606ef5241a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd79d6640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fcc0f0060 0x7f1fcc0a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fcc0f0060 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd89d8640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fcc0f0060 0x7f1fcc0a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.951+0000 7f1fd89d8640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fcc0f0060 0x7f1fcc0a48b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd000a4d0 con 0x7f1fcc0f0060 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fcc0f0060 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd000a4d0 con 0x7f1fcc0f0060 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef51bae0 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef51bae0 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fc802d5c0 0x7f1fc80243d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fc802d5c0 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fc802d5c0 0x7f1fc80243d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fc802d5c0 0x7f1fc80243d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc801ad90 con 0x7f1fc802d5c0 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fc802d5c0 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc801ad90 con 0x7f1fc802d5c0 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fcc0f0060 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd000a4d0 con 0x7f1fcc0f0060 2024-02-15T23:30:14.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.955+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef51bae0 2024-02-15T23:30:14.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fc802d5c0 2024-02-15T23:30:14.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc801ad90 con 0x7f1fc802d5c0 2024-02-15T23:30:14.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef51bae0 2024-02-15T23:30:14.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc801ad90 con 0x5606ef51bae0 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fcc0f0060 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fc802d5c0 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.959+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef51bae0 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef51bae0 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fc802d5c0 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fcc0f0060 2024-02-15T23:30:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef51bae0 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fcc0f0060 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fc802d5c0 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fcc0f0060 2024-02-15T23:30:14.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.963+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef521d30 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fc802d5c0 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x5606ef51bae0 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524870 con 0x7f1fcc0f0060 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:14.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5207a0 con 0x5606ef51bae0 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef520fa0 con 0x5606ef51bae0 2024-02-15T23:30:14.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef520420 con 0x5606ef51bae0 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 zone default found 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 4 Realm: () 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:14.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 zonegroup default 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef524cb0 con 0x7f1fcc0f0060 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef526b30 con 0x5606ef521d30 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef526e90 con 0x5606ef521d30 2024-02-15T23:30:14.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:14.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 started sync module instance, tier type = 2024-02-15T23:30:14.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:14.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.967+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef526100 con 0x7f1fcc0f0060 2024-02-15T23:30:14.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.971+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.971+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94587784946864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef526100 con 0x7f1fcc0f0060 2024-02-15T23:30:14.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.971+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef527800 con 0x5606ef51bae0 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.971+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94587784946864] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.971+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.971+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94587784950896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef526100 con 0x5606ef51bae0 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.971+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5281c0 con 0x5606ef521d30 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.975+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94587784950896] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.975+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.975+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94587784944736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef526080 con 0x5606ef521d30 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.975+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef528ef0 con 0x7f1fcc0f0060 2024-02-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.975+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.975+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94587784956432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef529740 con 0x7f1fcc0f0060 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.975+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef52a140 con 0x5606ef51bae0 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.979+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94587784944736] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.979+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94587784956432] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.979+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.979+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94587784961088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5292a0 con 0x5606ef51bae0 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.979+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef52a990 con 0x7f1fc802d5c0 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.979+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94587784961088] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.979+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.983+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94587784955248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5292a0 con 0x7f1fc802d5c0 2024-02-15T23:30:14.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.983+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef52aed0 con 0x7f1fc802d5c0 2024-02-15T23:30:14.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.983+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94587784955248] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.983+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.983+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94587784963312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef52ae90 con 0x7f1fc802d5c0 2024-02-15T23:30:14.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.983+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef52b800 con 0x7f1fc802d5c0 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94587784967008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef52bc60 con 0x7f1fc802d5c0 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 add_watcher() i=0 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 add_watcher() i=1 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 add_watcher() i=2 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 add_watcher() i=3 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 add_watcher() i=4 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 add_watcher() i=5 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94587784963312] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 add_watcher() i=6 2024-02-15T23:30:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94587784967008] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 add_watcher() i=7 2024-02-15T23:30:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef52a910 con 0x5606ef51bae0 2024-02-15T23:30:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94587784968064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef52a910 con 0x5606ef51bae0 2024-02-15T23:30:14.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94587784968064] v33'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1e8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:14.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:14.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.987+0000 7f1fda6bc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:14.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.991+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5372c0 con 0x5606ef51bae0 2024-02-15T23:30:14.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.991+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:14.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.991+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef537780 con 0x7f1fc802d5c0 2024-02-15T23:30:15.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.995+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.995+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef537c20 con 0x5606ef521d30 2024-02-15T23:30:15.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.995+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.995+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef538420 con 0x5606ef51bae0 2024-02-15T23:30:15.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.995+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'183 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.995+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef535330 con 0x7f1fcc0f0060 2024-02-15T23:30:15.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.995+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'62 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.995+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef535330 con 0x5606ef521d30 2024-02-15T23:30:15.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.999+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'41 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.999+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef539600 con 0x5606ef51bae0 2024-02-15T23:30:15.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.999+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:14.999+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef539690 con 0x7f1fc802d5c0 2024-02-15T23:30:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.003+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.003+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef539690 con 0x7f1fcc0f0060 2024-02-15T23:30:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.003+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.003+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef539bc0 con 0x5606ef521d30 2024-02-15T23:30:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.007+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.007+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53a590 con 0x7f1fcc0f0060 2024-02-15T23:30:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.007+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'63 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.007+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef534350 con 0x7f1fc802d5c0 2024-02-15T23:30:15.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.007+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'28 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.007+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef534350 con 0x7f1fcc0f0060 2024-02-15T23:30:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.011+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.011+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef534320 con 0x7f1fc802d5c0 2024-02-15T23:30:15.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.011+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'47 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.011+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef51bae0 2024-02-15T23:30:15.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.015+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'184 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.015+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.015+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'56 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.015+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x7f1fcc0f0060 2024-02-15T23:30:15.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.015+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'64 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.015+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.019+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.019+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef51bae0 2024-02-15T23:30:15.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.019+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.019+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef51bae0 2024-02-15T23:30:15.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.023+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'185 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.023+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.023+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'57 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.023+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x7f1fcc0f0060 2024-02-15T23:30:15.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.027+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.027+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.027+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.027+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.027+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'31 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.027+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.031+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'20 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.031+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.031+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'42 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.031+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x7f1fc802d5c0 2024-02-15T23:30:15.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.035+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.035+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.035+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.035+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x7f1fc802d5c0 2024-02-15T23:30:15.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.039+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.039+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x5606ef521d30 2024-02-15T23:30:15.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.039+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'58 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.039+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x7f1fc802d5c0 2024-02-15T23:30:15.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.043+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'48 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.043+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef53b100 con 0x7f1fcc0f0060 2024-02-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1e8d7e2640 20 reqs_thread_entry: start 2024-02-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 20 Filter name: none 2024-02-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1e06ffd640 20 reqs_thread_entry: start 2024-02-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555120 con 0x7f1fcc0f0060 2024-02-15T23:30:15.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:30:15.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:30:15.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:30:15.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 : miss 2024-02-15T23:30:15.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:95 8.14 8:292a4b40:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5567a0 con 0x5606ef521d30 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(95 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 info.flags=0x17 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 to cache LRU end 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 4.20 4:0757effc:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d3ca0 con 0x5606ef51bae0 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(96 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:97 4.1 4:8127f3db:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d3ca0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(97 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.047+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:98 4.6 4:6298ed6b:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d3ce0 con 0x5606ef521d30 2024-02-15T23:30:15.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(98 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2 [call out=425b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fda6bc980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-02-15T23:30:15.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 4.32 4:4ce75b3d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d4230 con 0x5606ef51bae0 2024-02-15T23:30:15.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(99 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:100 4.10 4:0bc08caa:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d4230 con 0x5606ef521d30 2024-02-15T23:30:15.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(100 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:101 4.12 4:4a835efd:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d4230 con 0x5606ef51bae0 2024-02-15T23:30:15.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(101 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 4.2e 4:76e1fdc0:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d4230 con 0x7f1fc802d5c0 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(102 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6 [call out=426b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fda6bc980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:103 4.2b 4:d440264d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d4230 con 0x5606ef51bae0 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(103 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.051+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:104 4.36 4:6ec57133:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d4230 con 0x5606ef51bae0 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(104 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-02-15T23:30:15.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:105 4.3e 4:7dc53008:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d4230 con 0x7f1fcc0f0060 2024-02-15T23:30:15.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(105 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:106 4.2d 4:b67ea1bb:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d4230 con 0x7f1fc802d5c0 2024-02-15T23:30:15.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(106 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 [call out=698b] v0'0 uv15 ondisk = 0) v8 ==== 195+0+698 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-02-15T23:30:15.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-02-15T23:30:15.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:107 3.1s0 3:81c0723d:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5572c0 con 0x7f1fc802d5c0 2024-02-15T23:30:15.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(107 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 10 manifest: total_size = 6 2024-02-15T23:30:15.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 20 get_obj_state: setting s->obj_tag to cd69b486-4810-48ae-b5d4-5bce307169d4.4227.3341004695983407631 2024-02-15T23:30:15.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 20 prepare_atomic_modification: state is not atomic. state=0x5606ef5d3168 2024-02-15T23:30:15.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2 2024-02-15T23:30:15.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.055+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:108 4.6 4:6298ed6b:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55bc10 con 0x5606ef521d30 2024-02-15T23:30:15.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.059+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== osd_op_reply(108 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2 [stat,call,call] v33'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.059+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:109 3.1s0 3:81c0723d:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55bc10 con 0x7f1fc802d5c0 2024-02-15T23:30:15.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(109 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_9c8454ddf7aa50116496bac348d7550d [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:110 4.6 4:6298ed6b:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55bc90 con 0x5606ef521d30 2024-02-15T23:30:15.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:111 3.7s0 3:e2e43506:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55bc90 con 0x5606ef521d30 2024-02-15T23:30:15.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(111 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 10 manifest: total_size = 3 2024-02-15T23:30:15.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 20 get_obj_state: setting s->obj_tag to cd69b486-4810-48ae-b5d4-5bce307169d4.4227.14468467014076800957 2024-02-15T23:30:15.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 20 prepare_atomic_modification: state is not atomic. state=0x5606ef5d3168 2024-02-15T23:30:15.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6 2024-02-15T23:30:15.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:112 4.2e 4:76e1fdc0:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560910 con 0x7f1fc802d5c0 2024-02-15T23:30:15.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 31 ==== osd_op_reply(110 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2 [stat,call,call] v33'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1eb77fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-02-15T23:30:15.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(112 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.063+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:113 3.7s0 3:e2e43506:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef559b70 con 0x5606ef521d30 2024-02-15T23:30:15.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 32 ==== osd_op_reply(113 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_b1b9a972ccd8c962a473909b97007eb4 [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:114 4.2e 4:76e1fdc0:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55ccd0 con 0x7f1fc802d5c0 2024-02-15T23:30:15.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:115 3.5s0 3:a06f9d9f:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55ccd0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 24 ==== osd_op_reply(115 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 10 manifest: total_size = 4 2024-02-15T23:30:15.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 20 get_obj_state: setting s->obj_tag to cd69b486-4810-48ae-b5d4-5bce307169d4.4227.8618271128383588280 2024-02-15T23:30:15.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 20 prepare_atomic_modification: state is not atomic. state=0x5606ef5d3168 2024-02-15T23:30:15.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8 2024-02-15T23:30:15.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.067+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:116 4.36 4:6ec57133:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55ccd0 con 0x5606ef51bae0 2024-02-15T23:30:15.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(114 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1eb6ffd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-02-15T23:30:15.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(116 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:117 3.5s0 3:a06f9d9f:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560950 con 0x7f1fcc0f0060 2024-02-15T23:30:15.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 25 ==== osd_op_reply(117 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v33'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:118 4.36 4:6ec57133:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560950 con 0x5606ef51bae0 2024-02-15T23:30:15.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:119 3.1as0 3:5803c7f1:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560950 con 0x5606ef51bae0 2024-02-15T23:30:15.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(119 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 10 manifest: total_size = 5 2024-02-15T23:30:15.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 20 get_obj_state: setting s->obj_tag to cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10084961356323858258 2024-02-15T23:30:15.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 20 prepare_atomic_modification: state is not atomic. state=0x5606ef5d3168 2024-02-15T23:30:15.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 2024-02-15T23:30:15.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:120 4.2d 4:b67ea1bb:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560950 con 0x7f1fc802d5c0 2024-02-15T23:30:15.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.071+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(118 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.075+0000 7f1eb77fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-02-15T23:30:15.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.075+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(120 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 [stat,call,call] v33'16 uv16 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.075+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:121 3.1as0 3:5803c7f1:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55fde0 con 0x5606ef51bae0 2024-02-15T23:30:15.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.075+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(121 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_24d27c169c2c881eb09a065116f2aa5c [call] v33'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.075+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:122 4.2d 4:b67ea1bb:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560950 con 0x7f1fc802d5c0 2024-02-15T23:30:15.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.075+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.075+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:123 3.2fs0 3:f6667cc5:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560950 con 0x5606ef521d30 2024-02-15T23:30:15.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 33 ==== osd_op_reply(123 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1fda6bc980 10 manifest: total_size = 5 2024-02-15T23:30:15.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1fda6bc980 20 get_obj_state: setting s->obj_tag to _kcjoO3sk-VnK9rwuHkeK2KNIiOWMJw- 2024-02-15T23:30:15.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1fda6bc980 20 get_obj_state: octx=0x7f1fc8024d90 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5606ef5d3168 s->prefetch_data=0 2024-02-15T23:30:15.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1fda6bc980 20 prepare_atomic_modification: state is not atomic. state=0x5606ef5d3168 2024-02-15T23:30:15.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1fda6bc980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 2024-02-15T23:30:15.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:124 4.2d 4:b67ea1bb:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560950 con 0x7f1fc802d5c0 2024-02-15T23:30:15.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(122 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 [stat,call,call] v33'17 uv17 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.079+0000 7f1eb6ffd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-02-15T23:30:15.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(124 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 [stat,call,call] v33'18 uv18 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:125 3.2fs0 3:f6667cc5:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55b5f0 con 0x5606ef521d30 2024-02-15T23:30:15.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 34 ==== osd_op_reply(125 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5_bb3aec0fdcdbc2974890f805c585d432 [call] v33'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:126 4.2d 4:b67ea1bb:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55b5f0 con 0x7f1fc802d5c0 2024-02-15T23:30:15.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 20 list_objects_ordered: starting attempt 1 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:127 4.20 4:0757effc:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef55b5f0 con 0x5606ef51bae0 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:128 4.1 4:8127f3db:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef560950 con 0x7f1fcc0f0060 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:129 4.6 4:6298ed6b:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef564eb0 con 0x5606ef521d30 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:130 4.32 4:4ce75b3d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5678d0 con 0x5606ef51bae0 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:131 4.10 4:0bc08caa:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef56a390 con 0x5606ef521d30 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:132 4.12 4:4a835efd:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef56cff0 con 0x5606ef51bae0 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:133 4.2e 4:76e1fdc0:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef56fdf0 con 0x7f1fc802d5c0 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:134 4.2b 4:d440264d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef572bd0 con 0x5606ef51bae0 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:135 4.36 4:6ec57133:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5759e0 con 0x5606ef51bae0 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:136 4.3e 4:7dc53008:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5678d0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:137 4.2d 4:b67ea1bb:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef572bd0 con 0x7f1fc802d5c0 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 26 ==== osd_op_reply(128 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 35 ==== osd_op_reply(129 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 36 ==== osd_op_reply(131 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 27 ==== osd_op_reply(136 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 38 ==== osd_op_reply(127 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 39 ==== osd_op_reply(135 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 40 ==== osd_op_reply(130 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 41 ==== osd_op_reply(134 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.083+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== osd_op_reply(133 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 42 ==== osd_op_reply(132 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(126 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 [stat,call,call] v33'19 uv19 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1eb77fe640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== osd_op_reply(137 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 [call out=124b] v0'0 uv19 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5])"; uploads.size()=0; is_truncated=0 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:138 4.20 4:0757effc:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef56cff0 con 0x5606ef51bae0 2024-02-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:139 4.1 4:8127f3db:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef564eb0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:140 4.6 4:6298ed6b:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef56fdf0 con 0x5606ef521d30 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:141 4.32 4:4ce75b3d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d2f80 con 0x5606ef51bae0 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:142 4.10 4:0bc08caa:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef569d40 con 0x5606ef521d30 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:143 4.12 4:4a835efd:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef56fdf0 con 0x5606ef51bae0 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:144 4.2e 4:76e1fdc0:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d2f80 con 0x7f1fc802d5c0 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:145 4.2b 4:d440264d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef569d40 con 0x5606ef51bae0 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:146 4.36 4:6ec57133:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef56fdf0 con 0x5606ef51bae0 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:147 4.3e 4:7dc53008:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef569d40 con 0x7f1fcc0f0060 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 28 ==== osd_op_reply(139 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:148 4.2d 4:b67ea1bb:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d2f80 con 0x7f1fc802d5c0 2024-02-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 37 ==== osd_op_reply(140 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 38 ==== osd_op_reply(142 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 29 ==== osd_op_reply(147 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 43 ==== osd_op_reply(138 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 44 ==== osd_op_reply(145 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 45 ==== osd_op_reply(146 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 46 ==== osd_op_reply(141 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 47 ==== osd_op_reply(143 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(144 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(148 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 [call out=124b] v0'0 uv19 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.087+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef569d40 con 0x7f1fcc0f0060 2024-02-15T23:30:15.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 30 ==== osd_op_reply(149 foo.buckets [call] v33'37 uv37 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fda6bc980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-02-15T23:30:15.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fda6bc980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-15T23:30:15.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fda6bc980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T23:30:15.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94587785162368 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d2f80 con 0x7f1fc802d5c0 2024-02-15T23:30:15.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== watch-notify(notify (1) cookie 94587784963312 notify 141733920789 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f1fc8066060 con 0x7f1fc802d5c0 2024-02-15T23:30:15.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1eb77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94587784963312 notifier 4646 bl.length()=149 2024-02-15T23:30:15.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(150 notify.6 [notify cookie 94587785162368 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1eb77fe640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1e9c003d60 con 0x7f1fc802d5c0 2024-02-15T23:30:15.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== watch-notify(notify_complete (2) cookie 94587785162368 notify 141733920789 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5606ef4e3880 con 0x7f1fc802d5c0 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.091+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5d2f80 con 0x7f1fcc0f0060 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 31 ==== osd_op_reply(152 myfoo [call,call,delete] v33'38 uv38 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 from cache 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5, ofs0, ns] 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:153 7.d 7:b4812045:::notify.4:head [notify cookie 94587785162368 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef556710 con 0x5606ef51bae0 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 48 ==== watch-notify(notify (1) cookie 94587784961088 notify 141733920795 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x5606ef4e3880 con 0x5606ef51bae0 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1eb6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94587784961088 notifier 4646 bl.length()=206 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1eb6ffd640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1e0c0032c0 con 0x5606ef51bae0 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 49 ==== osd_op_reply(153 notify.4 [notify cookie 94587785162368 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 50 ==== watch-notify(notify_complete (2) cookie 94587785162368 notify 141733920795 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5606ef4e3430 con 0x5606ef51bae0 2024-02-15T23:30:15.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 51 ==== osd_op_reply(154 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:155 8.14 8:292a4b40:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef556710 con 0x5606ef521d30 2024-02-15T23:30:15.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 39 ==== osd_op_reply(155 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 [call,call,delete] v33'2 uv2 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:156 4.20 4:0757effc:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef556710 con 0x5606ef51bae0 2024-02-15T23:30:15.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:157 4.1 4:8127f3db:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5751e0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:158 4.6 4:6298ed6b:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5755c0 con 0x5606ef521d30 2024-02-15T23:30:15.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:159 4.32 4:4ce75b3d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555120 con 0x5606ef51bae0 2024-02-15T23:30:15.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:160 4.10 4:0bc08caa:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5559a0 con 0x5606ef521d30 2024-02-15T23:30:15.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:161 4.12 4:4a835efd:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef556710 con 0x5606ef51bae0 2024-02-15T23:30:15.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:162 4.2e 4:76e1fdc0:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555db0 con 0x7f1fc802d5c0 2024-02-15T23:30:15.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:163 4.2b 4:d440264d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555120 con 0x5606ef51bae0 2024-02-15T23:30:15.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:164 4.36 4:6ec57133:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5751e0 con 0x5606ef51bae0 2024-02-15T23:30:15.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:165 4.3e 4:7dc53008:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef556710 con 0x7f1fcc0f0060 2024-02-15T23:30:15.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.095+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:166 4.2d 4:b67ea1bb:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5559a0 con 0x7f1fc802d5c0 2024-02-15T23:30:15.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 40 ==== osd_op_reply(158 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.2 [delete] v33'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== osd_op_reply(162 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.6 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 32 ==== osd_op_reply(157 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.1 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 52 ==== osd_op_reply(156 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.0 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 53 ==== osd_op_reply(159 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.3 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 54 ==== osd_op_reply(164 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.8 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 55 ==== osd_op_reply(163 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.7 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 56 ==== osd_op_reply(161 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.5 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 40 ==== osd_op_reply(166 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.10 [delete] v33'20 uv20 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 41 ==== osd_op_reply(160 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.4 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 33 ==== osd_op_reply(165 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5.9 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fda6bc980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 : miss 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fda6bc980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:167 6.13 6:ca3b21a6:::pubsub..bucket.myfoo%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555db0 con 0x7f1fc802d5c0 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 41 ==== osd_op_reply(167 pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fda6bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fda6bc980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 info.flags=0x0 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fda6bc980 10 adding default.rgw.log++pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 to cache LRU end 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fda6bc980 10 removing default.rgw.log++pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 from cache 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.099+0000 7f1fda6bc980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5, ofs0, ns] 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:168 7.e 7:7759931f:::notify.3:head [notify cookie 94587785648640 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef5755c0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 34 ==== watch-notify(notify (1) cookie 94587784956432 notify 141733920785 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f1fd0026ca0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1eb6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920785 cookie 94587784956432 notifier 4646 bl.length()=203 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1eb6ffd640 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1e0c0032c0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 35 ==== osd_op_reply(168 notify.3 [notify cookie 94587785648640 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 36 ==== osd_op_reply(169 notify.3 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 37 ==== watch-notify(notify_complete (2) cookie 94587785648640 notify 141733920785 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1fd003f4b0 con 0x7f1fcc0f0060 2024-02-15T23:30:15.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:170 6.13 6:ca3b21a6:::pubsub..bucket.myfoo%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x7f1fc802d5c0 2024-02-15T23:30:15.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 42 ==== osd_op_reply(170 pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.5 [delete] v33'29 uv25 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.103+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x7f1fcc0f0060 2024-02-15T23:30:15.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.107+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 38 ==== osd_op_reply(171 foo.buckets [call] v33'39 uv39 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.107+0000 7f1e8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:15.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.107+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94587784968064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x5606ef51bae0 2024-02-15T23:30:15.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 57 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 94587784968064] v33'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94587784946864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x7f1fcc0f0060 2024-02-15T23:30:15.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 39 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 94587784946864] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fda6bc980 20 remove_watcher() i=0 2024-02-15T23:30:15.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fda6bc980 2 removed watcher, disabling cache 2024-02-15T23:30:15.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94587784950896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x5606ef51bae0 2024-02-15T23:30:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 58 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 94587784950896] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fda6bc980 20 remove_watcher() i=1 2024-02-15T23:30:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.111+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94587784944736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x5606ef521d30 2024-02-15T23:30:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.115+0000 7f1fd79d6640 1 -- 172.21.15.133:0/1633794575 <== osd.3 v2:172.21.15.133:6816/1056376173 42 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 94587784944736] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc0f6040 con 0x5606ef521d30 2024-02-15T23:30:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.115+0000 7f1fda6bc980 20 remove_watcher() i=2 2024-02-15T23:30:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.115+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94587784956432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x7f1fcc0f0060 2024-02-15T23:30:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.115+0000 7f1fd89d8640 1 -- 172.21.15.133:0/1633794575 <== osd.2 v2:172.21.15.133:6808/3615800201 40 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 94587784956432] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd0039060 con 0x7f1fcc0f0060 2024-02-15T23:30:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.115+0000 7f1fda6bc980 20 remove_watcher() i=3 2024-02-15T23:30:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.115+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94587784961088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x5606ef51bae0 2024-02-15T23:30:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.119+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.1 v2:172.21.15.133:6800/2918336019 59 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 94587784961088] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x5606ef51bae0 2024-02-15T23:30:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.119+0000 7f1fda6bc980 20 remove_watcher() i=4 2024-02-15T23:30:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.119+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94587784955248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x7f1fc802d5c0 2024-02-15T23:30:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.119+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 43 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 94587784955248] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.119+0000 7f1fda6bc980 20 remove_watcher() i=5 2024-02-15T23:30:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.119+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94587784963312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x7f1fc802d5c0 2024-02-15T23:30:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.123+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 44 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 94587784963312] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.123+0000 7f1fda6bc980 20 remove_watcher() i=6 2024-02-15T23:30:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.123+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94587784967008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5606ef555d90 con 0x7f1fc802d5c0 2024-02-15T23:30:15.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 <== osd.0 v2:172.21.15.131:6800/31994139 45 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 94587784967008] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc8053040 con 0x7f1fc802d5c0 2024-02-15T23:30:15.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 20 remove_watcher() i=7 2024-02-15T23:30:15.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fc802d5c0 msgr2=0x7f1fc80243d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1fc802d5c0 0x7f1fc80243d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef51bae0 msgr2=0x5606ef51dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef51bae0 0x5606ef51dfa0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fcc0f0060 msgr2=0x7f1fcc0a48b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fcc0f0060 0x7f1fcc0a48b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5606ef521d30 msgr2=0x5606ef5241a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5606ef521d30 0x5606ef5241a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 msgr2=0x7f1ea8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 0x7f1ea8036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0011010 tx=0x7f1fd0020000 comp rx=0 tx=0).stop 2024-02-15T23:30:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fd81d7640 1 -- 172.21.15.133:0/1633794575 reap_dead start 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 msgr2=0x5606ef5104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef5104f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0aae70 tx=0x7f1fcc0e46e0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 shutdown_connections 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/1633794575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef3f23b0 0x5606ef5104f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 >> 172.21.15.133:0/1633794575 conn(0x5606ef503750 msgr2=0x5606ef500db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 shutdown_connections 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/1633794575 wait complete. 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/3503821110 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb00342b0 msgr2=0x7f1eb0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/3503821110 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb00342b0 0x7f1eb0036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5606ef4ea920 tx=0x7f1fd0005850 comp rx=0 tx=0).stop 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/3503821110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef4fa3e0 msgr2=0x5606ef4fa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/3503821110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef4fa3e0 0x5606ef4fa800 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc096e80 tx=0x7f1fcc018020 comp rx=0 tx=0).stop 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/3503821110 shutdown_connections 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/3503821110 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb00342b0 0x7f1eb0036770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/3503821110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef4fa3e0 0x5606ef4fa800 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/3503821110 >> 172.21.15.133:0/3503821110 conn(0x5606ef4ef1f0 msgr2=0x5606ef4efd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/3503821110 shutdown_connections 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/3503821110 wait complete. 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef3f6520 msgr2=0x5606ef4e9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef3f6520 0x5606ef4e9b80 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec00342b0 msgr2=0x7f1ec0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec00342b0 0x7f1ec0036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0ad000 tx=0x7f1fcc0a5040 comp rx=0 tx=0).stop 2024-02-15T23:30:15.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 msgr2=0x5606ef4e2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4e2ef0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800b710 tx=0x7f1fc8000bd0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 shutdown_connections 2024-02-15T23:30:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5606ef3f6520 0x5606ef4e9b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec00342b0 0x7f1ec0036770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 --2- 172.21.15.133:0/10771796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ef366910 0x5606ef4e2ef0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 >> 172.21.15.133:0/10771796 conn(0x5606ef3ec920 msgr2=0x5606ef4d6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 shutdown_connections 2024-02-15T23:30:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.127+0000 7f1fda6bc980 1 -- 172.21.15.133:0/10771796 wait complete. 2024-02-15T23:30:15.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-15T23:30:15.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-15T23:30:15.148 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-02-15T23:30:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.219+0000 7f984541c980 1 Processor -- start 2024-02-15T23:30:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.219+0000 7f984541c980 1 -- start start 2024-02-15T23:30:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.219+0000 7f984541c980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5571e082c050 0x5571e082c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.219+0000 7f984541c980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5571e07794d0 con 0x5571e082c970 2024-02-15T23:30:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.219+0000 7f984541c980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5571e0740180 con 0x5571e082c050 2024-02-15T23:30:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9842f37640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5571e082c050 0x5571e082c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9842f37640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5571e082c050 0x5571e082c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35984/0 (socket says 172.21.15.133:35984) 2024-02-15T23:30:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9842f37640 1 -- 172.21.15.133:0/2474213762 learned_addr learned my addr 172.21.15.133:0/2474213762 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9842736640 1 --1- 172.21.15.133:0/2474213762 >> v1:172.21.15.131:6789/0 conn(0x5571e082c970 0x5571e082d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:60374/0 (socket says 172.21.15.133:60374) 2024-02-15T23:30:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9842f37640 1 -- 172.21.15.133:0/2474213762 >> v1:172.21.15.131:6789/0 conn(0x5571e082c970 legacy=0x5571e082d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9842f37640 1 -- 172.21.15.133:0/2474213762 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571e082db60 con 0x5571e082c050 2024-02-15T23:30:15.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9842f37640 1 --2- 172.21.15.133:0/2474213762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e082c430 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f983c00a4e0 tx=0x7f983c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e323b616ee86f4f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9841f35640 1 -- 172.21.15.133:0/2474213762 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983c0aa540 con 0x5571e082c050 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9841f35640 1 -- 172.21.15.133:0/2474213762 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c0a6070 con 0x5571e082c050 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.223+0000 7f9841f35640 1 -- 172.21.15.133:0/2474213762 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983c0aa850 con 0x5571e082c050 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.227+0000 7f984541c980 1 -- 172.21.15.133:0/2474213762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 msgr2=0x5571e082c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.227+0000 7f984541c980 1 --2- 172.21.15.133:0/2474213762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e082c430 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f983c00a4e0 tx=0x7f983c01b090 comp rx=0 tx=0).stop 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.227+0000 7f984541c980 1 -- 172.21.15.133:0/2474213762 shutdown_connections 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.227+0000 7f984541c980 1 --2- 172.21.15.133:0/2474213762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e082c430 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.227+0000 7f984541c980 1 -- 172.21.15.133:0/2474213762 >> 172.21.15.133:0/2474213762 conn(0x5571e0827920 msgr2=0x5571e0829d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.227+0000 7f984541c980 1 -- 172.21.15.133:0/2474213762 shutdown_connections 2024-02-15T23:30:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.227+0000 7f984541c980 1 -- 172.21.15.133:0/2474213762 wait complete. 2024-02-15T23:30:15.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.239+0000 7f984541c980 1 Processor -- start 2024-02-15T23:30:15.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.239+0000 7f984541c980 1 -- start start 2024-02-15T23:30:15.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.239+0000 7f984541c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e0916540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.239+0000 7f984541c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e073d6b0 con 0x5571e082c050 2024-02-15T23:30:15.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e0916540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e0916540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35990/0 (socket says 172.21.15.133:35990) 2024-02-15T23:30:15.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 -- 172.21.15.133:0/1129915711 learned_addr learned my addr 172.21.15.133:0/1129915711 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 -- 172.21.15.133:0/1129915711 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c00a1c0 con 0x5571e082c050 2024-02-15T23:30:15.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 --2- 172.21.15.133:0/1129915711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e0916540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f983c017ca0 tx=0x7f983c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5917255918ceb8b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9730e09640 1 -- 172.21.15.133:0/1129915711 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983c0aa780 con 0x5571e082c050 2024-02-15T23:30:15.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9730e09640 1 -- 172.21.15.133:0/1129915711 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c0aa8e0 con 0x5571e082c050 2024-02-15T23:30:15.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9730e09640 1 -- 172.21.15.133:0/1129915711 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983c0aab80 con 0x5571e082c050 2024-02-15T23:30:15.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 -- 172.21.15.133:0/1129915711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 msgr2=0x5571e0916540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 --2- 172.21.15.133:0/1129915711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e0916540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f983c017ca0 tx=0x7f983c0033b0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 -- 172.21.15.133:0/1129915711 shutdown_connections 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 --2- 172.21.15.133:0/1129915711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c050 0x5571e0916540 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 -- 172.21.15.133:0/1129915711 >> 172.21.15.133:0/1129915711 conn(0x5571e0827920 msgr2=0x5571e09120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 -- 172.21.15.133:0/1129915711 shutdown_connections 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 -- 172.21.15.133:0/1129915711 wait complete. 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 Processor -- start 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 -- start start 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c970 0x5571e07a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f984541c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e0738e90 con 0x5571e082c970 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c970 0x5571e07a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c970 0x5571e07a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36006/0 (socket says 172.21.15.133:36006) 2024-02-15T23:30:15.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 -- 172.21.15.133:0/1281122364 learned_addr learned my addr 172.21.15.133:0/1281122364 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 -- 172.21.15.133:0/1281122364 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571e082db60 con 0x5571e082c970 2024-02-15T23:30:15.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.243+0000 7f9842f37640 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c970 0x5571e07a1680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f983c01aec0 tx=0x7f983c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f972f606640 1 -- 172.21.15.133:0/1281122364 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983c0c3070 con 0x5571e082c970 2024-02-15T23:30:15.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f972f606640 1 -- 172.21.15.133:0/1281122364 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c0b5570 con 0x5571e082c970 2024-02-15T23:30:15.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5571e07a1bc0 con 0x5571e082c970 2024-02-15T23:30:15.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f972f606640 1 -- 172.21.15.133:0/1281122364 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983c0b5830 con 0x5571e082c970 2024-02-15T23:30:15.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571e09214f0 con 0x5571e082c970 2024-02-15T23:30:15.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f972f606640 1 -- 172.21.15.133:0/1281122364 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f983c0a8070 con 0x5571e082c970 2024-02-15T23:30:15.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f972f606640 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9728034300 0x7f97280367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f972f606640 1 -- 172.21.15.133:0/1281122364 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f983c0e37b0 con 0x5571e082c970 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f9842736640 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9728034300 0x7f97280367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f984541c980 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e0922f60 0x5571e0925370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09259e0 con 0x5571e0922f60 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f9843738640 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e0922f60 0x5571e0925370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f9842736640 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9728034300 0x7f97280367c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9838000f70 tx=0x7f9838001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f9843738640 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e0922f60 0x5571e0925370 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f9843738640 1 -- 172.21.15.133:0/1281122364 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98340083f0 con 0x5571e0922f60 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09226c0 con 0x5571e0922f60 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f9843738640 1 -- 172.21.15.133:0/1281122364 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f98340083f0 con 0x5571e0922f60 2024-02-15T23:30:15.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0927740 con 0x5571e0922f60 2024-02-15T23:30:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f9843738640 1 -- 172.21.15.133:0/1281122364 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f98340083f0 con 0x5571e0922f60 2024-02-15T23:30:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.247+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0926940 con 0x5571e0922f60 2024-02-15T23:30:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f9843738640 1 -- 172.21.15.133:0/1281122364 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f98340083f0 con 0x5571e0922f60 2024-02-15T23:30:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0926d50 con 0x5571e0922f60 2024-02-15T23:30:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f9843738640 1 -- 172.21.15.133:0/1281122364 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9834012040 con 0x5571e0922f60 2024-02-15T23:30:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f984541c980 1 Processor -- start 2024-02-15T23:30:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f984541c980 1 -- start start 2024-02-15T23:30:15.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f984541c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e0935de0 0x5571e0936200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f984541c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e06d1f20 con 0x5571e0935de0 2024-02-15T23:30:15.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f9842736640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e0935de0 0x5571e0936200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f9842736640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e0935de0 0x5571e0936200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36012/0 (socket says 172.21.15.133:36012) 2024-02-15T23:30:15.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f9842736640 1 -- 172.21.15.133:0/92359257 learned_addr learned my addr 172.21.15.133:0/92359257 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f9842736640 1 -- 172.21.15.133:0/92359257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571e0936740 con 0x5571e0935de0 2024-02-15T23:30:15.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f9842736640 1 --2- 172.21.15.133:0/92359257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e0935de0 0x5571e0936200 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9838001ee0 tx=0x7f983800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f972ce01640 1 -- 172.21.15.133:0/92359257 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9838007040 con 0x5571e0935de0 2024-02-15T23:30:15.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f972ce01640 1 -- 172.21.15.133:0/92359257 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983800d660 con 0x5571e0935de0 2024-02-15T23:30:15.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f984541c980 1 -- 172.21.15.133:0/92359257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5571e0936990 con 0x5571e0935de0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f972ce01640 1 -- 172.21.15.133:0/92359257 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983800d900 con 0x5571e0935de0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f984541c980 1 -- 172.21.15.133:0/92359257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571e09374e0 con 0x5571e0935de0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f972ce01640 1 -- 172.21.15.133:0/92359257 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f983801a070 con 0x5571e0935de0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.251+0000 7f972ce01640 1 --2- 172.21.15.133:0/92359257 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f971c034300 0x7f971c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f972ce01640 1 -- 172.21.15.133:0/92359257 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9838017050 con 0x5571e0935de0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9843738640 1 --2- 172.21.15.133:0/92359257 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f971c034300 0x7f971c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 Processor -- start 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- start start 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9843738640 1 --2- 172.21.15.133:0/92359257 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f971c034300 0x7f971c0367c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5571e0926380 tx=0x7f9834003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e091ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e06c5790 con 0x5571e091e8a0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9842736640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e091ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9842736640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e091ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36016/0 (socket says 172.21.15.133:36016) 2024-02-15T23:30:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9842736640 1 -- 172.21.15.133:0/2883492825 learned_addr learned my addr 172.21.15.133:0/2883492825 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9842736640 1 -- 172.21.15.133:0/2883492825 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571e091d0f0 con 0x5571e091e8a0 2024-02-15T23:30:15.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9842736640 1 --2- 172.21.15.133:0/2883492825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e091ecc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9838048ba0 tx=0x7f9838043f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83288f0baaef114 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f97267fc640 1 -- 172.21.15.133:0/2883492825 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983801a320 con 0x5571e091e8a0 2024-02-15T23:30:15.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f97267fc640 1 -- 172.21.15.133:0/2883492825 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983801a480 con 0x5571e091e8a0 2024-02-15T23:30:15.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f97267fc640 1 -- 172.21.15.133:0/2883492825 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983803aaa0 con 0x5571e091e8a0 2024-02-15T23:30:15.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- 172.21.15.133:0/2883492825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 msgr2=0x5571e091ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 --2- 172.21.15.133:0/2883492825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e091ecc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9838048ba0 tx=0x7f9838043f80 comp rx=0 tx=0).stop 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- 172.21.15.133:0/2883492825 shutdown_connections 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 --2- 172.21.15.133:0/2883492825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e091ecc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- 172.21.15.133:0/2883492825 >> 172.21.15.133:0/2883492825 conn(0x5571e093f0a0 msgr2=0x5571e093d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- 172.21.15.133:0/2883492825 shutdown_connections 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- 172.21.15.133:0/2883492825 wait complete. 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 Processor -- start 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- start start 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e094be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f984541c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e094c350 con 0x5571e091e8a0 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9842736640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e094be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9842736640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e094be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36030/0 (socket says 172.21.15.133:36030) 2024-02-15T23:30:15.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.255+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 learned_addr learned my addr 172.21.15.133:0/3744547596 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571e09374e0 con 0x5571e091e8a0 2024-02-15T23:30:15.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9842736640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e094be10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f983801a630 tx=0x7f9838048b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9724ff9640 1 -- 172.21.15.133:0/3744547596 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983801a320 con 0x5571e091e8a0 2024-02-15T23:30:15.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5571e094c550 con 0x5571e091e8a0 2024-02-15T23:30:15.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9724ff9640 1 -- 172.21.15.133:0/3744547596 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983801abb0 con 0x5571e091e8a0 2024-02-15T23:30:15.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9724ff9640 1 -- 172.21.15.133:0/3744547596 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f983804a220 con 0x5571e091e8a0 2024-02-15T23:30:15.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571e094c9e0 con 0x5571e091e8a0 2024-02-15T23:30:15.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9724ff9640 1 -- 172.21.15.133:0/3744547596 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f983804a380 con 0x5571e091e8a0 2024-02-15T23:30:15.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9724ff9640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f970c0342b0 0x7f970c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9724ff9640 1 -- 172.21.15.133:0/3744547596 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f983804b060 con 0x5571e091e8a0 2024-02-15T23:30:15.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9843738640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f970c0342b0 0x7f970c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e09573d0 0x5571e0959890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0959fe0 con 0x5571e09573d0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9842f37640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e09573d0 0x5571e0959890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9843738640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f970c0342b0 0x7f970c036770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9834008fd0 tx=0x7f983401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9842f37640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e09573d0 0x5571e0959890 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 20 realm 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095a3b0 con 0x5571e09573d0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.259+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095ac30 con 0x5571e09573d0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095af90 con 0x5571e09573d0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095b790 con 0x5571e09573d0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 20 searching for the correct realm 2024-02-15T23:30:15.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5571e095d620 0x5571e095fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842736640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5571e095d620 0x5571e095fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842736640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5571e095d620 0x5571e095fae0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9838040070 con 0x5571e095d620 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842736640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9838027060 0x7f983803a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x7f9838027060 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9843738640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9838027060 0x7f983803a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9843738640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9838027060 0x7f983803a270 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983402c040 con 0x7f9838027060 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x7f9838027060 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983402c040 con 0x7f9838027060 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e09573d0 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e09573d0 2024-02-15T23:30:15.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x5571e082c050 0x7f983c005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e082c050 2024-02-15T23:30:15.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.263+0000 7f9842f37640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x5571e082c050 0x7f983c005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x5571e082c050 0x7f983c005040 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e082c050 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e082c050 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e082c050 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x7f9838027060 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983402c040 con 0x7f9838027060 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9838040070 con 0x5571e095d620 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e09573d0 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e082c050 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e082c050 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e09573d0 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x7f9838027060 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f983402c040 con 0x7f9838027060 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.267+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9838040070 con 0x5571e095d620 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e082c050 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e082c050 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e09573d0 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e09573d0 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e082c050 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e082c050 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x7f9838027060 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983402c040 con 0x7f9838027060 2024-02-15T23:30:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e09573d0 2024-02-15T23:30:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0cf7c0 con 0x5571e09573d0 2024-02-15T23:30:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.271+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x7f9838027060 2024-02-15T23:30:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983402c040 con 0x7f9838027060 2024-02-15T23:30:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e082c050 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x7f9838027060 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e095d620 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e082c050 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x5571e09573d0 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09601b0 con 0x7f9838027060 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095c0c0 con 0x5571e09573d0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.275+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095c8c0 con 0x5571e09573d0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095c8c0 con 0x5571e09573d0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:15.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 zone default found 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 4 Realm: () 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 zonegroup default 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095c8c0 con 0x7f9838027060 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0961fd0 con 0x5571e095d620 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0962360 con 0x5571e095d620 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 started sync module instance, tier type = 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e095c6d0 con 0x7f9838027060 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93947587597328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0962760 con 0x7f9838027060 2024-02-15T23:30:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.279+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0962f60 con 0x5571e09573d0 2024-02-15T23:30:15.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.283+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.283+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93947587602272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09631c0 con 0x5571e09573d0 2024-02-15T23:30:15.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.283+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0963c90 con 0x5571e095d620 2024-02-15T23:30:15.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.283+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93947587597328] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.283+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93947587602272] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.283+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.283+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93947587606384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0962c20 con 0x5571e095d620 2024-02-15T23:30:15.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.283+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09644e0 con 0x7f9838027060 2024-02-15T23:30:15.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.287+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.287+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93947587608944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0964d30 con 0x7f9838027060 2024-02-15T23:30:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.287+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0965730 con 0x5571e09573d0 2024-02-15T23:30:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.287+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93947587606384] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.287+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93947587608944] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.287+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.287+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93947587613232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0964890 con 0x5571e09573d0 2024-02-15T23:30:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.287+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0965f80 con 0x5571e082c050 2024-02-15T23:30:15.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.291+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.291+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93947587613232] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.291+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93947587615456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0964890 con 0x5571e082c050 2024-02-15T23:30:15.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.291+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0961940 con 0x5571e082c050 2024-02-15T23:30:15.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.291+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93947587615456] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.291+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.291+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93947587598656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0966540 con 0x5571e082c050 2024-02-15T23:30:15.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.291+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0966eb0 con 0x5571e082c050 2024-02-15T23:30:15.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93947587598656] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93947587616512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0966eb0 con 0x5571e082c050 2024-02-15T23:30:15.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 20 add_watcher() i=0 2024-02-15T23:30:15.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 20 add_watcher() i=1 2024-02-15T23:30:15.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 20 add_watcher() i=2 2024-02-15T23:30:15.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 20 add_watcher() i=3 2024-02-15T23:30:15.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 20 add_watcher() i=4 2024-02-15T23:30:15.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 20 add_watcher() i=5 2024-02-15T23:30:15.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 20 add_watcher() i=6 2024-02-15T23:30:15.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93947587616512] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 20 add_watcher() i=7 2024-02-15T23:30:15.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.295+0000 7f984541c980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:15.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e096a200 con 0x5571e09573d0 2024-02-15T23:30:15.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93947587619712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0967440 con 0x5571e09573d0 2024-02-15T23:30:15.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93947587619712] v33'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f96f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 5 note: GC not initialized 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f9673fff640 20 reqs_thread_entry: start 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 20 Filter name: none 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f9671ffb640 20 reqs_thread_entry: start 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e098c180 con 0x5571e09573d0 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:30:15.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:30:15.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:30:15.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:15.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.299+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~370 in=370b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0991af0 con 0x5571e09573d0 2024-02-15T23:30:15.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~370] v33'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f984541c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:30:15.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f984541c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:30:15.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f984541c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:30:15.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93947587794416 in=558b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e098e9e0 con 0x5571e09573d0 2024-02-15T23:30:15.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 93947587613232 notify 141733920796 ret 0) v3 ==== 588+0+0 (crc 0 0 0) 0x5571e09214f0 con 0x5571e09573d0 2024-02-15T23:30:15.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f97267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 93947587613232 notifier 4653 bl.length()=546 2024-02-15T23:30:15.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f97267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:30:15.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f97267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:30:15.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(64 notify.4 [notify cookie 93947587794416 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f97267fc640 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f9708003ea0 con 0x5571e09573d0 2024-02-15T23:30:15.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 93947587794416 notify 141733920796 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5571e07a1bc0 con 0x5571e09573d0 2024-02-15T23:30:15.312 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:30:15.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f96f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:15.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93947587619712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e09549d0 con 0x5571e09573d0 2024-02-15T23:30:15.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93947587619712] v33'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.303+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93947587597328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0966b80 con 0x7f9838027060 2024-02-15T23:30:15.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.307+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93947587597328] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.307+0000 7f984541c980 20 remove_watcher() i=0 2024-02-15T23:30:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.307+0000 7f984541c980 2 removed watcher, disabling cache 2024-02-15T23:30:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.307+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93947587602272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0966b80 con 0x5571e09573d0 2024-02-15T23:30:15.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.307+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93947587602272] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.307+0000 7f984541c980 20 remove_watcher() i=1 2024-02-15T23:30:15.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.307+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93947587606384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0962760 con 0x5571e095d620 2024-02-15T23:30:15.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.311+0000 7f9842736640 1 -- 172.21.15.133:0/3744547596 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93947587606384] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983805f040 con 0x5571e095d620 2024-02-15T23:30:15.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.311+0000 7f984541c980 20 remove_watcher() i=2 2024-02-15T23:30:15.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.311+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93947587608944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0966b80 con 0x7f9838027060 2024-02-15T23:30:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.311+0000 7f9843738640 1 -- 172.21.15.133:0/3744547596 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93947587608944] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983403c040 con 0x7f9838027060 2024-02-15T23:30:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.311+0000 7f984541c980 20 remove_watcher() i=3 2024-02-15T23:30:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.311+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93947587613232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0963770 con 0x5571e09573d0 2024-02-15T23:30:15.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.315+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93947587613232] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e09573d0 2024-02-15T23:30:15.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.315+0000 7f984541c980 20 remove_watcher() i=4 2024-02-15T23:30:15.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.315+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93947587615456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0966b80 con 0x5571e082c050 2024-02-15T23:30:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.315+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93947587615456] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.315+0000 7f984541c980 20 remove_watcher() i=5 2024-02-15T23:30:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.315+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93947587598656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0965230 con 0x5571e082c050 2024-02-15T23:30:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93947587598656] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 20 remove_watcher() i=6 2024-02-15T23:30:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93947587616512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5571e0963770 con 0x5571e082c050 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93947587616512] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f983c0f3040 con 0x5571e082c050 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 20 remove_watcher() i=7 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x5571e082c050 msgr2=0x7f983c005040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x5571e082c050 0x7f983c005040 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e09573d0 msgr2=0x5571e0959890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e09573d0 0x5571e0959890 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9838027060 msgr2=0x7f983803a270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f9838027060 0x7f983803a270 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5571e095d620 msgr2=0x5571e095fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5571e095d620 0x5571e095fae0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f970c0342b0 msgr2=0x7f970c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f970c0342b0 0x7f970c036770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9834008fd0 tx=0x7f983401c070 comp rx=0 tx=0).stop 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 msgr2=0x5571e094be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 --2- 172.21.15.133:0/3744547596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e091e8a0 0x5571e094be10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f983801a630 tx=0x7f9838048b00 comp rx=0 tx=0).stop 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 reap_dead start 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f9842f37640 1 -- 172.21.15.133:0/3744547596 reap_dead start 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 shutdown_connections 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 >> 172.21.15.133:0/3744547596 conn(0x5571e093f0a0 msgr2=0x5571e093c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 shutdown_connections 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.319+0000 7f984541c980 1 -- 172.21.15.133:0/3744547596 wait complete. 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/92359257 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f971c034300 msgr2=0x7f971c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/92359257 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f971c034300 0x7f971c0367c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5571e0926380 tx=0x7f9834003070 comp rx=0 tx=0).stop 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/92359257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e0935de0 msgr2=0x5571e0936200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/92359257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e0935de0 0x5571e0936200 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9838001ee0 tx=0x7f983800ea10 comp rx=0 tx=0).stop 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/92359257 shutdown_connections 2024-02-15T23:30:15.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/92359257 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f971c034300 0x7f971c0367c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/92359257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e0935de0 0x5571e0936200 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/92359257 >> 172.21.15.133:0/92359257 conn(0x5571e092abf0 msgr2=0x5571e092b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/92359257 shutdown_connections 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/92359257 wait complete. 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e0922f60 msgr2=0x5571e0925370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e0922f60 0x5571e0925370 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9728034300 msgr2=0x7f97280367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9728034300 0x7f97280367c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9838000f70 tx=0x7f9838001380 comp rx=0 tx=0).stop 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c970 msgr2=0x5571e07a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c970 0x5571e07a1680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f983c01aec0 tx=0x7f983c017e30 comp rx=0 tx=0).stop 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 shutdown_connections 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5571e0922f60 0x5571e0925370 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f9728034300 0x7f97280367c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 --2- 172.21.15.133:0/1281122364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571e082c970 0x5571e07a1680 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 >> 172.21.15.133:0/1281122364 conn(0x5571e0827920 msgr2=0x5571e0910be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 shutdown_connections 2024-02-15T23:30:15.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.323+0000 7f984541c980 1 -- 172.21.15.133:0/1281122364 wait complete. 2024-02-15T23:30:15.341 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:30:15.341 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-15T23:30:15.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-15T23:30:15.341 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-02-15T23:30:15.416 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:15.416 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:15.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.407+0000 7f381b09d980 1 Processor -- start 2024-02-15T23:30:15.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.407+0000 7f381b09d980 1 -- start start 2024-02-15T23:30:15.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.407+0000 7f381b09d980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55b636130860 0x55b636132c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.407+0000 7f381b09d980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b6360764d0 con 0x55b63612c360 2024-02-15T23:30:15.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.407+0000 7f381b09d980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b63603d180 con 0x55b636130860 2024-02-15T23:30:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f38183b7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55b636130860 0x55b636132c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f38183b7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55b636130860 0x55b636132c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36036/0 (socket says 172.21.15.133:36036) 2024-02-15T23:30:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f38183b7640 1 -- 172.21.15.133:0/3486009843 learned_addr learned my addr 172.21.15.133:0/3486009843 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f38183b7640 1 -- 172.21.15.133:0/3486009843 >> v1:172.21.15.131:6789/0 conn(0x55b63612c360 legacy=0x55b63612c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f38183b7640 1 -- 172.21.15.133:0/3486009843 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6361341a0 con 0x55b636130860 2024-02-15T23:30:15.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f38183b7640 1 --2- 172.21.15.133:0/3486009843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b636132c50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f380800a5c0 tx=0x7f380801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4025f085f50d1f7c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f3817bb6640 1 -- 172.21.15.133:0/3486009843 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080aa470 con 0x55b636130860 2024-02-15T23:30:15.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f3817bb6640 1 -- 172.21.15.133:0/3486009843 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38080aa5d0 con 0x55b636130860 2024-02-15T23:30:15.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.411+0000 7f3817bb6640 1 -- 172.21.15.133:0/3486009843 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080aa890 con 0x55b636130860 2024-02-15T23:30:15.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.415+0000 7f381b09d980 1 -- 172.21.15.133:0/3486009843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 msgr2=0x55b636132c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.415+0000 7f381b09d980 1 --2- 172.21.15.133:0/3486009843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b636132c50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f380800a5c0 tx=0x7f380801b340 comp rx=0 tx=0).stop 2024-02-15T23:30:15.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.415+0000 7f381b09d980 1 -- 172.21.15.133:0/3486009843 shutdown_connections 2024-02-15T23:30:15.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.415+0000 7f381b09d980 1 --2- 172.21.15.133:0/3486009843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b636132c50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.415+0000 7f381b09d980 1 -- 172.21.15.133:0/3486009843 >> 172.21.15.133:0/3486009843 conn(0x55b63609fa50 msgr2=0x55b63609fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.415+0000 7f381b09d980 1 -- 172.21.15.133:0/3486009843 shutdown_connections 2024-02-15T23:30:15.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.415+0000 7f381b09d980 1 -- 172.21.15.133:0/3486009843 wait complete. 2024-02-15T23:30:15.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.427+0000 7f381b09d980 1 Processor -- start 2024-02-15T23:30:15.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.427+0000 7f381b09d980 1 -- start start 2024-02-15T23:30:15.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.427+0000 7f381b09d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b63612c360 0x55b636216260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.427+0000 7f381b09d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b63603a6b0 con 0x55b63612c360 2024-02-15T23:30:15.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.427+0000 7f3818bb8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b63612c360 0x55b636216260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b63612c360 0x55b636216260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36044/0 (socket says 172.21.15.133:36044) 2024-02-15T23:30:15.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 -- 172.21.15.133:0/608626184 learned_addr learned my addr 172.21.15.133:0/608626184 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 -- 172.21.15.133:0/608626184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808005df0 con 0x55b63612c360 2024-02-15T23:30:15.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 --2- 172.21.15.133:0/608626184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b63612c360 0x55b636216260 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3800001d10 tx=0x7f380000b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6569450430f8c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3706e0d640 1 -- 172.21.15.133:0/608626184 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3800014070 con 0x55b63612c360 2024-02-15T23:30:15.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3706e0d640 1 -- 172.21.15.133:0/608626184 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380000f560 con 0x55b63612c360 2024-02-15T23:30:15.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3706e0d640 1 -- 172.21.15.133:0/608626184 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f380000f840 con 0x55b63612c360 2024-02-15T23:30:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 -- 172.21.15.133:0/608626184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b63612c360 msgr2=0x55b636216260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 --2- 172.21.15.133:0/608626184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b63612c360 0x55b636216260 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3800001d10 tx=0x7f380000b5c0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 -- 172.21.15.133:0/608626184 shutdown_connections 2024-02-15T23:30:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 --2- 172.21.15.133:0/608626184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b63612c360 0x55b636216260 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 -- 172.21.15.133:0/608626184 >> 172.21.15.133:0/608626184 conn(0x55b63609fa50 msgr2=0x55b636211df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 -- 172.21.15.133:0/608626184 shutdown_connections 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 -- 172.21.15.133:0/608626184 wait complete. 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 Processor -- start 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 -- start start 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b63621d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b636035e90 con 0x55b636130860 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b63621d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b63621d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36060/0 (socket says 172.21.15.133:36060) 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 -- 172.21.15.133:0/2891464185 learned_addr learned my addr 172.21.15.133:0/2891464185 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 -- 172.21.15.133:0/2891464185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6360764d0 con 0x55b636130860 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f3818bb8640 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b63621d3e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3800002000 tx=0x7f3800000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f370560a640 1 -- 172.21.15.133:0/2891464185 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3800014050 con 0x55b636130860 2024-02-15T23:30:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b63621d920 con 0x55b636130860 2024-02-15T23:30:15.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.431+0000 7f370560a640 1 -- 172.21.15.133:0/2891464185 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380000fe70 con 0x55b636130860 2024-02-15T23:30:15.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f370560a640 1 -- 172.21.15.133:0/2891464185 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f380001b8e0 con 0x55b636130860 2024-02-15T23:30:15.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b63621ddd0 con 0x55b636130860 2024-02-15T23:30:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f370560a640 1 -- 172.21.15.133:0/2891464185 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3800022020 con 0x55b636130860 2024-02-15T23:30:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f370560a640 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f37000342b0 0x7f3700036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f370560a640 1 -- 172.21.15.133:0/2891464185 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3800048bc0 con 0x55b636130860 2024-02-15T23:30:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38183b7640 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f37000342b0 0x7f3700036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f381b09d980 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636221fd0 0x55b6362243c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636224900 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38193b9640 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636221fd0 0x55b6362243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38183b7640 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f37000342b0 0x7f3700036770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f38080ae000 tx=0x7f38080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38193b9640 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636221fd0 0x55b6362243c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38193b9640 1 -- 172.21.15.133:0/2891464185 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f381000a4d0 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b6362216e0 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38193b9640 1 -- 172.21.15.133:0/2891464185 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f381000a4d0 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636226600 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38193b9640 1 -- 172.21.15.133:0/2891464185 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f381000a4d0 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636225800 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38193b9640 1 -- 172.21.15.133:0/2891464185 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f381000a4d0 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636225c10 con 0x55b636221fd0 2024-02-15T23:30:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.435+0000 7f38193b9640 1 -- 172.21.15.133:0/2891464185 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f381000a4d0 con 0x55b636221fd0 2024-02-15T23:30:15.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f381b09d980 1 Processor -- start 2024-02-15T23:30:15.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f381b09d980 1 -- start start 2024-02-15T23:30:15.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f381b09d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636234c20 0x55b636235040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f381b09d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b635fcef20 con 0x55b636234c20 2024-02-15T23:30:15.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f38183b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636234c20 0x55b636235040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f38183b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636234c20 0x55b636235040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36070/0 (socket says 172.21.15.133:36070) 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f38183b7640 1 -- 172.21.15.133:0/1264206943 learned_addr learned my addr 172.21.15.133:0/1264206943 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f38183b7640 1 -- 172.21.15.133:0/1264206943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b636235580 con 0x55b636234c20 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f38183b7640 1 --2- 172.21.15.133:0/1264206943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636234c20 0x55b636235040 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f38080ac040 tx=0x7f38080180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f36fe7fc640 1 -- 172.21.15.133:0/1264206943 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080b3cd0 con 0x55b636234c20 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f381b09d980 1 -- 172.21.15.133:0/1264206943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b636235770 con 0x55b636234c20 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f36fe7fc640 1 -- 172.21.15.133:0/1264206943 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38080c3070 con 0x55b636234c20 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f36fe7fc640 1 -- 172.21.15.133:0/1264206943 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080c8430 con 0x55b636234c20 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f381b09d980 1 -- 172.21.15.133:0/1264206943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b636236260 con 0x55b636234c20 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f36fe7fc640 1 -- 172.21.15.133:0/1264206943 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f38080c5030 con 0x55b636234c20 2024-02-15T23:30:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f36fe7fc640 1 --2- 172.21.15.133:0/1264206943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36f00342b0 0x7f36f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f36fe7fc640 1 -- 172.21.15.133:0/1264206943 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f38080e6930 con 0x55b636234c20 2024-02-15T23:30:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f38193b9640 1 --2- 172.21.15.133:0/1264206943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36f00342b0 0x7f36f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f381b09d980 1 Processor -- start 2024-02-15T23:30:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.439+0000 7f381b09d980 1 -- start start 2024-02-15T23:30:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636242030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38193b9640 1 --2- 172.21.15.133:0/1264206943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36f00342b0 0x7f36f0036770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55b636225240 tx=0x7f3810005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b635fc2790 con 0x55b636241c50 2024-02-15T23:30:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636242030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636242030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36078/0 (socket says 172.21.15.133:36078) 2024-02-15T23:30:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 -- 172.21.15.133:0/4146060317 learned_addr learned my addr 172.21.15.133:0/4146060317 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 -- 172.21.15.133:0/4146060317 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b636242600 con 0x55b636241c50 2024-02-15T23:30:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 --2- 172.21.15.133:0/4146060317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636242030 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f38080befd0 tx=0x7f38080bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4248b145dbbb192d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f36effff640 1 -- 172.21.15.133:0/4146060317 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080d6040 con 0x55b636241c50 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f36effff640 1 -- 172.21.15.133:0/4146060317 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38080c7b20 con 0x55b636241c50 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f36effff640 1 -- 172.21.15.133:0/4146060317 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080c7dc0 con 0x55b636241c50 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 -- 172.21.15.133:0/4146060317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 msgr2=0x55b636242030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 --2- 172.21.15.133:0/4146060317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636242030 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f38080befd0 tx=0x7f38080bd450 comp rx=0 tx=0).stop 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 -- 172.21.15.133:0/4146060317 shutdown_connections 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 --2- 172.21.15.133:0/4146060317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636242030 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 -- 172.21.15.133:0/4146060317 >> 172.21.15.133:0/4146060317 conn(0x55b63623df90 msgr2=0x55b63623bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 -- 172.21.15.133:0/4146060317 shutdown_connections 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 -- 172.21.15.133:0/4146060317 wait complete. 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 Processor -- start 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 -- start start 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636248ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f381b09d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b636249000 con 0x55b636241c50 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636248ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636248ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36086/0 (socket says 172.21.15.133:36086) 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 learned_addr learned my addr 172.21.15.133:0/859016303 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b636236260 con 0x55b636241c50 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.443+0000 7f38183b7640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636248ac0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f38080b3b20 tx=0x7f38080e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f36ee7fc640 1 -- 172.21.15.133:0/859016303 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080d6040 con 0x55b636241c50 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b636249200 con 0x55b636241c50 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f36ee7fc640 1 -- 172.21.15.133:0/859016303 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38080e6cf0 con 0x55b636241c50 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f36ee7fc640 1 -- 172.21.15.133:0/859016303 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080bd9d0 con 0x55b636241c50 2024-02-15T23:30:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b636249200 con 0x55b636241c50 2024-02-15T23:30:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f36ee7fc640 1 -- 172.21.15.133:0/859016303 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f38080bdb30 con 0x55b636241c50 2024-02-15T23:30:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f36ee7fc640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36e40342b0 0x7f36e4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f36ee7fc640 1 -- 172.21.15.133:0/859016303 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f38080c10e0 con 0x55b636241c50 2024-02-15T23:30:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f38193b9640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36e40342b0 0x7f36e4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636253d90 0x55b636256230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636256980 con 0x55b636253d90 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f3818bb8640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636253d90 0x55b636256230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f38193b9640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36e40342b0 0x7f36e4036770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3810011010 tx=0x7f3810020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f3818bb8640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636253d90 0x55b636256230 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 realm 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636256d50 con 0x55b636253d90 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b6362575d0 con 0x55b636253d90 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636257930 con 0x55b636253d90 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.447+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636253d90 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f381b09d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f381b09d980 20 searching for the correct realm 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55b636259fe0 0x55b63625c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625cb70 con 0x55b636259fe0 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38183b7640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55b636259fe0 0x55b63625c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38183b7640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55b636259fe0 0x55b63625c4a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38183b7640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f38080f1070 0x7f38080f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625cb70 con 0x7f38080f1070 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38193b9640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f38080f1070 0x7f38080f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38193b9640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f38080f1070 0x7f38080f4120 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f381000a4d0 con 0x7f38080f1070 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625cb70 con 0x7f38080f1070 2024-02-15T23:30:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f381000a4d0 con 0x7f38080f1070 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625cb70 con 0x55b636253d90 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636253d90 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f3818bb8640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55b63612c360 0x7f3800026920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b63612c360 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f3818bb8640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55b63612c360 0x7f3800026920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.451+0000 7f3818bb8640 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55b63612c360 0x7f3800026920 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800016070 con 0x55b63612c360 2024-02-15T23:30:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b63612c360 2024-02-15T23:30:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800016070 con 0x55b63612c360 2024-02-15T23:30:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x7f38080f1070 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f381000a4d0 con 0x7f38080f1070 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636259fe0 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636253d90 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b63612c360 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800016070 con 0x55b63612c360 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636253d90 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x7f38080f1070 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636259fe0 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636259fe0 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b63612c360 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800016070 con 0x55b63612c360 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.455+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636259fe0 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636259fe0 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636253d90 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636253d90 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3800016070 con 0x55b636253d90 2024-02-15T23:30:15.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b63612c360 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636259fe0 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x7f38080f1070 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636253d90 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x7f38080f1070 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636259fe0 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b63612c360 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x7f38080f1070 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.459+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636259fe0 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b63612c360 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x55b636253d90 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258130 con 0x7f38080f1070 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258930 con 0x55b636253d90 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258c90 con 0x55b636253d90 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636258c90 con 0x55b636253d90 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 zone default found 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 4 Realm: () 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 zonegroup default 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636259150 con 0x7f38080f1070 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636259550 con 0x55b636259fe0 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625e9c0 con 0x55b636259fe0 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 started sync module instance, tier type = 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.463+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625e270 con 0x7f38080f1070 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.467+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.467+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94241080860112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625e620 con 0x7f38080f1070 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.467+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625f700 con 0x55b636253d90 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.467+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.467+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94241080865376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625fb20 con 0x55b636253d90 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.467+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636260320 con 0x55b636259fe0 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.467+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94241080860112] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.471+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94241080865376] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.471+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.471+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94241080866432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625ff40 con 0x55b636259fe0 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.471+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636260b20 con 0x7f38080f1070 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.471+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.471+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94241080870800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636261230 con 0x7f38080f1070 2024-02-15T23:30:15.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.471+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636261ce0 con 0x55b636253d90 2024-02-15T23:30:15.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.471+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94241080866432] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.475+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94241080870800] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.475+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.475+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94241080874976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636261ca0 con 0x55b636253d90 2024-02-15T23:30:15.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.475+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636260e00 con 0x55b63612c360 2024-02-15T23:30:15.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.475+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94241080874976] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.475+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.475+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94241080867488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636262560 con 0x55b63612c360 2024-02-15T23:30:15.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.475+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636262ed0 con 0x55b63612c360 2024-02-15T23:30:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(56 notify.6 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94241080879664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b6362632f0 con 0x55b63612c360 2024-02-15T23:30:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636263ca0 con 0x55b63612c360 2024-02-15T23:30:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94241080867488] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94241080879664] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94241080877248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636263c60 con 0x55b63612c360 2024-02-15T23:30:15.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 20 add_watcher() i=0 2024-02-15T23:30:15.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 20 add_watcher() i=1 2024-02-15T23:30:15.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 20 add_watcher() i=2 2024-02-15T23:30:15.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 20 add_watcher() i=3 2024-02-15T23:30:15.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 20 add_watcher() i=4 2024-02-15T23:30:15.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 20 add_watcher() i=5 2024-02-15T23:30:15.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.479+0000 7f381b09d980 20 add_watcher() i=6 2024-02-15T23:30:15.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94241080877248] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 20 add_watcher() i=7 2024-02-15T23:30:15.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:15.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636266c90 con 0x55b636253d90 2024-02-15T23:30:15.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94241080883136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636264150 con 0x55b636253d90 2024-02-15T23:30:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94241080883136] v33'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f36cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 5 note: GC not initialized 2024-02-15T23:30:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f36ce7e4640 20 reqs_thread_entry: start 2024-02-15T23:30:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 20 Filter name: none 2024-02-15T23:30:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f36c77fe640 20 reqs_thread_entry: start 2024-02-15T23:30:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:30:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.483+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636288bb0 con 0x55b636253d90 2024-02-15T23:30:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~370 out=370b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+493 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 20 rados_obj.operate() r=0 bl.length=370 2024-02-15T23:30:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:30:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:30:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63628e4e0 con 0x55b636253d90 2024-02-15T23:30:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v33'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94241081057248 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63628b410 con 0x55b636253d90 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== watch-notify(notify (1) cookie 94241080874976 notify 141733920797 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55b63621ddd0 con 0x55b636253d90 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f36effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 94241080874976 notifier 4660 bl.length()=534 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f36effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f36effff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(64 notify.4 [notify cookie 94241081057248 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f36effff640 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f36dc003ea0 con 0x55b636253d90 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== watch-notify(notify_complete (2) cookie 94241081057248 notify 141733920797 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b63621d920 con 0x55b636253d90 2024-02-15T23:30:15.497 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:30:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f36cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.487+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94241080883136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b636287b40 con 0x55b636253d90 2024-02-15T23:30:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.491+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94241080883136] v33'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.491+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94241080860112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b6362637c0 con 0x7f38080f1070 2024-02-15T23:30:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.491+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94241080860112] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.491+0000 7f381b09d980 20 remove_watcher() i=0 2024-02-15T23:30:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.491+0000 7f381b09d980 2 removed watcher, disabling cache 2024-02-15T23:30:15.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.491+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94241080865376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625ddd0 con 0x55b636253d90 2024-02-15T23:30:15.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94241080865376] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f381b09d980 20 remove_watcher() i=1 2024-02-15T23:30:15.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94241080866432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625ddd0 con 0x55b636259fe0 2024-02-15T23:30:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f38183b7640 1 -- 172.21.15.133:0/859016303 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94241080866432] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38080b0020 con 0x55b636259fe0 2024-02-15T23:30:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f381b09d980 20 remove_watcher() i=2 2024-02-15T23:30:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94241080870800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625f700 con 0x7f38080f1070 2024-02-15T23:30:15.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f38193b9640 1 -- 172.21.15.133:0/859016303 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94241080870800] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3810039060 con 0x7f38080f1070 2024-02-15T23:30:15.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f381b09d980 20 remove_watcher() i=3 2024-02-15T23:30:15.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.495+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94241080874976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625f700 con 0x55b636253d90 2024-02-15T23:30:15.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.499+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94241080874976] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b636253d90 2024-02-15T23:30:15.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.499+0000 7f381b09d980 20 remove_watcher() i=4 2024-02-15T23:30:15.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.499+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94241080867488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b63625f700 con 0x55b63612c360 2024-02-15T23:30:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.499+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94241080867488] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.499+0000 7f381b09d980 20 remove_watcher() i=5 2024-02-15T23:30:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.499+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94241080879664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b6362617e0 con 0x55b63612c360 2024-02-15T23:30:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.503+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94241080879664] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.503+0000 7f381b09d980 20 remove_watcher() i=6 2024-02-15T23:30:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.503+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94241080877248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b6362637c0 con 0x55b63612c360 2024-02-15T23:30:15.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.503+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94241080877248] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3800057040 con 0x55b63612c360 2024-02-15T23:30:15.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.503+0000 7f381b09d980 20 remove_watcher() i=7 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55b63612c360 msgr2=0x7f3800026920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55b63612c360 0x7f3800026920 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636253d90 msgr2=0x55b636256230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636253d90 0x55b636256230 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f38080f1070 msgr2=0x7f38080f4120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f38080f1070 0x7f38080f4120 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55b636259fe0 msgr2=0x55b63625c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55b636259fe0 0x55b63625c4a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36e40342b0 msgr2=0x7f36e4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36e40342b0 0x7f36e4036770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3810011010 tx=0x7f3810020000 comp rx=0 tx=0).stop 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f3818bb8640 1 -- 172.21.15.133:0/859016303 reap_dead start 2024-02-15T23:30:15.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 msgr2=0x55b636248ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636248ac0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f38080b3b20 tx=0x7f38080e4b90 comp rx=0 tx=0).stop 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 shutdown_connections 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/859016303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636241c50 0x55b636248ac0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 >> 172.21.15.133:0/859016303 conn(0x55b63623df90 msgr2=0x55b63623bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 shutdown_connections 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/859016303 wait complete. 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/1264206943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36f00342b0 msgr2=0x7f36f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/1264206943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36f00342b0 0x7f36f0036770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55b636225240 tx=0x7f3810005850 comp rx=0 tx=0).stop 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/1264206943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636234c20 msgr2=0x55b636235040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/1264206943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636234c20 0x55b636235040 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f38080ac040 tx=0x7f38080180e0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/1264206943 shutdown_connections 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/1264206943 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f36f00342b0 0x7f36f0036770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/1264206943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636234c20 0x55b636235040 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/1264206943 >> 172.21.15.133:0/1264206943 conn(0x55b636229a30 msgr2=0x55b63622a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/1264206943 shutdown_connections 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/1264206943 wait complete. 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636221fd0 msgr2=0x55b6362243c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636221fd0 0x55b6362243c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f37000342b0 msgr2=0x7f3700036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f37000342b0 0x7f3700036770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f38080ae000 tx=0x7f38080a6000 comp rx=0 tx=0).stop 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 msgr2=0x55b63621d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b63621d3e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3800002000 tx=0x7f3800000bd0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 shutdown_connections 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55b636221fd0 0x55b6362243c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f37000342b0 0x7f3700036770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 --2- 172.21.15.133:0/2891464185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b636130860 0x55b63621d3e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 >> 172.21.15.133:0/2891464185 conn(0x55b63609fa50 msgr2=0x55b636210900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 shutdown_connections 2024-02-15T23:30:15.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.507+0000 7f381b09d980 1 -- 172.21.15.133:0/2891464185 wait complete. 2024-02-15T23:30:15.525 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:30:15.543 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:15.543 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-15T23:30:15.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-15T23:30:15.543 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-15T23:30:15.599 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:15.599 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:15.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3cefcd8980 1 Processor -- start 2024-02-15T23:30:15.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3cefcd8980 1 -- start start 2024-02-15T23:30:15.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3cefcd8980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556fb954d900 0x556fb95dbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3cefcd8980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556fb95254c0 con 0x556fb95dc330 2024-02-15T23:30:15.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3cefcd8980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x556fb94ec180 con 0x556fb954d900 2024-02-15T23:30:15.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3ced7f3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556fb954d900 0x556fb95dbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3cecff2640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x556fb95dc330 0x556fb95de720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:60386/0 (socket says 172.21.15.133:60386) 2024-02-15T23:30:15.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3ced7f3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556fb954d900 0x556fb95dbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36094/0 (socket says 172.21.15.133:36094) 2024-02-15T23:30:15.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.591+0000 7f3cecff2640 1 -- 172.21.15.133:0/3974481382 learned_addr learned my addr 172.21.15.133:0/3974481382 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:15.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.595+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3974481382 >> v1:172.21.15.131:6789/0 conn(0x556fb95dc330 legacy=0x556fb95de720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.595+0000 7f3cdffff640 1 -- 172.21.15.133:0/3974481382 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987228830 0 0) 0x556fb95254c0 con 0x556fb95dc330 2024-02-15T23:30:15.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.595+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3974481382 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb95e0ee0 con 0x556fb954d900 2024-02-15T23:30:15.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.595+0000 7f3ced7f3640 1 --2- 172.21.15.133:0/3974481382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb95dbdf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000a480 tx=0x7f3ce001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c7ea67b0bf7bf7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.595+0000 7f3cdffff640 1 -- 172.21.15.133:0/3974481382 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce00ab540 con 0x556fb954d900 2024-02-15T23:30:15.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.595+0000 7f3cdffff640 1 -- 172.21.15.133:0/3974481382 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce00ab6a0 con 0x556fb954d900 2024-02-15T23:30:15.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.599+0000 7f3cdffff640 1 -- 172.21.15.133:0/3974481382 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce00ab960 con 0x556fb954d900 2024-02-15T23:30:15.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.599+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3974481382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 msgr2=0x556fb95dbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.599+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3974481382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb95dbdf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000a480 tx=0x7f3ce001b280 comp rx=0 tx=0).stop 2024-02-15T23:30:15.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.599+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3974481382 shutdown_connections 2024-02-15T23:30:15.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.599+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3974481382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb95dbdf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.599+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3974481382 >> 172.21.15.133:0/3974481382 conn(0x556fb95d3910 msgr2=0x556fb95d5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.599+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3974481382 shutdown_connections 2024-02-15T23:30:15.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.599+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3974481382 wait complete. 2024-02-15T23:30:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.611+0000 7f3cefcd8980 1 Processor -- start 2024-02-15T23:30:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.611+0000 7f3cefcd8980 1 -- start start 2024-02-15T23:30:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb94e96b0 con 0x556fb954d900 2024-02-15T23:30:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3ced7f3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3ced7f3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36102/0 (socket says 172.21.15.133:36102) 2024-02-15T23:30:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3ced7f3640 1 -- 172.21.15.133:0/4112503524 learned_addr learned my addr 172.21.15.133:0/4112503524 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3ced7f3640 1 -- 172.21.15.133:0/4112503524 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0005d30 con 0x556fb954d900 2024-02-15T23:30:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3ced7f3640 1 --2- 172.21.15.133:0/4112503524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c2e80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0018eb0 tx=0x7f3ce0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33724d32dc8c21d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3bdb606640 1 -- 172.21.15.133:0/4112503524 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce00ab810 con 0x556fb954d900 2024-02-15T23:30:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3bdb606640 1 -- 172.21.15.133:0/4112503524 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce00ab970 con 0x556fb954d900 2024-02-15T23:30:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3bdb606640 1 -- 172.21.15.133:0/4112503524 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce00abc10 con 0x556fb954d900 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 -- 172.21.15.133:0/4112503524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 msgr2=0x556fb96c2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/4112503524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c2e80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0018eb0 tx=0x7f3ce0003030 comp rx=0 tx=0).stop 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 -- 172.21.15.133:0/4112503524 shutdown_connections 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/4112503524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c2e80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 -- 172.21.15.133:0/4112503524 >> 172.21.15.133:0/4112503524 conn(0x556fb95d3910 msgr2=0x556fb96bea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 -- 172.21.15.133:0/4112503524 shutdown_connections 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 -- 172.21.15.133:0/4112503524 wait complete. 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 Processor -- start 2024-02-15T23:30:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 -- start start 2024-02-15T23:30:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3cefcd8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb94e4e90 con 0x556fb954d900 2024-02-15T23:30:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3ced7f3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3ced7f3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36114/0 (socket says 172.21.15.133:36114) 2024-02-15T23:30:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.615+0000 7f3ced7f3640 1 -- 172.21.15.133:0/2872864973 learned_addr learned my addr 172.21.15.133:0/2872864973 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3ced7f3640 1 -- 172.21.15.133:0/2872864973 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb95e0ee0 con 0x556fb954d900 2024-02-15T23:30:15.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3ced7f3640 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c7a40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00b7040 tx=0x7f3ce0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3bd9e03640 1 -- 172.21.15.133:0/2872864973 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce00b5a60 con 0x556fb954d900 2024-02-15T23:30:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3bd9e03640 1 -- 172.21.15.133:0/2872864973 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce00c5070 con 0x556fb954d900 2024-02-15T23:30:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3bd9e03640 1 -- 172.21.15.133:0/2872864973 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce00b5d10 con 0x556fb954d900 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fb96c7f80 con 0x556fb954d900 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb96c8410 con 0x556fb954d900 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3bd9e03640 1 -- 172.21.15.133:0/2872864973 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3ce00c7030 con 0x556fb954d900 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3bd9e03640 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bd4038710 0x7f3bd403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3bd9e03640 1 -- 172.21.15.133:0/2872864973 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3ce00e45e0 con 0x556fb954d900 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cecff2640 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bd4038710 0x7f3bd403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb95dc330 0x556fb96ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb96cebc0 con 0x556fb95dc330 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cedff4640 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb95dc330 0x556fb96ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cecff2640 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bd4038710 0x7f3bd403abd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000c10 tx=0x7f3ce40013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cedff4640 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb95dc330 0x556fb96ce680 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cedff4640 1 -- 172.21.15.133:0/2872864973 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ce800a4d0 con 0x556fb95dc330 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.619+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb96cef20 con 0x556fb95dc330 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cedff4640 1 -- 172.21.15.133:0/2872864973 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3ce800a4d0 con 0x556fb95dc330 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb96d07b0 con 0x556fb95dc330 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cedff4640 1 -- 172.21.15.133:0/2872864973 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3ce800a4d0 con 0x556fb95dc330 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb96cf8f0 con 0x556fb95dc330 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cedff4640 1 -- 172.21.15.133:0/2872864973 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3ce800a4d0 con 0x556fb95dc330 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb96cfd00 con 0x556fb95dc330 2024-02-15T23:30:15.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cedff4640 1 -- 172.21.15.133:0/2872864973 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3ce800a4d0 con 0x556fb95dc330 2024-02-15T23:30:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 Processor -- start 2024-02-15T23:30:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 -- start start 2024-02-15T23:30:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96dee50 0x556fb96df270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb947df20 con 0x556fb96dee50 2024-02-15T23:30:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cecff2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96dee50 0x556fb96df270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cecff2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96dee50 0x556fb96df270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36130/0 (socket says 172.21.15.133:36130) 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cecff2640 1 -- 172.21.15.133:0/2699930646 learned_addr learned my addr 172.21.15.133:0/2699930646 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cecff2640 1 -- 172.21.15.133:0/2699930646 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb96df7b0 con 0x556fb96dee50 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cecff2640 1 --2- 172.21.15.133:0/2699930646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96dee50 0x556fb96df270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400e620 tx=0x7f3ce400e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3bd2ffd640 1 -- 172.21.15.133:0/2699930646 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce401b380 con 0x556fb96dee50 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3bd2ffd640 1 -- 172.21.15.133:0/2699930646 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce401b4e0 con 0x556fb96dee50 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2699930646 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fb96dfa00 con 0x556fb96dee50 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3bd2ffd640 1 -- 172.21.15.133:0/2699930646 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce401b780 con 0x556fb96dee50 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.623+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2699930646 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb96e0550 con 0x556fb96dee50 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3bd2ffd640 1 -- 172.21.15.133:0/2699930646 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3ce401a070 con 0x556fb96dee50 2024-02-15T23:30:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3bd2ffd640 1 --2- 172.21.15.133:0/2699930646 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bc8034300 0x7f3bc80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3bd2ffd640 1 -- 172.21.15.133:0/2699930646 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3ce4017050 con 0x556fb96dee50 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cedff4640 1 --2- 172.21.15.133:0/2699930646 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bc8034300 0x7f3bc80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 Processor -- start 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 -- start start 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cedff4640 1 --2- 172.21.15.133:0/2699930646 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bc8034300 0x7f3bc80367c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x556fb96cf330 tx=0x7f3ce8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96ec1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb9471790 con 0x556fb96ebdd0 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cecff2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96ec1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cecff2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96ec1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36132/0 (socket says 172.21.15.133:36132) 2024-02-15T23:30:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cecff2640 1 -- 172.21.15.133:0/828578534 learned_addr learned my addr 172.21.15.133:0/828578534 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cecff2640 1 -- 172.21.15.133:0/828578534 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb96ec7c0 con 0x556fb96ebdd0 2024-02-15T23:30:15.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cecff2640 1 --2- 172.21.15.133:0/828578534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96ec1f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4027030 tx=0x7f3ce400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdfeb83ec405b28 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3bd0ff9640 1 -- 172.21.15.133:0/828578534 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce4047070 con 0x556fb96ebdd0 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3bd0ff9640 1 -- 172.21.15.133:0/828578534 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400d300 con 0x556fb96ebdd0 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3bd0ff9640 1 -- 172.21.15.133:0/828578534 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce400d470 con 0x556fb96ebdd0 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 -- 172.21.15.133:0/828578534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 msgr2=0x556fb96ec1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/828578534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96ec1f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4027030 tx=0x7f3ce400ded0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 -- 172.21.15.133:0/828578534 shutdown_connections 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/828578534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96ec1f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 -- 172.21.15.133:0/828578534 >> 172.21.15.133:0/828578534 conn(0x556fb96e8160 msgr2=0x556fb96e61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 -- 172.21.15.133:0/828578534 shutdown_connections 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 -- 172.21.15.133:0/828578534 wait complete. 2024-02-15T23:30:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.627+0000 7f3cefcd8980 1 Processor -- start 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cefcd8980 1 -- start start 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cefcd8980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cefcd8980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb96f3290 con 0x556fb96ebdd0 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cecff2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cecff2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36146/0 (socket says 172.21.15.133:36146) 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 learned_addr learned my addr 172.21.15.133:0/3878955120 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb96e0550 con 0x556fb96ebdd0 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cecff2640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96f2d50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400eae0 tx=0x7f3ce4048a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3bbeffd640 1 -- 172.21.15.133:0/3878955120 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce400d470 con 0x556fb96ebdd0 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fb96f3490 con 0x556fb96ebdd0 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3bbeffd640 1 -- 172.21.15.133:0/3878955120 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce402f070 con 0x556fb96ebdd0 2024-02-15T23:30:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3bbeffd640 1 -- 172.21.15.133:0/3878955120 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ce4048de0 con 0x556fb96ebdd0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb96f38c0 con 0x556fb96ebdd0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3bbeffd640 1 -- 172.21.15.133:0/3878955120 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3ce4031020 con 0x556fb96ebdd0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3bbeffd640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bb80342b0 0x7f3bb8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3bbeffd640 1 -- 172.21.15.133:0/3878955120 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3ce4009050 con 0x556fb96ebdd0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cedff4640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bb80342b0 0x7f3bb8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb96fe350 0x556fb9700810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9700f60 con 0x556fb96fe350 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3ced7f3640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb96fe350 0x556fb9700810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.631+0000 7f3cedff4640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bb80342b0 0x7f3bb8036770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8011010 tx=0x7f3ce8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3ced7f3640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb96fe350 0x556fb9700810 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 realm 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9701330 con 0x556fb96fe350 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9701bb0 con 0x556fb96fe350 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9701f10 con 0x556fb96fe350 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9702710 con 0x556fb96fe350 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 20 searching for the correct realm 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556fb97045a0 0x556fb9706a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cecff2640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556fb97045a0 0x556fb9706a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cecff2640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556fb97045a0 0x556fb9706a60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce4041040 con 0x556fb97045a0 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cecff2640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ce4027060 0x7f3ce401a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce4027060 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cedff4640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ce4027060 0x7f3ce401a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cedff4640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ce4027060 0x7f3ce401a540 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce800a4d0 con 0x7f3ce4027060 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce4027060 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce800a4d0 con 0x7f3ce4027060 2024-02-15T23:30:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb96fe350 2024-02-15T23:30:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.635+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb96fe350 2024-02-15T23:30:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3ce00ab030 0x7f3ce00c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce00ab030 2024-02-15T23:30:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3ce00ab030 0x7f3ce00c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3ce00ab030 0x7f3ce00c9590 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:15.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce00ab030 2024-02-15T23:30:15.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce4027060 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce800a4d0 con 0x7f3ce4027060 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce4041040 con 0x556fb97045a0 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb96fe350 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce00ab030 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.639+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb96fe350 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce4027060 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce4041040 con 0x556fb97045a0 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce4041040 con 0x556fb97045a0 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce00ab030 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce4041040 con 0x556fb97045a0 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce4041040 con 0x556fb97045a0 2024-02-15T23:30:15.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb96fe350 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb96fe350 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce00ab030 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce4041040 con 0x556fb97045a0 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce4027060 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.643+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb96fe350 2024-02-15T23:30:15.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce4027060 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce00ab030 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce4027060 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb97045a0 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce00ab030 2024-02-15T23:30:15.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x556fb96fe350 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707130 con 0x7f3ce4027060 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:15.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9703010 con 0x556fb96fe350 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9703810 con 0x556fb96fe350 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.647+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707570 con 0x556fb96fe350 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 zone default found 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 4 Realm: () 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 zonegroup default 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9707570 con 0x7f3ce4027060 2024-02-15T23:30:15.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb97093f0 con 0x556fb97045a0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9709750 con 0x556fb97045a0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 started sync module instance, tier type = 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:15.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb97089c0 con 0x7f3ce4027060 2024-02-15T23:30:15.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93938340892064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb97089c0 con 0x7f3ce4027060 2024-02-15T23:30:15.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970a100 con 0x556fb96fe350 2024-02-15T23:30:15.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.651+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93938340892064] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.655+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.655+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93938340889888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970a0c0 con 0x556fb96fe350 2024-02-15T23:30:15.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.655+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970aac0 con 0x556fb97045a0 2024-02-15T23:30:15.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.655+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.655+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93938340898240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970b310 con 0x556fb97045a0 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.655+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970bd10 con 0x7f3ce4027060 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.655+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93938340889888] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.659+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.659+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93938340902928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970c0c0 con 0x7f3ce4027060 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.659+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970ca70 con 0x556fb96fe350 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.659+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93938340898240] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.659+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93938340902928] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.659+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.659+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93938340895776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970c590 con 0x556fb96fe350 2024-02-15T23:30:15.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.659+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970d2c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.663+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93938340895776] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.663+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.663+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93938340900464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970c590 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.663+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970d8d0 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.663+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(56 notify.6 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.663+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93938340900464] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.663+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93938340908576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970d8d0 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.663+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970e110 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93938340908576] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93938340910128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970dcf0 con 0x7f3ce00ab030 2024-02-15T23:30:15.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 20 add_watcher() i=0 2024-02-15T23:30:15.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 20 add_watcher() i=1 2024-02-15T23:30:15.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 20 add_watcher() i=2 2024-02-15T23:30:15.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 20 add_watcher() i=3 2024-02-15T23:30:15.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 20 add_watcher() i=4 2024-02-15T23:30:15.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 20 add_watcher() i=5 2024-02-15T23:30:15.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 20 add_watcher() i=6 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93938340910128] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 20 add_watcher() i=7 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9711640 con 0x556fb96fe350 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.667+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93938340911856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970e9f0 con 0x556fb96fe350 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.671+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93938340911856] v33'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.671+0000 7f3ba37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:15.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.671+0000 7f3cefcd8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:15.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.671+0000 7f3cefcd8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:15.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.671+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9719b90 con 0x556fb96fe350 2024-02-15T23:30:15.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.671+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.671+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971a030 con 0x7f3ce00ab030 2024-02-15T23:30:15.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.675+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.675+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971a4d0 con 0x556fb97045a0 2024-02-15T23:30:15.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.675+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.675+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971acd0 con 0x556fb96fe350 2024-02-15T23:30:15.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.675+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'192 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.675+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9717dd0 con 0x7f3ce4027060 2024-02-15T23:30:15.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.679+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'65 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.679+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9717dd0 con 0x556fb97045a0 2024-02-15T23:30:15.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.679+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'43 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.679+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971beb0 con 0x556fb96fe350 2024-02-15T23:30:15.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.679+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.679+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971beb0 con 0x7f3ce00ab030 2024-02-15T23:30:15.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.683+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.683+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971beb0 con 0x7f3ce4027060 2024-02-15T23:30:15.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.683+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.683+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9716cf0 con 0x556fb97045a0 2024-02-15T23:30:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.687+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.687+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9717300 con 0x7f3ce4027060 2024-02-15T23:30:15.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.687+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'66 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.687+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971caa0 con 0x7f3ce00ab030 2024-02-15T23:30:15.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.691+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'30 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.691+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971caa0 con 0x7f3ce4027060 2024-02-15T23:30:15.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.691+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.691+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x7f3ce00ab030 2024-02-15T23:30:15.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.691+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'49 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.691+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb96fe350 2024-02-15T23:30:15.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.695+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'193 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.695+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb97045a0 2024-02-15T23:30:15.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.695+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'59 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.695+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x7f3ce4027060 2024-02-15T23:30:15.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.699+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'67 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.699+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb97045a0 2024-02-15T23:30:15.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.699+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.699+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb96fe350 2024-02-15T23:30:15.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.699+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.699+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb96fe350 2024-02-15T23:30:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.703+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'194 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.703+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb97045a0 2024-02-15T23:30:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.703+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'60 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.703+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x7f3ce4027060 2024-02-15T23:30:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.707+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.707+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb97045a0 2024-02-15T23:30:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.707+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.707+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb97045a0 2024-02-15T23:30:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.707+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'32 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.707+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb97045a0 2024-02-15T23:30:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.711+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'21 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.711+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb97045a0 2024-02-15T23:30:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.711+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'44 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.711+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x7f3ce00ab030 2024-02-15T23:30:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.715+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.715+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971cf40 con 0x556fb97045a0 2024-02-15T23:30:15.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.715+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.715+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971d110 con 0x7f3ce00ab030 2024-02-15T23:30:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.715+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.715+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971d110 con 0x556fb97045a0 2024-02-15T23:30:15.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.719+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'61 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.719+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971d110 con 0x7f3ce00ab030 2024-02-15T23:30:15.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.719+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'50 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.719+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb971d110 con 0x7f3ce4027060 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3ba27e4640 20 reqs_thread_entry: start 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 20 Filter name: none 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3b13fff640 20 reqs_thread_entry: start 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 20 rados->read ofs=0 len=0 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9719150 con 0x556fb96fe350 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:30:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:30:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb97394f0 con 0x7f3ce4027060 2024-02-15T23:30:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.723+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-15T23:30:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.727+0000 7f3ba37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.727+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93938340911856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9715670 con 0x556fb96fe350 2024-02-15T23:30:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.727+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93938340911856] v33'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.727+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93938340892064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970daf0 con 0x7f3ce4027060 2024-02-15T23:30:15.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.727+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93938340892064] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.727+0000 7f3cefcd8980 20 remove_watcher() i=0 2024-02-15T23:30:15.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.727+0000 7f3cefcd8980 2 removed watcher, disabling cache 2024-02-15T23:30:15.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.727+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93938340889888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9708da0 con 0x556fb96fe350 2024-02-15T23:30:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.731+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93938340889888] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.731+0000 7f3cefcd8980 20 remove_watcher() i=1 2024-02-15T23:30:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.731+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93938340898240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9708da0 con 0x556fb97045a0 2024-02-15T23:30:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.731+0000 7f3cecff2640 1 -- 172.21.15.133:0/3878955120 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93938340898240] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce405f040 con 0x556fb97045a0 2024-02-15T23:30:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.731+0000 7f3cefcd8980 20 remove_watcher() i=2 2024-02-15T23:30:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.731+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93938340902928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9708da0 con 0x7f3ce4027060 2024-02-15T23:30:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.735+0000 7f3cedff4640 1 -- 172.21.15.133:0/3878955120 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93938340902928] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce8039060 con 0x7f3ce4027060 2024-02-15T23:30:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.735+0000 7f3cefcd8980 20 remove_watcher() i=3 2024-02-15T23:30:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.735+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93938340895776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb970b810 con 0x556fb96fe350 2024-02-15T23:30:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.735+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93938340895776] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x556fb96fe350 2024-02-15T23:30:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.735+0000 7f3cefcd8980 20 remove_watcher() i=4 2024-02-15T23:30:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.735+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93938340900464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9708da0 con 0x7f3ce00ab030 2024-02-15T23:30:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.739+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93938340900464] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.739+0000 7f3cefcd8980 20 remove_watcher() i=5 2024-02-15T23:30:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.739+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93938340908576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9709c20 con 0x7f3ce00ab030 2024-02-15T23:30:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.739+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93938340908576] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.739+0000 7f3cefcd8980 20 remove_watcher() i=6 2024-02-15T23:30:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.739+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93938340910128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556fb9708da0 con 0x7f3ce00ab030 2024-02-15T23:30:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93938340910128] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ce00bf3c0 con 0x7f3ce00ab030 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 20 remove_watcher() i=7 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3ce00ab030 msgr2=0x7f3ce00c9590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f3ce00ab030 0x7f3ce00c9590 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb96fe350 msgr2=0x556fb9700810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb96fe350 0x556fb9700810 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ce4027060 msgr2=0x7f3ce401a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f3ce4027060 0x7f3ce401a540 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556fb97045a0 msgr2=0x556fb9706a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556fb97045a0 0x556fb9706a60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bb80342b0 msgr2=0x7f3bb8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bb80342b0 0x7f3bb8036770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8011010 tx=0x7f3ce8020000 comp rx=0 tx=0).stop 2024-02-15T23:30:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 msgr2=0x556fb96f2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96f2d50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400eae0 tx=0x7f3ce4048a20 comp rx=0 tx=0).stop 2024-02-15T23:30:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3ced7f3640 1 -- 172.21.15.133:0/3878955120 reap_dead start 2024-02-15T23:30:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 shutdown_connections 2024-02-15T23:30:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/3878955120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96ebdd0 0x556fb96f2d50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 >> 172.21.15.133:0/3878955120 conn(0x556fb96e8160 msgr2=0x556fb96e57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 shutdown_connections 2024-02-15T23:30:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/3878955120 wait complete. 2024-02-15T23:30:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2699930646 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bc8034300 msgr2=0x7f3bc80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2699930646 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bc8034300 0x7f3bc80367c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x556fb96cf330 tx=0x7f3ce8005850 comp rx=0 tx=0).stop 2024-02-15T23:30:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2699930646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96dee50 msgr2=0x556fb96df270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2699930646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96dee50 0x556fb96df270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400e620 tx=0x7f3ce400e650 comp rx=0 tx=0).stop 2024-02-15T23:30:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2699930646 shutdown_connections 2024-02-15T23:30:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2699930646 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bc8034300 0x7f3bc80367c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2699930646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb96dee50 0x556fb96df270 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2699930646 >> 172.21.15.133:0/2699930646 conn(0x556fb96d3c60 msgr2=0x556fb96d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2699930646 shutdown_connections 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2699930646 wait complete. 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb95dc330 msgr2=0x556fb96ce680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb95dc330 0x556fb96ce680 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bd4038710 msgr2=0x7f3bd403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bd4038710 0x7f3bd403abd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000c10 tx=0x7f3ce40013c0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 msgr2=0x556fb96c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c7a40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00b7040 tx=0x7f3ce0018020 comp rx=0 tx=0).stop 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 shutdown_connections 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556fb95dc330 0x556fb96ce680 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3bd4038710 0x7f3bd403abd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 --2- 172.21.15.133:0/2872864973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556fb954d900 0x556fb96c7a40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:15.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 >> 172.21.15.133:0/2872864973 conn(0x556fb95d3910 msgr2=0x556fb96bd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:15.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 shutdown_connections 2024-02-15T23:30:15.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:15.743+0000 7f3cefcd8980 1 -- 172.21.15.133:0/2872864973 wait complete. 2024-02-15T23:30:15.763 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-15T23:30:15.785 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:15.793 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-15T23:30:50.794 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-02-15T23:30:50.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-02-15T23:30:50.795 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-02-15T23:30:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabae4d1980 1 Processor -- start 2024-02-15T23:30:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabae4d1980 1 -- start start 2024-02-15T23:30:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabae4d1980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x562eedb4e520 0x562eedb50910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabae4d1980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562eeda964c0 con 0x562eedabe080 2024-02-15T23:30:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabae4d1980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x562eeda5d180 con 0x562eedb4e520 2024-02-15T23:30:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabab7eb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x562eedb4e520 0x562eedb50910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabab7eb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x562eedb4e520 0x562eedb50910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39014/0 (socket says 172.21.15.133:39014) 2024-02-15T23:30:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabab7eb640 1 -- 172.21.15.133:0/1250124113 learned_addr learned my addr 172.21.15.133:0/1250124113 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabab7eb640 1 -- 172.21.15.133:0/1250124113 >> v1:172.21.15.131:6789/0 conn(0x562eedabe080 legacy=0x562eedb4ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.827+0000 7fabab7eb640 1 -- 172.21.15.133:0/1250124113 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eedb51ef0 con 0x562eedb4e520 2024-02-15T23:30:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabab7eb640 1 --2- 172.21.15.133:0/1250124113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4e520 0x562eedb50910 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fab9400a5c0 tx=0x7fab9401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8122d3382653563 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabaafea640 1 -- 172.21.15.133:0/1250124113 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab940aa470 con 0x562eedb4e520 2024-02-15T23:30:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabaafea640 1 -- 172.21.15.133:0/1250124113 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940aa5d0 con 0x562eedb4e520 2024-02-15T23:30:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabaafea640 1 -- 172.21.15.133:0/1250124113 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab940aa890 con 0x562eedb4e520 2024-02-15T23:30:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabae4d1980 1 -- 172.21.15.133:0/1250124113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4e520 msgr2=0x562eedb50910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabae4d1980 1 --2- 172.21.15.133:0/1250124113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4e520 0x562eedb50910 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fab9400a5c0 tx=0x7fab9401b340 comp rx=0 tx=0).stop 2024-02-15T23:30:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabae4d1980 1 -- 172.21.15.133:0/1250124113 shutdown_connections 2024-02-15T23:30:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabae4d1980 1 --2- 172.21.15.133:0/1250124113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4e520 0x562eedb50910 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabae4d1980 1 -- 172.21.15.133:0/1250124113 >> 172.21.15.133:0/1250124113 conn(0x562eedb448e0 msgr2=0x562eedb46d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabae4d1980 1 -- 172.21.15.133:0/1250124113 shutdown_connections 2024-02-15T23:30:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.831+0000 7fabae4d1980 1 -- 172.21.15.133:0/1250124113 wait complete. 2024-02-15T23:30:50.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.847+0000 7fabae4d1980 1 Processor -- start 2024-02-15T23:30:50.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.847+0000 7fabae4d1980 1 -- start start 2024-02-15T23:30:50.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.847+0000 7fabae4d1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc34100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.847+0000 7fabae4d1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eeda5a6b0 con 0x562eedabe080 2024-02-15T23:30:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.847+0000 7fababfec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc34100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.847+0000 7fababfec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc34100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39016/0 (socket says 172.21.15.133:39016) 2024-02-15T23:30:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.847+0000 7fababfec640 1 -- 172.21.15.133:0/1451558252 learned_addr learned my addr 172.21.15.133:0/1451558252 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fababfec640 1 -- 172.21.15.133:0/1451558252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94005df0 con 0x562eedabe080 2024-02-15T23:30:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fababfec640 1 --2- 172.21.15.133:0/1451558252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc34100 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fab9c001d10 tx=0x7fab9c00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52afea65ebf96a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7faa99e0b640 1 -- 172.21.15.133:0/1451558252 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab9c014070 con 0x562eedabe080 2024-02-15T23:30:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7faa99e0b640 1 -- 172.21.15.133:0/1451558252 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c00f560 con 0x562eedabe080 2024-02-15T23:30:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7faa99e0b640 1 -- 172.21.15.133:0/1451558252 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab9c00f840 con 0x562eedabe080 2024-02-15T23:30:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 -- 172.21.15.133:0/1451558252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 msgr2=0x562eedc34100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 --2- 172.21.15.133:0/1451558252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc34100 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fab9c001d10 tx=0x7fab9c00b5c0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 -- 172.21.15.133:0/1451558252 shutdown_connections 2024-02-15T23:30:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 --2- 172.21.15.133:0/1451558252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc34100 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 -- 172.21.15.133:0/1451558252 >> 172.21.15.133:0/1451558252 conn(0x562eedb448e0 msgr2=0x562eedc2fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 -- 172.21.15.133:0/1451558252 shutdown_connections 2024-02-15T23:30:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 -- 172.21.15.133:0/1451558252 wait complete. 2024-02-15T23:30:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 Processor -- start 2024-02-15T23:30:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 -- start start 2024-02-15T23:30:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc3af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fabae4d1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eeda55e90 con 0x562eedabe080 2024-02-15T23:30:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fababfec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc3af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fababfec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc3af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39030/0 (socket says 172.21.15.133:39030) 2024-02-15T23:30:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fababfec640 1 -- 172.21.15.133:0/2477524623 learned_addr learned my addr 172.21.15.133:0/2477524623 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fababfec640 1 -- 172.21.15.133:0/2477524623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eeda964c0 con 0x562eedabe080 2024-02-15T23:30:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7fababfec640 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc3af50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x562eedc34f90 tx=0x7fab9c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.851+0000 7faa93fff640 1 -- 172.21.15.133:0/2477524623 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab9c014050 con 0x562eedabe080 2024-02-15T23:30:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562eedc3b490 con 0x562eedabe080 2024-02-15T23:30:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7faa93fff640 1 -- 172.21.15.133:0/2477524623 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c001520 con 0x562eedabe080 2024-02-15T23:30:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7faa93fff640 1 -- 172.21.15.133:0/2477524623 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab9c01bad0 con 0x562eedabe080 2024-02-15T23:30:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562eedc3b940 con 0x562eedabe080 2024-02-15T23:30:50.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7faa93fff640 1 -- 172.21.15.133:0/2477524623 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fab9c022020 con 0x562eedabe080 2024-02-15T23:30:50.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7faa93fff640 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa940342b0 0x7faa94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7faa93fff640 1 -- 172.21.15.133:0/2477524623 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fab9c048e80 con 0x562eedabe080 2024-02-15T23:30:50.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabab7eb640 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa940342b0 0x7faa94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedb4e520 0x562eedc41be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc42120 con 0x562eedb4e520 2024-02-15T23:30:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabac7ed640 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedb4e520 0x562eedc41be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabab7eb640 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa940342b0 0x7faa94036770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab940ae000 tx=0x7fab940a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabac7ed640 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedb4e520 0x562eedc41be0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabac7ed640 1 -- 172.21.15.133:0/2477524623 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faba400a4d0 con 0x562eedb4e520 2024-02-15T23:30:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc3f2e0 con 0x562eedb4e520 2024-02-15T23:30:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabac7ed640 1 -- 172.21.15.133:0/2477524623 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faba400a4d0 con 0x562eedb4e520 2024-02-15T23:30:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc43e20 con 0x562eedb4e520 2024-02-15T23:30:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabac7ed640 1 -- 172.21.15.133:0/2477524623 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7faba400a4d0 con 0x562eedb4e520 2024-02-15T23:30:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc43020 con 0x562eedb4e520 2024-02-15T23:30:50.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabac7ed640 1 -- 172.21.15.133:0/2477524623 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faba400a4d0 con 0x562eedb4e520 2024-02-15T23:30:50.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.855+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc43430 con 0x562eedb4e520 2024-02-15T23:30:50.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabac7ed640 1 -- 172.21.15.133:0/2477524623 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7faba400a4d0 con 0x562eedb4e520 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabae4d1980 1 Processor -- start 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabae4d1980 1 -- start start 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabae4d1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4a940 0x562eedb48de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabae4d1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eed9eef20 con 0x562eedb4a940 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabab7eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4a940 0x562eedb48de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabab7eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4a940 0x562eedb48de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39034/0 (socket says 172.21.15.133:39034) 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabab7eb640 1 -- 172.21.15.133:0/970641159 learned_addr learned my addr 172.21.15.133:0/970641159 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabab7eb640 1 -- 172.21.15.133:0/970641159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eedb49320 con 0x562eedb4a940 2024-02-15T23:30:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabab7eb640 1 --2- 172.21.15.133:0/970641159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4a940 0x562eedb48de0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fab940ac040 tx=0x7fab940180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7faa917fa640 1 -- 172.21.15.133:0/970641159 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab940b3cd0 con 0x562eedb4a940 2024-02-15T23:30:50.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabae4d1980 1 -- 172.21.15.133:0/970641159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562eedb49570 con 0x562eedb4a940 2024-02-15T23:30:50.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7fabae4d1980 1 -- 172.21.15.133:0/970641159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562eedb499a0 con 0x562eedb4a940 2024-02-15T23:30:50.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7faa917fa640 1 -- 172.21.15.133:0/970641159 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940c3070 con 0x562eedb4a940 2024-02-15T23:30:50.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7faa917fa640 1 -- 172.21.15.133:0/970641159 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab940c8430 con 0x562eedb4a940 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7faa917fa640 1 -- 172.21.15.133:0/970641159 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fab940c5030 con 0x562eedb4a940 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7faa917fa640 1 --2- 172.21.15.133:0/970641159 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa840342b0 0x7faa84036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.859+0000 7faa917fa640 1 -- 172.21.15.133:0/970641159 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fab940e69e0 con 0x562eedb4a940 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabac7ed640 1 --2- 172.21.15.133:0/970641159 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa840342b0 0x7faa84036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 Processor -- start 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- start start 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabac7ed640 1 --2- 172.21.15.133:0/970641159 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa840342b0 0x7faa84036770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x562eedc42ac0 tx=0x7faba4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc61a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eed9e2790 con 0x562eedc61660 2024-02-15T23:30:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabab7eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc61a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabab7eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc61a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39046/0 (socket says 172.21.15.133:39046) 2024-02-15T23:30:50.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabab7eb640 1 -- 172.21.15.133:0/795206618 learned_addr learned my addr 172.21.15.133:0/795206618 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:50.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabab7eb640 1 -- 172.21.15.133:0/795206618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eedc62010 con 0x562eedc61660 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabab7eb640 1 --2- 172.21.15.133:0/795206618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc61a40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fab940e4da0 tx=0x7fab940bce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8040d0f23f16f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7faa8affd640 1 -- 172.21.15.133:0/795206618 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab940c73d0 con 0x562eedc61660 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7faa8affd640 1 -- 172.21.15.133:0/795206618 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940c7530 con 0x562eedc61660 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7faa8affd640 1 -- 172.21.15.133:0/795206618 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab940c0190 con 0x562eedc61660 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- 172.21.15.133:0/795206618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 msgr2=0x562eedc61a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 --2- 172.21.15.133:0/795206618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc61a40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fab940e4da0 tx=0x7fab940bce80 comp rx=0 tx=0).stop 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- 172.21.15.133:0/795206618 shutdown_connections 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 --2- 172.21.15.133:0/795206618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc61a40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- 172.21.15.133:0/795206618 >> 172.21.15.133:0/795206618 conn(0x562eedc5d9a0 msgr2=0x562eedc5ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- 172.21.15.133:0/795206618 shutdown_connections 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- 172.21.15.133:0/795206618 wait complete. 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 Processor -- start 2024-02-15T23:30:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- start start 2024-02-15T23:30:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc68510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabae4d1980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eedc68a50 con 0x562eedc61660 2024-02-15T23:30:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabab7eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc68510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabab7eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc68510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39048/0 (socket says 172.21.15.133:39048) 2024-02-15T23:30:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.863+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 learned_addr learned my addr 172.21.15.133:0/2110210902 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eedb499a0 con 0x562eedc61660 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabab7eb640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc68510 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fab940bca40 tx=0x7fab940e4d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7faa897fa640 1 -- 172.21.15.133:0/2110210902 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab940eb070 con 0x562eedc61660 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562eedc68c50 con 0x562eedc61660 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562eedc690e0 con 0x562eedc61660 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7faa897fa640 1 -- 172.21.15.133:0/2110210902 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940adc30 con 0x562eedc61660 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7faa897fa640 1 -- 172.21.15.133:0/2110210902 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab940c79d0 con 0x562eedc61660 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7faa897fa640 1 -- 172.21.15.133:0/2110210902 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fab940c7b30 con 0x562eedc61660 2024-02-15T23:30:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7faa897fa640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa740342b0 0x7faa74036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7faa897fa640 1 -- 172.21.15.133:0/2110210902 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fab940ae180 con 0x562eedc61660 2024-02-15T23:30:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabac7ed640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa740342b0 0x7faa74036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedc73760 0x562eedc75bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76300 con 0x562eedc73760 2024-02-15T23:30:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fababfec640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedc73760 0x562eedc75bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabac7ed640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa740342b0 0x7faa74036770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faba4011010 tx=0x7faba4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fababfec640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedc73760 0x562eedc75bb0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 20 realm 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc766d0 con 0x562eedc73760 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76f20 con 0x562eedc73760 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.867+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc77280 con 0x562eedc73760 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabae4d1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc73760 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabae4d1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabae4d1980 20 searching for the correct realm 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562eedc79520 0x562eedc7b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7bfc0 con 0x562eedc79520 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabab7eb640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562eedc79520 0x562eedc7b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabab7eb640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562eedc79520 0x562eedc7b910 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab940e0070 con 0x562eedc79520 2024-02-15T23:30:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabab7eb640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fab940fa060 0x7fab940d4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7bfc0 con 0x7fab940fa060 2024-02-15T23:30:50.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabac7ed640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fab940fa060 0x7fab940d4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabac7ed640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fab940fa060 0x7fab940d4150 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faba400a4d0 con 0x7fab940fa060 2024-02-15T23:30:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7bfc0 con 0x7fab940fa060 2024-02-15T23:30:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faba400a4d0 con 0x7fab940fa060 2024-02-15T23:30:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7bfc0 con 0x562eedc73760 2024-02-15T23:30:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc73760 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fababfec640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fab9c0243d0 0x7fab9c026920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab9c0243d0 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.871+0000 7fababfec640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fab9c0243d0 0x7fab9c026920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fab9c0243d0 0x7fab9c026920 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x7fab9c0243d0 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab9c0243d0 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x7fab9c0243d0 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab940fa060 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faba400a4d0 con 0x7fab940fa060 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc79520 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc73760 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab9c0243d0 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x7fab9c0243d0 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc73760 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab940fa060 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc79520 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.875+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc79520 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab9c0243d0 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x7fab9c0243d0 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc79520 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc79520 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc73760 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc73760 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab9c0243d0 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x7fab9c0243d0 2024-02-15T23:30:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc79520 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab940fa060 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc73760 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x562eedc73760 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab940fa060 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.879+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc79520 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab9c0243d0 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x7fab9c0243d0 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab940fa060 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc79520 2024-02-15T23:30:50.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab9c0243d0 2024-02-15T23:30:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab9c016070 con 0x7fab9c0243d0 2024-02-15T23:30:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x562eedc73760 2024-02-15T23:30:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc76bc0 con 0x7fab940fa060 2024-02-15T23:30:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc77fb0 con 0x562eedc73760 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc78310 con 0x562eedc73760 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc78310 con 0x562eedc73760 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 20 zone default found 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 4 Realm: () 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.883+0000 7fabae4d1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 zonegroup default 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc77c00 con 0x7fab940fa060 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc78be0 con 0x562eedc79520 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 rados->read ofs=0 len=0 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7dde0 con 0x562eedc79520 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 started sync module instance, tier type = 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7d6c0 con 0x7fab940fa060 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94759557780000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7da70 con 0x7fab940fa060 2024-02-15T23:30:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7eb10 con 0x562eedc73760 2024-02-15T23:30:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.887+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94759557780000] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.891+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.891+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94759557784016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7ea90 con 0x562eedc73760 2024-02-15T23:30:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.891+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7f540 con 0x562eedc79520 2024-02-15T23:30:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.891+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94759557784016] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.891+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.891+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94759557785072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7ea10 con 0x562eedc79520 2024-02-15T23:30:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.891+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc80260 con 0x7fab940fa060 2024-02-15T23:30:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.895+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.895+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94759557791440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc80ab0 con 0x7fab940fa060 2024-02-15T23:30:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.895+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc814b0 con 0x562eedc73760 2024-02-15T23:30:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.895+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94759557785072] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.895+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94759557791440] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.895+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.895+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94759557795760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc80610 con 0x562eedc73760 2024-02-15T23:30:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.895+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc81d00 con 0x7fab9c0243d0 2024-02-15T23:30:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.899+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94759557795760] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.899+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.899+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94759557789984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc80610 con 0x7fab9c0243d0 2024-02-15T23:30:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.899+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc82310 con 0x7fab9c0243d0 2024-02-15T23:30:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.899+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94759557789984] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.899+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.899+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94759557797984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc82310 con 0x7fab9c0243d0 2024-02-15T23:30:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.899+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc82c80 con 0x7fab9c0243d0 2024-02-15T23:30:50.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94759557797984] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94759557799536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc82c80 con 0x7fab9c0243d0 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fabae4d1980 20 add_watcher() i=0 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fabae4d1980 20 add_watcher() i=1 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fabae4d1980 20 add_watcher() i=2 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fabae4d1980 20 add_watcher() i=3 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fabae4d1980 20 add_watcher() i=4 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fabae4d1980 20 add_watcher() i=5 2024-02-15T23:30:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.903+0000 7fabae4d1980 20 add_watcher() i=6 2024-02-15T23:30:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94759557799536] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 20 add_watcher() i=7 2024-02-15T23:30:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc86190 con 0x562eedc73760 2024-02-15T23:30:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94759557802624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc83540 con 0x562eedc73760 2024-02-15T23:30:50.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94759557802624] v33'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7faa61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 5 note: GC not initialized 2024-02-15T23:30:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7faa60fe1640 20 reqs_thread_entry: start 2024-02-15T23:30:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 20 Filter name: none 2024-02-15T23:30:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fa9da7fc640 20 reqs_thread_entry: start 2024-02-15T23:30:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.907+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca8670 con 0x562eedc73760 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca8a30 con 0x7fab940fa060 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca8a30 con 0x562eedc73760 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca8a30 con 0x562eedc79520 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca8d90 con 0x562eedc79520 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca90f0 con 0x562eedc79520 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca90f0 con 0x562eedc73760 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca90f0 con 0x562eedc73760 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca90f0 con 0x562eedc79520 2024-02-15T23:30:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca90f0 con 0x562eedc79520 2024-02-15T23:30:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.911+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca90f0 con 0x7fab9c0243d0 2024-02-15T23:30:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv31 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa970 con 0x562eedc73760 2024-02-15T23:30:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa970 con 0x7fab940fa060 2024-02-15T23:30:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa970 con 0x562eedc79520 2024-02-15T23:30:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa920 con 0x7fab9c0243d0 2024-02-15T23:30:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa920 con 0x7fab9c0243d0 2024-02-15T23:30:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa920 con 0x562eedc79520 2024-02-15T23:30:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.915+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x7fab9c0243d0 2024-02-15T23:30:50.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc73760 2024-02-15T23:30:50.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc79520 2024-02-15T23:30:50.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x7fab9c0243d0 2024-02-15T23:30:50.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x7fab940fa060 2024-02-15T23:30:50.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x7fab9c0243d0 2024-02-15T23:30:50.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc73760 2024-02-15T23:30:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc73760 2024-02-15T23:30:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.919+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc79520 2024-02-15T23:30:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc73760 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc73760 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc79520 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc79520 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x562eedc79520 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa8b0 con 0x7fab9c0243d0 2024-02-15T23:30:50.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7faa61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:50.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.923+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94759557802624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedca6360 con 0x562eedc73760 2024-02-15T23:30:50.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.927+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94759557802624] v33'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.927+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94759557780000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedcaa570 con 0x7fab940fa060 2024-02-15T23:30:50.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.927+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94759557780000] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.927+0000 7fabae4d1980 20 remove_watcher() i=0 2024-02-15T23:30:50.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.927+0000 7fabae4d1980 2 removed watcher, disabling cache 2024-02-15T23:30:50.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.927+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94759557784016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7d220 con 0x562eedc73760 2024-02-15T23:30:50.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94759557784016] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fabae4d1980 20 remove_watcher() i=1 2024-02-15T23:30:50.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94759557785072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7d220 con 0x562eedc79520 2024-02-15T23:30:50.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fabab7eb640 1 -- 172.21.15.133:0/2110210902 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94759557785072] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab94104040 con 0x562eedc79520 2024-02-15T23:30:50.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fabae4d1980 20 remove_watcher() i=2 2024-02-15T23:30:50.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94759557791440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7d220 con 0x7fab940fa060 2024-02-15T23:30:50.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fabac7ed640 1 -- 172.21.15.133:0/2110210902 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94759557791440] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faba4039060 con 0x7fab940fa060 2024-02-15T23:30:50.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fabae4d1980 20 remove_watcher() i=3 2024-02-15T23:30:50.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.931+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94759557795760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7d220 con 0x562eedc73760 2024-02-15T23:30:50.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.935+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94759557795760] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x562eedc73760 2024-02-15T23:30:50.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.935+0000 7fabae4d1980 20 remove_watcher() i=4 2024-02-15T23:30:50.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.935+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94759557789984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7d220 con 0x7fab9c0243d0 2024-02-15T23:30:50.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.939+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94759557789984] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.939+0000 7fabae4d1980 20 remove_watcher() i=5 2024-02-15T23:30:50.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.939+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94759557797984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7f920 con 0x7fab9c0243d0 2024-02-15T23:30:50.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.939+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94759557797984] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.939+0000 7fabae4d1980 20 remove_watcher() i=6 2024-02-15T23:30:50.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.939+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94759557799536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562eedc7f920 con 0x7fab9c0243d0 2024-02-15T23:30:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94759557799536] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab9c059080 con 0x7fab9c0243d0 2024-02-15T23:30:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 20 remove_watcher() i=7 2024-02-15T23:30:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fab9c0243d0 msgr2=0x7fab9c026920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fab9c0243d0 0x7fab9c026920 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedc73760 msgr2=0x562eedc75bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedc73760 0x562eedc75bb0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fab940fa060 msgr2=0x7fab940d4150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fab940fa060 0x7fab940d4150 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562eedc79520 msgr2=0x562eedc7b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562eedc79520 0x562eedc7b910 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa740342b0 msgr2=0x7faa74036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa740342b0 0x7faa74036770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faba4011010 tx=0x7faba4020000 comp rx=0 tx=0).stop 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 msgr2=0x562eedc68510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fababfec640 1 -- 172.21.15.133:0/2110210902 reap_dead start 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc68510 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fab940bca40 tx=0x7fab940e4d00 comp rx=0 tx=0).stop 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 shutdown_connections 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2110210902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedc61660 0x562eedc68510 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 >> 172.21.15.133:0/2110210902 conn(0x562eedc5d9a0 msgr2=0x562eedc5b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 shutdown_connections 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2110210902 wait complete. 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/970641159 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa840342b0 msgr2=0x7faa84036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/970641159 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa840342b0 0x7faa84036770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x562eedc42ac0 tx=0x7faba4005850 comp rx=0 tx=0).stop 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/970641159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4a940 msgr2=0x562eedb48de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/970641159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4a940 0x562eedb48de0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fab940ac040 tx=0x7fab940180e0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/970641159 shutdown_connections 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/970641159 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa840342b0 0x7faa84036770 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/970641159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedb4a940 0x562eedb48de0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/970641159 >> 172.21.15.133:0/970641159 conn(0x562eedc47270 msgr2=0x562eedc47d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/970641159 shutdown_connections 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/970641159 wait complete. 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedb4e520 msgr2=0x562eedc41be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedb4e520 0x562eedc41be0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa940342b0 msgr2=0x7faa94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa940342b0 0x7faa94036770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab940ae000 tx=0x7fab940a6000 comp rx=0 tx=0).stop 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 msgr2=0x562eedc3af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc3af50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x562eedc34f90 tx=0x7fab9c000bd0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 shutdown_connections 2024-02-15T23:30:50.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562eedb4e520 0x562eedc41be0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7faa940342b0 0x7faa94036770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 --2- 172.21.15.133:0/2477524623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eedabe080 0x562eedc3af50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:50.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 >> 172.21.15.133:0/2477524623 conn(0x562eedb448e0 msgr2=0x562eedc2e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:50.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 shutdown_connections 2024-02-15T23:30:50.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:50.943+0000 7fabae4d1980 1 -- 172.21.15.133:0/2477524623 wait complete. 2024-02-15T23:30:50.964 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-02-15T23:30:50.965 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-02-15T23:30:50.965 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-15T23:30:50.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-15T23:30:50.966 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-15T23:30:51.043 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:51.043 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22df98c980 1 Processor -- start 2024-02-15T23:30:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22df98c980 1 -- start start 2024-02-15T23:30:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22df98c980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56395ecda540 0x56395ecdc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22df98c980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56395ec234b0 con 0x56395ecd6030 2024-02-15T23:30:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22df98c980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x56395ebea180 con 0x56395ecda540 2024-02-15T23:30:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22dcca6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56395ecda540 0x56395ecdc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22dd4a7640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x56395ecd6030 0x56395ecd6410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:35104/0 (socket says 172.21.15.133:35104) 2024-02-15T23:30:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22dd4a7640 1 -- 172.21.15.133:0/2857559314 learned_addr learned my addr 172.21.15.133:0/2857559314 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:51.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22dcca6640 1 -- 172.21.15.133:0/2857559314 >> v1:172.21.15.131:6789/0 conn(0x56395ecd6030 legacy=0x56395ecd6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.039+0000 7f22dcca6640 1 -- 172.21.15.133:0/2857559314 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56395ecdf080 con 0x56395ecda540 2024-02-15T23:30:51.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22dcca6640 1 --2- 172.21.15.133:0/2857559314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecda540 0x56395ecdc930 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f22d400a480 tx=0x7f22d401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6216cef3067fd81a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22cffff640 1 -- 172.21.15.133:0/2857559314 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d40ab540 con 0x56395ecda540 2024-02-15T23:30:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22cffff640 1 -- 172.21.15.133:0/2857559314 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40ab6a0 con 0x56395ecda540 2024-02-15T23:30:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22cffff640 1 -- 172.21.15.133:0/2857559314 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d40ab960 con 0x56395ecda540 2024-02-15T23:30:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22df98c980 1 -- 172.21.15.133:0/2857559314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecda540 msgr2=0x56395ecdc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22df98c980 1 --2- 172.21.15.133:0/2857559314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecda540 0x56395ecdc930 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f22d400a480 tx=0x7f22d401b280 comp rx=0 tx=0).stop 2024-02-15T23:30:51.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22df98c980 1 -- 172.21.15.133:0/2857559314 shutdown_connections 2024-02-15T23:30:51.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22df98c980 1 --2- 172.21.15.133:0/2857559314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecda540 0x56395ecdc930 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22df98c980 1 -- 172.21.15.133:0/2857559314 >> 172.21.15.133:0/2857559314 conn(0x56395ecd1900 msgr2=0x56395ecd3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22df98c980 1 -- 172.21.15.133:0/2857559314 shutdown_connections 2024-02-15T23:30:51.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.043+0000 7f22df98c980 1 -- 172.21.15.133:0/2857559314 wait complete. 2024-02-15T23:30:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22df98c980 1 Processor -- start 2024-02-15T23:30:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22df98c980 1 -- start start 2024-02-15T23:30:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22df98c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22df98c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395ebe76b0 con 0x56395ecd6030 2024-02-15T23:30:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22dd4a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22dd4a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39058/0 (socket says 172.21.15.133:39058) 2024-02-15T23:30:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22dd4a7640 1 -- 172.21.15.133:0/1267734548 learned_addr learned my addr 172.21.15.133:0/1267734548 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22dd4a7640 1 -- 172.21.15.133:0/1267734548 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4005d30 con 0x56395ecd6030 2024-02-15T23:30:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f22dd4a7640 1 --2- 172.21.15.133:0/1267734548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc1100 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f22d8006fb0 tx=0x7f22d8001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c99350a0aac13 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f21cb606640 1 -- 172.21.15.133:0/1267734548 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d8004530 con 0x56395ecd6030 2024-02-15T23:30:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f21cb606640 1 -- 172.21.15.133:0/1267734548 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d8004690 con 0x56395ecd6030 2024-02-15T23:30:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.059+0000 7f21cb606640 1 -- 172.21.15.133:0/1267734548 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d80049b0 con 0x56395ecd6030 2024-02-15T23:30:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- 172.21.15.133:0/1267734548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 msgr2=0x56395edc1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 --2- 172.21.15.133:0/1267734548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc1100 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f22d8006fb0 tx=0x7f22d8001940 comp rx=0 tx=0).stop 2024-02-15T23:30:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- 172.21.15.133:0/1267734548 shutdown_connections 2024-02-15T23:30:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 --2- 172.21.15.133:0/1267734548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc1100 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- 172.21.15.133:0/1267734548 >> 172.21.15.133:0/1267734548 conn(0x56395ecd1900 msgr2=0x56395edbcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- 172.21.15.133:0/1267734548 shutdown_connections 2024-02-15T23:30:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- 172.21.15.133:0/1267734548 wait complete. 2024-02-15T23:30:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 Processor -- start 2024-02-15T23:30:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- start start 2024-02-15T23:30:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395ebe2e90 con 0x56395ecd6030 2024-02-15T23:30:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22dd4a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22dd4a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39064/0 (socket says 172.21.15.133:39064) 2024-02-15T23:30:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22dd4a7640 1 -- 172.21.15.133:0/189202274 learned_addr learned my addr 172.21.15.133:0/189202274 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22dd4a7640 1 -- 172.21.15.133:0/189202274 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56395ec234b0 con 0x56395ecd6030 2024-02-15T23:30:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22dd4a7640 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc7f70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x56395edc1f90 tx=0x7f22d8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f21c9e03640 1 -- 172.21.15.133:0/189202274 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d8013760 con 0x56395ecd6030 2024-02-15T23:30:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56395edc84b0 con 0x56395ecd6030 2024-02-15T23:30:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56395edc8900 con 0x56395ecd6030 2024-02-15T23:30:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f21c9e03640 1 -- 172.21.15.133:0/189202274 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d80138c0 con 0x56395ecd6030 2024-02-15T23:30:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.063+0000 7f21c9e03640 1 -- 172.21.15.133:0/189202274 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d8013b60 con 0x56395ecd6030 2024-02-15T23:30:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f21c9e03640 1 -- 172.21.15.133:0/189202274 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f22d8013cc0 con 0x56395ecd6030 2024-02-15T23:30:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f21c9e03640 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21c40342b0 0x7f21c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f21c9e03640 1 -- 172.21.15.133:0/189202274 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f22d80495e0 con 0x56395ecd6030 2024-02-15T23:30:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22dcca6640 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21c40342b0 0x7f21c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395ecda540 0x56395edcebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395edcf120 con 0x56395ecda540 2024-02-15T23:30:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22ddca8640 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395ecda540 0x56395edcebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22dcca6640 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21c40342b0 0x7f21c4036770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f22d40ad000 tx=0x7f22d40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22ddca8640 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395ecda540 0x56395edcebe0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22ddca8640 1 -- 172.21.15.133:0/189202274 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f22d00083f0 con 0x56395ecda540 2024-02-15T23:30:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395edcc2c0 con 0x56395ecda540 2024-02-15T23:30:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22ddca8640 1 -- 172.21.15.133:0/189202274 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f22d00083f0 con 0x56395ecda540 2024-02-15T23:30:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395edd0b00 con 0x56395ecda540 2024-02-15T23:30:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22ddca8640 1 -- 172.21.15.133:0/189202274 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f22d00083f0 con 0x56395ecda540 2024-02-15T23:30:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395edcf960 con 0x56395ecda540 2024-02-15T23:30:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22ddca8640 1 -- 172.21.15.133:0/189202274 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f22d00083f0 con 0x56395ecda540 2024-02-15T23:30:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395edcfd70 con 0x56395ecda540 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22ddca8640 1 -- 172.21.15.133:0/189202274 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f22d00121d0 con 0x56395ecda540 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 Processor -- start 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 -- start start 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395eddf440 0x56395eddf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.067+0000 7f22df98c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395eb7bf20 con 0x56395eddf440 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22dcca6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395eddf440 0x56395eddf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22dcca6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395eddf440 0x56395eddf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39074/0 (socket says 172.21.15.133:39074) 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22dcca6640 1 -- 172.21.15.133:0/1443476290 learned_addr learned my addr 172.21.15.133:0/1443476290 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22dcca6640 1 -- 172.21.15.133:0/1443476290 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56395eddfda0 con 0x56395eddf440 2024-02-15T23:30:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22dcca6640 1 --2- 172.21.15.133:0/1443476290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395eddf440 0x56395eddf860 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f22d4096e80 tx=0x7f22d4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f21c2ffd640 1 -- 172.21.15.133:0/1443476290 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d40aa6e0 con 0x56395eddf440 2024-02-15T23:30:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22df98c980 1 -- 172.21.15.133:0/1443476290 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56395eddff90 con 0x56395eddf440 2024-02-15T23:30:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f21c2ffd640 1 -- 172.21.15.133:0/1443476290 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40aa840 con 0x56395eddf440 2024-02-15T23:30:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f21c2ffd640 1 -- 172.21.15.133:0/1443476290 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d40aaae0 con 0x56395eddf440 2024-02-15T23:30:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22df98c980 1 -- 172.21.15.133:0/1443476290 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56395ede0a80 con 0x56395eddf440 2024-02-15T23:30:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f21c2ffd640 1 -- 172.21.15.133:0/1443476290 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f22d40aacd0 con 0x56395eddf440 2024-02-15T23:30:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f21c2ffd640 1 --2- 172.21.15.133:0/1443476290 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21b40342b0 0x7f21b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f21c2ffd640 1 -- 172.21.15.133:0/1443476290 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f22d40e6580 con 0x56395eddf440 2024-02-15T23:30:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22ddca8640 1 --2- 172.21.15.133:0/1443476290 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21b40342b0 0x7f21b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22df98c980 1 Processor -- start 2024-02-15T23:30:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22df98c980 1 -- start start 2024-02-15T23:30:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22ddca8640 1 --2- 172.21.15.133:0/1443476290 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21b40342b0 0x7f21b4036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x56395edd0510 tx=0x7f22d0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22df98c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edec880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22df98c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395eb6f790 con 0x56395edec460 2024-02-15T23:30:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22dcca6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22dcca6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edec880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39076/0 (socket says 172.21.15.133:39076) 2024-02-15T23:30:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.071+0000 7f22dcca6640 1 -- 172.21.15.133:0/1401682524 learned_addr learned my addr 172.21.15.133:0/1401682524 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22dcca6640 1 -- 172.21.15.133:0/1401682524 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56395edece50 con 0x56395edec460 2024-02-15T23:30:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22dcca6640 1 --2- 172.21.15.133:0/1401682524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edec880 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f22d40e4840 tx=0x7f22d40bdcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a3b1d1fb53a9c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f21c0ff9640 1 -- 172.21.15.133:0/1401682524 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d40bd370 con 0x56395edec460 2024-02-15T23:30:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f21c0ff9640 1 -- 172.21.15.133:0/1401682524 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40bd4d0 con 0x56395edec460 2024-02-15T23:30:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f21c0ff9640 1 -- 172.21.15.133:0/1401682524 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d40c0db0 con 0x56395edec460 2024-02-15T23:30:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- 172.21.15.133:0/1401682524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 msgr2=0x56395edec880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 --2- 172.21.15.133:0/1401682524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edec880 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f22d40e4840 tx=0x7f22d40bdcb0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- 172.21.15.133:0/1401682524 shutdown_connections 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 --2- 172.21.15.133:0/1401682524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edec880 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- 172.21.15.133:0/1401682524 >> 172.21.15.133:0/1401682524 conn(0x56395ede87f0 msgr2=0x56395ede6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- 172.21.15.133:0/1401682524 shutdown_connections 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- 172.21.15.133:0/1401682524 wait complete. 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 Processor -- start 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- start start 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edf3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395edf38d0 con 0x56395edec460 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22dcca6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edf3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22dcca6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edf3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39090/0 (socket says 172.21.15.133:39090) 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 learned_addr learned my addr 172.21.15.133:0/3959515655 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56395ede0a80 con 0x56395edec460 2024-02-15T23:30:51.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22dcca6640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edf3390 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f22d40bd680 tx=0x7f22d40ab410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f21b2ffd640 1 -- 172.21.15.133:0/3959515655 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d40df040 con 0x56395edec460 2024-02-15T23:30:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56395edf3ad0 con 0x56395edec460 2024-02-15T23:30:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f21b2ffd640 1 -- 172.21.15.133:0/3959515655 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40bdde0 con 0x56395edec460 2024-02-15T23:30:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f21b2ffd640 1 -- 172.21.15.133:0/3959515655 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d40bd370 con 0x56395edec460 2024-02-15T23:30:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.075+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56395edf3f00 con 0x56395edec460 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f21b2ffd640 1 -- 172.21.15.133:0/3959515655 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f22d40b4920 con 0x56395edec460 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f21b2ffd640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21a8034260 0x7f21a8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f21b2ffd640 1 -- 172.21.15.133:0/3959515655 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f22d40f0d20 con 0x56395edec460 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22ddca8640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21a8034260 0x7f21a8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395edfe920 0x56395ee00de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee01530 con 0x56395edfe920 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22dd4a7640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395edfe920 0x56395ee00de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22ddca8640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21a8034260 0x7f21a8036720 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f22d0008fd0 tx=0x7f22d001d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22dd4a7640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395edfe920 0x56395ee00de0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 realm 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee01900 con 0x56395edfe920 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee02150 con 0x56395edfe920 2024-02-15T23:30:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee024b0 con 0x56395edfe920 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee01df0 con 0x56395edfe920 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 20 searching for the correct realm 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56395ee04700 0x56395ee06b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.079+0000 7f22dcca6640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56395ee04700 0x56395ee06b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dcca6640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56395ee04700 0x56395ee06b30 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dcca6640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f22d40ef020 0x7f22d40a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d40ef020 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22ddca8640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f22d40ef020 0x7f22d40a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22ddca8640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f22d40ef020 0x7f22d40a9310 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d002d040 con 0x7f22d40ef020 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d40ef020 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d002d040 con 0x7f22d40ef020 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395edfe920 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395edfe920 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dd4a7640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f22d80113d0 0x7f22d801d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d80113d0 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dd4a7640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f22d80113d0 0x7f22d801d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.083+0000 7f22dd4a7640 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f22d80113d0 0x7f22d801d710 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x7f22d80113d0 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d80113d0 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x7f22d80113d0 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d40ef020 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d002d040 con 0x7f22d40ef020 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395edfe920 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d80113d0 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x7f22d80113d0 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395edfe920 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d40ef020 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f22d002d040 con 0x7f22d40ef020 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.087+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d80113d0 2024-02-15T23:30:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x7f22d80113d0 2024-02-15T23:30:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395edfe920 2024-02-15T23:30:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395edfe920 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d80113d0 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x7f22d80113d0 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d40ef020 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d002d040 con 0x7f22d40ef020 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395edfe920 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x56395edfe920 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d40ef020 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d002d040 con 0x7f22d40ef020 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.091+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d80113d0 2024-02-15T23:30:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x7f22d80113d0 2024-02-15T23:30:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d40ef020 2024-02-15T23:30:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395ee04700 2024-02-15T23:30:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d80113d0 2024-02-15T23:30:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d8024020 con 0x7f22d80113d0 2024-02-15T23:30:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x56395edfe920 2024-02-15T23:30:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07200 con 0x7f22d40ef020 2024-02-15T23:30:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee03320 con 0x56395edfe920 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee02fa0 con 0x56395edfe920 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee03c60 con 0x56395edfe920 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 zone default found 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 4 Realm: () 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 zonegroup default 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.095+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee07640 con 0x7f22d40ef020 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee094c0 con 0x56395ee04700 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee09820 con 0x56395ee04700 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 20 started sync module instance, tier type = 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee08a90 con 0x7f22d40ef020 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804404899392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee08a90 con 0x7f22d40ef020 2024-02-15T23:30:51.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0a1f0 con 0x56395edfe920 2024-02-15T23:30:51.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.099+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804404899392] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.103+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.103+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804404903152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0a1b0 con 0x56395edfe920 2024-02-15T23:30:51.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.103+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0ab90 con 0x56395ee04700 2024-02-15T23:30:51.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.103+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804404903152] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.103+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.103+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804404897264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0af70 con 0x56395ee04700 2024-02-15T23:30:51.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.103+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0b8e0 con 0x7f22d40ef020 2024-02-15T23:30:51.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.107+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.107+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804404909392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0c130 con 0x7f22d40ef020 2024-02-15T23:30:51.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.107+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0cbb0 con 0x56395edfe920 2024-02-15T23:30:51.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.107+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804404897264] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.107+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804404909392] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.107+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.107+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804404913840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0bc90 con 0x56395edfe920 2024-02-15T23:30:51.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.107+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0d430 con 0x7f22d80113d0 2024-02-15T23:30:51.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.111+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804404913840] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.111+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.111+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804404905648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0bc90 con 0x7f22d80113d0 2024-02-15T23:30:51.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.111+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0da40 con 0x7f22d80113d0 2024-02-15T23:30:51.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.111+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804404905648] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.111+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.111+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804404916112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0da40 con 0x7f22d80113d0 2024-02-15T23:30:51.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.111+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0e3b0 con 0x7f22d80113d0 2024-02-15T23:30:51.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804404916112] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804404918144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0e3b0 con 0x7f22d80113d0 2024-02-15T23:30:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 20 add_watcher() i=0 2024-02-15T23:30:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 20 add_watcher() i=1 2024-02-15T23:30:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 20 add_watcher() i=2 2024-02-15T23:30:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 20 add_watcher() i=3 2024-02-15T23:30:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 20 add_watcher() i=4 2024-02-15T23:30:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 20 add_watcher() i=5 2024-02-15T23:30:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 20 add_watcher() i=6 2024-02-15T23:30:51.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804404918144] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 20 add_watcher() i=7 2024-02-15T23:30:51.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:51.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee117d0 con 0x56395edfe920 2024-02-15T23:30:51.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.115+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804404920544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0ed10 con 0x56395edfe920 2024-02-15T23:30:51.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804404920544] v33'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f21937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:51.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:51.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 5 note: GC not initialized 2024-02-15T23:30:51.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f21927e4640 20 reqs_thread_entry: start 2024-02-15T23:30:51.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 20 Filter name: none 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f2103fff640 20 reqs_thread_entry: start 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee33d60 con 0x56395edfe920 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee34120 con 0x7f22d40ef020 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee34120 con 0x56395edfe920 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee34120 con 0x56395ee04700 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee34480 con 0x56395ee04700 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.119+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee347e0 con 0x56395ee04700 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee347e0 con 0x56395edfe920 2024-02-15T23:30:51.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee347e0 con 0x56395edfe920 2024-02-15T23:30:51.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee347e0 con 0x56395ee04700 2024-02-15T23:30:51.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee347e0 con 0x56395ee04700 2024-02-15T23:30:51.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee347e0 con 0x7f22d80113d0 2024-02-15T23:30:51.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv31 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee360b0 con 0x56395edfe920 2024-02-15T23:30:51.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee360b0 con 0x7f22d40ef020 2024-02-15T23:30:51.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee360b0 con 0x56395ee04700 2024-02-15T23:30:51.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee360b0 con 0x7f22d80113d0 2024-02-15T23:30:51.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.123+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee360b0 con 0x7f22d80113d0 2024-02-15T23:30:51.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee360b0 con 0x56395ee04700 2024-02-15T23:30:51.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36060 con 0x7f22d80113d0 2024-02-15T23:30:51.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36060 con 0x56395edfe920 2024-02-15T23:30:51.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36060 con 0x56395ee04700 2024-02-15T23:30:51.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36060 con 0x7f22d80113d0 2024-02-15T23:30:51.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36060 con 0x7f22d40ef020 2024-02-15T23:30:51.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.127+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x7f22d80113d0 2024-02-15T23:30:51.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x56395edfe920 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x56395edfe920 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x56395ee04700 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x56395edfe920 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x56395edfe920 2024-02-15T23:30:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x56395ee04700 2024-02-15T23:30:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x56395ee04700 2024-02-15T23:30:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x56395ee04700 2024-02-15T23:30:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee36040 con 0x7f22d80113d0 2024-02-15T23:30:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.131+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.135+0000 7f21937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.135+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804404920544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee323c0 con 0x56395edfe920 2024-02-15T23:30:51.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.135+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94804404920544] v33'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.135+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804404899392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0e0b0 con 0x7f22d40ef020 2024-02-15T23:30:51.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.135+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94804404899392] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.135+0000 7f22df98c980 20 remove_watcher() i=0 2024-02-15T23:30:51.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.135+0000 7f22df98c980 2 removed watcher, disabling cache 2024-02-15T23:30:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.135+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804404903152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee08e40 con 0x56395edfe920 2024-02-15T23:30:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.139+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94804404903152] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.139+0000 7f22df98c980 20 remove_watcher() i=1 2024-02-15T23:30:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.139+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804404897264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee08e40 con 0x56395ee04700 2024-02-15T23:30:51.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.139+0000 7f22dcca6640 1 -- 172.21.15.133:0/3959515655 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94804404897264] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d40ec070 con 0x56395ee04700 2024-02-15T23:30:51.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.139+0000 7f22df98c980 20 remove_watcher() i=2 2024-02-15T23:30:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.139+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804404909392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee085f0 con 0x7f22d40ef020 2024-02-15T23:30:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.143+0000 7f22ddca8640 1 -- 172.21.15.133:0/3959515655 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94804404909392] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d003d040 con 0x7f22d40ef020 2024-02-15T23:30:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.143+0000 7f22df98c980 20 remove_watcher() i=3 2024-02-15T23:30:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.143+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804404913840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee08e40 con 0x56395edfe920 2024-02-15T23:30:51.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.143+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94804404913840] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x56395edfe920 2024-02-15T23:30:51.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.143+0000 7f22df98c980 20 remove_watcher() i=4 2024-02-15T23:30:51.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.143+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804404905648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee085f0 con 0x7f22d80113d0 2024-02-15T23:30:51.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.147+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94804404905648] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.147+0000 7f22df98c980 20 remove_watcher() i=5 2024-02-15T23:30:51.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.147+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804404916112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee0c6b0 con 0x7f22d80113d0 2024-02-15T23:30:51.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.147+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94804404916112] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.147+0000 7f22df98c980 20 remove_watcher() i=6 2024-02-15T23:30:51.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.147+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804404918144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56395ee08e40 con 0x7f22d80113d0 2024-02-15T23:30:51.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94804404918144] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f22d805d080 con 0x7f22d80113d0 2024-02-15T23:30:51.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 20 remove_watcher() i=7 2024-02-15T23:30:51.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f22d80113d0 msgr2=0x7f22d801d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f22d80113d0 0x7f22d801d710 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395edfe920 msgr2=0x56395ee00de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395edfe920 0x56395ee00de0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f22d40ef020 msgr2=0x7f22d40a9310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f22d40ef020 0x7f22d40a9310 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56395ee04700 msgr2=0x56395ee06b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56395ee04700 0x56395ee06b30 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21a8034260 msgr2=0x7f21a8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21a8034260 0x7f21a8036720 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f22d0008fd0 tx=0x7f22d001d070 comp rx=0 tx=0).stop 2024-02-15T23:30:51.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 msgr2=0x56395edf3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/3959515655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395edec460 0x56395edf3390 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f22d40bd680 tx=0x7f22d40ab410 comp rx=0 tx=0).stop 2024-02-15T23:30:51.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 reap_dead start 2024-02-15T23:30:51.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22dd4a7640 1 -- 172.21.15.133:0/3959515655 reap_dead start 2024-02-15T23:30:51.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 shutdown_connections 2024-02-15T23:30:51.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 >> 172.21.15.133:0/3959515655 conn(0x56395ede87f0 msgr2=0x56395ede5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 shutdown_connections 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/3959515655 wait complete. 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/1443476290 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21b40342b0 msgr2=0x7f21b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/1443476290 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21b40342b0 0x7f21b4036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x56395edd0510 tx=0x7f22d0003070 comp rx=0 tx=0).stop 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/1443476290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395eddf440 msgr2=0x56395eddf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/1443476290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395eddf440 0x56395eddf860 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f22d4096e80 tx=0x7f22d4018020 comp rx=0 tx=0).stop 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/1443476290 shutdown_connections 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/1443476290 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21b40342b0 0x7f21b4036770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/1443476290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395eddf440 0x56395eddf860 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/1443476290 >> 172.21.15.133:0/1443476290 conn(0x56395edd4250 msgr2=0x56395edd4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/1443476290 shutdown_connections 2024-02-15T23:30:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/1443476290 wait complete. 2024-02-15T23:30:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395ecda540 msgr2=0x56395edcebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395ecda540 0x56395edcebe0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21c40342b0 msgr2=0x7f21c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21c40342b0 0x7f21c4036770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f22d40ad000 tx=0x7f22d40a5040 comp rx=0 tx=0).stop 2024-02-15T23:30:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 msgr2=0x56395edc7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc7f70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x56395edc1f90 tx=0x7f22d8000f50 comp rx=0 tx=0).stop 2024-02-15T23:30:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 shutdown_connections 2024-02-15T23:30:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56395ecda540 0x56395edcebe0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f21c40342b0 0x7f21c4036770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 --2- 172.21.15.133:0/189202274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56395ecd6030 0x56395edc7f70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 >> 172.21.15.133:0/189202274 conn(0x56395ecd1900 msgr2=0x56395edbb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 shutdown_connections 2024-02-15T23:30:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.151+0000 7f22df98c980 1 -- 172.21.15.133:0/189202274 wait complete. 2024-02-15T23:30:51.170 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-02-15T23:30:51.170 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-02-15T23:30:51.171 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-15T23:30:51.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-15T23:30:51.171 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-15T23:30:51.245 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:51.245 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f8358cb5980 1 Processor -- start 2024-02-15T23:30:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f8358cb5980 1 -- start start 2024-02-15T23:30:51.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f8358cb5980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5572fe9f7040 0x5572fe9f7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f8358cb5980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5572fe9444c0 con 0x5572fe9f7960 2024-02-15T23:30:51.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f8358cb5980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5572fe90b180 con 0x5572fe9f7040 2024-02-15T23:30:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f83567d0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5572fe9f7040 0x5572fe9f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f83567d0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5572fe9f7040 0x5572fe9f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39104/0 (socket says 172.21.15.133:39104) 2024-02-15T23:30:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f8355fcf640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5572fe9f7960 0x5572fe9f8320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:35114/0 (socket says 172.21.15.133:35114) 2024-02-15T23:30:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f83567d0640 1 -- 172.21.15.133:0/2695665762 learned_addr learned my addr 172.21.15.133:0/2695665762 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f83567d0640 1 -- 172.21.15.133:0/2695665762 >> v1:172.21.15.131:6789/0 conn(0x5572fe9f7960 legacy=0x5572fe9f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.239+0000 7f83567d0640 1 -- 172.21.15.133:0/2695665762 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572fe9f8b50 con 0x5572fe9f7040 2024-02-15T23:30:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f83567d0640 1 --2- 172.21.15.133:0/2695665762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572fe9f7420 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f835000a4e0 tx=0x7f835001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0ec6737fd33ad7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f83557ce640 1 -- 172.21.15.133:0/2695665762 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83500aa540 con 0x5572fe9f7040 2024-02-15T23:30:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f83557ce640 1 -- 172.21.15.133:0/2695665762 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500a6070 con 0x5572fe9f7040 2024-02-15T23:30:51.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f83557ce640 1 -- 172.21.15.133:0/2695665762 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83500aa850 con 0x5572fe9f7040 2024-02-15T23:30:51.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f8358cb5980 1 -- 172.21.15.133:0/2695665762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 msgr2=0x5572fe9f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f8358cb5980 1 --2- 172.21.15.133:0/2695665762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572fe9f7420 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f835000a4e0 tx=0x7f835001b090 comp rx=0 tx=0).stop 2024-02-15T23:30:51.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f8358cb5980 1 -- 172.21.15.133:0/2695665762 shutdown_connections 2024-02-15T23:30:51.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f8358cb5980 1 --2- 172.21.15.133:0/2695665762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572fe9f7420 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f8358cb5980 1 -- 172.21.15.133:0/2695665762 >> 172.21.15.133:0/2695665762 conn(0x5572fe9f2910 msgr2=0x5572fe9f4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f8358cb5980 1 -- 172.21.15.133:0/2695665762 shutdown_connections 2024-02-15T23:30:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.243+0000 7f8358cb5980 1 -- 172.21.15.133:0/2695665762 wait complete. 2024-02-15T23:30:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.259+0000 7f8358cb5980 1 Processor -- start 2024-02-15T23:30:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.259+0000 7f8358cb5980 1 -- start start 2024-02-15T23:30:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.259+0000 7f8358cb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feade480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.259+0000 7f8358cb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fe9086b0 con 0x5572fe9f7040 2024-02-15T23:30:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.259+0000 7f83567d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feade480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.259+0000 7f83567d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feade480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39108/0 (socket says 172.21.15.133:39108) 2024-02-15T23:30:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.259+0000 7f83567d0640 1 -- 172.21.15.133:0/246786925 learned_addr learned my addr 172.21.15.133:0/246786925 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f83567d0640 1 -- 172.21.15.133:0/246786925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835000a1c0 con 0x5572fe9f7040 2024-02-15T23:30:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f83567d0640 1 --2- 172.21.15.133:0/246786925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feade480 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8350017ca0 tx=0x7f83500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafa78ad982b6dd1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8244608640 1 -- 172.21.15.133:0/246786925 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83500aa780 con 0x5572fe9f7040 2024-02-15T23:30:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8244608640 1 -- 172.21.15.133:0/246786925 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500aa8e0 con 0x5572fe9f7040 2024-02-15T23:30:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8244608640 1 -- 172.21.15.133:0/246786925 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83500aab80 con 0x5572fe9f7040 2024-02-15T23:30:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- 172.21.15.133:0/246786925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 msgr2=0x5572feade480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 --2- 172.21.15.133:0/246786925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feade480 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8350017ca0 tx=0x7f83500033b0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- 172.21.15.133:0/246786925 shutdown_connections 2024-02-15T23:30:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 --2- 172.21.15.133:0/246786925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feade480 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- 172.21.15.133:0/246786925 >> 172.21.15.133:0/246786925 conn(0x5572fe9f2910 msgr2=0x5572fe96c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- 172.21.15.133:0/246786925 shutdown_connections 2024-02-15T23:30:51.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- 172.21.15.133:0/246786925 wait complete. 2024-02-15T23:30:51.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 Processor -- start 2024-02-15T23:30:51.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- start start 2024-02-15T23:30:51.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feaeb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fe903e90 con 0x5572fe9f7040 2024-02-15T23:30:51.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f83567d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feaeb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f83567d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feaeb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39116/0 (socket says 172.21.15.133:39116) 2024-02-15T23:30:51.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f83567d0640 1 -- 172.21.15.133:0/3053922072 learned_addr learned my addr 172.21.15.133:0/3053922072 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f83567d0640 1 -- 172.21.15.133:0/3053922072 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572fe9f8b50 con 0x5572fe9f7040 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f83567d0640 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feaeb540 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f835001aec0 tx=0x7f8350017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8242e05640 1 -- 172.21.15.133:0/3053922072 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83500c4070 con 0x5572fe9f7040 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572feaeba80 con 0x5572fe9f7040 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8242e05640 1 -- 172.21.15.133:0/3053922072 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500b5650 con 0x5572fe9f7040 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572feaebeb0 con 0x5572fe9f7040 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.263+0000 7f8242e05640 1 -- 172.21.15.133:0/3053922072 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83500b58f0 con 0x5572fe9f7040 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8242e05640 1 -- 172.21.15.133:0/3053922072 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f83500a8070 con 0x5572fe9f7040 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8242e05640 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f823c034300 0x7f823c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8242e05640 1 -- 172.21.15.133:0/3053922072 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f83500e3820 con 0x5572fe9f7040 2024-02-15T23:30:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8355fcf640 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f823c034300 0x7f823c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8358cb5980 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572fe9f7960 0x5572feaf21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feaf2710 con 0x5572fe9f7960 2024-02-15T23:30:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8356fd1640 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572fe9f7960 0x5572feaf21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8355fcf640 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f823c034300 0x7f823c0367c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8340001e50 tx=0x7f83400013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8356fd1640 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572fe9f7960 0x5572feaf21d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8356fd1640 1 -- 172.21.15.133:0/3053922072 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f83480083f0 con 0x5572fe9f7960 2024-02-15T23:30:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feaf2a70 con 0x5572fe9f7960 2024-02-15T23:30:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8356fd1640 1 -- 172.21.15.133:0/3053922072 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f83480083f0 con 0x5572fe9f7960 2024-02-15T23:30:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feaf4300 con 0x5572fe9f7960 2024-02-15T23:30:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8356fd1640 1 -- 172.21.15.133:0/3053922072 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f83480083f0 con 0x5572fe9f7960 2024-02-15T23:30:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feaf3440 con 0x5572fe9f7960 2024-02-15T23:30:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8356fd1640 1 -- 172.21.15.133:0/3053922072 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f83480083f0 con 0x5572fe9f7960 2024-02-15T23:30:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feaf3850 con 0x5572fe9f7960 2024-02-15T23:30:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.267+0000 7f8356fd1640 1 -- 172.21.15.133:0/3053922072 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8348012040 con 0x5572fe9f7960 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8358cb5980 1 Processor -- start 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8358cb5980 1 -- start start 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8358cb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb029b0 0x5572feb02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8358cb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fe89cf20 con 0x5572feb029b0 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8355fcf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb029b0 0x5572feb02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8355fcf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb029b0 0x5572feb02dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39128/0 (socket says 172.21.15.133:39128) 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8355fcf640 1 -- 172.21.15.133:0/2372582020 learned_addr learned my addr 172.21.15.133:0/2372582020 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8355fcf640 1 -- 172.21.15.133:0/2372582020 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572feb03310 con 0x5572feb029b0 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8355fcf640 1 --2- 172.21.15.133:0/2372582020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb029b0 0x5572feb02dd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f834000e640 tx=0x7f834000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f823bfff640 1 -- 172.21.15.133:0/2372582020 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8340007040 con 0x5572feb029b0 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8358cb5980 1 -- 172.21.15.133:0/2372582020 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572feb03560 con 0x5572feb029b0 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f823bfff640 1 -- 172.21.15.133:0/2372582020 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000d660 con 0x5572feb029b0 2024-02-15T23:30:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f823bfff640 1 -- 172.21.15.133:0/2372582020 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f834000d920 con 0x5572feb029b0 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8358cb5980 1 -- 172.21.15.133:0/2372582020 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572feb040b0 con 0x5572feb029b0 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f823bfff640 1 -- 172.21.15.133:0/2372582020 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f834001a070 con 0x5572feb029b0 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f823bfff640 1 --2- 172.21.15.133:0/2372582020 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82300342b0 0x7f8230036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f823bfff640 1 -- 172.21.15.133:0/2372582020 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f8340017050 con 0x5572feb029b0 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8356fd1640 1 --2- 172.21.15.133:0/2372582020 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82300342b0 0x7f8230036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.271+0000 7f8358cb5980 1 Processor -- start 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- start start 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8356fd1640 1 --2- 172.21.15.133:0/2372582020 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82300342b0 0x7f8230036770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5572feaf2e80 tx=0x7f8348003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb0fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572fe890790 con 0x5572feb0f930 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb0fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb0fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39144/0 (socket says 172.21.15.133:39144) 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 -- 172.21.15.133:0/1288089396 learned_addr learned my addr 172.21.15.133:0/1288089396 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 -- 172.21.15.133:0/1288089396 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572feb10320 con 0x5572feb0f930 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 --2- 172.21.15.133:0/1288089396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb0fd50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f834000ff70 tx=0x7f834001ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3145ebde05e97e03 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8239ffb640 1 -- 172.21.15.133:0/1288089396 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8340025360 con 0x5572feb0f930 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8239ffb640 1 -- 172.21.15.133:0/1288089396 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000de00 con 0x5572feb0f930 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8239ffb640 1 -- 172.21.15.133:0/1288089396 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f834003abb0 con 0x5572feb0f930 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- 172.21.15.133:0/1288089396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 msgr2=0x5572feb0fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1288089396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb0fd50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f834000ff70 tx=0x7f834001ae40 comp rx=0 tx=0).stop 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- 172.21.15.133:0/1288089396 shutdown_connections 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1288089396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb0fd50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- 172.21.15.133:0/1288089396 >> 172.21.15.133:0/1288089396 conn(0x5572feb0bcc0 msgr2=0x5572feb09d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- 172.21.15.133:0/1288089396 shutdown_connections 2024-02-15T23:30:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- 172.21.15.133:0/1288089396 wait complete. 2024-02-15T23:30:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 Processor -- start 2024-02-15T23:30:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- start start 2024-02-15T23:30:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb16870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8358cb5980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572feb16db0 con 0x5572feb0f930 2024-02-15T23:30:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb16870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb16870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39148/0 (socket says 172.21.15.133:39148) 2024-02-15T23:30:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 learned_addr learned my addr 172.21.15.133:0/1078275671 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.275+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572feb040b0 con 0x5572feb0f930 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8355fcf640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb16870 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f834000eed0 tx=0x7f8340048c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8227fff640 1 -- 172.21.15.133:0/1078275671 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8340034070 con 0x5572feb0f930 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572feb16fb0 con 0x5572feb0f930 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572feb173e0 con 0x5572feb0f930 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8227fff640 1 -- 172.21.15.133:0/1078275671 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340025360 con 0x5572feb0f930 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8227fff640 1 -- 172.21.15.133:0/1078275671 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f834004ab10 con 0x5572feb0f930 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8227fff640 1 -- 172.21.15.133:0/1078275671 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8340041070 con 0x5572feb0f930 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8227fff640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82200342b0 0x7f8220036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8227fff640 1 -- 172.21.15.133:0/1078275671 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f834001e950 con 0x5572feb0f930 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8356fd1640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82200342b0 0x7f8220036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572feb21de0 0x5572feb24280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb249d0 con 0x5572feb21de0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f83567d0640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572feb21de0 0x5572feb24280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8356fd1640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82200342b0 0x7f8220036770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8348008fd0 tx=0x7f834801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f83567d0640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572feb21de0 0x5572feb24280 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 realm 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb24da0 con 0x5572feb21de0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb255f0 con 0x5572feb21de0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb25950 con 0x5572feb21de0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.279+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb25290 con 0x5572feb21de0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8358cb5980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8358cb5980 20 searching for the correct realm 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572feb27ba0 0x5572feb29fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8355fcf640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572feb27ba0 0x5572feb29fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8355fcf640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572feb27ba0 0x5572feb29fd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8355fcf640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f8340027060 0x7f83400299f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f8340027060 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8356fd1640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f8340027060 0x7f83400299f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8356fd1640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f8340027060 0x7f83400299f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834802c040 con 0x7f8340027060 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f8340027060 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834802c040 con 0x7f8340027060 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb21de0 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb21de0 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f83567d0640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f83500b43a0 0x7f83500b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f83500b43a0 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.283+0000 7f83567d0640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f83500b43a0 0x7f83500b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f83500b43a0 0x7f83500b5a50 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f83500b43a0 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f8340027060 2024-02-15T23:30:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834802c040 con 0x7f8340027060 2024-02-15T23:30:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb21de0 2024-02-15T23:30:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f83500b43a0 2024-02-15T23:30:51.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb21de0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f8340027060 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f834802c040 con 0x7f8340027060 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.287+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f83500b43a0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb21de0 2024-02-15T23:30:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb21de0 2024-02-15T23:30:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f83500b43a0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f8340027060 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834802c040 con 0x7f8340027060 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb21de0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f8340027060 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.291+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834802c040 con 0x7f8340027060 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f83500b43a0 2024-02-15T23:30:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f8340027060 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb27ba0 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f83500b43a0 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x5572feb21de0 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2a6a0 con 0x7f8340027060 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb267c0 con 0x5572feb21de0 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb26440 con 0x5572feb21de0 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb27040 con 0x5572feb21de0 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.295+0000 7f8358cb5980 20 zone default found 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 4 Realm: () 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 zonegroup default 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb27040 con 0x7f8340027060 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2c4c0 con 0x5572feb27ba0 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2c820 con 0x5572feb27ba0 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 started sync module instance, tier type = 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2bda0 con 0x7f8340027060 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93952387758336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2c150 con 0x7f8340027060 2024-02-15T23:30:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2d580 con 0x5572feb21de0 2024-02-15T23:30:51.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.299+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93952387758336] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.303+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.303+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93952387763264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2d560 con 0x5572feb21de0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.303+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2e020 con 0x5572feb27ba0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.303+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93952387763264] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.303+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.303+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93952387767008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2e3d0 con 0x5572feb27ba0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.303+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2ed40 con 0x7f8340027060 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.307+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.307+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93952387770800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2f590 con 0x7f8340027060 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.307+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2ff80 con 0x5572feb21de0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.307+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93952387767008] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.307+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93952387770800] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.307+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.307+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93952387775072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2f0f0 con 0x5572feb21de0 2024-02-15T23:30:51.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.307+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb307d0 con 0x7f83500b43a0 2024-02-15T23:30:51.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.311+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93952387775072] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.311+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.311+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93952387764320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2f0f0 con 0x7f83500b43a0 2024-02-15T23:30:51.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.311+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb30de0 con 0x7f83500b43a0 2024-02-15T23:30:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.311+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(56 notify.6 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.311+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93952387764320] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.311+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93952387777328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb30de0 con 0x7f83500b43a0 2024-02-15T23:30:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.311+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb31750 con 0x7f83500b43a0 2024-02-15T23:30:51.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93952387777328] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93952387778880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb31930 con 0x7f83500b43a0 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 20 add_watcher() i=0 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 20 add_watcher() i=1 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 20 add_watcher() i=2 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 20 add_watcher() i=3 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 20 add_watcher() i=4 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 20 add_watcher() i=5 2024-02-15T23:30:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 20 add_watcher() i=6 2024-02-15T23:30:51.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93952387778880] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 20 add_watcher() i=7 2024-02-15T23:30:51.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:51.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.315+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb34c70 con 0x5572feb21de0 2024-02-15T23:30:51.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93952387794592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb31aa0 con 0x5572feb21de0 2024-02-15T23:30:51.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93952387794592] v33'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f820cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 5 note: GC not initialized 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f81877fe640 20 reqs_thread_entry: start 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 20 Filter name: none 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f81857fa640 20 reqs_thread_entry: start 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb56680 con 0x5572feb21de0 2024-02-15T23:30:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:30:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb56680 con 0x7f83500b43a0 2024-02-15T23:30:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.319+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv31 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.323+0000 7f820cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.323+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93952387794592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb56680 con 0x5572feb21de0 2024-02-15T23:30:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.323+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93952387794592] v33'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.323+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93952387758336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb56680 con 0x7f8340027060 2024-02-15T23:30:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.323+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93952387758336] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.323+0000 7f8358cb5980 20 remove_watcher() i=0 2024-02-15T23:30:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.323+0000 7f8358cb5980 2 removed watcher, disabling cache 2024-02-15T23:30:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.323+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93952387763264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb56680 con 0x5572feb21de0 2024-02-15T23:30:51.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.327+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93952387763264] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.327+0000 7f8358cb5980 20 remove_watcher() i=1 2024-02-15T23:30:51.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.327+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93952387767008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb56680 con 0x5572feb27ba0 2024-02-15T23:30:51.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.327+0000 7f8355fcf640 1 -- 172.21.15.133:0/1078275671 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93952387767008] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8340036070 con 0x5572feb27ba0 2024-02-15T23:30:51.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.327+0000 7f8358cb5980 20 remove_watcher() i=2 2024-02-15T23:30:51.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.327+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93952387770800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2cc40 con 0x7f8340027060 2024-02-15T23:30:51.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.331+0000 7f8356fd1640 1 -- 172.21.15.133:0/1078275671 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93952387770800] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834803c040 con 0x7f8340027060 2024-02-15T23:30:51.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.331+0000 7f8358cb5980 20 remove_watcher() i=3 2024-02-15T23:30:51.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.331+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93952387775072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2dae0 con 0x5572feb21de0 2024-02-15T23:30:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.331+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93952387775072] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x5572feb21de0 2024-02-15T23:30:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.331+0000 7f8358cb5980 20 remove_watcher() i=4 2024-02-15T23:30:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.331+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93952387764320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2cc40 con 0x7f83500b43a0 2024-02-15T23:30:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.335+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93952387764320] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.335+0000 7f8358cb5980 20 remove_watcher() i=5 2024-02-15T23:30:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.335+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93952387777328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2fa60 con 0x7f83500b43a0 2024-02-15T23:30:51.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.335+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93952387777328] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.335+0000 7f8358cb5980 20 remove_watcher() i=6 2024-02-15T23:30:51.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.335+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93952387778880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572feb2dae0 con 0x7f83500b43a0 2024-02-15T23:30:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93952387778880] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f83500b4a00 con 0x7f83500b43a0 2024-02-15T23:30:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 20 remove_watcher() i=7 2024-02-15T23:30:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f83500b43a0 msgr2=0x7f83500b5a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f83500b43a0 0x7f83500b5a50 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572feb21de0 msgr2=0x5572feb24280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572feb21de0 0x5572feb24280 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f8340027060 msgr2=0x7f83400299f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f8340027060 0x7f83400299f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572feb27ba0 msgr2=0x5572feb29fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5572feb27ba0 0x5572feb29fd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82200342b0 msgr2=0x7f8220036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82200342b0 0x7f8220036770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8348008fd0 tx=0x7f834801c070 comp rx=0 tx=0).stop 2024-02-15T23:30:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 msgr2=0x5572feb16870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/1078275671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb0f930 0x5572feb16870 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f834000eed0 tx=0x7f8340048c10 comp rx=0 tx=0).stop 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 reap_dead start 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f83567d0640 1 -- 172.21.15.133:0/1078275671 reap_dead start 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 shutdown_connections 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 >> 172.21.15.133:0/1078275671 conn(0x5572feb0bcc0 msgr2=0x5572feb09320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 shutdown_connections 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/1078275671 wait complete. 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/2372582020 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82300342b0 msgr2=0x7f8230036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/2372582020 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82300342b0 0x7f8230036770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5572feaf2e80 tx=0x7f8348003070 comp rx=0 tx=0).stop 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/2372582020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb029b0 msgr2=0x5572feb02dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/2372582020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb029b0 0x5572feb02dd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f834000e640 tx=0x7f834000ea40 comp rx=0 tx=0).stop 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/2372582020 shutdown_connections 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/2372582020 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82300342b0 0x7f8230036770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/2372582020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572feb029b0 0x5572feb02dd0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/2372582020 >> 172.21.15.133:0/2372582020 conn(0x5572feaf77c0 msgr2=0x5572feaf82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/2372582020 shutdown_connections 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/2372582020 wait complete. 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572fe9f7960 msgr2=0x5572feaf21d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572fe9f7960 0x5572feaf21d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f823c034300 msgr2=0x7f823c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f823c034300 0x7f823c0367c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8340001e50 tx=0x7f83400013b0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 msgr2=0x5572feaeb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feaeb540 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f835001aec0 tx=0x7f8350017e30 comp rx=0 tx=0).stop 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 shutdown_connections 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5572fe9f7960 0x5572feaf21d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f823c034300 0x7f823c0367c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 --2- 172.21.15.133:0/3053922072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572fe9f7040 0x5572feaeb540 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 >> 172.21.15.133:0/3053922072 conn(0x5572fe9f2910 msgr2=0x5572feadcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 shutdown_connections 2024-02-15T23:30:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.339+0000 7f8358cb5980 1 -- 172.21.15.133:0/3053922072 wait complete. 2024-02-15T23:30:51.357 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-02-15T23:30:51.357 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-02-15T23:30:51.357 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-15T23:30:51.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-15T23:30:51.358 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-02-15T23:30:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.427+0000 7f41a62f7980 1 Processor -- start 2024-02-15T23:30:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.427+0000 7f41a62f7980 1 -- start start 2024-02-15T23:30:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.427+0000 7f41a62f7980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5599885cc020 0x5599885cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.427+0000 7f41a62f7980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5599885194d0 con 0x5599885cc940 2024-02-15T23:30:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.427+0000 7f41a62f7980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5599884e0180 con 0x5599885cc020 2024-02-15T23:30:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.427+0000 7f41a3e12640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5599885cc020 0x5599885cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.427+0000 7f41a3e12640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5599885cc020 0x5599885cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39156/0 (socket says 172.21.15.133:39156) 2024-02-15T23:30:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.427+0000 7f41a3e12640 1 -- 172.21.15.133:0/3177865319 learned_addr learned my addr 172.21.15.133:0/3177865319 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a3e12640 1 -- 172.21.15.133:0/3177865319 >> v1:172.21.15.131:6789/0 conn(0x5599885cc940 legacy=0x5599885cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a3e12640 1 -- 172.21.15.133:0/3177865319 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599885cdb80 con 0x5599885cc020 2024-02-15T23:30:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a3e12640 1 --2- 172.21.15.133:0/3177865319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885cc400 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f419400a4e0 tx=0x7f419401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb30aa34232d2ff1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a2e10640 1 -- 172.21.15.133:0/3177865319 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41940aa540 con 0x5599885cc020 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a2e10640 1 -- 172.21.15.133:0/3177865319 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41940a6070 con 0x5599885cc020 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a2e10640 1 -- 172.21.15.133:0/3177865319 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41940aa850 con 0x5599885cc020 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a62f7980 1 -- 172.21.15.133:0/3177865319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 msgr2=0x5599885cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3177865319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885cc400 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f419400a4e0 tx=0x7f419401b090 comp rx=0 tx=0).stop 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a62f7980 1 -- 172.21.15.133:0/3177865319 shutdown_connections 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3177865319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885cc400 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a62f7980 1 -- 172.21.15.133:0/3177865319 >> 172.21.15.133:0/3177865319 conn(0x5599885c78f0 msgr2=0x5599885c9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a62f7980 1 -- 172.21.15.133:0/3177865319 shutdown_connections 2024-02-15T23:30:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.431+0000 7f41a62f7980 1 -- 172.21.15.133:0/3177865319 wait complete. 2024-02-15T23:30:51.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.447+0000 7f41a62f7980 1 Processor -- start 2024-02-15T23:30:51.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.447+0000 7f41a62f7980 1 -- start start 2024-02-15T23:30:51.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.447+0000 7f41a62f7980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.447+0000 7f41a62f7980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599884dd6b0 con 0x5599885cc020 2024-02-15T23:30:51.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.447+0000 7f41a3e12640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.447+0000 7f41a3e12640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39172/0 (socket says 172.21.15.133:39172) 2024-02-15T23:30:51.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.447+0000 7f41a3e12640 1 -- 172.21.15.133:0/2647838233 learned_addr learned my addr 172.21.15.133:0/2647838233 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.447+0000 7f41a3e12640 1 -- 172.21.15.133:0/2647838233 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419400a1c0 con 0x5599885cc020 2024-02-15T23:30:51.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a3e12640 1 --2- 172.21.15.133:0/2647838233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885407a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4194017ca0 tx=0x7f41940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cd0d54711a7c1a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f4091e0b640 1 -- 172.21.15.133:0/2647838233 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41940aa780 con 0x5599885cc020 2024-02-15T23:30:51.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f4091e0b640 1 -- 172.21.15.133:0/2647838233 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41940aa8e0 con 0x5599885cc020 2024-02-15T23:30:51.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f4091e0b640 1 -- 172.21.15.133:0/2647838233 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41940aab80 con 0x5599885cc020 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 -- 172.21.15.133:0/2647838233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 msgr2=0x5599885407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 --2- 172.21.15.133:0/2647838233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885407a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4194017ca0 tx=0x7f41940033b0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 -- 172.21.15.133:0/2647838233 shutdown_connections 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 --2- 172.21.15.133:0/2647838233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599885407a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 -- 172.21.15.133:0/2647838233 >> 172.21.15.133:0/2647838233 conn(0x5599885c78f0 msgr2=0x5599886b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 -- 172.21.15.133:0/2647838233 shutdown_connections 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 -- 172.21.15.133:0/2647838233 wait complete. 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 Processor -- start 2024-02-15T23:30:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 -- start start 2024-02-15T23:30:51.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599886be430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599884d8e90 con 0x5599885cc020 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a3e12640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599886be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a3e12640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599886be430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39180/0 (socket says 172.21.15.133:39180) 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a3e12640 1 -- 172.21.15.133:0/1358628150 learned_addr learned my addr 172.21.15.133:0/1358628150 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a3e12640 1 -- 172.21.15.133:0/1358628150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599885cdb80 con 0x5599885cc020 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a3e12640 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599886be430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4194017ca0 tx=0x7f4194017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f408bfff640 1 -- 172.21.15.133:0/1358628150 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41940c4070 con 0x5599885cc020 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599886be970 con 0x5599885cc020 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f408bfff640 1 -- 172.21.15.133:0/1358628150 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41940b5650 con 0x5599885cc020 2024-02-15T23:30:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.451+0000 7f408bfff640 1 -- 172.21.15.133:0/1358628150 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41940b58f0 con 0x5599885cc020 2024-02-15T23:30:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599886bedc0 con 0x5599885cc020 2024-02-15T23:30:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f408bfff640 1 -- 172.21.15.133:0/1358628150 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f41940a8070 con 0x5599885cc020 2024-02-15T23:30:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f408bfff640 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f408c0342b0 0x7f408c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f408bfff640 1 -- 172.21.15.133:0/1358628150 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f41940e37f0 con 0x5599885cc020 2024-02-15T23:30:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a3611640 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f408c0342b0 0x7f408c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599885cc940 0x5599886c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886c55c0 con 0x5599885cc940 2024-02-15T23:30:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a4613640 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599885cc940 0x5599886c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a3611640 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f408c0342b0 0x7f408c036770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f418c001e20 tx=0x7f418c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a4613640 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599885cc940 0x5599886c5080 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a4613640 1 -- 172.21.15.133:0/1358628150 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f419c0083f0 con 0x5599885cc940 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886c27a0 con 0x5599885cc940 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a4613640 1 -- 172.21.15.133:0/1358628150 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f419c0083f0 con 0x5599885cc940 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886c72f0 con 0x5599885cc940 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a4613640 1 -- 172.21.15.133:0/1358628150 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f419c0083f0 con 0x5599885cc940 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886c64f0 con 0x5599885cc940 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a4613640 1 -- 172.21.15.133:0/1358628150 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f419c0083f0 con 0x5599885cc940 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886c6900 con 0x5599885cc940 2024-02-15T23:30:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.455+0000 7f41a4613640 1 -- 172.21.15.133:0/1358628150 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f419c012040 con 0x5599885cc940 2024-02-15T23:30:51.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a62f7980 1 Processor -- start 2024-02-15T23:30:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a62f7980 1 -- start start 2024-02-15T23:30:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a62f7980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886b7fd0 0x5599886b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a62f7980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559988471f20 con 0x5599886b7fd0 2024-02-15T23:30:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a3611640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886b7fd0 0x5599886b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a3611640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886b7fd0 0x5599886b6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39186/0 (socket says 172.21.15.133:39186) 2024-02-15T23:30:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a3611640 1 -- 172.21.15.133:0/3677207956 learned_addr learned my addr 172.21.15.133:0/3677207956 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a3611640 1 -- 172.21.15.133:0/3677207956 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599886b69b0 con 0x5599886b7fd0 2024-02-15T23:30:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a3611640 1 --2- 172.21.15.133:0/3677207956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886b7fd0 0x5599886b6470 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f418c001780 tx=0x7f418c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f40897fa640 1 -- 172.21.15.133:0/3677207956 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c00e580 con 0x5599886b7fd0 2024-02-15T23:30:51.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a62f7980 1 -- 172.21.15.133:0/3677207956 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599886b6c60 con 0x5599886b7fd0 2024-02-15T23:30:51.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f40897fa640 1 -- 172.21.15.133:0/3677207956 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00e6e0 con 0x5599886b7fd0 2024-02-15T23:30:51.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f40897fa640 1 -- 172.21.15.133:0/3677207956 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c00e980 con 0x5599886b7fd0 2024-02-15T23:30:51.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a62f7980 1 -- 172.21.15.133:0/3677207956 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599886b70f0 con 0x5599886b7fd0 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f40897fa640 1 -- 172.21.15.133:0/3677207956 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f418c00eae0 con 0x5599886b7fd0 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f40897fa640 1 --2- 172.21.15.133:0/3677207956 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f407c0342b0 0x7f407c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f40897fa640 1 -- 172.21.15.133:0/3677207956 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f418c018040 con 0x5599886b7fd0 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a4613640 1 --2- 172.21.15.133:0/3677207956 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f407c0342b0 0x7f407c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.459+0000 7f41a62f7980 1 Processor -- start 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- start start 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a4613640 1 --2- 172.21.15.133:0/3677207956 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f407c0342b0 0x7f407c036770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5599886c5f30 tx=0x7f419c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886e5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559988465790 con 0x5599886e4d60 2024-02-15T23:30:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886e5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39196/0 (socket says 172.21.15.133:39196) 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 -- 172.21.15.133:0/1957573267 learned_addr learned my addr 172.21.15.133:0/1957573267 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 -- 172.21.15.133:0/1957573267 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599886e5730 con 0x5599886e4d60 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 --2- 172.21.15.133:0/1957573267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886e5160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f418c01cfd0 tx=0x7f418c01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cf3b2d1b32dccb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f4082ffd640 1 -- 172.21.15.133:0/1957573267 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c03f030 con 0x5599886e4d60 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f4082ffd640 1 -- 172.21.15.133:0/1957573267 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c01bc10 con 0x5599886e4d60 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f4082ffd640 1 -- 172.21.15.133:0/1957573267 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c03b280 con 0x5599886e4d60 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- 172.21.15.133:0/1957573267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 msgr2=0x5599886e5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1957573267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886e5160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f418c01cfd0 tx=0x7f418c01aa60 comp rx=0 tx=0).stop 2024-02-15T23:30:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- 172.21.15.133:0/1957573267 shutdown_connections 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1957573267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886e5160 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- 172.21.15.133:0/1957573267 >> 172.21.15.133:0/1957573267 conn(0x5599886e10a0 msgr2=0x5599886df100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- 172.21.15.133:0/1957573267 shutdown_connections 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- 172.21.15.133:0/1957573267 wait complete. 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 Processor -- start 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- start start 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886ebc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a62f7980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599886ec160 con 0x5599886e4d60 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886ebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886ebc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39206/0 (socket says 172.21.15.133:39206) 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 learned_addr learned my addr 172.21.15.133:0/3957128500 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.463+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599886b70f0 con 0x5599886e4d60 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a3611640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886ebc20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f418c01af40 tx=0x7f418c049600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f40817fa640 1 -- 172.21.15.133:0/3957128500 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c03f040 con 0x5599886e4d60 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599886ec360 con 0x5599886e4d60 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599886ec360 con 0x5599886e4d60 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f40817fa640 1 -- 172.21.15.133:0/3957128500 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c04b200 con 0x5599886e4d60 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f40817fa640 1 -- 172.21.15.133:0/3957128500 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c01ca60 con 0x5599886e4d60 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f40817fa640 1 -- 172.21.15.133:0/3957128500 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f418c042070 con 0x5599886e4d60 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f40817fa640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f406c034260 0x7f406c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f40817fa640 1 -- 172.21.15.133:0/3957128500 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f418c040070 con 0x5599886e4d60 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a4613640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f406c034260 0x7f406c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599886f6e90 0x5599886f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886f9a80 con 0x5599886f6e90 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a3e12640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599886f6e90 0x5599886f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a4613640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f406c034260 0x7f406c036720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f419c008fd0 tx=0x7f419c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a3e12640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599886f6e90 0x5599886f9330 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 realm 2024-02-15T23:30:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886f9e50 con 0x5599886f6e90 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886fa6a0 con 0x5599886f6e90 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886faa00 con 0x5599886f6e90 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886fa340 con 0x5599886f6e90 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.467+0000 7f41a62f7980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a62f7980 20 searching for the correct realm 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5599886fcc50 0x5599886ff060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3611640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5599886fcc50 0x5599886ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3611640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5599886fcc50 0x5599886ff060 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c01a310 con 0x5599886fcc50 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3611640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f418c039070 0x7f418c024580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f418c039070 2024-02-15T23:30:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a4613640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f418c039070 0x7f418c024580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a4613640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f418c039070 0x7f418c024580 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419c02c040 con 0x7f418c039070 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f418c039070 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419c02c040 con 0x7f418c039070 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886f6e90 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886f6e90 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3e12640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41940b5a50 0x7f41940b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f41940b5a50 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3e12640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41940b5a50 0x7f41940b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.471+0000 7f41a3e12640 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41940b5a50 0x7f41940b43a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f41940b5a50 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f418c039070 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419c02c040 con 0x7f418c039070 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c01a310 con 0x5599886fcc50 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886f6e90 2024-02-15T23:30:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f41940b5a50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886f6e90 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f418c039070 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f419c02c040 con 0x7f418c039070 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c01a310 con 0x5599886fcc50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.475+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f41940b5a50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886f6e90 2024-02-15T23:30:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886f6e90 2024-02-15T23:30:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f41940b5a50 2024-02-15T23:30:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f418c039070 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419c02c040 con 0x7f418c039070 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886f6e90 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.479+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f418c039070 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419c02c040 con 0x7f418c039070 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f41940b5a50 2024-02-15T23:30:51.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f418c039070 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886fcc50 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f41940b5a50 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x5599886f6e90 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886ff730 con 0x7f418c039070 2024-02-15T23:30:51.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886fb870 con 0x5599886f6e90 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.483+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886fb4f0 con 0x5599886f6e90 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886fc0f0 con 0x5599886f6e90 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 zone default found 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 4 Realm: () 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 zonegroup default 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599886fc0f0 con 0x7f418c039070 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988701550 con 0x5599886fcc50 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599887018b0 con 0x5599886fcc50 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 started sync module instance, tier type = 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988700e30 con 0x7f418c039070 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117907401104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599887011e0 con 0x7f418c039070 2024-02-15T23:30:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599887025e0 con 0x5599886f6e90 2024-02-15T23:30:51.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.487+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94117907401104] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.491+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.491+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117907405984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599887025e0 con 0x5599886f6e90 2024-02-15T23:30:51.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.491+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599887030b0 con 0x5599886fcc50 2024-02-15T23:30:51.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.491+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.491+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117907409808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988703900 con 0x5599886fcc50 2024-02-15T23:30:51.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.491+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988704310 con 0x7f418c039070 2024-02-15T23:30:51.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.491+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94117907405984] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.495+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.495+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117907407040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599887046c0 con 0x7f418c039070 2024-02-15T23:30:51.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.495+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988705030 con 0x5599886f6e90 2024-02-15T23:30:51.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.495+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94117907409808] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.495+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.495+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117907412064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988705030 con 0x5599886f6e90 2024-02-15T23:30:51.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.495+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599887059f0 con 0x7f41940b5a50 2024-02-15T23:30:51.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.495+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94117907407040] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.499+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94117907412064] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.499+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.499+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117907420496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988703f10 con 0x7f41940b5a50 2024-02-15T23:30:51.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.499+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988705970 con 0x7f41940b5a50 2024-02-15T23:30:51.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.499+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94117907420496] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.499+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.499+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117907418000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988705970 con 0x7f41940b5a50 2024-02-15T23:30:51.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.499+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988706850 con 0x7f41940b5a50 2024-02-15T23:30:51.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94117907418000] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117907422544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988706850 con 0x7f41940b5a50 2024-02-15T23:30:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a62f7980 20 add_watcher() i=0 2024-02-15T23:30:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a62f7980 20 add_watcher() i=1 2024-02-15T23:30:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a62f7980 20 add_watcher() i=2 2024-02-15T23:30:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a62f7980 20 add_watcher() i=3 2024-02-15T23:30:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a62f7980 20 add_watcher() i=4 2024-02-15T23:30:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a62f7980 20 add_watcher() i=5 2024-02-15T23:30:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a62f7980 20 add_watcher() i=6 2024-02-15T23:30:51.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.503+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94117907422544] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 20 add_watcher() i=7 2024-02-15T23:30:51.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:51.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988709b60 con 0x5599886f6e90 2024-02-15T23:30:51.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117907436928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5599887069c0 con 0x5599886f6e90 2024-02-15T23:30:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94117907436928] v33'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f4059fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 5 note: GC not initialized 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f4058fe1640 20 reqs_thread_entry: start 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 20 Filter name: none 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f3fd27fc640 20 reqs_thread_entry: start 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55998872b670 con 0x5599886f6e90 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.507+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55998872b670 con 0x7f41940b5a50 2024-02-15T23:30:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv31 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f4059fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117907436928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988709030 con 0x5599886f6e90 2024-02-15T23:30:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94117907436928] v33'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117907401104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55998872b630 con 0x7f418c039070 2024-02-15T23:30:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94117907401104] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f41a62f7980 20 remove_watcher() i=0 2024-02-15T23:30:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f41a62f7980 2 removed watcher, disabling cache 2024-02-15T23:30:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.511+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117907405984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55998872b630 con 0x5599886f6e90 2024-02-15T23:30:51.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.515+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94117907405984] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.515+0000 7f41a62f7980 20 remove_watcher() i=1 2024-02-15T23:30:51.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.515+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117907409808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55998872b630 con 0x5599886fcc50 2024-02-15T23:30:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a3611640 1 -- 172.21.15.133:0/3957128500 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94117907409808] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f418c05f040 con 0x5599886fcc50 2024-02-15T23:30:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a62f7980 20 remove_watcher() i=2 2024-02-15T23:30:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117907407040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988701ca0 con 0x7f418c039070 2024-02-15T23:30:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a4613640 1 -- 172.21.15.133:0/3957128500 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94117907407040] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f419c03c040 con 0x7f418c039070 2024-02-15T23:30:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a62f7980 20 remove_watcher() i=3 2024-02-15T23:30:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117907412064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988702140 con 0x5599886f6e90 2024-02-15T23:30:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94117907412064] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x5599886f6e90 2024-02-15T23:30:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a62f7980 20 remove_watcher() i=4 2024-02-15T23:30:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.519+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117907420496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988702140 con 0x7f41940b5a50 2024-02-15T23:30:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.523+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94117907420496] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.523+0000 7f41a62f7980 20 remove_watcher() i=5 2024-02-15T23:30:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.523+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117907418000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988702b90 con 0x7f41940b5a50 2024-02-15T23:30:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.523+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94117907418000] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.523+0000 7f41a62f7980 20 remove_watcher() i=6 2024-02-15T23:30:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.523+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117907422544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559988702b90 con 0x7f41940b5a50 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94117907422544] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f41940bd780 con 0x7f41940b5a50 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 20 remove_watcher() i=7 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41940b5a50 msgr2=0x7f41940b43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f41940b5a50 0x7f41940b43a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599886f6e90 msgr2=0x5599886f9330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599886f6e90 0x5599886f9330 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f418c039070 msgr2=0x7f418c024580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f418c039070 0x7f418c024580 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5599886fcc50 msgr2=0x5599886ff060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5599886fcc50 0x5599886ff060 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f406c034260 msgr2=0x7f406c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f406c034260 0x7f406c036720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f419c008fd0 tx=0x7f419c01c070 comp rx=0 tx=0).stop 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 msgr2=0x5599886ebc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3957128500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886e4d60 0x5599886ebc20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f418c01af40 tx=0x7f418c049600 comp rx=0 tx=0).stop 2024-02-15T23:30:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 reap_dead start 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a3e12640 1 -- 172.21.15.133:0/3957128500 reap_dead start 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 shutdown_connections 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 >> 172.21.15.133:0/3957128500 conn(0x5599886e10a0 msgr2=0x5599886de700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 shutdown_connections 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3957128500 wait complete. 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3677207956 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f407c0342b0 msgr2=0x7f407c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3677207956 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f407c0342b0 0x7f407c036770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5599886c5f30 tx=0x7f419c003070 comp rx=0 tx=0).stop 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3677207956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886b7fd0 msgr2=0x5599886b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3677207956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886b7fd0 0x5599886b6470 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f418c001780 tx=0x7f418c00f7a0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3677207956 shutdown_connections 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3677207956 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f407c0342b0 0x7f407c036770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/3677207956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599886b7fd0 0x5599886b6470 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3677207956 >> 172.21.15.133:0/3677207956 conn(0x5599886ca780 msgr2=0x5599886cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3677207956 shutdown_connections 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/3677207956 wait complete. 2024-02-15T23:30:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599885cc940 msgr2=0x5599886c5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599885cc940 0x5599886c5080 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.527+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f408c0342b0 msgr2=0x7f408c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f408c0342b0 0x7f408c036770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f418c001e20 tx=0x7f418c0013a0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 msgr2=0x5599886be430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599886be430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4194017ca0 tx=0x7f4194017e30 comp rx=0 tx=0).stop 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 shutdown_connections 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5599885cc940 0x5599886c5080 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f408c0342b0 0x7f408c036770 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 --2- 172.21.15.133:0/1358628150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599885cc020 0x5599886be430 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 >> 172.21.15.133:0/1358628150 conn(0x5599885c78f0 msgr2=0x5599886b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 shutdown_connections 2024-02-15T23:30:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.531+0000 7f41a62f7980 1 -- 172.21.15.133:0/1358628150 wait complete. 2024-02-15T23:30:51.547 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-02-15T23:30:51.547 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-02-15T23:30:51.547 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-15T23:30:51.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-15T23:30:51.548 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-02-15T23:30:51.621 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:51.621 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:51.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9de0ed980 1 Processor -- start 2024-02-15T23:30:51.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9de0ed980 1 -- start start 2024-02-15T23:30:51.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9de0ed980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x563e11ec1050 0x563e11ec1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9de0ed980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563e11e0e4d0 con 0x563e11ec1970 2024-02-15T23:30:51.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9de0ed980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x563e11dd5180 con 0x563e11ec1050 2024-02-15T23:30:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9dbc08640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x563e11ec1050 0x563e11ec1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9dbc08640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x563e11ec1050 0x563e11ec1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39222/0 (socket says 172.21.15.133:39222) 2024-02-15T23:30:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9dbc08640 1 -- 172.21.15.133:0/3512919612 learned_addr learned my addr 172.21.15.133:0/3512919612 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9db407640 1 --1- 172.21.15.133:0/3512919612 >> v1:172.21.15.131:6789/0 conn(0x563e11ec1970 0x563e11ec2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:35136/0 (socket says 172.21.15.133:35136) 2024-02-15T23:30:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9dbc08640 1 -- 172.21.15.133:0/3512919612 >> v1:172.21.15.131:6789/0 conn(0x563e11ec1970 legacy=0x563e11ec2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.615+0000 7fc9dbc08640 1 -- 172.21.15.133:0/3512919612 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e11ec2b60 con 0x563e11ec1050 2024-02-15T23:30:51.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9dbc08640 1 --2- 172.21.15.133:0/3512919612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11ec1430 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00a4e0 tx=0x7fc9cc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf006db66e77e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9dac06640 1 -- 172.21.15.133:0/3512919612 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9cc0aa540 con 0x563e11ec1050 2024-02-15T23:30:51.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9dac06640 1 -- 172.21.15.133:0/3512919612 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc0a6070 con 0x563e11ec1050 2024-02-15T23:30:51.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9dac06640 1 -- 172.21.15.133:0/3512919612 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9cc0aa850 con 0x563e11ec1050 2024-02-15T23:30:51.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9de0ed980 1 -- 172.21.15.133:0/3512919612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 msgr2=0x563e11ec1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/3512919612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11ec1430 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00a4e0 tx=0x7fc9cc01b090 comp rx=0 tx=0).stop 2024-02-15T23:30:51.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9de0ed980 1 -- 172.21.15.133:0/3512919612 shutdown_connections 2024-02-15T23:30:51.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/3512919612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11ec1430 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9de0ed980 1 -- 172.21.15.133:0/3512919612 >> 172.21.15.133:0/3512919612 conn(0x563e11ebc920 msgr2=0x563e11ebed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9de0ed980 1 -- 172.21.15.133:0/3512919612 shutdown_connections 2024-02-15T23:30:51.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.619+0000 7fc9de0ed980 1 -- 172.21.15.133:0/3512919612 wait complete. 2024-02-15T23:30:51.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9de0ed980 1 Processor -- start 2024-02-15T23:30:51.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9de0ed980 1 -- start start 2024-02-15T23:30:51.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9de0ed980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9de0ed980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e11dd26b0 con 0x563e11ec1050 2024-02-15T23:30:51.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9dbc08640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9dbc08640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39228/0 (socket says 172.21.15.133:39228) 2024-02-15T23:30:51.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9dbc08640 1 -- 172.21.15.133:0/1729154765 learned_addr learned my addr 172.21.15.133:0/1729154765 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9dbc08640 1 -- 172.21.15.133:0/1729154765 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc00a1c0 con 0x563e11ec1050 2024-02-15T23:30:51.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc9dbc08640 1 --2- 172.21.15.133:0/1729154765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fae860 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc017ca0 tx=0x7fc9cc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c608a88dae16bc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc8c9e0b640 1 -- 172.21.15.133:0/1729154765 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9cc0aa780 con 0x563e11ec1050 2024-02-15T23:30:51.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc8c9e0b640 1 -- 172.21.15.133:0/1729154765 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc0aa8e0 con 0x563e11ec1050 2024-02-15T23:30:51.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.635+0000 7fc8c9e0b640 1 -- 172.21.15.133:0/1729154765 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9cc0aab80 con 0x563e11ec1050 2024-02-15T23:30:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1729154765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 msgr2=0x563e11fae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/1729154765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fae860 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc017ca0 tx=0x7fc9cc0033b0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1729154765 shutdown_connections 2024-02-15T23:30:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/1729154765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fae860 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1729154765 >> 172.21.15.133:0/1729154765 conn(0x563e11ebc920 msgr2=0x563e11fa5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1729154765 shutdown_connections 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1729154765 wait complete. 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 Processor -- start 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- start start 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fb5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e11dcde90 con 0x563e11ec1050 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9dbc08640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fb5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9dbc08640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fb5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39242/0 (socket says 172.21.15.133:39242) 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9dbc08640 1 -- 172.21.15.133:0/141918601 learned_addr learned my addr 172.21.15.133:0/141918601 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9dbc08640 1 -- 172.21.15.133:0/141918601 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e11ec2b60 con 0x563e11ec1050 2024-02-15T23:30:51.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9dbc08640 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fb5540 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc01aec0 tx=0x7fc9cc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc8c3fff640 1 -- 172.21.15.133:0/141918601 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9cc0c4070 con 0x563e11ec1050 2024-02-15T23:30:51.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc8c3fff640 1 -- 172.21.15.133:0/141918601 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc0b5650 con 0x563e11ec1050 2024-02-15T23:30:51.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e11fb5a80 con 0x563e11ec1050 2024-02-15T23:30:51.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc8c3fff640 1 -- 172.21.15.133:0/141918601 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9cc0b5910 con 0x563e11ec1050 2024-02-15T23:30:51.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.639+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e11fb5ed0 con 0x563e11ec1050 2024-02-15T23:30:51.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc8c3fff640 1 -- 172.21.15.133:0/141918601 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc9cc0a8070 con 0x563e11ec1050 2024-02-15T23:30:51.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc8c3fff640 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8c40342b0 0x7fc8c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc8c3fff640 1 -- 172.21.15.133:0/141918601 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc9cc0e3860 con 0x563e11ec1050 2024-02-15T23:30:51.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9db407640 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8c40342b0 0x7fc8c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11ec1970 0x563e11fbc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11fbc710 con 0x563e11ec1970 2024-02-15T23:30:51.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9dc409640 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11ec1970 0x563e11fbc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9db407640 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8c40342b0 0x7fc8c4036770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0001e50 tx=0x7fc9d00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9dc409640 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11ec1970 0x563e11fbc1d0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9dc409640 1 -- 172.21.15.133:0/141918601 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9d40083f0 con 0x563e11ec1970 2024-02-15T23:30:51.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11fbcb00 con 0x563e11ec1970 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9dc409640 1 -- 172.21.15.133:0/141918601 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc9d40083f0 con 0x563e11ec1970 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11fbe3b0 con 0x563e11ec1970 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9dc409640 1 -- 172.21.15.133:0/141918601 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc9d40083f0 con 0x563e11ec1970 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11fbd5b0 con 0x563e11ec1970 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9dc409640 1 -- 172.21.15.133:0/141918601 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc9d40083f0 con 0x563e11ec1970 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11fbd9c0 con 0x563e11ec1970 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9dc409640 1 -- 172.21.15.133:0/141918601 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc9d4012040 con 0x563e11ec1970 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 Processor -- start 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 -- start start 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fcca50 0x563e11fcce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.643+0000 7fc9de0ed980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e11d66f20 con 0x563e11fcca50 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9db407640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fcca50 0x563e11fcce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9db407640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fcca50 0x563e11fcce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39250/0 (socket says 172.21.15.133:39250) 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9db407640 1 -- 172.21.15.133:0/1552335874 learned_addr learned my addr 172.21.15.133:0/1552335874 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9db407640 1 -- 172.21.15.133:0/1552335874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e11fcd3b0 con 0x563e11fcca50 2024-02-15T23:30:51.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9db407640 1 --2- 172.21.15.133:0/1552335874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fcca50 0x563e11fcce70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000e640 tx=0x7fc9d000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc8c17fa640 1 -- 172.21.15.133:0/1552335874 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9d0007040 con 0x563e11fcca50 2024-02-15T23:30:51.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1552335874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e11fcd600 con 0x563e11fcca50 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc8c17fa640 1 -- 172.21.15.133:0/1552335874 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d000d660 con 0x563e11fcca50 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc8c17fa640 1 -- 172.21.15.133:0/1552335874 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9d000d920 con 0x563e11fcca50 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1552335874 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e11fce150 con 0x563e11fcca50 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc8c17fa640 1 -- 172.21.15.133:0/1552335874 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc9d001a070 con 0x563e11fcca50 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc8c17fa640 1 --2- 172.21.15.133:0/1552335874 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8b40342b0 0x7fc8b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc8c17fa640 1 -- 172.21.15.133:0/1552335874 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc9d0017050 con 0x563e11fcca50 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9dc409640 1 --2- 172.21.15.133:0/1552335874 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8b40342b0 0x7fc8b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9de0ed980 1 Processor -- start 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9de0ed980 1 -- start start 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9dc409640 1 --2- 172.21.15.133:0/1552335874 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8b40342b0 0x7fc8b4036770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x563e11fbcff0 tx=0x7fc9d4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9de0ed980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fd9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9de0ed980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e11d5a790 con 0x563e11fd9a30 2024-02-15T23:30:51.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9db407640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fd9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9db407640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fd9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39254/0 (socket says 172.21.15.133:39254) 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.647+0000 7fc9db407640 1 -- 172.21.15.133:0/4213067723 learned_addr learned my addr 172.21.15.133:0/4213067723 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9db407640 1 -- 172.21.15.133:0/4213067723 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e11fda400 con 0x563e11fd9a30 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9db407640 1 --2- 172.21.15.133:0/4213067723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fd9e30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000ff70 tx=0x7fc9d001ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fc05c693d0f340 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc8baffd640 1 -- 172.21.15.133:0/4213067723 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9d0025360 con 0x563e11fd9a30 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc8baffd640 1 -- 172.21.15.133:0/4213067723 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d000de00 con 0x563e11fd9a30 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc8baffd640 1 -- 172.21.15.133:0/4213067723 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9d003abb0 con 0x563e11fd9a30 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- 172.21.15.133:0/4213067723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 msgr2=0x563e11fd9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/4213067723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fd9e30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000ff70 tx=0x7fc9d001ae40 comp rx=0 tx=0).stop 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- 172.21.15.133:0/4213067723 shutdown_connections 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/4213067723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fd9e30 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- 172.21.15.133:0/4213067723 >> 172.21.15.133:0/4213067723 conn(0x563e11fd5d70 msgr2=0x563e11fd3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- 172.21.15.133:0/4213067723 shutdown_connections 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- 172.21.15.133:0/4213067723 wait complete. 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 Processor -- start 2024-02-15T23:30:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- start start 2024-02-15T23:30:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fe0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e11fe0eb0 con 0x563e11fd9a30 2024-02-15T23:30:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9db407640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fe0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9db407640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fe0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39270/0 (socket says 172.21.15.133:39270) 2024-02-15T23:30:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 learned_addr learned my addr 172.21.15.133:0/476886173 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e11fce150 con 0x563e11fd9a30 2024-02-15T23:30:51.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9db407640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fe0970 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000eed0 tx=0x7fc9d0048c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc8b97fa640 1 -- 172.21.15.133:0/476886173 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9d0034070 con 0x563e11fd9a30 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e11fe10b0 con 0x563e11fd9a30 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc8b97fa640 1 -- 172.21.15.133:0/476886173 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0025360 con 0x563e11fd9a30 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc8b97fa640 1 -- 172.21.15.133:0/476886173 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9d004ab10 con 0x563e11fd9a30 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.651+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e11fe14e0 con 0x563e11fd9a30 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc8b97fa640 1 -- 172.21.15.133:0/476886173 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc9d0041070 con 0x563e11fd9a30 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc8b97fa640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8a40342b0 0x7fc8a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc8b97fa640 1 -- 172.21.15.133:0/476886173 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc9d001e950 con 0x563e11fd9a30 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dc409640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8a40342b0 0x7fc8a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11febee0 0x563e11fee380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11feead0 con 0x563e11febee0 2024-02-15T23:30:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dbc08640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11febee0 0x563e11fee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dc409640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8a40342b0 0x7fc8a4036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4008fd0 tx=0x7fc9d401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dbc08640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11febee0 0x563e11fee380 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 realm 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11feeea0 con 0x563e11febee0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11fef6f0 con 0x563e11febee0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11fefa50 con 0x563e11febee0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff0250 con 0x563e11febee0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 20 searching for the correct realm 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563e11ff1f70 0x563e11ff4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9db407640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563e11ff1f70 0x563e11ff4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.655+0000 7fc9db407640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563e11ff1f70 0x563e11ff4360 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9db407640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc9d0027060 0x7fc9d00299f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9d0027060 2024-02-15T23:30:51.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dc409640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc9d0027060 0x7fc9d00299f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dc409640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc9d0027060 0x7fc9d00299f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d402c040 con 0x7fc9d0027060 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9d0027060 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d402c040 con 0x7fc9d0027060 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11febee0 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11febee0 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc9cc0d03a0 0x7fc9cc0a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc9cc0d03a0 0x7fc9cc0a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc9cc0d03a0 0x7fc9cc0a9ad0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0d1790 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.659+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0d1790 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9d0027060 2024-02-15T23:30:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d402c040 con 0x7fc9d0027060 2024-02-15T23:30:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11febee0 2024-02-15T23:30:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0d1790 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11febee0 2024-02-15T23:30:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9d0027060 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc9d402c040 con 0x7fc9d0027060 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0d1790 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.663+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11febee0 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11febee0 2024-02-15T23:30:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc9cc0d1790 con 0x563e11febee0 2024-02-15T23:30:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9d0027060 2024-02-15T23:30:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d402c040 con 0x7fc9d0027060 2024-02-15T23:30:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11febee0 2024-02-15T23:30:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9d0027060 2024-02-15T23:30:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d402c040 con 0x7fc9d0027060 2024-02-15T23:30:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.667+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9d0027060 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11ff1f70 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x563e11febee0 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff48a0 con 0x7fc9d0027060 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff0b50 con 0x563e11febee0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff07d0 con 0x563e11febee0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff13d0 con 0x563e11febee0 2024-02-15T23:30:51.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 zone default found 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 4 Realm: () 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 zonegroup default 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff13d0 con 0x7fc9d0027060 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff65e0 con 0x563e11ff1f70 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff6940 con 0x563e11ff1f70 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 started sync module instance, tier type = 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.671+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff5ec0 con 0x7fc9d0027060 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.675+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.675+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94824589908512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff6270 con 0x7fc9d0027060 2024-02-15T23:30:51.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.675+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff5ec0 con 0x563e11febee0 2024-02-15T23:30:51.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.675+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94824589908512] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.675+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.675+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94824589913392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff76c0 con 0x563e11febee0 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.675+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff8070 con 0x563e11ff1f70 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.679+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.679+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94824589913392] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.679+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94824589914448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff8420 con 0x563e11ff1f70 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.679+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff8d90 con 0x7fc9d0027060 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.679+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.679+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94824589920800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff95e0 con 0x7fc9d0027060 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.679+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff9fe0 con 0x563e11febee0 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94824589914448] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94824589920800] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94824589925088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff9140 con 0x563e11febee0 2024-02-15T23:30:51.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ffa830 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94824589925088] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94824589917072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff9140 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.683+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ffae40 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94824589917072] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94824589927312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ffae40 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ffb7b0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94824589931280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ffbbd0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 20 add_watcher() i=0 2024-02-15T23:30:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 20 add_watcher() i=1 2024-02-15T23:30:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 20 add_watcher() i=2 2024-02-15T23:30:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 20 add_watcher() i=3 2024-02-15T23:30:51.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 20 add_watcher() i=4 2024-02-15T23:30:51.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.687+0000 7fc9de0ed980 20 add_watcher() i=5 2024-02-15T23:30:51.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94824589927312] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9de0ed980 20 add_watcher() i=6 2024-02-15T23:30:51.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94824589931280] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9de0ed980 20 add_watcher() i=7 2024-02-15T23:30:51.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9de0ed980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:51.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ffa9a0 con 0x563e11febee0 2024-02-15T23:30:51.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94824589932336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ffa9a0 con 0x563e11febee0 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94824589932336] v33'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9de0ed980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9de0ed980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.691+0000 7fc9de0ed980 5 note: GC not initialized 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc890fe1640 20 reqs_thread_entry: start 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9de0ed980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9de0ed980 20 Filter name: none 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc80a7fc640 20 reqs_thread_entry: start 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9de0ed980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e120206a0 con 0x563e11febee0 2024-02-15T23:30:51.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9de0ed980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:30:51.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e120206a0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv31 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.695+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94824589932336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e120206a0 con 0x563e11febee0 2024-02-15T23:30:51.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94824589932336] v33'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94824589908512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e120206a0 con 0x7fc9d0027060 2024-02-15T23:30:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94824589908512] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9de0ed980 20 remove_watcher() i=0 2024-02-15T23:30:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9de0ed980 2 removed watcher, disabling cache 2024-02-15T23:30:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94824589913392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e120206a0 con 0x563e11febee0 2024-02-15T23:30:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94824589913392] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9de0ed980 20 remove_watcher() i=1 2024-02-15T23:30:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.699+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94824589914448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e120206a0 con 0x563e11ff1f70 2024-02-15T23:30:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.703+0000 7fc9db407640 1 -- 172.21.15.133:0/476886173 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94824589914448] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d0036070 con 0x563e11ff1f70 2024-02-15T23:30:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.703+0000 7fc9de0ed980 20 remove_watcher() i=2 2024-02-15T23:30:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.703+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94824589920800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff71d0 con 0x7fc9d0027060 2024-02-15T23:30:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.703+0000 7fc9dc409640 1 -- 172.21.15.133:0/476886173 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94824589920800] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9d403c040 con 0x7fc9d0027060 2024-02-15T23:30:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.703+0000 7fc9de0ed980 20 remove_watcher() i=3 2024-02-15T23:30:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.703+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94824589925088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff5a20 con 0x563e11febee0 2024-02-15T23:30:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.707+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94824589925088] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x563e11febee0 2024-02-15T23:30:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.707+0000 7fc9de0ed980 20 remove_watcher() i=4 2024-02-15T23:30:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.707+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94824589917072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff9ae0 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.707+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94824589917072] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.707+0000 7fc9de0ed980 20 remove_watcher() i=5 2024-02-15T23:30:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.707+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94824589927312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ff5a20 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94824589927312] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 20 remove_watcher() i=6 2024-02-15T23:30:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94824589931280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e11ffa390 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94824589931280] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9cc0f2040 con 0x7fc9cc0d03a0 2024-02-15T23:30:51.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 20 remove_watcher() i=7 2024-02-15T23:30:51.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc9cc0d03a0 msgr2=0x7fc9cc0a9ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fc9cc0d03a0 0x7fc9cc0a9ad0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11febee0 msgr2=0x563e11fee380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11febee0 0x563e11fee380 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc9d0027060 msgr2=0x7fc9d00299f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fc9d0027060 0x7fc9d00299f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563e11ff1f70 msgr2=0x563e11ff4360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x563e11ff1f70 0x563e11ff4360 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8a40342b0 msgr2=0x7fc8a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8a40342b0 0x7fc8a4036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4008fd0 tx=0x7fc9d401c070 comp rx=0 tx=0).stop 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 msgr2=0x563e11fe0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9dbc08640 1 -- 172.21.15.133:0/476886173 reap_dead start 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fe0970 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000eed0 tx=0x7fc9d0048c10 comp rx=0 tx=0).stop 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 shutdown_connections 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/476886173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fd9a30 0x563e11fe0970 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 >> 172.21.15.133:0/476886173 conn(0x563e11fd5d70 msgr2=0x563e11fd33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 shutdown_connections 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.711+0000 7fc9de0ed980 1 -- 172.21.15.133:0/476886173 wait complete. 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1552335874 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8b40342b0 msgr2=0x7fc8b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/1552335874 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8b40342b0 0x7fc8b4036770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x563e11fbcff0 tx=0x7fc9d4003070 comp rx=0 tx=0).stop 2024-02-15T23:30:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1552335874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fcca50 msgr2=0x563e11fcce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/1552335874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fcca50 0x563e11fcce70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000e640 tx=0x7fc9d000ea40 comp rx=0 tx=0).stop 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1552335874 shutdown_connections 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/1552335874 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8b40342b0 0x7fc8b4036770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/1552335874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11fcca50 0x563e11fcce70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1552335874 >> 172.21.15.133:0/1552335874 conn(0x563e11fc1860 msgr2=0x563e11fc2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1552335874 shutdown_connections 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/1552335874 wait complete. 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11ec1970 msgr2=0x563e11fbc1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11ec1970 0x563e11fbc1d0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8c40342b0 msgr2=0x7fc8c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8c40342b0 0x7fc8c4036770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0001e50 tx=0x7fc9d00013b0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 msgr2=0x563e11fb5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fb5540 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc01aec0 tx=0x7fc9cc017e30 comp rx=0 tx=0).stop 2024-02-15T23:30:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 shutdown_connections 2024-02-15T23:30:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x563e11ec1970 0x563e11fbc1d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fc8c40342b0 0x7fc8c4036770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 --2- 172.21.15.133:0/141918601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e11ec1050 0x563e11fb5540 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 >> 172.21.15.133:0/141918601 conn(0x563e11ebc920 msgr2=0x563e11fa4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 shutdown_connections 2024-02-15T23:30:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.715+0000 7fc9de0ed980 1 -- 172.21.15.133:0/141918601 wait complete. 2024-02-15T23:30:51.732 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-02-15T23:30:51.732 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-02-15T23:30:51.732 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-15T23:30:51.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-15T23:30:51.732 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-02-15T23:30:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd6a56980 1 Processor -- start 2024-02-15T23:30:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd6a56980 1 -- start start 2024-02-15T23:30:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd6a56980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557b1f8638c0 0x557b1f863ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd6a56980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557b1f7ae4d0 con 0x557b1f8641e0 2024-02-15T23:30:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd6a56980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x557b1f775180 con 0x557b1f8638c0 2024-02-15T23:30:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd4571640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557b1f8638c0 0x557b1f863ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd4571640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x557b1f8638c0 0x557b1f863ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39280/0 (socket says 172.21.15.133:39280) 2024-02-15T23:30:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd4571640 1 -- 172.21.15.133:0/4226034794 learned_addr learned my addr 172.21.15.133:0/4226034794 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd3d70640 1 --1- 172.21.15.133:0/4226034794 >> v1:172.21.15.131:6789/0 conn(0x557b1f8641e0 0x557b1f860330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:35138/0 (socket says 172.21.15.133:35138) 2024-02-15T23:30:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd4571640 1 -- 172.21.15.133:0/4226034794 >> v1:172.21.15.131:6789/0 conn(0x557b1f8641e0 legacy=0x557b1f860330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.807+0000 7f0bd4571640 1 -- 172.21.15.133:0/4226034794 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1f860a40 con 0x557b1f8638c0 2024-02-15T23:30:51.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd4571640 1 --2- 172.21.15.133:0/4226034794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f863ca0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400a5c0 tx=0x7f0bc401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f071ecdfcd3a935 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd356f640 1 -- 172.21.15.133:0/4226034794 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40aa470 con 0x557b1f8638c0 2024-02-15T23:30:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd356f640 1 -- 172.21.15.133:0/4226034794 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40aa5d0 con 0x557b1f8638c0 2024-02-15T23:30:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd356f640 1 -- 172.21.15.133:0/4226034794 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40aa890 con 0x557b1f8638c0 2024-02-15T23:30:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4226034794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 msgr2=0x557b1f863ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/4226034794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f863ca0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400a5c0 tx=0x7f0bc401b340 comp rx=0 tx=0).stop 2024-02-15T23:30:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4226034794 shutdown_connections 2024-02-15T23:30:51.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/4226034794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f863ca0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4226034794 >> 172.21.15.133:0/4226034794 conn(0x557b1f85c070 msgr2=0x557b1f85e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4226034794 shutdown_connections 2024-02-15T23:30:51.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.811+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4226034794 wait complete. 2024-02-15T23:30:51.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.827+0000 7f0bd6a56980 1 Processor -- start 2024-02-15T23:30:51.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.827+0000 7f0bd6a56980 1 -- start start 2024-02-15T23:30:51.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.827+0000 7f0bd6a56980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f94c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.827+0000 7f0bd6a56980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1f7726b0 con 0x557b1f8638c0 2024-02-15T23:30:51.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.827+0000 7f0bd4571640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f94c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.827+0000 7f0bd4571640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f94c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39284/0 (socket says 172.21.15.133:39284) 2024-02-15T23:30:51.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.827+0000 7f0bd4571640 1 -- 172.21.15.133:0/3996413185 learned_addr learned my addr 172.21.15.133:0/3996413185 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.827+0000 7f0bd4571640 1 -- 172.21.15.133:0/3996413185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4005df0 con 0x557b1f8638c0 2024-02-15T23:30:51.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd4571640 1 --2- 172.21.15.133:0/3996413185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f94c780 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ac040 tx=0x7f0bc4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fafca5ddd6543c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0ac260c640 1 -- 172.21.15.133:0/3996413185 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40aa9b0 con 0x557b1f8638c0 2024-02-15T23:30:51.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0ac260c640 1 -- 172.21.15.133:0/3996413185 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40aab30 con 0x557b1f8638c0 2024-02-15T23:30:51.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0ac260c640 1 -- 172.21.15.133:0/3996413185 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40aae10 con 0x557b1f8638c0 2024-02-15T23:30:51.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- 172.21.15.133:0/3996413185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 msgr2=0x557b1f94c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/3996413185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f94c780 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ac040 tx=0x7f0bc4003030 comp rx=0 tx=0).stop 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- 172.21.15.133:0/3996413185 shutdown_connections 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/3996413185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f94c780 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- 172.21.15.133:0/3996413185 >> 172.21.15.133:0/3996413185 conn(0x557b1f85c070 msgr2=0x557b1f948310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- 172.21.15.133:0/3996413185 shutdown_connections 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- 172.21.15.133:0/3996413185 wait complete. 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 Processor -- start 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- start start 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f9534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1f76de90 con 0x557b1f8638c0 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd4571640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f9534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd4571640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f9534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39290/0 (socket says 172.21.15.133:39290) 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd4571640 1 -- 172.21.15.133:0/497274233 learned_addr learned my addr 172.21.15.133:0/497274233 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd4571640 1 -- 172.21.15.133:0/497274233 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1f860a40 con 0x557b1f8638c0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd4571640 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f9534a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4005940 tx=0x7f0bc40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0ac0e09640 1 -- 172.21.15.133:0/497274233 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40c6750 con 0x557b1f8638c0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b1f9539e0 con 0x557b1f8638c0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b1f953e90 con 0x557b1f8638c0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0ac0e09640 1 -- 172.21.15.133:0/497274233 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40c68b0 con 0x557b1f8638c0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.831+0000 7f0ac0e09640 1 -- 172.21.15.133:0/497274233 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc40c6b50 con 0x557b1f8638c0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0ac0e09640 1 -- 172.21.15.133:0/497274233 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0bc40c6cb0 con 0x557b1f8638c0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0ac0e09640 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0abc034350 0x7f0abc036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0ac0e09640 1 -- 172.21.15.133:0/497274233 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0bc40e4400 con 0x557b1f8638c0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd3d70640 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0abc034350 0x7f0abc036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f8641e0 0x557b1f95a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f95a680 con 0x557b1f8641e0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd4d72640 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f8641e0 0x557b1f95a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd3d70640 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0abc034350 0x7f0abc036810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000f70 tx=0x7f0bc8001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd4d72640 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f8641e0 0x557b1f95a140 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd4d72640 1 -- 172.21.15.133:0/497274233 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f95aa90 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd4d72640 1 -- 172.21.15.133:0/497274233 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f95c340 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd4d72640 1 -- 172.21.15.133:0/497274233 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f95b540 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd4d72640 1 -- 172.21.15.133:0/497274233 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f95b950 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd4d72640 1 -- 172.21.15.133:0/497274233 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x557b1f8641e0 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd6a56980 1 Processor -- start 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.835+0000 7f0bd6a56980 1 -- start start 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd6a56980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8631a0 0x557b1f861640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd6a56980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1f706f20 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd3d70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8631a0 0x557b1f861640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd3d70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8631a0 0x557b1f861640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39298/0 (socket says 172.21.15.133:39298) 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1917539768 learned_addr learned my addr 172.21.15.133:0/1917539768 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1917539768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1f861b80 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd3d70640 1 --2- 172.21.15.133:0/1917539768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8631a0 0x557b1f861640 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8001ee0 tx=0x7f0bc800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0ab9ffb640 1 -- 172.21.15.133:0/1917539768 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc8007040 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1917539768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b1f861e30 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0ab9ffb640 1 -- 172.21.15.133:0/1917539768 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800d660 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0ab9ffb640 1 -- 172.21.15.133:0/1917539768 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc800d900 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1917539768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b1f8622c0 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0ab9ffb640 1 -- 172.21.15.133:0/1917539768 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0bc801a070 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0ab9ffb640 1 --2- 172.21.15.133:0/1917539768 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aac0342b0 0x7f0aac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0ab9ffb640 1 -- 172.21.15.133:0/1917539768 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0bc8017050 con 0x557b1f8631a0 2024-02-15T23:30:51.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd4d72640 1 --2- 172.21.15.133:0/1917539768 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aac0342b0 0x7f0aac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd6a56980 1 Processor -- start 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd6a56980 1 -- start start 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd4d72640 1 --2- 172.21.15.133:0/1917539768 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aac0342b0 0x7f0aac036770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x557b1f95af80 tx=0x7f0bcc005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd6a56980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f97a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.839+0000 7f0bd6a56980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1f6fa790 con 0x557b1f979d50 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f97a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f97a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39312/0 (socket says 172.21.15.133:39312) 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 -- 172.21.15.133:0/4053052046 learned_addr learned my addr 172.21.15.133:0/4053052046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 -- 172.21.15.133:0/4053052046 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1f97a720 con 0x557b1f979d50 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 --2- 172.21.15.133:0/4053052046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f97a150 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0bc801bfd0 tx=0x7f0bc8024380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7024514700f34d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0ab37fe640 1 -- 172.21.15.133:0/4053052046 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc801a4e0 con 0x557b1f979d50 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0ab37fe640 1 -- 172.21.15.133:0/4053052046 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8048e90 con 0x557b1f979d50 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0ab37fe640 1 -- 172.21.15.133:0/4053052046 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc801a770 con 0x557b1f979d50 2024-02-15T23:30:51.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4053052046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 msgr2=0x557b1f97a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/4053052046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f97a150 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0bc801bfd0 tx=0x7f0bc8024380 comp rx=0 tx=0).stop 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4053052046 shutdown_connections 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/4053052046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f97a150 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4053052046 >> 172.21.15.133:0/4053052046 conn(0x557b1f976090 msgr2=0x557b1f9740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4053052046 shutdown_connections 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- 172.21.15.133:0/4053052046 wait complete. 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 Processor -- start 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- start start 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f980c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1f981150 con 0x557b1f979d50 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f980c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f980c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39316/0 (socket says 172.21.15.133:39316) 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 learned_addr learned my addr 172.21.15.133:0/1082527737 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1f8622c0 con 0x557b1f979d50 2024-02-15T23:30:51.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd3d70640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f980c10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0bc803d040 tx=0x7f0bc8048ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0ab1ffb640 1 -- 172.21.15.133:0/1082527737 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc8024d40 con 0x557b1f979d50 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b1f981350 con 0x557b1f979d50 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b1f9817e0 con 0x557b1f979d50 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0ab1ffb640 1 -- 172.21.15.133:0/1082527737 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc804aba0 con 0x557b1f979d50 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.843+0000 7f0ab1ffb640 1 -- 172.21.15.133:0/1082527737 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc8024ea0 con 0x557b1f979d50 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0ab1ffb640 1 -- 172.21.15.133:0/1082527737 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0bc8041050 con 0x557b1f979d50 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0ab1ffb640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aa40342b0 0x7f0aa4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0ab1ffb640 1 -- 172.21.15.133:0/1082527737 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0bc8006070 con 0x557b1f979d50 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4d72640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aa40342b0 0x7f0aa4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f98c1f0 0x557b1f98e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f98edc0 con 0x557b1f98c1f0 2024-02-15T23:30:51.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4571640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f98c1f0 0x557b1f98e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4d72640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aa40342b0 0x7f0aa4036770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc011010 tx=0x7f0bcc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4571640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f98c1f0 0x557b1f98e670 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0bc40b0020 con 0x557b1f98c1f0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 realm 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f98f190 con 0x557b1f98c1f0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0bc40b0020 con 0x557b1f98c1f0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f98f9e0 con 0x557b1f98c1f0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f98fd40 con 0x557b1f98c1f0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f98f680 con 0x557b1f98c1f0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 20 searching for the correct realm 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b1f991f90 0x557b1f9943e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.847+0000 7f0bd3d70640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b1f991f90 0x557b1f9943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd3d70640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b1f991f90 0x557b1f9943e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd3d70640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0bc8027060 0x7f0bc8047390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc8027060 2024-02-15T23:30:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4d72640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0bc8027060 0x7f0bc8047390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4d72640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0bc8027060 0x7f0bc8047390 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8027060 2024-02-15T23:30:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc8027060 2024-02-15T23:30:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8027060 2024-02-15T23:30:51.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f98c1f0 2024-02-15T23:30:51.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f98c1f0 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0bc40d0060 0x7f0bc40c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc40d0060 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0bc40d0060 0x7f0bc40c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0bc40d0060 0x7f0bc40c73f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x7f0bc40d0060 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.851+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc40d0060 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x7f0bc40d0060 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc8027060 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bcc00a4d0 con 0x7f0bc8027060 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f98c1f0 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc40d0060 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x7f0bc40d0060 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f98c1f0 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc8027060 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc40d0060 2024-02-15T23:30:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x7f0bc40d0060 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.855+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f98c1f0 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f98c1f0 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc40d0060 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x7f0bc40d0060 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc8027060 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f98c1f0 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc40da040 con 0x557b1f98c1f0 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc8027060 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.859+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc40d0060 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc8027060 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f991f90 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc40d0060 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x557b1f98c1f0 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f994ab0 con 0x7f0bc8027060 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f990be0 con 0x557b1f98c1f0 2024-02-15T23:30:51.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f990860 con 0x557b1f98c1f0 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f991460 con 0x557b1f98c1f0 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 zone default found 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 4 Realm: () 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 zonegroup default 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f991460 con 0x7f0bc8027060 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9968d0 con 0x557b1f991f90 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.863+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f996ca0 con 0x557b1f991f90 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd6a56980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd6a56980 20 started sync module instance, tier type = 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd6a56980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9961b0 con 0x7f0bc8027060 2024-02-15T23:30:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93987299482896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f996560 con 0x7f0bc8027060 2024-02-15T23:30:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f997a00 con 0x557b1f98c1f0 2024-02-15T23:30:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93987299482896] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93987299487936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9979c0 con 0x557b1f98c1f0 2024-02-15T23:30:51.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.867+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f998470 con 0x557b1f991f90 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.871+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93987299487936] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.871+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.871+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93987299491696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f998820 con 0x557b1f991f90 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.871+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f999190 con 0x7f0bc8027060 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.871+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.871+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93987299495456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9999e0 con 0x7f0bc8027060 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.871+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f99a400 con 0x557b1f98c1f0 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.875+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93987299491696] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.875+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93987299495456] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.875+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.875+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93987299499744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f999540 con 0x557b1f98c1f0 2024-02-15T23:30:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.875+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f99ac50 con 0x7f0bc40d0060 2024-02-15T23:30:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.879+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93987299499744] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.879+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.879+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93987299488992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f999540 con 0x7f0bc40d0060 2024-02-15T23:30:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.879+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f99b260 con 0x7f0bc40d0060 2024-02-15T23:30:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.879+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93987299488992] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.879+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.879+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93987299502000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f99b260 con 0x7f0bc40d0060 2024-02-15T23:30:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.879+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f99bbd0 con 0x7f0bc40d0060 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93987299502000] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93987299503552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f99bdb0 con 0x7f0bc40d0060 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 20 add_watcher() i=0 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 20 add_watcher() i=1 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 20 add_watcher() i=2 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 20 add_watcher() i=3 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 20 add_watcher() i=4 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 20 add_watcher() i=5 2024-02-15T23:30:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 20 add_watcher() i=6 2024-02-15T23:30:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93987299503552] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 20 add_watcher() i=7 2024-02-15T23:30:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:51.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f99efb0 con 0x557b1f98c1f0 2024-02-15T23:30:51.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.883+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93987299506544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f99c230 con 0x557b1f98c1f0 2024-02-15T23:30:51.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93987299506544] v33'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0a8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:51.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:51.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 5 note: GC not initialized 2024-02-15T23:30:51.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0a897e2640 20 reqs_thread_entry: start 2024-02-15T23:30:51.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 20 Filter name: none 2024-02-15T23:30:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f09faffd640 20 reqs_thread_entry: start 2024-02-15T23:30:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 20 rados->read ofs=0 len=0 2024-02-15T23:30:51.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9c0aa0 con 0x557b1f98c1f0 2024-02-15T23:30:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:30:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9c0aa0 con 0x7f0bc40d0060 2024-02-15T23:30:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.887+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv31 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.891+0000 7f0a8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:51.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.891+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93987299506544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9c0aa0 con 0x557b1f98c1f0 2024-02-15T23:30:51.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.891+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93987299506544] v33'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.891+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93987299482896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9c0aa0 con 0x7f0bc8027060 2024-02-15T23:30:51.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.891+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93987299482896] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.891+0000 7f0bd6a56980 20 remove_watcher() i=0 2024-02-15T23:30:51.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.891+0000 7f0bd6a56980 2 removed watcher, disabling cache 2024-02-15T23:30:51.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.891+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93987299487936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9c0aa0 con 0x557b1f98c1f0 2024-02-15T23:30:51.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.895+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93987299487936] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.895+0000 7f0bd6a56980 20 remove_watcher() i=1 2024-02-15T23:30:51.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.895+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93987299491696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9c0aa0 con 0x557b1f991f90 2024-02-15T23:30:51.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.895+0000 7f0bd3d70640 1 -- 172.21.15.133:0/1082527737 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93987299491696] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc801ccd0 con 0x557b1f991f90 2024-02-15T23:30:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.895+0000 7f0bd6a56980 20 remove_watcher() i=2 2024-02-15T23:30:51.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.895+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93987299495456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f995d10 con 0x7f0bc8027060 2024-02-15T23:30:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.899+0000 7f0bd4d72640 1 -- 172.21.15.133:0/1082527737 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93987299495456] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bcc039060 con 0x7f0bc8027060 2024-02-15T23:30:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.899+0000 7f0bd6a56980 20 remove_watcher() i=3 2024-02-15T23:30:51.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.899+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93987299499744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f9970c0 con 0x557b1f98c1f0 2024-02-15T23:30:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.899+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93987299499744] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x557b1f98c1f0 2024-02-15T23:30:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.899+0000 7f0bd6a56980 20 remove_watcher() i=4 2024-02-15T23:30:51.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.899+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93987299488992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f997f70 con 0x7f0bc40d0060 2024-02-15T23:30:51.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.903+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93987299488992] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.903+0000 7f0bd6a56980 20 remove_watcher() i=5 2024-02-15T23:30:51.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.903+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93987299502000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f997560 con 0x7f0bc40d0060 2024-02-15T23:30:51.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.903+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93987299502000] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.903+0000 7f0bd6a56980 20 remove_watcher() i=6 2024-02-15T23:30:51.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.903+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93987299503552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b1f997560 con 0x7f0bc40d0060 2024-02-15T23:30:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93987299503552] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0bc4101040 con 0x7f0bc40d0060 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 20 remove_watcher() i=7 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0bc40d0060 msgr2=0x7f0bc40c73f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0bc40d0060 0x7f0bc40c73f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f98c1f0 msgr2=0x557b1f98e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f98c1f0 0x557b1f98e670 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0bc8027060 msgr2=0x7f0bc8047390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0bc8027060 0x7f0bc8047390 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b1f991f90 msgr2=0x557b1f9943e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x557b1f991f90 0x557b1f9943e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aa40342b0 msgr2=0x7f0aa4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aa40342b0 0x7f0aa4036770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc011010 tx=0x7f0bcc020000 comp rx=0 tx=0).stop 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd4571640 1 -- 172.21.15.133:0/1082527737 reap_dead start 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 msgr2=0x557b1f980c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f980c10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0bc803d040 tx=0x7f0bc8048ce0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 shutdown_connections 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1082527737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f979d50 0x557b1f980c10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 >> 172.21.15.133:0/1082527737 conn(0x557b1f976090 msgr2=0x557b1f9736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 shutdown_connections 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1082527737 wait complete. 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1917539768 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aac0342b0 msgr2=0x7f0aac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1917539768 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aac0342b0 0x7f0aac036770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x557b1f95af80 tx=0x7f0bcc005850 comp rx=0 tx=0).stop 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1917539768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8631a0 msgr2=0x557b1f861640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1917539768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8631a0 0x557b1f861640 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8001ee0 tx=0x7f0bc800ea10 comp rx=0 tx=0).stop 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1917539768 shutdown_connections 2024-02-15T23:30:51.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1917539768 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0aac0342b0 0x7f0aac036770 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/1917539768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8631a0 0x557b1f861640 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1917539768 >> 172.21.15.133:0/1917539768 conn(0x557b1f95f7f0 msgr2=0x557b1f960300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1917539768 shutdown_connections 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/1917539768 wait complete. 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f8641e0 msgr2=0x557b1f95a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f8641e0 0x557b1f95a140 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0abc034350 msgr2=0x7f0abc036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0abc034350 0x7f0abc036810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000f70 tx=0x7f0bc8001380 comp rx=0 tx=0).stop 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 msgr2=0x557b1f9534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f9534a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4005940 tx=0x7f0bc40180e0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 shutdown_connections 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x557b1f8641e0 0x557b1f95a140 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0abc034350 0x7f0abc036810 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 --2- 172.21.15.133:0/497274233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b1f8638c0 0x557b1f9534a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 >> 172.21.15.133:0/497274233 conn(0x557b1f85c070 msgr2=0x557b1f946e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 shutdown_connections 2024-02-15T23:30:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.907+0000 7f0bd6a56980 1 -- 172.21.15.133:0/497274233 wait complete. 2024-02-15T23:30:51.925 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-02-15T23:30:51.926 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-02-15T23:30:51.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-15T23:30:51.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-15T23:30:51.926 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-02-15T23:30:52.005 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:52.005 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:52.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ef311980 1 Processor -- start 2024-02-15T23:30:52.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ef311980 1 -- start start 2024-02-15T23:30:52.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ef311980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5622ae230360 0x5622ae230740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ef311980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5622ae17a4d0 con 0x5622ae230c80 2024-02-15T23:30:52.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ef311980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5622ae141180 con 0x5622ae230360 2024-02-15T23:30:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ece2c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5622ae230360 0x5622ae230740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ec62b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5622ae230c80 0x5622ae231630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:35146/0 (socket says 172.21.15.133:35146) 2024-02-15T23:30:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ece2c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5622ae230360 0x5622ae230740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39322/0 (socket says 172.21.15.133:39322) 2024-02-15T23:30:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ec62b640 1 -- 172.21.15.133:0/173646834 learned_addr learned my addr 172.21.15.133:0/173646834 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ece2c640 1 -- 172.21.15.133:0/173646834 >> v1:172.21.15.131:6789/0 conn(0x5622ae230c80 legacy=0x5622ae231630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:51.999+0000 7f70ece2c640 1 -- 172.21.15.133:0/173646834 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622ae231e60 con 0x5622ae230360 2024-02-15T23:30:52.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ece2c640 1 --2- 172.21.15.133:0/173646834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae230740 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00a420 tx=0x7f70dc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8877930fa2d3c881 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ebe2a640 1 -- 172.21.15.133:0/173646834 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70dc0aa530 con 0x5622ae230360 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ebe2a640 1 -- 172.21.15.133:0/173646834 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc0a6050 con 0x5622ae230360 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ebe2a640 1 -- 172.21.15.133:0/173646834 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70dc0aa800 con 0x5622ae230360 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ef311980 1 -- 172.21.15.133:0/173646834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 msgr2=0x5622ae230740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ef311980 1 --2- 172.21.15.133:0/173646834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae230740 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00a420 tx=0x7f70dc01afd0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ef311980 1 -- 172.21.15.133:0/173646834 shutdown_connections 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ef311980 1 --2- 172.21.15.133:0/173646834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae230740 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ef311980 1 -- 172.21.15.133:0/173646834 >> 172.21.15.133:0/173646834 conn(0x5622ae1a3a50 msgr2=0x5622ae1a3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ef311980 1 -- 172.21.15.133:0/173646834 shutdown_connections 2024-02-15T23:30:52.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.003+0000 7f70ef311980 1 -- 172.21.15.133:0/173646834 wait complete. 2024-02-15T23:30:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ef311980 1 Processor -- start 2024-02-15T23:30:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ef311980 1 -- start start 2024-02-15T23:30:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ef311980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae31a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ef311980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ae13e6b0 con 0x5622ae230360 2024-02-15T23:30:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ece2c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae31a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ece2c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae31a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39338/0 (socket says 172.21.15.133:39338) 2024-02-15T23:30:52.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ece2c640 1 -- 172.21.15.133:0/3475997817 learned_addr learned my addr 172.21.15.133:0/3475997817 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ece2c640 1 -- 172.21.15.133:0/3475997817 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc00a100 con 0x5622ae230360 2024-02-15T23:30:52.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.019+0000 7f70ece2c640 1 --2- 172.21.15.133:0/3475997817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae31a850 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0ad040 tx=0x7f70dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fc8bdf4c942449 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f6fdae0d640 1 -- 172.21.15.133:0/3475997817 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70dc0aa6c0 con 0x5622ae230360 2024-02-15T23:30:52.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f6fdae0d640 1 -- 172.21.15.133:0/3475997817 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc0aa820 con 0x5622ae230360 2024-02-15T23:30:52.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f6fdae0d640 1 -- 172.21.15.133:0/3475997817 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70dc0aaac0 con 0x5622ae230360 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- 172.21.15.133:0/3475997817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 msgr2=0x5622ae31a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 --2- 172.21.15.133:0/3475997817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae31a850 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0ad040 tx=0x7f70dc0033b0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- 172.21.15.133:0/3475997817 shutdown_connections 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 --2- 172.21.15.133:0/3475997817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae31a850 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- 172.21.15.133:0/3475997817 >> 172.21.15.133:0/3475997817 conn(0x5622ae1a3a50 msgr2=0x5622ae3163e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- 172.21.15.133:0/3475997817 shutdown_connections 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- 172.21.15.133:0/3475997817 wait complete. 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 Processor -- start 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- start start 2024-02-15T23:30:52.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae321500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ae139e90 con 0x5622ae230360 2024-02-15T23:30:52.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ece2c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae321500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ece2c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae321500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39350/0 (socket says 172.21.15.133:39350) 2024-02-15T23:30:52.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ece2c640 1 -- 172.21.15.133:0/2569896215 learned_addr learned my addr 172.21.15.133:0/2569896215 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ece2c640 1 -- 172.21.15.133:0/2569896215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622ae231e60 con 0x5622ae230360 2024-02-15T23:30:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ece2c640 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae321500 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f70dc003430 tx=0x7f70dc019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f6fd960a640 1 -- 172.21.15.133:0/2569896215 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70dc0b6950 con 0x5622ae230360 2024-02-15T23:30:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622ae321a40 con 0x5622ae230360 2024-02-15T23:30:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f6fd960a640 1 -- 172.21.15.133:0/2569896215 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc0b6ab0 con 0x5622ae230360 2024-02-15T23:30:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f6fd960a640 1 -- 172.21.15.133:0/2569896215 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70dc0b6d50 con 0x5622ae230360 2024-02-15T23:30:52.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.023+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622ae321ed0 con 0x5622ae230360 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f6fd960a640 1 -- 172.21.15.133:0/2569896215 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70dc0c0450 con 0x5622ae230360 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f6fd960a640 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fd40342b0 0x7f6fd4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f6fd960a640 1 -- 172.21.15.133:0/2569896215 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f70dc0e4070 con 0x5622ae230360 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ec62b640 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fd40342b0 0x7f6fd4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae230c80 0x5622ae328140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae328680 con 0x5622ae230c80 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ed62d640 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae230c80 0x5622ae328140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ec62b640 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fd40342b0 0x7f6fd4036770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70d4001da0 tx=0x7f70d4001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ed62d640 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae230c80 0x5622ae328140 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ed62d640 1 -- 172.21.15.133:0/2569896215 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70e40083f0 con 0x5622ae230c80 2024-02-15T23:30:52.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae328a40 con 0x5622ae230c80 2024-02-15T23:30:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ed62d640 1 -- 172.21.15.133:0/2569896215 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f70e40083f0 con 0x5622ae230c80 2024-02-15T23:30:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae32a2f0 con 0x5622ae230c80 2024-02-15T23:30:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ed62d640 1 -- 172.21.15.133:0/2569896215 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f70e40083f0 con 0x5622ae230c80 2024-02-15T23:30:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae3294f0 con 0x5622ae230c80 2024-02-15T23:30:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ed62d640 1 -- 172.21.15.133:0/2569896215 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f70e40083f0 con 0x5622ae230c80 2024-02-15T23:30:52.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae329900 con 0x5622ae230c80 2024-02-15T23:30:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ed62d640 1 -- 172.21.15.133:0/2569896215 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f70e4012040 con 0x5622ae230c80 2024-02-15T23:30:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 Processor -- start 2024-02-15T23:30:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 -- start start 2024-02-15T23:30:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae3389b0 0x5622ae338dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.027+0000 7f70ef311980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ae0d2f20 con 0x5622ae3389b0 2024-02-15T23:30:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ec62b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae3389b0 0x5622ae338dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ec62b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae3389b0 0x5622ae338dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39358/0 (socket says 172.21.15.133:39358) 2024-02-15T23:30:52.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ec62b640 1 -- 172.21.15.133:0/67990919 learned_addr learned my addr 172.21.15.133:0/67990919 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ec62b640 1 -- 172.21.15.133:0/67990919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622ae339310 con 0x5622ae3389b0 2024-02-15T23:30:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ec62b640 1 --2- 172.21.15.133:0/67990919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae3389b0 0x5622ae338dd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f70d400d660 tx=0x7f70d400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f6fd27fc640 1 -- 172.21.15.133:0/67990919 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70d4020070 con 0x5622ae3389b0 2024-02-15T23:30:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ef311980 1 -- 172.21.15.133:0/67990919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622ae339560 con 0x5622ae3389b0 2024-02-15T23:30:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f6fd27fc640 1 -- 172.21.15.133:0/67990919 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d400c770 con 0x5622ae3389b0 2024-02-15T23:30:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ef311980 1 -- 172.21.15.133:0/67990919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622ae33a0b0 con 0x5622ae3389b0 2024-02-15T23:30:52.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f6fd27fc640 1 -- 172.21.15.133:0/67990919 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70d4013040 con 0x5622ae3389b0 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f6fd27fc640 1 -- 172.21.15.133:0/67990919 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70d400a040 con 0x5622ae3389b0 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f6fd27fc640 1 --2- 172.21.15.133:0/67990919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fc40342b0 0x7f6fc4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f6fd27fc640 1 -- 172.21.15.133:0/67990919 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f70d404b670 con 0x5622ae3389b0 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ed62d640 1 --2- 172.21.15.133:0/67990919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fc40342b0 0x7f6fc4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ef311980 1 Processor -- start 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ef311980 1 -- start start 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ed62d640 1 --2- 172.21.15.133:0/67990919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fc40342b0 0x7f6fc4036770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5622ae328f30 tx=0x7f70e4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ef311980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae345da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ef311980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ae0c6790 con 0x5622ae345980 2024-02-15T23:30:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ec62b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae345da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ec62b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae345da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39370/0 (socket says 172.21.15.133:39370) 2024-02-15T23:30:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.031+0000 7f70ec62b640 1 -- 172.21.15.133:0/41253360 learned_addr learned my addr 172.21.15.133:0/41253360 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ec62b640 1 -- 172.21.15.133:0/41253360 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622ae346370 con 0x5622ae345980 2024-02-15T23:30:52.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ec62b640 1 --2- 172.21.15.133:0/41253360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae345da0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f70d40499c0 tx=0x7f70d4019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef32a6960fe6b0da server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f6fc3fff640 1 -- 172.21.15.133:0/41253360 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70d401aac0 con 0x5622ae345980 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f6fc3fff640 1 -- 172.21.15.133:0/41253360 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4040030 con 0x5622ae345980 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f6fc3fff640 1 -- 172.21.15.133:0/41253360 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70d401acc0 con 0x5622ae345980 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- 172.21.15.133:0/41253360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 msgr2=0x5622ae345da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 --2- 172.21.15.133:0/41253360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae345da0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f70d40499c0 tx=0x7f70d4019f10 comp rx=0 tx=0).stop 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- 172.21.15.133:0/41253360 shutdown_connections 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 --2- 172.21.15.133:0/41253360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae345da0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- 172.21.15.133:0/41253360 >> 172.21.15.133:0/41253360 conn(0x5622ae341d10 msgr2=0x5622ae33fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- 172.21.15.133:0/41253360 shutdown_connections 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- 172.21.15.133:0/41253360 wait complete. 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 Processor -- start 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- start start 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae34c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ae34ce20 con 0x5622ae345980 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ec62b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae34c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ec62b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae34c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39384/0 (socket says 172.21.15.133:39384) 2024-02-15T23:30:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 learned_addr learned my addr 172.21.15.133:0/232792486 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622ae33a0b0 con 0x5622ae345980 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ec62b640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae34c8e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f70d40198a0 tx=0x7f70d4049950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f6fc27fc640 1 -- 172.21.15.133:0/232792486 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70d4024580 con 0x5622ae345980 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622ae34d020 con 0x5622ae345980 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622ae34d450 con 0x5622ae345980 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f6fc27fc640 1 -- 172.21.15.133:0/232792486 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4033070 con 0x5622ae345980 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.035+0000 7f6fc27fc640 1 -- 172.21.15.133:0/232792486 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70d4024720 con 0x5622ae345980 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f6fc27fc640 1 -- 172.21.15.133:0/232792486 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70d4024880 con 0x5622ae345980 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f6fc27fc640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fb80342b0 0x7f6fb8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f6fc27fc640 1 -- 172.21.15.133:0/232792486 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f70d403ad50 con 0x5622ae345980 2024-02-15T23:30:52.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ed62d640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fb80342b0 0x7f6fb8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae357e60 0x5622ae35a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ece2c640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae357e60 0x5622ae35a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae35aa70 con 0x5622ae357e60 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ed62d640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fb80342b0 0x7f6fb8036770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f70e4008fd0 tx=0x7f70e401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ece2c640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae357e60 0x5622ae35a320 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 realm 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae35ae40 con 0x5622ae357e60 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:52.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae35b690 con 0x5622ae357e60 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae35b9f0 con 0x5622ae357e60 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae35b2f0 con 0x5622ae357e60 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 20 searching for the correct realm 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5622ae35dd70 0x5622ae360160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ec62b640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5622ae35dd70 0x5622ae360160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ec62b640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5622ae35dd70 0x5622ae360160 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4022070 con 0x5622ae35dd70 2024-02-15T23:30:52.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ec62b640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f70d4056040 0x7f70d4029130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70d4056040 2024-02-15T23:30:52.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.039+0000 7f70ed62d640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f70d4056040 0x7f70d4029130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ed62d640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f70d4056040 0x7f70d4029130 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70e402c040 con 0x7f70d4056040 2024-02-15T23:30:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70d4056040 2024-02-15T23:30:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70e402c040 con 0x7f70d4056040 2024-02-15T23:30:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae357e60 2024-02-15T23:30:52.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae357e60 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f70dc0c9020 0x7f70dc0a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70dc0c9020 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f70dc0c9020 0x7f70dc0a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f70dc0c9020 0x7f70dc0a95c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x7f70dc0c9020 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70dc0c9020 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x7f70dc0c9020 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70d4056040 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70e402c040 con 0x7f70d4056040 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4022070 con 0x5622ae35dd70 2024-02-15T23:30:52.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.043+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae357e60 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70dc0c9020 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x7f70dc0c9020 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae357e60 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70d4056040 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f70e402c040 con 0x7f70d4056040 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4022070 con 0x5622ae35dd70 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4022070 con 0x5622ae35dd70 2024-02-15T23:30:52.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70dc0c9020 2024-02-15T23:30:52.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x7f70dc0c9020 2024-02-15T23:30:52.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae357e60 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae357e60 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.047+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70dc0c9020 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x7f70dc0c9020 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70d4056040 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70e402c040 con 0x7f70d4056040 2024-02-15T23:30:52.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae357e60 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x5622ae357e60 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70d4056040 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70e402c040 con 0x7f70d4056040 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70dc0c9020 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x7f70dc0c9020 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70d4056040 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae35dd70 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70dc0c9020 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70dc0c6070 con 0x7f70dc0c9020 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.051+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x5622ae357e60 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360740 con 0x7f70d4056040 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae35c820 con 0x5622ae357e60 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae35c4a0 con 0x5622ae357e60 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae35d120 con 0x5622ae357e60 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 zone default found 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 4 Realm: () 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:52.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 zonegroup default 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae360b80 con 0x7f70d4056040 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae362a00 con 0x5622ae35dd70 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae362d60 con 0x5622ae35dd70 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 started sync module instance, tier type = 2024-02-15T23:30:52.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:52.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae361fd0 con 0x7f70d4056040 2024-02-15T23:30:52.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94706951660416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae361fd0 con 0x7f70d4056040 2024-02-15T23:30:52.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.055+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae3636d0 con 0x5622ae357e60 2024-02-15T23:30:52.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.059+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94706951660416] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.059+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.059+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94706951664480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae361fd0 con 0x5622ae357e60 2024-02-15T23:30:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.059+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae364090 con 0x5622ae35dd70 2024-02-15T23:30:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.059+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94706951664480] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94706951658288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae361f50 con 0x5622ae35dd70 2024-02-15T23:30:52.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae364e00 con 0x7f70d4056040 2024-02-15T23:30:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94706951669984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae365650 con 0x7f70d4056040 2024-02-15T23:30:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae366020 con 0x5622ae357e60 2024-02-15T23:30:52.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94706951658288] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94706951669984] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94706951674656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae3651b0 con 0x5622ae357e60 2024-02-15T23:30:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.063+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae366870 con 0x7f70dc0c9020 2024-02-15T23:30:52.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.067+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.067+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94706951676880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae3651b0 con 0x7f70dc0c9020 2024-02-15T23:30:52.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.067+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae367340 con 0x7f70dc0c9020 2024-02-15T23:30:52.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.067+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94706951674656] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.067+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94706951676880] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.067+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.067+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94706951677936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae366e30 con 0x7f70dc0c9020 2024-02-15T23:30:52.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.067+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae3677e0 con 0x7f70dc0c9020 2024-02-15T23:30:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94706951677936] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94706951668800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae3677e0 con 0x7f70dc0c9020 2024-02-15T23:30:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 20 add_watcher() i=0 2024-02-15T23:30:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 20 add_watcher() i=1 2024-02-15T23:30:52.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 20 add_watcher() i=2 2024-02-15T23:30:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 20 add_watcher() i=3 2024-02-15T23:30:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 20 add_watcher() i=4 2024-02-15T23:30:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 20 add_watcher() i=5 2024-02-15T23:30:52.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 20 add_watcher() i=6 2024-02-15T23:30:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94706951668800] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 20 add_watcher() i=7 2024-02-15T23:30:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:52.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.071+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae36abd0 con 0x5622ae357e60 2024-02-15T23:30:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94706951681296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae368070 con 0x5622ae357e60 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94706951681296] v33'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f6fa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 5 note: GC not initialized 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f6fa1fe3640 20 reqs_thread_entry: start 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 20 Filter name: none 2024-02-15T23:30:52.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f6f137fe640 20 reqs_thread_entry: start 2024-02-15T23:30:52.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae38c6c0 con 0x5622ae357e60 2024-02-15T23:30:52.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:30:52.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae38c6c0 con 0x7f70dc0c9020 2024-02-15T23:30:52.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.075+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv31 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.079+0000 7f6fa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:52.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.079+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94706951681296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae38c6c0 con 0x5622ae357e60 2024-02-15T23:30:52.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.079+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94706951681296] v33'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.079+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94706951660416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae38c6c0 con 0x7f70d4056040 2024-02-15T23:30:52.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.079+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94706951660416] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.079+0000 7f70ef311980 20 remove_watcher() i=0 2024-02-15T23:30:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.079+0000 7f70ef311980 2 removed watcher, disabling cache 2024-02-15T23:30:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.079+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94706951664480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae38c6c0 con 0x5622ae357e60 2024-02-15T23:30:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94706951664480] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ef311980 20 remove_watcher() i=1 2024-02-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94706951658288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae38c6c0 con 0x5622ae35dd70 2024-02-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ec62b640 1 -- 172.21.15.133:0/232792486 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94706951658288] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70d4060040 con 0x5622ae35dd70 2024-02-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ef311980 20 remove_watcher() i=2 2024-02-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94706951669984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae361b30 con 0x7f70d4056040 2024-02-15T23:30:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ed62d640 1 -- 172.21.15.133:0/232792486 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94706951669984] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70e403c040 con 0x7f70d4056040 2024-02-15T23:30:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ef311980 20 remove_watcher() i=3 2024-02-15T23:30:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.083+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94706951674656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae361b30 con 0x5622ae357e60 2024-02-15T23:30:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.087+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94706951674656] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x5622ae357e60 2024-02-15T23:30:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.087+0000 7f70ef311980 20 remove_watcher() i=4 2024-02-15T23:30:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.087+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94706951676880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae361b30 con 0x7f70dc0c9020 2024-02-15T23:30:52.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.087+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94706951676880] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.087+0000 7f70ef311980 20 remove_watcher() i=5 2024-02-15T23:30:52.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.087+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94706951677936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae3663d0 con 0x7f70dc0c9020 2024-02-15T23:30:52.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94706951677936] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 20 remove_watcher() i=6 2024-02-15T23:30:52.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94706951668800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622ae361b30 con 0x7f70dc0c9020 2024-02-15T23:30:52.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94706951668800] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70dc0f6080 con 0x7f70dc0c9020 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 20 remove_watcher() i=7 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f70dc0c9020 msgr2=0x7f70dc0a95c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f70dc0c9020 0x7f70dc0a95c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae357e60 msgr2=0x5622ae35a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae357e60 0x5622ae35a320 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f70d4056040 msgr2=0x7f70d4029130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f70d4056040 0x7f70d4029130 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5622ae35dd70 msgr2=0x5622ae360160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5622ae35dd70 0x5622ae360160 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fb80342b0 msgr2=0x7f6fb8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fb80342b0 0x7f6fb8036770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f70e4008fd0 tx=0x7f70e401c070 comp rx=0 tx=0).stop 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 msgr2=0x5622ae34c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ece2c640 1 -- 172.21.15.133:0/232792486 reap_dead start 2024-02-15T23:30:52.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae34c8e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f70d40198a0 tx=0x7f70d4049950 comp rx=0 tx=0).stop 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 shutdown_connections 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 --2- 172.21.15.133:0/232792486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae345980 0x5622ae34c8e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 >> 172.21.15.133:0/232792486 conn(0x5622ae341d10 msgr2=0x5622ae33f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 shutdown_connections 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/232792486 wait complete. 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.091+0000 7f70ef311980 1 -- 172.21.15.133:0/67990919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fc40342b0 msgr2=0x7f6fc4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/67990919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fc40342b0 0x7f6fc4036770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5622ae328f30 tx=0x7f70e4003070 comp rx=0 tx=0).stop 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/67990919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae3389b0 msgr2=0x5622ae338dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/67990919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae3389b0 0x5622ae338dd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f70d400d660 tx=0x7f70d400da60 comp rx=0 tx=0).stop 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/67990919 shutdown_connections 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/67990919 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fc40342b0 0x7f6fc4036770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/67990919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae3389b0 0x5622ae338dd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/67990919 >> 172.21.15.133:0/67990919 conn(0x5622ae32d7c0 msgr2=0x5622ae32e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/67990919 shutdown_connections 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/67990919 wait complete. 2024-02-15T23:30:52.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae230c80 msgr2=0x5622ae328140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae230c80 0x5622ae328140 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fd40342b0 msgr2=0x7f6fd4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fd40342b0 0x7f6fd4036770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70d4001da0 tx=0x7f70d4001300 comp rx=0 tx=0).stop 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 msgr2=0x5622ae321500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae321500 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f70dc003430 tx=0x7f70dc019810 comp rx=0 tx=0).stop 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 shutdown_connections 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5622ae230c80 0x5622ae328140 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6fd40342b0 0x7f6fd4036770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 --2- 172.21.15.133:0/2569896215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622ae230360 0x5622ae321500 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 >> 172.21.15.133:0/2569896215 conn(0x5622ae1a3a50 msgr2=0x5622ae314ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 shutdown_connections 2024-02-15T23:30:52.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.095+0000 7f70ef311980 1 -- 172.21.15.133:0/2569896215 wait complete. 2024-02-15T23:30:52.110 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-15T23:00:00.000000Z","epoch":1708038000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-02-15T23:30:52.110 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-15T23:00:00.000000Z', 'epoch': 1708038000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-02-15T23:30:52.110 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-15T23:30:52.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-15T23:30:52.110 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-02-15T23:30:52.187 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:52.188 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:52.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f75436980 1 Processor -- start 2024-02-15T23:30:52.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f75436980 1 -- start start 2024-02-15T23:30:52.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f75436980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5600e73c5e50 0x5600e7453da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f75436980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5600e739d460 con 0x5600e73c7190 2024-02-15T23:30:52.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f75436980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5600e7364180 con 0x5600e73c5e50 2024-02-15T23:30:52.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f72750640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5600e73c5e50 0x5600e7453da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f72f51640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x5600e73c7190 0x5600e73c5740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:35156/0 (socket says 172.21.15.133:35156) 2024-02-15T23:30:52.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f72f51640 1 -- 172.21.15.133:0/1797837412 learned_addr learned my addr 172.21.15.133:0/1797837412 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:52.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f71f4f640 1 -- 172.21.15.133:0/1797837412 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728973418 0 0) 0x5600e739d460 con 0x5600e73c7190 2024-02-15T23:30:52.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f71f4f640 1 -- 172.21.15.133:0/1797837412 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f5c001e20 con 0x5600e73c7190 2024-02-15T23:30:52.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f72750640 1 -- 172.21.15.133:0/1797837412 >> v1:172.21.15.131:6789/0 conn(0x5600e73c7190 legacy=0x5600e73c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f72750640 1 -- 172.21.15.133:0/1797837412 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e73c6260 con 0x5600e73c5e50 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f72750640 1 --2- 172.21.15.133:0/1797837412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7453da0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800a480 tx=0x7f1f6801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f963d36e2edc76 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.183+0000 7f1f71f4f640 1 -- 172.21.15.133:0/1797837412 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f680aa530 con 0x5600e73c5e50 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f71f4f640 1 -- 172.21.15.133:0/1797837412 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f680a6050 con 0x5600e73c5e50 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f71f4f640 1 -- 172.21.15.133:0/1797837412 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f680aa7c0 con 0x5600e73c5e50 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f75436980 1 -- 172.21.15.133:0/1797837412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 msgr2=0x5600e7453da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f75436980 1 --2- 172.21.15.133:0/1797837412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7453da0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800a480 tx=0x7f1f6801b280 comp rx=0 tx=0).stop 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f75436980 1 -- 172.21.15.133:0/1797837412 shutdown_connections 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f75436980 1 --2- 172.21.15.133:0/1797837412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7453da0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f75436980 1 -- 172.21.15.133:0/1797837412 >> 172.21.15.133:0/1797837412 conn(0x5600e744ca80 msgr2=0x5600e744eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f75436980 1 -- 172.21.15.133:0/1797837412 shutdown_connections 2024-02-15T23:30:52.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.187+0000 7f1f75436980 1 -- 172.21.15.133:0/1797837412 wait complete. 2024-02-15T23:30:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 Processor -- start 2024-02-15T23:30:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 -- start start 2024-02-15T23:30:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7541860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e73616b0 con 0x5600e73c5e50 2024-02-15T23:30:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f72f51640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7541860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f72f51640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7541860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39394/0 (socket says 172.21.15.133:39394) 2024-02-15T23:30:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f72f51640 1 -- 172.21.15.133:0/3038502023 learned_addr learned my addr 172.21.15.133:0/3038502023 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f72f51640 1 -- 172.21.15.133:0/3038502023 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f68005d30 con 0x5600e73c5e50 2024-02-15T23:30:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f72f51640 1 --2- 172.21.15.133:0/3038502023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7541860 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1f64001c30 tx=0x7f1f6400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304643a0e8eba45b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1e60e09640 1 -- 172.21.15.133:0/3038502023 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6400e690 con 0x5600e73c5e50 2024-02-15T23:30:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1e60e09640 1 -- 172.21.15.133:0/3038502023 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400e7f0 con 0x5600e73c5e50 2024-02-15T23:30:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1e60e09640 1 -- 172.21.15.133:0/3038502023 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6400eb50 con 0x5600e73c5e50 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 -- 172.21.15.133:0/3038502023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 msgr2=0x5600e7541860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 --2- 172.21.15.133:0/3038502023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7541860 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1f64001c30 tx=0x7f1f6400b6d0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 -- 172.21.15.133:0/3038502023 shutdown_connections 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 --2- 172.21.15.133:0/3038502023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7541860 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 -- 172.21.15.133:0/3038502023 >> 172.21.15.133:0/3038502023 conn(0x5600e744ca80 msgr2=0x5600e753d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 -- 172.21.15.133:0/3038502023 shutdown_connections 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.199+0000 7f1f75436980 1 -- 172.21.15.133:0/3038502023 wait complete. 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f75436980 1 Processor -- start 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f75436980 1 -- start start 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f75436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7548750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f75436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e735ce90 con 0x5600e73c5e50 2024-02-15T23:30:52.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f72f51640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7548750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f72f51640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7548750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39406/0 (socket says 172.21.15.133:39406) 2024-02-15T23:30:52.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f72f51640 1 -- 172.21.15.133:0/3367178389 learned_addr learned my addr 172.21.15.133:0/3367178389 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f72f51640 1 -- 172.21.15.133:0/3367178389 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c001e20 con 0x5600e73c5e50 2024-02-15T23:30:52.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f72f51640 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7548750 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400b710 tx=0x7f1f64000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1e5f606640 1 -- 172.21.15.133:0/3367178389 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6401f070 con 0x5600e73c5e50 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600e7548c90 con 0x5600e73c5e50 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1e5f606640 1 -- 172.21.15.133:0/3367178389 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6401a2e0 con 0x5600e73c5e50 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600e7549140 con 0x5600e73c5e50 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1e5f606640 1 -- 172.21.15.133:0/3367178389 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6401a820 con 0x5600e73c5e50 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1e5f606640 1 -- 172.21.15.133:0/3367178389 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1f6400a040 con 0x5600e73c5e50 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1e5f606640 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e58034300 0x7f1e580367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1e5f606640 1 -- 172.21.15.133:0/3367178389 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1f640498b0 con 0x5600e73c5e50 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f72750640 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e58034300 0x7f1e580367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f75436980 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e73c7190 0x5600e754f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e754f8e0 con 0x5600e73c7190 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f73752640 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e73c7190 0x5600e754f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f72750640 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e58034300 0x7f1e580367c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1f680ac000 tx=0x7f1f680a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.203+0000 7f1f73752640 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e73c7190 0x5600e754f3a0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f73752640 1 -- 172.21.15.133:0/3367178389 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f6c00a4d0 con 0x5600e73c7190 2024-02-15T23:30:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e754cab0 con 0x5600e73c7190 2024-02-15T23:30:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f73752640 1 -- 172.21.15.133:0/3367178389 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1f6c00a4d0 con 0x5600e73c7190 2024-02-15T23:30:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75515e0 con 0x5600e73c7190 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f73752640 1 -- 172.21.15.133:0/3367178389 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1f6c00a4d0 con 0x5600e73c7190 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75507e0 con 0x5600e73c7190 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f73752640 1 -- 172.21.15.133:0/3367178389 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1f6c00a4d0 con 0x5600e73c7190 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7550bf0 con 0x5600e73c7190 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f73752640 1 -- 172.21.15.133:0/3367178389 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1f6c00a4d0 con 0x5600e73c7190 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 Processor -- start 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 -- start start 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e755fc80 0x5600e75600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e72f5f20 con 0x5600e755fc80 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f72750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e755fc80 0x5600e75600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f72750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e755fc80 0x5600e75600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39410/0 (socket says 172.21.15.133:39410) 2024-02-15T23:30:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f72750640 1 -- 172.21.15.133:0/374560012 learned_addr learned my addr 172.21.15.133:0/374560012 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f72750640 1 -- 172.21.15.133:0/374560012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e75605e0 con 0x5600e755fc80 2024-02-15T23:30:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f72750640 1 --2- 172.21.15.133:0/374560012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e755fc80 0x5600e75600a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1f68096d70 tx=0x7f1f68018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1e5ce01640 1 -- 172.21.15.133:0/374560012 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f680b4d40 con 0x5600e755fc80 2024-02-15T23:30:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 -- 172.21.15.133:0/374560012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600e75607d0 con 0x5600e755fc80 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1e5ce01640 1 -- 172.21.15.133:0/374560012 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f680bb040 con 0x5600e755fc80 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1e5ce01640 1 -- 172.21.15.133:0/374560012 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f680bf3f0 con 0x5600e755fc80 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.207+0000 7f1f75436980 1 -- 172.21.15.133:0/374560012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600e75612c0 con 0x5600e755fc80 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1e5ce01640 1 -- 172.21.15.133:0/374560012 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1f680bf5e0 con 0x5600e755fc80 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1e5ce01640 1 --2- 172.21.15.133:0/374560012 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e4c034300 0x7f1e4c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1e5ce01640 1 -- 172.21.15.133:0/374560012 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1f680e5950 con 0x5600e755fc80 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f73752640 1 --2- 172.21.15.133:0/374560012 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e4c034300 0x7f1e4c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 Processor -- start 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- start start 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f73752640 1 --2- 172.21.15.133:0/374560012 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e4c034300 0x7f1e4c0367c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5600e7550220 tx=0x7f1f6c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e756d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e72e9790 con 0x5600e756cc80 2024-02-15T23:30:52.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f72750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e756d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f72750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e756d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39424/0 (socket says 172.21.15.133:39424) 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f72750640 1 -- 172.21.15.133:0/3314398684 learned_addr learned my addr 172.21.15.133:0/3314398684 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f72750640 1 -- 172.21.15.133:0/3314398684 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e756d670 con 0x5600e756cc80 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f72750640 1 --2- 172.21.15.133:0/3314398684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e756d0a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1f680e3c20 tx=0x7f1f680bf890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1795419031f77d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1e567fc640 1 -- 172.21.15.133:0/3314398684 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f680b3370 con 0x5600e756cc80 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1e567fc640 1 -- 172.21.15.133:0/3314398684 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f680b34d0 con 0x5600e756cc80 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1e567fc640 1 -- 172.21.15.133:0/3314398684 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f680b3c60 con 0x5600e756cc80 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- 172.21.15.133:0/3314398684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 msgr2=0x5600e756d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 --2- 172.21.15.133:0/3314398684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e756d0a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1f680e3c20 tx=0x7f1f680bf890 comp rx=0 tx=0).stop 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- 172.21.15.133:0/3314398684 shutdown_connections 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 --2- 172.21.15.133:0/3314398684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e756d0a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- 172.21.15.133:0/3314398684 >> 172.21.15.133:0/3314398684 conn(0x5600e7569010 msgr2=0x5600e7567070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- 172.21.15.133:0/3314398684 shutdown_connections 2024-02-15T23:30:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- 172.21.15.133:0/3314398684 wait complete. 2024-02-15T23:30:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 Processor -- start 2024-02-15T23:30:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- start start 2024-02-15T23:30:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e7573bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.211+0000 7f1f75436980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e7574130 con 0x5600e756cc80 2024-02-15T23:30:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e7573bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72750640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e7573bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39430/0 (socket says 172.21.15.133:39430) 2024-02-15T23:30:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 learned_addr learned my addr 172.21.15.133:0/4236946984 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e75612c0 con 0x5600e756cc80 2024-02-15T23:30:52.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72750640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e7573bf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1f680b3680 tx=0x7f1f680e3bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1e54ff9640 1 -- 172.21.15.133:0/4236946984 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f680e9070 con 0x5600e756cc80 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600e7574330 con 0x5600e756cc80 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1e54ff9640 1 -- 172.21.15.133:0/4236946984 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f68006750 con 0x5600e756cc80 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600e7574760 con 0x5600e756cc80 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1e54ff9640 1 -- 172.21.15.133:0/4236946984 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f680b3370 con 0x5600e756cc80 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1e54ff9640 1 -- 172.21.15.133:0/4236946984 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1f680be7d0 con 0x5600e756cc80 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1e54ff9640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e3c0342b0 0x7f1e3c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1e54ff9640 1 -- 172.21.15.133:0/4236946984 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1f680e70d0 con 0x5600e756cc80 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f73752640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e3c0342b0 0x7f1e3c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e757efe0 0x5600e75814a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7581bf0 con 0x5600e757efe0 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72f51640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e757efe0 0x5600e75814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f73752640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e3c0342b0 0x7f1e3c036770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c011010 tx=0x7f1f6c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72f51640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e757efe0 0x5600e75814a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 20 realm 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7581fc0 con 0x5600e757efe0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7582810 con 0x5600e757efe0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.215+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7582b70 con 0x5600e757efe0 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f75436980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7583370 con 0x5600e757efe0 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f75436980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f75436980 20 searching for the correct realm 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5600e7585230 0x5600e75876b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72750640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5600e7585230 0x5600e75876b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72750640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5600e7585230 0x5600e75876b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680eb070 con 0x5600e7585230 2024-02-15T23:30:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72750640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1f680a93a0 0x7f1f680ee410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f680a93a0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f73752640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1f680a93a0 0x7f1f680ee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f73752640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1f680a93a0 0x7f1f680ee410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f6c00a4d0 con 0x7f1f680a93a0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f680a93a0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f6c00a4d0 con 0x7f1f680a93a0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e757efe0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e757efe0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1f64017050 0x7f1f64024420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f64017050 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1f64017050 0x7f1f64024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.219+0000 7f1f72f51640 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1f64017050 0x7f1f64024420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f64017050 2024-02-15T23:30:52.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f680a93a0 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f6c00a4d0 con 0x7f1f680a93a0 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e757efe0 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f64017050 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e757efe0 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f680a93a0 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.223+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f64017050 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e757efe0 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e757efe0 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f64017050 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f680a93a0 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e757efe0 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f680a93a0 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f64017050 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f680a93a0 2024-02-15T23:30:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e7585230 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.227+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f64017050 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x5600e757efe0 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7587d30 con 0x7f1f680a93a0 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7584810 con 0x5600e757efe0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7583cc0 con 0x5600e757efe0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75841a0 con 0x5600e757efe0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 zone default found 2024-02-15T23:30:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 4 Realm: () 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 zonegroup default 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7588170 con 0x7f1f680a93a0 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7589ff0 con 0x5600e7585230 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758a350 con 0x5600e7585230 2024-02-15T23:30:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 started sync module instance, tier type = 2024-02-15T23:30:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75895c0 con 0x7f1f680a93a0 2024-02-15T23:30:52.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.231+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.235+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94561881332080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75895c0 con 0x7f1f680a93a0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.235+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758acc0 con 0x5600e757efe0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.235+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94561881332080] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.235+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.235+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94561881330224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758acc0 con 0x5600e757efe0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.235+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758b630 con 0x5600e7585230 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94561881330224] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94561881335840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758ac40 con 0x5600e7585230 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758c320 con 0x7f1f680a93a0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94561881341872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758cb70 con 0x7f1f680a93a0 2024-02-15T23:30:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758d5a0 con 0x5600e757efe0 2024-02-15T23:30:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94561881335840] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.239+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94561881341872] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.243+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.243+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94561881346240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758c6d0 con 0x5600e757efe0 2024-02-15T23:30:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.243+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758de20 con 0x7f1f64017050 2024-02-15T23:30:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.243+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94561881346240] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.243+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.243+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94561881340384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758c6d0 con 0x7f1f64017050 2024-02-15T23:30:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.243+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758e430 con 0x7f1f64017050 2024-02-15T23:30:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(56 notify.6 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94561881350032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758e850 con 0x7f1f64017050 2024-02-15T23:30:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758f200 con 0x7f1f64017050 2024-02-15T23:30:52.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94561881340384] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94561881350032] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94561881348480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758e3b0 con 0x7f1f64017050 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 20 add_watcher() i=0 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 20 add_watcher() i=1 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 20 add_watcher() i=2 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 20 add_watcher() i=3 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 20 add_watcher() i=4 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 20 add_watcher() i=5 2024-02-15T23:30:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.247+0000 7f1f75436980 20 add_watcher() i=6 2024-02-15T23:30:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94561881348480] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 add_watcher() i=7 2024-02-15T23:30:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758e3b0 con 0x5600e757efe0 2024-02-15T23:30:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94561881353504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758e3b0 con 0x5600e757efe0 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94561881353504] v33'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1e297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 5 note: GC not initialized 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1da3fff640 20 reqs_thread_entry: start 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 Filter name: none 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1da1ffb640 20 reqs_thread_entry: start 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-15T23:30:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75b40f0 con 0x7f1f64017050 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75b28e0 con 0x5600e757efe0 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T23:30:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-15T23:30:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-15T23:30:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.251+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75b2cc0 con 0x7f1f64017050 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~347] v33'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f75436980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f75436980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f75436980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94561881504592 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75b3500 con 0x7f1f64017050 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== watch-notify(notify (1) cookie 94561881348480 notify 141733920791 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f1f64032040 con 0x7f1f64017050 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1e567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94561881348480 notifier 4723 bl.length()=523 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1e567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1e567fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1e567fc640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1e38003ea0 con 0x7f1f64017050 2024-02-15T23:30:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(65 notify.7 [notify cookie 94561881504592 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== watch-notify(notify_complete (2) cookie 94561881504592 notify 141733920791 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5600e7549140 con 0x7f1f64017050 2024-02-15T23:30:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.255+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75b3500 con 0x5600e757efe0 2024-02-15T23:30:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f75436980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-15T23:30:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f75436980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T23:30:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f75436980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-15T23:30:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94561881504592 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e75b74c0 con 0x7f1f64017050 2024-02-15T23:30:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== watch-notify(notify (1) cookie 94561881340384 notify 141733920792 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x5600e7549140 con 0x7f1f64017050 2024-02-15T23:30:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1e55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94561881340384 notifier 4723 bl.length()=177 2024-02-15T23:30:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1e55ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-15T23:30:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1e55ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T23:30:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(68 notify.5 [notify cookie 94561881504592 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1e55ffb640 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1da8003400 con 0x7f1f64017050 2024-02-15T23:30:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== watch-notify(notify_complete (2) cookie 94561881504592 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5600e7548c90 con 0x7f1f64017050 2024-02-15T23:30:52.267 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:30:52.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1e297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:52.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.259+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94561881353504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e7594430 con 0x5600e757efe0 2024-02-15T23:30:52.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94561881353504] v33'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94561881332080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758ed20 con 0x7f1f680a93a0 2024-02-15T23:30:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94561881332080] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f75436980 20 remove_watcher() i=0 2024-02-15T23:30:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f75436980 2 removed watcher, disabling cache 2024-02-15T23:30:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94561881330224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758ed20 con 0x5600e757efe0 2024-02-15T23:30:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94561881330224] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f75436980 20 remove_watcher() i=1 2024-02-15T23:30:52.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.263+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94561881335840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758ed20 con 0x5600e7585230 2024-02-15T23:30:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.267+0000 7f1f72750640 1 -- 172.21.15.133:0/4236946984 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94561881335840] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f680fb040 con 0x5600e7585230 2024-02-15T23:30:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.267+0000 7f1f75436980 20 remove_watcher() i=2 2024-02-15T23:30:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.267+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94561881341872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758a820 con 0x7f1f680a93a0 2024-02-15T23:30:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.267+0000 7f1f73752640 1 -- 172.21.15.133:0/4236946984 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94561881341872] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f6c039060 con 0x7f1f680a93a0 2024-02-15T23:30:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.267+0000 7f1f75436980 20 remove_watcher() i=3 2024-02-15T23:30:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.267+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94561881346240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758a820 con 0x5600e757efe0 2024-02-15T23:30:52.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.271+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94561881346240] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x5600e757efe0 2024-02-15T23:30:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.271+0000 7f1f75436980 20 remove_watcher() i=4 2024-02-15T23:30:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.271+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94561881340384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758d0c0 con 0x7f1f64017050 2024-02-15T23:30:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.271+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94561881340384] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.271+0000 7f1f75436980 20 remove_watcher() i=5 2024-02-15T23:30:52.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.271+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94561881350032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758a820 con 0x7f1f64017050 2024-02-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94561881350032] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 20 remove_watcher() i=6 2024-02-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94561881348480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600e758df90 con 0x7f1f64017050 2024-02-15T23:30:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94561881348480] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f64014070 con 0x7f1f64017050 2024-02-15T23:30:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 20 remove_watcher() i=7 2024-02-15T23:30:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1f64017050 msgr2=0x7f1f64024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f1f64017050 0x7f1f64024420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e757efe0 msgr2=0x5600e75814a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e757efe0 0x5600e75814a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1f680a93a0 msgr2=0x7f1f680ee410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1f680a93a0 0x7f1f680ee410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5600e7585230 msgr2=0x5600e75876b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x5600e7585230 0x5600e75876b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e3c0342b0 msgr2=0x7f1e3c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e3c0342b0 0x7f1e3c036770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c011010 tx=0x7f1f6c020000 comp rx=0 tx=0).stop 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 msgr2=0x5600e7573bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e7573bf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1f680b3680 tx=0x7f1f680e3bb0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f72f51640 1 -- 172.21.15.133:0/4236946984 reap_dead start 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 shutdown_connections 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/4236946984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e756cc80 0x5600e7573bf0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 >> 172.21.15.133:0/4236946984 conn(0x5600e7569010 msgr2=0x5600e7566670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 shutdown_connections 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/4236946984 wait complete. 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/374560012 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e4c034300 msgr2=0x7f1e4c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/374560012 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e4c034300 0x7f1e4c0367c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5600e7550220 tx=0x7f1f6c005850 comp rx=0 tx=0).stop 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/374560012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e755fc80 msgr2=0x5600e75600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/374560012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e755fc80 0x5600e75600a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1f68096d70 tx=0x7f1f68018020 comp rx=0 tx=0).stop 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/374560012 shutdown_connections 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/374560012 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e4c034300 0x7f1e4c0367c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/374560012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e755fc80 0x5600e75600a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/374560012 >> 172.21.15.133:0/374560012 conn(0x5600e7554a90 msgr2=0x5600e75555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/374560012 shutdown_connections 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/374560012 wait complete. 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e73c7190 msgr2=0x5600e754f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.275+0000 7f1f75436980 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e73c7190 0x5600e754f3a0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e58034300 msgr2=0x7f1e580367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e58034300 0x7f1e580367c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1f680ac000 tx=0x7f1f680a5000 comp rx=0 tx=0).stop 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 msgr2=0x5600e7548750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7548750 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400b710 tx=0x7f1f64000bd0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 shutdown_connections 2024-02-15T23:30:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5600e73c7190 0x5600e754f3a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1e58034300 0x7f1e580367c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 --2- 172.21.15.133:0/3367178389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600e73c5e50 0x5600e7548750 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 >> 172.21.15.133:0/3367178389 conn(0x5600e744ca80 msgr2=0x5600e753bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 shutdown_connections 2024-02-15T23:30:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.279+0000 7f1f75436980 1 -- 172.21.15.133:0/3367178389 wait complete. 2024-02-15T23:30:52.293 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:30:52.309 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:52.316 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-02-15T23:30:52.316 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-15T23:30:52.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-15T23:30:52.317 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-02-15T23:30:52.365 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:52.366 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:52.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2fa9b2980 1 Processor -- start 2024-02-15T23:30:52.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2fa9b2980 1 -- start start 2024-02-15T23:30:52.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2fa9b2980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55eebb32b8d0 0x55eebb3b9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2fa9b2980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55eebb3034d0 con 0x55eebb3ba380 2024-02-15T23:30:52.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2fa9b2980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55eebb2ca180 con 0x55eebb32b8d0 2024-02-15T23:30:52.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2f84cd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55eebb32b8d0 0x55eebb3b9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2f84cd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55eebb32b8d0 0x55eebb3b9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39440/0 (socket says 172.21.15.133:39440) 2024-02-15T23:30:52.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2f84cd640 1 -- 172.21.15.133:0/1182100276 learned_addr learned my addr 172.21.15.133:0/1182100276 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2f84cd640 1 -- 172.21.15.133:0/1182100276 >> v1:172.21.15.131:6789/0 conn(0x55eebb3ba380 legacy=0x55eebb3bc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.359+0000 7fd2f84cd640 1 -- 172.21.15.133:0/1182100276 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eebb3beed0 con 0x55eebb32b8d0 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2f84cd640 1 --2- 172.21.15.133:0/1182100276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb3b9e40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000a4e0 tx=0x7fd2f001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e46799b50a18a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2f74cb640 1 -- 172.21.15.133:0/1182100276 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2f00aa540 con 0x55eebb32b8d0 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2f74cb640 1 -- 172.21.15.133:0/1182100276 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f00a6070 con 0x55eebb32b8d0 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2f74cb640 1 -- 172.21.15.133:0/1182100276 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2f00aa850 con 0x55eebb32b8d0 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1182100276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 msgr2=0x55eebb3b9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/1182100276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb3b9e40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000a4e0 tx=0x7fd2f001b090 comp rx=0 tx=0).stop 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1182100276 shutdown_connections 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/1182100276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb3b9e40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1182100276 >> 172.21.15.133:0/1182100276 conn(0x55eebb3b1920 msgr2=0x55eebb3b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1182100276 shutdown_connections 2024-02-15T23:30:52.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.363+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1182100276 wait complete. 2024-02-15T23:30:52.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.375+0000 7fd2fa9b2980 1 Processor -- start 2024-02-15T23:30:52.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.375+0000 7fd2fa9b2980 1 -- start start 2024-02-15T23:30:52.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.375+0000 7fd2fa9b2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.375+0000 7fd2fa9b2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb2c76b0 con 0x55eebb32b8d0 2024-02-15T23:30:52.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39450/0 (socket says 172.21.15.133:39450) 2024-02-15T23:30:52.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 -- 172.21.15.133:0/1341276305 learned_addr learned my addr 172.21.15.133:0/1341276305 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 -- 172.21.15.133:0/1341276305 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f000a1c0 con 0x55eebb32b8d0 2024-02-15T23:30:52.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 --2- 172.21.15.133:0/1341276305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a10c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0017ca0 tx=0x7fd2f00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7314a47a5423f933 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd1e660c640 1 -- 172.21.15.133:0/1341276305 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2f00aa780 con 0x55eebb32b8d0 2024-02-15T23:30:52.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd1e660c640 1 -- 172.21.15.133:0/1341276305 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f00aa8e0 con 0x55eebb32b8d0 2024-02-15T23:30:52.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd1e660c640 1 -- 172.21.15.133:0/1341276305 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2f00aab80 con 0x55eebb32b8d0 2024-02-15T23:30:52.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1341276305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 msgr2=0x55eebb4a10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/1341276305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a10c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0017ca0 tx=0x7fd2f00033b0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1341276305 shutdown_connections 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/1341276305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a10c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1341276305 >> 172.21.15.133:0/1341276305 conn(0x55eebb3b1920 msgr2=0x55eebb49cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1341276305 shutdown_connections 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/1341276305 wait complete. 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 Processor -- start 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- start start 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb2c2e90 con 0x55eebb32b8d0 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39466/0 (socket says 172.21.15.133:39466) 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 -- 172.21.15.133:0/125534862 learned_addr learned my addr 172.21.15.133:0/125534862 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 -- 172.21.15.133:0/125534862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eebb3beed0 con 0x55eebb32b8d0 2024-02-15T23:30:52.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2f84cd640 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a7da0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd2f001aec0 tx=0x7fd2f0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd1e4e09640 1 -- 172.21.15.133:0/125534862 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2f00c4070 con 0x55eebb32b8d0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eebb4a82e0 con 0x55eebb32b8d0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eebb4a8710 con 0x55eebb32b8d0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd1e4e09640 1 -- 172.21.15.133:0/125534862 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f0005150 con 0x55eebb32b8d0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.379+0000 7fd1e4e09640 1 -- 172.21.15.133:0/125534862 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2f00053f0 con 0x55eebb32b8d0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd1e4e09640 1 -- 172.21.15.133:0/125534862 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd2f00a8070 con 0x55eebb32b8d0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd1e4e09640 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1e0034300 0x7fd1e00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd1e4e09640 1 -- 172.21.15.133:0/125534862 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd2f00e3390 con 0x55eebb32b8d0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f7ccc640 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1e0034300 0x7fd1e00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb3ba380 0x55eebb4aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4aef70 con 0x55eebb3ba380 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f8cce640 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb3ba380 0x55eebb4aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f7ccc640 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1e0034300 0x7fd1e00367c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec001e20 tx=0x7fd2ec0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f8cce640 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb3ba380 0x55eebb4aea30 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f8cce640 1 -- 172.21.15.133:0/125534862 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2e80083f0 con 0x55eebb3ba380 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4af350 con 0x55eebb3ba380 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f8cce640 1 -- 172.21.15.133:0/125534862 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd2e80083f0 con 0x55eebb3ba380 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4b0c00 con 0x55eebb3ba380 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f8cce640 1 -- 172.21.15.133:0/125534862 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd2e80083f0 con 0x55eebb3ba380 2024-02-15T23:30:52.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4afe00 con 0x55eebb3ba380 2024-02-15T23:30:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f8cce640 1 -- 172.21.15.133:0/125534862 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd2e80083f0 con 0x55eebb3ba380 2024-02-15T23:30:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4b0210 con 0x55eebb3ba380 2024-02-15T23:30:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2f8cce640 1 -- 172.21.15.133:0/125534862 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd2e8012040 con 0x55eebb3ba380 2024-02-15T23:30:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 Processor -- start 2024-02-15T23:30:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 -- start start 2024-02-15T23:30:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4bf2e0 0x55eebb4bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.383+0000 7fd2fa9b2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb25bf20 con 0x55eebb4bf2e0 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f7ccc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4bf2e0 0x55eebb4bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f7ccc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4bf2e0 0x55eebb4bf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39468/0 (socket says 172.21.15.133:39468) 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/150737081 learned_addr learned my addr 172.21.15.133:0/150737081 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/150737081 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eebb4bfc40 con 0x55eebb4bf2e0 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f7ccc640 1 --2- 172.21.15.133:0/150737081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4bf2e0 0x55eebb4bf700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec001780 tx=0x7fd2ec00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd1ddffb640 1 -- 172.21.15.133:0/150737081 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2ec00e580 con 0x55eebb4bf2e0 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd1ddffb640 1 -- 172.21.15.133:0/150737081 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec00e6e0 con 0x55eebb4bf2e0 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/150737081 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eebb4bfe90 con 0x55eebb4bf2e0 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd1ddffb640 1 -- 172.21.15.133:0/150737081 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2ec00e980 con 0x55eebb4bf2e0 2024-02-15T23:30:52.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/150737081 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eebb4c09e0 con 0x55eebb4bf2e0 2024-02-15T23:30:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd1ddffb640 1 -- 172.21.15.133:0/150737081 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd2ec00eae0 con 0x55eebb4bf2e0 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd1ddffb640 1 --2- 172.21.15.133:0/150737081 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1d0034300 0x7fd1d00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd1ddffb640 1 -- 172.21.15.133:0/150737081 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd2ec018040 con 0x55eebb4bf2e0 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f8cce640 1 --2- 172.21.15.133:0/150737081 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1d0034300 0x7fd1d00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2fa9b2980 1 Processor -- start 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2fa9b2980 1 -- start start 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f8cce640 1 --2- 172.21.15.133:0/150737081 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1d0034300 0x7fd1d00367c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55eebb4af840 tx=0x7fd2e8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2fa9b2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2fa9b2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb24f790 con 0x55eebb4cc290 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f7ccc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f7ccc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39480/0 (socket says 172.21.15.133:39480) 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.387+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2457866288 learned_addr learned my addr 172.21.15.133:0/2457866288 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2457866288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eebb4ccc80 con 0x55eebb4cc290 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2f7ccc640 1 --2- 172.21.15.133:0/2457866288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4cc6b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00ffd0 tx=0x7fd2ec01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45d171545bc7982 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd1d77fe640 1 -- 172.21.15.133:0/2457866288 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2ec00ed90 con 0x55eebb4cc290 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd1d77fe640 1 -- 172.21.15.133:0/2457866288 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec023d90 con 0x55eebb4cc290 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd1d77fe640 1 -- 172.21.15.133:0/2457866288 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2ec03b1f0 con 0x55eebb4cc290 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2457866288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 msgr2=0x55eebb4cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2457866288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4cc6b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00ffd0 tx=0x7fd2ec01aa60 comp rx=0 tx=0).stop 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2457866288 shutdown_connections 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2457866288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4cc6b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2457866288 >> 172.21.15.133:0/2457866288 conn(0x55eebb4c8620 msgr2=0x55eebb4c6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2457866288 shutdown_connections 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2457866288 wait complete. 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 Processor -- start 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- start start 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4d3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb4d3770 con 0x55eebb4cc290 2024-02-15T23:30:52.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2f7ccc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2f7ccc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:39488/0 (socket says 172.21.15.133:39488) 2024-02-15T23:30:52.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 learned_addr learned my addr 172.21.15.133:0/2506785749 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:52.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eebb4c09e0 con 0x55eebb4cc290 2024-02-15T23:30:52.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2f7ccc640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4d3230 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec01be20 tx=0x7fd2ec049420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd1d5ffb640 1 -- 172.21.15.133:0/2506785749 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2ec01c410 con 0x55eebb4cc290 2024-02-15T23:30:52.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eebb4d3970 con 0x55eebb4cc290 2024-02-15T23:30:52.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eebb4d3d40 con 0x55eebb4cc290 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd1d5ffb640 1 -- 172.21.15.133:0/2506785749 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec01a310 con 0x55eebb4cc290 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.391+0000 7fd1d5ffb640 1 -- 172.21.15.133:0/2506785749 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2ec01a480 con 0x55eebb4cc290 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd1d5ffb640 1 -- 172.21.15.133:0/2506785749 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd2ec024c60 con 0x55eebb4cc290 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd1d5ffb640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1c8034260 0x7fd1c8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd1d5ffb640 1 -- 172.21.15.133:0/2506785749 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd2ec041040 con 0x55eebb4cc290 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f8cce640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1c8034260 0x7fd1c8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb4de600 0x55eebb4e0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e1210 con 0x55eebb4de600 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f84cd640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb4de600 0x55eebb4e0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f8cce640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1c8034260 0x7fd1c8036720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8008fd0 tx=0x7fd2e801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f84cd640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb4de600 0x55eebb4e0ac0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 realm 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e15e0 con 0x55eebb4de600 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e1e60 con 0x55eebb4de600 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e21c0 con 0x55eebb4de600 2024-02-15T23:30:52.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e29c0 con 0x55eebb4de600 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 20 searching for the correct realm 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55eebb4e4850 0x55eebb4e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f7ccc640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55eebb4e4850 0x55eebb4e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f7ccc640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55eebb4e4850 0x55eebb4e6d10 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f7ccc640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd2ec038c20 0x7fd2ec04a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2ec038c20 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f8cce640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd2ec038c20 0x7fd2ec04a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f8cce640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd2ec038c20 0x7fd2ec04a070 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e802c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.395+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2ec038c20 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e802c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4de600 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4de600 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd2f00e1a30 0x7fd2f00b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd2f00e1a30 0x7fd2f00b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd2f00e1a30 0x7fd2f00b43a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:52.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2ec038c20 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e802c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4de600 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.399+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4de600 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2ec038c20 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd2e802c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4de600 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4de600 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2ec038c20 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e802c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.403+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4de600 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2ec038c20 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e802c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2ec038c20 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4e4850 2024-02-15T23:30:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x55eebb4de600 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e73e0 con 0x7fd2ec038c20 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e32c0 con 0x55eebb4de600 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e3ac0 con 0x55eebb4de600 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e3ac0 con 0x55eebb4de600 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 zone default found 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 4 Realm: () 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:52.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 zonegroup default 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e3ac0 con 0x7fd2ec038c20 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.407+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e9200 con 0x55eebb4e4850 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e9590 con 0x55eebb4e4850 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 20 started sync module instance, tier type = 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e8ae0 con 0x7fd2ec038c20 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483833062976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e8e90 con 0x7fd2ec038c20 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ea2f0 con 0x55eebb4de600 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483833062976] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483833067952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ea270 con 0x55eebb4de600 2024-02-15T23:30:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.411+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ead00 con 0x55eebb4e4850 2024-02-15T23:30:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.415+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.415+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483833071648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4eb550 con 0x55eebb4e4850 2024-02-15T23:30:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.415+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ebf50 con 0x7fd2ec038c20 2024-02-15T23:30:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.415+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483833067952] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.415+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.415+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483833076304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ec300 con 0x7fd2ec038c20 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.415+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4eccb0 con 0x55eebb4de600 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.415+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483833071648] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.419+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483833076304] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.419+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.419+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483833069008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ec7d0 con 0x55eebb4de600 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.419+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ed500 con 0x7fd2f00e1a30 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.419+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483833069008] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.419+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.419+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483833073840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ec7d0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.419+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4edb10 con 0x7fd2f00e1a30 2024-02-15T23:30:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.423+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483833073840] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.423+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.423+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483833081952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4edb10 con 0x7fd2f00e1a30 2024-02-15T23:30:52.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.423+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ee370 con 0x7fd2f00e1a30 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483833084688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ee9f0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 add_watcher() i=0 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 add_watcher() i=1 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 add_watcher() i=2 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 add_watcher() i=3 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 add_watcher() i=4 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 add_watcher() i=5 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483833081952] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 add_watcher() i=6 2024-02-15T23:30:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483833084688] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 add_watcher() i=7 2024-02-15T23:30:52.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:52.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4f1a20 con 0x55eebb4de600 2024-02-15T23:30:52.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483833087312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4eee80 con 0x55eebb4de600 2024-02-15T23:30:52.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483833087312] v33'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd1ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:52.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:52.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd2fa9b2980 5 note: GC not initialized 2024-02-15T23:30:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.427+0000 7fd1ad7e2640 20 reqs_thread_entry: start 2024-02-15T23:30:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 20 Filter name: none 2024-02-15T23:30:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd11effd640 20 reqs_thread_entry: start 2024-02-15T23:30:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-15T23:30:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb513730 con 0x7fd2f00e1a30 2024-02-15T23:30:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(62 bar [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T23:30:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-02-15T23:30:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T23:30:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb517320 con 0x7fd2ec038c20 2024-02-15T23:30:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v33'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-15T23:30:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T23:30:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-15T23:30:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94483833250048 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb517da0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== watch-notify(notify (1) cookie 94483833073840 notify 141733920794 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x7fd2f00fa040 con 0x7fd2f00e1a30 2024-02-15T23:30:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd1d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94483833073840 notifier 4730 bl.length()=357 2024-02-15T23:30:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd1d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-15T23:30:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd1d77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T23:30:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd1d77fe640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd1bc003ea0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(64 notify.5 [notify cookie 94483833250048 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.431+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.435+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== watch-notify(notify_complete (2) cookie 94483833250048 notify 141733920794 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eebb4a8710 con 0x7fd2f00e1a30 2024-02-15T23:30:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.435+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb517ca0 con 0x55eebb4de600 2024-02-15T23:30:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.435+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv7 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.435+0000 7fd2fa9b2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 : miss 2024-02-15T23:30:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.435+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.435+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 8.6 8:67e3dc8d:root::.bucket.meta.myfoo6%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb5156e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(67 .bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 20 rados_obj.operate() r=0 bl.length=353 2024-02-15T23:30:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 info.flags=0x17 2024-02-15T23:30:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 to cache LRU end 2024-02-15T23:30:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:30:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 2024-02-15T23:30:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:68 8.6 8:67e3dc8d:root::.bucket.meta.myfoo6%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb51eb70 con 0x7fd2f00e1a30 2024-02-15T23:30:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(68 .bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v33'2 uv2 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 info.flags=0x17 2024-02-15T23:30:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 to cache LRU end 2024-02-15T23:30:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-02-15T23:30:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9, ofs0, ns] 2024-02-15T23:30:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.9 7:93e5b521:::notify.7:head [notify cookie 94483833248592 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb5191a0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== watch-notify(notify (1) cookie 94483833084688 notify 141733920795 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x55eebb4a8710 con 0x7fd2f00e1a30 2024-02-15T23:30:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd1d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94483833084688 notifier 4730 bl.length()=721 2024-02-15T23:30:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd1d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 info.flags=0x17 2024-02-15T23:30:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd1d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 to cache LRU end 2024-02-15T23:30:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd1d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-02-15T23:30:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd1d6ffd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd12c003530 con 0x7fd2f00e1a30 2024-02-15T23:30:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.439+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(69 notify.7 [notify cookie 94483833248592 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(70 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== watch-notify(notify_complete (2) cookie 94483833248592 notify 141733920795 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eebb4a82e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 20 handle_bi_update(): bucket=:myfoo6[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9]): orig_sources= new_sources= 2024-02-15T23:30:52.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 20 handle_bi_update(): bucket=:myfoo6[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9]): potential sources added=[] removed=[] 2024-02-15T23:30:52.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 20 handle_bi_update(): bucket=:myfoo6[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9]): orig_dests= new_dests= 2024-02-15T23:30:52.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 20 handle_bi_update(): bucket=:myfoo6[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9]): potential dests added=[] removed=[] 2024-02-15T23:30:52.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb515b50 con 0x55eebb4de600 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(71 bud.buckets [call] v33'3 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 20 rados->read ofs=0 len=0 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb515b50 con 0x55eebb4de600 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 20 rados_obj.operate() r=0 bl.length=166 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 4.15 4:a90f14c0:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb515b50 con 0x55eebb4e4850 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(73 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:74 4.28 4:15120710:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb5191a0 con 0x55eebb4de600 2024-02-15T23:30:52.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(74 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:75 4.29 4:95a6eeaf:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb519150 con 0x55eebb4e4850 2024-02-15T23:30:52.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(75 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.443+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 4.2d 4:b545390f:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb5195d0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(76 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.3 [call out=85b] v0'0 uv21 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 4.10 4:08eccc6f:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb5195d0 con 0x55eebb4e4850 2024-02-15T23:30:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(77 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:78 4.2a 4:54d91852:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb519a20 con 0x55eebb4de600 2024-02-15T23:30:52.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(78 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:79 4.2 4:4272956c:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb519a20 con 0x55eebb4de600 2024-02-15T23:30:52.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(79 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 4.28 4:1784b628:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb519a20 con 0x55eebb4de600 2024-02-15T23:30:52.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(80 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:81 4.6 4:62758c93:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb519a20 con 0x55eebb4e4850 2024-02-15T23:30:52.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(81 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.8 [call out=85b] v0'0 uv13 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:82 4.11 4:8abd9b85:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb519a20 con 0x7fd2f00e1a30 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(82 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.9 [call out=377b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 10 cls_bucket_list_unordered: got thirteen 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:83 4.3c 4:3c3a1419:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb519a20 con 0x55eebb4de600 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(83 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 get_obj_state: octx=0x7fd2f0005620 obj=myfoo6:thirteen state=0x55eebb51d678 s->prefetch_data=0 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:84 3.bs0 3:d16e49ba:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb519a20 con 0x7fd2f00e1a30 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(84 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 10 manifest: total_size = 8 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 get_obj_state: setting s->obj_tag to cd69b486-4810-48ae-b5d4-5bce307169d4.4227.4974770963839902112 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 Read xattr rgw_rados: user.rgw.acl 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 Read xattr rgw_rados: user.rgw.content_type 2024-02-15T23:30:52.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 Read xattr rgw_rados: user.rgw.etag 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 Read xattr rgw_rados: user.rgw.idtag 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 Read xattr rgw_rados: user.rgw.manifest 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 20 get_obj_state: octx=0x7fd2f0005620 obj=myfoo6:thirteen state=0x55eebb51d678 s->prefetch_data=0 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.447+0000 7fd2fa9b2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 : hit (requested=0x17, cached=0x17) 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.451+0000 7fd2fa9b2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.451+0000 7fd2fa9b2980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.9 2024-02-15T23:30:52.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.451+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:85 4.11 4:8abd9b85:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb518ca0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.451+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(85 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.9 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.451+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:86 3.bs0 3:d16e49ba:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb518ca0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(86 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v33'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:87 4.11 4:8abd9b85:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb522200 con 0x7fd2f00e1a30 2024-02-15T23:30:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:1 objects processed in :myfoo6[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9]). Next marker thirteen 2024-02-15T23:30:52.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb517780 con 0x7fd2ec038c20 2024-02-15T23:30:52.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~347] v33'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2fa9b2980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-15T23:30:52.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2fa9b2980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T23:30:52.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2fa9b2980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-15T23:30:52.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94483833258224 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb51d930 con 0x7fd2f00e1a30 2024-02-15T23:30:52.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== osd_op_reply(87 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9.9 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd1d77fe640 20 handle_completion(): completion ok for obj=thirteen 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== watch-notify(notify (1) cookie 94483833073840 notify 141733920796 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7fd2f010f000 con 0x7fd2f00e1a30 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd1d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 94483833073840 notifier 4730 bl.length()=523 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd1d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd1d6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd1d6ffd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd12c0030d0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.455+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== osd_op_reply(89 notify.5 [notify cookie 94483833258224 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== watch-notify(notify_complete (2) cookie 94483833258224 notify 141733920796 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd2f010c040 con 0x7fd2f00e1a30 2024-02-15T23:30:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb518780 con 0x55eebb4de600 2024-02-15T23:30:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-15T23:30:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T23:30:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-15T23:30:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94483833258224 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb51d490 con 0x7fd2f00e1a30 2024-02-15T23:30:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== watch-notify(notify (1) cookie 94483833073840 notify 141733920797 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7fd2f010c040 con 0x7fd2f00e1a30 2024-02-15T23:30:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd1d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 94483833073840 notifier 4730 bl.length()=177 2024-02-15T23:30:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd1d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-15T23:30:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd1d77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T23:30:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd1d77fe640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd1bc003ea0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(92 notify.5 [notify cookie 94483833258224 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== watch-notify(notify_complete (2) cookie 94483833258224 notify 141733920797 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eebb4a82e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 10 removing user index: bar 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 10 removing default.rgw.meta+users.uid+bar from cache 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94483833259904 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb51d490 con 0x7fd2f00e1a30 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== watch-notify(notify (1) cookie 94483833084688 notify 141733920798 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55eebb4a82e0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd1d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 94483833084688 notifier 4730 bl.length()=152 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd1d6ffd640 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd12c0030d0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 40 ==== osd_op_reply(94 notify.7 [notify cookie 94483833259904 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.459+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 41 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.463+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 42 ==== watch-notify(notify_complete (2) cookie 94483833259904 notify 141733920798 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eebb3beed0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.463+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb5180f0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.463+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 43 ==== osd_op_reply(96 bar [delete] v33'6 uv6 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.470 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:30:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.463+0000 7fd1ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.463+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483833087312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb505890 con 0x55eebb4de600 2024-02-15T23:30:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94483833087312] v33'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483833062976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4ee550 con 0x7fd2ec038c20 2024-02-15T23:30:52.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94483833062976] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2fa9b2980 20 remove_watcher() i=0 2024-02-15T23:30:52.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2fa9b2980 2 removed watcher, disabling cache 2024-02-15T23:30:52.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483833067952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e32c0 con 0x55eebb4de600 2024-02-15T23:30:52.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94483833067952] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2fa9b2980 20 remove_watcher() i=1 2024-02-15T23:30:52.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.467+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483833071648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e32c0 con 0x55eebb4e4850 2024-02-15T23:30:52.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.471+0000 7fd2f7ccc640 1 -- 172.21.15.133:0/2506785749 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94483833071648] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2ec035070 con 0x55eebb4e4850 2024-02-15T23:30:52.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.471+0000 7fd2fa9b2980 20 remove_watcher() i=2 2024-02-15T23:30:52.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.471+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483833076304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e32c0 con 0x7fd2ec038c20 2024-02-15T23:30:52.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.471+0000 7fd2f8cce640 1 -- 172.21.15.133:0/2506785749 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94483833076304] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e803c040 con 0x7fd2ec038c20 2024-02-15T23:30:52.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.471+0000 7fd2fa9b2980 20 remove_watcher() i=3 2024-02-15T23:30:52.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.471+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483833069008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e32c0 con 0x55eebb4de600 2024-02-15T23:30:52.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.475+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94483833069008] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x55eebb4de600 2024-02-15T23:30:52.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.475+0000 7fd2fa9b2980 20 remove_watcher() i=4 2024-02-15T23:30:52.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.475+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483833073840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e32c0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.475+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 44 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94483833073840] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.475+0000 7fd2fa9b2980 20 remove_watcher() i=5 2024-02-15T23:30:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.475+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483833081952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e32c0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 45 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94483833081952] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 20 remove_watcher() i=6 2024-02-15T23:30:52.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483833084688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55eebb4e32c0 con 0x7fd2f00e1a30 2024-02-15T23:30:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 <== osd.0 v2:172.21.15.131:6800/31994139 46 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94483833084688] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2f00e3050 con 0x7fd2f00e1a30 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 20 remove_watcher() i=7 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd2f00e1a30 msgr2=0x7fd2f00b43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd2f00e1a30 0x7fd2f00b43a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb4de600 msgr2=0x55eebb4e0ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb4de600 0x55eebb4e0ac0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd2ec038c20 msgr2=0x7fd2ec04a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd2ec038c20 0x7fd2ec04a070 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55eebb4e4850 msgr2=0x55eebb4e6d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55eebb4e4850 0x55eebb4e6d10 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1c8034260 msgr2=0x7fd1c8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1c8034260 0x7fd1c8036720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8008fd0 tx=0x7fd2e801c070 comp rx=0 tx=0).stop 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 msgr2=0x55eebb4d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/2506785749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4cc290 0x55eebb4d3230 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec01be20 tx=0x7fd2ec049420 comp rx=0 tx=0).stop 2024-02-15T23:30:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2f84cd640 1 -- 172.21.15.133:0/2506785749 reap_dead start 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 shutdown_connections 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 >> 172.21.15.133:0/2506785749 conn(0x55eebb4c8620 msgr2=0x55eebb4c5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 shutdown_connections 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.479+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/2506785749 wait complete. 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/150737081 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1d0034300 msgr2=0x7fd1d00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/150737081 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1d0034300 0x7fd1d00367c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55eebb4af840 tx=0x7fd2e8003070 comp rx=0 tx=0).stop 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/150737081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4bf2e0 msgr2=0x55eebb4bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/150737081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4bf2e0 0x55eebb4bf700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec001780 tx=0x7fd2ec00f7a0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/150737081 shutdown_connections 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/150737081 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1d0034300 0x7fd1d00367c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/150737081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb4bf2e0 0x55eebb4bf700 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/150737081 >> 172.21.15.133:0/150737081 conn(0x55eebb4b40f0 msgr2=0x55eebb4b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/150737081 shutdown_connections 2024-02-15T23:30:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/150737081 wait complete. 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb3ba380 msgr2=0x55eebb4aea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb3ba380 0x55eebb4aea30 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1e0034300 msgr2=0x7fd1e00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1e0034300 0x7fd1e00367c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec001e20 tx=0x7fd2ec0013a0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 msgr2=0x55eebb4a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a7da0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd2f001aec0 tx=0x7fd2f0017e30 comp rx=0 tx=0).stop 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 shutdown_connections 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55eebb3ba380 0x55eebb4aea30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd1e0034300 0x7fd1e00367c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 --2- 172.21.15.133:0/125534862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eebb32b8d0 0x55eebb4a7da0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 >> 172.21.15.133:0/125534862 conn(0x55eebb3b1920 msgr2=0x55eebb49b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 shutdown_connections 2024-02-15T23:30:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:52.483+0000 7fd2fa9b2980 1 -- 172.21.15.133:0/125534862 wait complete. 2024-02-15T23:30:52.498 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:30:57.511 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:57.511 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-15T23:30:57.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-15T23:30:57.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-15T23:30:57.512 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-02-15T23:30:57.558 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.551+0000 7fd83be5a980 1 Processor -- start 2024-02-15T23:30:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.551+0000 7fd83be5a980 1 -- start start 2024-02-15T23:30:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.551+0000 7fd83be5a980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55c84d894590 0x55c84d896980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.551+0000 7fd83be5a980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c84d7dd460 con 0x55c84d890080 2024-02-15T23:30:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.551+0000 7fd83be5a980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c84d7a4180 con 0x55c84d894590 2024-02-15T23:30:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd839174640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55c84d894590 0x55c84d896980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd839174640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55c84d894590 0x55c84d896980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35774/0 (socket says 172.21.15.133:35774) 2024-02-15T23:30:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd839174640 1 -- 172.21.15.133:0/924738808 learned_addr learned my addr 172.21.15.133:0/924738808 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd839975640 1 --1- 172.21.15.133:0/924738808 >> v1:172.21.15.131:6789/0 conn(0x55c84d890080 0x55c84d890460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32882/0 (socket says 172.21.15.133:32882) 2024-02-15T23:30:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd839174640 1 -- 172.21.15.133:0/924738808 >> v1:172.21.15.131:6789/0 conn(0x55c84d890080 legacy=0x55c84d890460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd839174640 1 -- 172.21.15.133:0/924738808 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c84d897ed0 con 0x55c84d894590 2024-02-15T23:30:57.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd839174640 1 --2- 172.21.15.133:0/924738808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d894590 0x55c84d896980 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd83000a5c0 tx=0x7fd83001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0701fd500d02d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd838973640 1 -- 172.21.15.133:0/924738808 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8300aa470 con 0x55c84d894590 2024-02-15T23:30:57.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd838973640 1 -- 172.21.15.133:0/924738808 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8300aa5d0 con 0x55c84d894590 2024-02-15T23:30:57.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.555+0000 7fd838973640 1 -- 172.21.15.133:0/924738808 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8300aa890 con 0x55c84d894590 2024-02-15T23:30:57.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.559+0000 7fd83be5a980 1 -- 172.21.15.133:0/924738808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d894590 msgr2=0x55c84d896980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.559+0000 7fd83be5a980 1 --2- 172.21.15.133:0/924738808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d894590 0x55c84d896980 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd83000a5c0 tx=0x7fd83001b340 comp rx=0 tx=0).stop 2024-02-15T23:30:57.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.559+0000 7fd83be5a980 1 -- 172.21.15.133:0/924738808 shutdown_connections 2024-02-15T23:30:57.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.559+0000 7fd83be5a980 1 --2- 172.21.15.133:0/924738808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d894590 0x55c84d896980 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.559+0000 7fd83be5a980 1 -- 172.21.15.133:0/924738808 >> 172.21.15.133:0/924738808 conn(0x55c84d88b950 msgr2=0x55c84d88dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.559+0000 7fd83be5a980 1 -- 172.21.15.133:0/924738808 shutdown_connections 2024-02-15T23:30:57.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.559+0000 7fd83be5a980 1 -- 172.21.15.133:0/924738808 wait complete. 2024-02-15T23:30:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.571+0000 7fd83be5a980 1 Processor -- start 2024-02-15T23:30:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.571+0000 7fd83be5a980 1 -- start start 2024-02-15T23:30:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.571+0000 7fd83be5a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d978f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.571+0000 7fd83be5a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c84d7a16b0 con 0x55c84d890080 2024-02-15T23:30:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d978f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d978f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35780/0 (socket says 172.21.15.133:35780) 2024-02-15T23:30:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 -- 172.21.15.133:0/2597350658 learned_addr learned my addr 172.21.15.133:0/2597350658 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 -- 172.21.15.133:0/2597350658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830005df0 con 0x55c84d890080 2024-02-15T23:30:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 --2- 172.21.15.133:0/2597350658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d978f50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd834006fb0 tx=0x7fd834001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72300ef2198be553 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd727e07640 1 -- 172.21.15.133:0/2597350658 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd834013420 con 0x55c84d890080 2024-02-15T23:30:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd727e07640 1 -- 172.21.15.133:0/2597350658 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834013580 con 0x55c84d890080 2024-02-15T23:30:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd727e07640 1 -- 172.21.15.133:0/2597350658 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd834013860 con 0x55c84d890080 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 -- 172.21.15.133:0/2597350658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 msgr2=0x55c84d978f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2597350658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d978f50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd834006fb0 tx=0x7fd834001940 comp rx=0 tx=0).stop 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 -- 172.21.15.133:0/2597350658 shutdown_connections 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2597350658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d978f50 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 -- 172.21.15.133:0/2597350658 >> 172.21.15.133:0/2597350658 conn(0x55c84d88b950 msgr2=0x55c84d974ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 -- 172.21.15.133:0/2597350658 shutdown_connections 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 -- 172.21.15.133:0/2597350658 wait complete. 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 Processor -- start 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 -- start start 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d97fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd83be5a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c84d79ce90 con 0x55c84d890080 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d97fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d97fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35782/0 (socket says 172.21.15.133:35782) 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 -- 172.21.15.133:0/2987583652 learned_addr learned my addr 172.21.15.133:0/2987583652 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.575+0000 7fd839975640 1 -- 172.21.15.133:0/2987583652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c84d7dd460 con 0x55c84d890080 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd839975640 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d97fda0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55c84d979de0 tx=0x7fd834000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd726604640 1 -- 172.21.15.133:0/2987583652 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8340037a0 con 0x55c84d890080 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd726604640 1 -- 172.21.15.133:0/2987583652 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834003900 con 0x55c84d890080 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c84d9802e0 con 0x55c84d890080 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd726604640 1 -- 172.21.15.133:0/2987583652 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd834003ba0 con 0x55c84d890080 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c84d980730 con 0x55c84d890080 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd726604640 1 -- 172.21.15.133:0/2987583652 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd834028460 con 0x55c84d890080 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd726604640 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7200342b0 0x7fd720036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd726604640 1 -- 172.21.15.133:0/2987583652 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd8340496b0 con 0x55c84d890080 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd839174640 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7200342b0 0x7fd720036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d894590 0x55c84d986a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d986f70 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83a176640 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d894590 0x55c84d986a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd839174640 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7200342b0 0x7fd720036770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd8300ae000 tx=0x7fd8300a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83a176640 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d894590 0x55c84d986a30 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83a176640 1 -- 172.21.15.133:0/2987583652 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd82c0083f0 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d984130 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83a176640 1 -- 172.21.15.133:0/2987583652 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd82c0083f0 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d988c70 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83a176640 1 -- 172.21.15.133:0/2987583652 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd82c0083f0 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.579+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d987e70 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83a176640 1 -- 172.21.15.133:0/2987583652 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd82c0083f0 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d988280 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83a176640 1 -- 172.21.15.133:0/2987583652 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd82c0121d0 con 0x55c84d894590 2024-02-15T23:30:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83be5a980 1 Processor -- start 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83be5a980 1 -- start start 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83be5a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9972b0 0x55c84d9976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83be5a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c84d735f20 con 0x55c84d9972b0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd839174640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9972b0 0x55c84d9976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd839174640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9972b0 0x55c84d9976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35794/0 (socket says 172.21.15.133:35794) 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd839174640 1 -- 172.21.15.133:0/3913340100 learned_addr learned my addr 172.21.15.133:0/3913340100 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd839174640 1 -- 172.21.15.133:0/3913340100 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c84d997c10 con 0x55c84d9972b0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd839174640 1 --2- 172.21.15.133:0/3913340100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9972b0 0x55c84d9976d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd8300ac040 tx=0x7fd8300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd71f7fe640 1 -- 172.21.15.133:0/3913340100 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8300b3cd0 con 0x55c84d9972b0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83be5a980 1 -- 172.21.15.133:0/3913340100 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c84d997e00 con 0x55c84d9972b0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd83be5a980 1 -- 172.21.15.133:0/3913340100 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c84d9988f0 con 0x55c84d9972b0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd71f7fe640 1 -- 172.21.15.133:0/3913340100 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8300c3070 con 0x55c84d9972b0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd71f7fe640 1 -- 172.21.15.133:0/3913340100 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8300c8430 con 0x55c84d9972b0 2024-02-15T23:30:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.583+0000 7fd71f7fe640 1 -- 172.21.15.133:0/3913340100 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd8300c5030 con 0x55c84d9972b0 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd71f7fe640 1 --2- 172.21.15.133:0/3913340100 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7140342b0 0x7fd714036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd71f7fe640 1 -- 172.21.15.133:0/3913340100 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd8300e6aa0 con 0x55c84d9972b0 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83a176640 1 --2- 172.21.15.133:0/3913340100 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7140342b0 0x7fd714036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 Processor -- start 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83a176640 1 --2- 172.21.15.133:0/3913340100 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7140342b0 0x7fd714036770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55c84d987910 tx=0x7fd82c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- start start 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9a4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c84d729790 con 0x55c84d9a4250 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd839174640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd839174640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35802/0 (socket says 172.21.15.133:35802) 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd839174640 1 -- 172.21.15.133:0/4252285877 learned_addr learned my addr 172.21.15.133:0/4252285877 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd839174640 1 -- 172.21.15.133:0/4252285877 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c84d9a4c40 con 0x55c84d9a4250 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd839174640 1 --2- 172.21.15.133:0/4252285877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9a4670 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd8300e4da0 tx=0x7fd8300bce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c6f0c05ab47e78 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd71d7fa640 1 -- 172.21.15.133:0/4252285877 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8300e4eb0 con 0x55c84d9a4250 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd71d7fa640 1 -- 172.21.15.133:0/4252285877 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8300e6040 con 0x55c84d9a4250 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd71d7fa640 1 -- 172.21.15.133:0/4252285877 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8300c73d0 con 0x55c84d9a4250 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- 172.21.15.133:0/4252285877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 msgr2=0x55c84d9a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 --2- 172.21.15.133:0/4252285877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9a4670 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd8300e4da0 tx=0x7fd8300bce80 comp rx=0 tx=0).stop 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- 172.21.15.133:0/4252285877 shutdown_connections 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 --2- 172.21.15.133:0/4252285877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9a4670 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- 172.21.15.133:0/4252285877 >> 172.21.15.133:0/4252285877 conn(0x55c84d9a05e0 msgr2=0x55c84d99e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- 172.21.15.133:0/4252285877 shutdown_connections 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- 172.21.15.133:0/4252285877 wait complete. 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 Processor -- start 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- start start 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd83be5a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c84d9ab6d0 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd839174640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd839174640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35814/0 (socket says 172.21.15.133:35814) 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.587+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 learned_addr learned my addr 172.21.15.133:0/142355147 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300d6040 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd839174640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9ab190 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd8300bca40 tx=0x7fd8300e4d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd70b7fe640 1 -- 172.21.15.133:0/142355147 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8300c0040 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c84d9ab8d0 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd70b7fe640 1 -- 172.21.15.133:0/142355147 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8300c01a0 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd70b7fe640 1 -- 172.21.15.133:0/142355147 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8300c0310 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c84d9abd60 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd70b7fe640 1 -- 172.21.15.133:0/142355147 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd8300ada20 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd70b7fe640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7040342b0 0x7fd704036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd70b7fe640 1 -- 172.21.15.133:0/142355147 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd8300f2d70 con 0x55c84d9a4250 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83a176640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7040342b0 0x7fd704036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d9b6400 0x55c84d9b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9b9010 con 0x55c84d9b6400 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd839975640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d9b6400 0x55c84d9b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83a176640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7040342b0 0x7fd704036770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd82c008fd0 tx=0x7fd82c01d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd839975640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d9b6400 0x55c84d9b88c0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 20 realm 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9b93e0 con 0x55c84d9b6400 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:57.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.591+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9b9c60 con 0x55c84d9b6400 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9b9fc0 con 0x55c84d9b6400 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9ba7c0 con 0x55c84d9b6400 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 20 searching for the correct realm 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55c84d9bc650 0x55c84d9bea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839174640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55c84d9bc650 0x55c84d9bea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839174640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55c84d9bc650 0x55c84d9bea80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839174640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd8300f1070 0x7fd8300ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd8300f1070 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83a176640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd8300f1070 0x7fd8300ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83a176640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd8300f1070 0x7fd8300ad340 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd82c02d040 con 0x7fd8300f1070 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd8300f1070 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd82c02d040 con 0x7fd8300f1070 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9b6400 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9b6400 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839975640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd83401dba0 0x7fd834046130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.595+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd83401dba0 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839975640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd83401dba0 0x7fd834046130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839975640 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd83401dba0 0x7fd834046130 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd83401dba0 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd8300f1070 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd82c02d040 con 0x7fd8300f1070 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9b6400 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.599+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd83401dba0 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9b6400 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd8300f1070 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd82c02d040 con 0x7fd8300f1070 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd83401dba0 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9b6400 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9b6400 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.603+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd83401dba0 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd8300f1070 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd82c02d040 con 0x7fd8300f1070 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9b6400 2024-02-15T23:30:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd8300f1070 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd82c02d040 con 0x7fd8300f1070 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd83401dba0 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd8300f1070 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9bc650 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.607+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd83401dba0 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x55c84d9b6400 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf150 con 0x7fd8300f1070 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bb0c0 con 0x55c84d9b6400 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bb8c0 con 0x55c84d9b6400 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf590 con 0x55c84d9b6400 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 zone default found 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 4 Realm: () 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 zonegroup default 2024-02-15T23:30:57.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9bf590 con 0x7fd8300f1070 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c1320 con 0x55c84d9bc650 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c16f0 con 0x55c84d9bc650 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 started sync module instance, tier type = 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.611+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c0c00 con 0x7fd8300f1070 2024-02-15T23:30:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.615+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.615+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94318783891296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c0fb0 con 0x7fd8300f1070 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.615+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c2450 con 0x55c84d9b6400 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.615+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94318783891296] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.615+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.615+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94318783896336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c23d0 con 0x55c84d9b6400 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.615+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c2e40 con 0x55c84d9bc650 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94318783896336] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94318783897392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c2350 con 0x55c84d9bc650 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c3b30 con 0x7fd8300f1070 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94318783903680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c4380 con 0x7fd8300f1070 2024-02-15T23:30:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c4da0 con 0x55c84d9b6400 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94318783897392] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.619+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94318783903680] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.623+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.623+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94318783907968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c3ee0 con 0x55c84d9b6400 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.623+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c55f0 con 0x7fd83401dba0 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.623+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94318783907968] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.623+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.623+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94318783902192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c3ee0 con 0x7fd83401dba0 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.623+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c5c00 con 0x7fd83401dba0 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(56 notify.6 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94318783911776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c6020 con 0x7fd83401dba0 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c6a40 con 0x7fd83401dba0 2024-02-15T23:30:57.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94318783902192] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94318783915296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c6a00 con 0x7fd83401dba0 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 20 add_watcher() i=0 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 20 add_watcher() i=1 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 20 add_watcher() i=2 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 20 add_watcher() i=3 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 20 add_watcher() i=4 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 20 add_watcher() i=5 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94318783911776] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.627+0000 7fd83be5a980 20 add_watcher() i=6 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94318783915296] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 20 add_watcher() i=7 2024-02-15T23:30:57.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c5b80 con 0x55c84d9b6400 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94318783910224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c5b80 con 0x55c84d9b6400 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94318783910224] v33'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd6eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 5 note: GC not initialized 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd6ea7fc640 20 reqs_thread_entry: start 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 20 Filter name: none 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd65bfff640 20 reqs_thread_entry: start 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:30:57.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.631+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9eb930 con 0x7fd83401dba0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9ea120 con 0x7fd83401dba0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T23:30:57.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9ea520 con 0x7fd83401dba0 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v33'7 uv7 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94318784066448 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9ead80 con 0x7fd83401dba0 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== watch-notify(notify (1) cookie 94318783902192 notify 141733920799 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7fd8340601a0 con 0x7fd83401dba0 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd71d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 94318783902192 notifier 4737 bl.length()=523 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd71d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd71d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(65 notify.5 [notify cookie 94318784066448 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.635+0000 7fd71d7fa640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd6fc003ea0 con 0x7fd83401dba0 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== watch-notify(notify_complete (2) cookie 94318784066448 notify 141733920799 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c84d980730 con 0x7fd83401dba0 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9ead80 con 0x7fd83401dba0 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'11 uv11 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd83be5a980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd83be5a980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd83be5a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94318784063712 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9ead00 con 0x55c84d9bc650 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== watch-notify(notify (1) cookie 94318783897392 notify 141733920774 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55c84d9a4c40 con 0x55c84d9bc650 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd71cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94318783897392 notifier 4737 bl.length()=177 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd71cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd71cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd71cff9640 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd664003400 con 0x55c84d9bc650 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(68 notify.2 [notify cookie 94318784063712 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.639+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== watch-notify(notify_complete (2) cookie 94318784063712 notify 141733920774 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c84d9988f0 con 0x55c84d9bc650 2024-02-15T23:30:57.657 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd6eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94318783910224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9cc140 con 0x55c84d9b6400 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94318783910224] v33'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94318783891296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c5150 con 0x7fd8300f1070 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94318783891296] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd83be5a980 20 remove_watcher() i=0 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd83be5a980 2 removed watcher, disabling cache 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.643+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94318783896336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c0760 con 0x55c84d9b6400 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.647+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94318783896336] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.647+0000 7fd83be5a980 20 remove_watcher() i=1 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.647+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94318783897392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c0760 con 0x55c84d9bc650 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.647+0000 7fd839174640 1 -- 172.21.15.133:0/142355147 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94318783897392] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd8300e2070 con 0x55c84d9bc650 2024-02-15T23:30:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.647+0000 7fd83be5a980 20 remove_watcher() i=2 2024-02-15T23:30:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.647+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94318783903680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c1fb0 con 0x7fd8300f1070 2024-02-15T23:30:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.651+0000 7fd83a176640 1 -- 172.21.15.133:0/142355147 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94318783903680] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd82c03d040 con 0x7fd8300f1070 2024-02-15T23:30:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.651+0000 7fd83be5a980 20 remove_watcher() i=3 2024-02-15T23:30:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.651+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94318783907968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c0760 con 0x55c84d9b6400 2024-02-15T23:30:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.651+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94318783907968] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x55c84d9b6400 2024-02-15T23:30:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.651+0000 7fd83be5a980 20 remove_watcher() i=4 2024-02-15T23:30:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.651+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94318783902192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c0760 con 0x7fd83401dba0 2024-02-15T23:30:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.655+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94318783902192] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.655+0000 7fd83be5a980 20 remove_watcher() i=5 2024-02-15T23:30:57.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.655+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94318783911776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c31f0 con 0x7fd83401dba0 2024-02-15T23:30:57.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.655+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94318783911776] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.655+0000 7fd83be5a980 20 remove_watcher() i=6 2024-02-15T23:30:57.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.655+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94318783915296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c84d9c31f0 con 0x7fd83401dba0 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94318783915296] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd834024020 con 0x7fd83401dba0 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 20 remove_watcher() i=7 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd83401dba0 msgr2=0x7fd834046130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fd83401dba0 0x7fd834046130 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d9b6400 msgr2=0x55c84d9b88c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d9b6400 0x55c84d9b88c0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd8300f1070 msgr2=0x7fd8300ad340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fd8300f1070 0x7fd8300ad340 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55c84d9bc650 msgr2=0x55c84d9bea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55c84d9bc650 0x55c84d9bea80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7040342b0 msgr2=0x7fd704036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7040342b0 0x7fd704036770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd82c008fd0 tx=0x7fd82c01d070 comp rx=0 tx=0).stop 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 msgr2=0x55c84d9ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd839975640 1 -- 172.21.15.133:0/142355147 reap_dead start 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9ab190 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd8300bca40 tx=0x7fd8300e4d00 comp rx=0 tx=0).stop 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 shutdown_connections 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/142355147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9a4250 0x55c84d9ab190 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 >> 172.21.15.133:0/142355147 conn(0x55c84d9a05e0 msgr2=0x55c84d99dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 shutdown_connections 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/142355147 wait complete. 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/3913340100 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7140342b0 msgr2=0x7fd714036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/3913340100 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7140342b0 0x7fd714036770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55c84d987910 tx=0x7fd82c003070 comp rx=0 tx=0).stop 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/3913340100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9972b0 msgr2=0x55c84d9976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/3913340100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9972b0 0x55c84d9976d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd8300ac040 tx=0x7fd8300180e0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/3913340100 shutdown_connections 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/3913340100 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7140342b0 0x7fd714036770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/3913340100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d9972b0 0x55c84d9976d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/3913340100 >> 172.21.15.133:0/3913340100 conn(0x55c84d98c0c0 msgr2=0x55c84d98cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/3913340100 shutdown_connections 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/3913340100 wait complete. 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d894590 msgr2=0x55c84d986a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d894590 0x55c84d986a30 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7200342b0 msgr2=0x7fd720036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7200342b0 0x7fd720036770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd8300ae000 tx=0x7fd8300a6000 comp rx=0 tx=0).stop 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 msgr2=0x55c84d97fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d97fda0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55c84d979de0 tx=0x7fd834000f50 comp rx=0 tx=0).stop 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 shutdown_connections 2024-02-15T23:30:57.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55c84d894590 0x55c84d986a30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd7200342b0 0x7fd720036770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 --2- 172.21.15.133:0/2987583652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c84d890080 0x55c84d97fda0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 >> 172.21.15.133:0/2987583652 conn(0x55c84d88b950 msgr2=0x55c84d9735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 shutdown_connections 2024-02-15T23:30:57.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.659+0000 7fd83be5a980 1 -- 172.21.15.133:0/2987583652 wait complete. 2024-02-15T23:30:57.679 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T23:30:57.695 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:57.702 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-02-15T23:30:57.702 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-15T23:30:57.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-15T23:30:57.703 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-02-15T23:30:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:57.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.735+0000 7fa44ff15980 1 Processor -- start 2024-02-15T23:30:57.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.735+0000 7fa44ff15980 1 -- start start 2024-02-15T23:30:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.735+0000 7fa44ff15980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56459a2d1e20 0x56459a366190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.735+0000 7fa44ff15980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56459a2a94d0 con 0x56459a2d3160 2024-02-15T23:30:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.735+0000 7fa44ff15980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x56459a270180 con 0x56459a2d1e20 2024-02-15T23:30:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.739+0000 7fa44d22f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56459a2d1e20 0x56459a366190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.739+0000 7fa44d22f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x56459a2d1e20 0x56459a366190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35826/0 (socket says 172.21.15.133:35826) 2024-02-15T23:30:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.739+0000 7fa44d22f640 1 -- 172.21.15.133:0/13546021 learned_addr learned my addr 172.21.15.133:0/13546021 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.739+0000 7fa44da30640 1 --1- 172.21.15.133:0/13546021 >> v1:172.21.15.131:6789/0 conn(0x56459a2d3160 0x56459a2d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32892/0 (socket says 172.21.15.133:32892) 2024-02-15T23:30:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.739+0000 7fa44d22f640 1 -- 172.21.15.133:0/13546021 >> v1:172.21.15.131:6789/0 conn(0x56459a2d3160 legacy=0x56459a2d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.739+0000 7fa44d22f640 1 -- 172.21.15.133:0/13546021 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459a2d2230 con 0x56459a2d1e20 2024-02-15T23:30:57.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.739+0000 7fa44d22f640 1 --2- 172.21.15.133:0/13546021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a366190 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa44400a5c0 tx=0x7fa44401b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27abf7b077aa288 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.739+0000 7fa44ca2e640 1 -- 172.21.15.133:0/13546021 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440ac5b0 con 0x56459a2d1e20 2024-02-15T23:30:57.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ca2e640 1 -- 172.21.15.133:0/13546021 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440ac710 con 0x56459a2d1e20 2024-02-15T23:30:57.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ca2e640 1 -- 172.21.15.133:0/13546021 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440ac9d0 con 0x56459a2d1e20 2024-02-15T23:30:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ff15980 1 -- 172.21.15.133:0/13546021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 msgr2=0x56459a366190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ff15980 1 --2- 172.21.15.133:0/13546021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a366190 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa44400a5c0 tx=0x7fa44401b360 comp rx=0 tx=0).stop 2024-02-15T23:30:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ff15980 1 -- 172.21.15.133:0/13546021 shutdown_connections 2024-02-15T23:30:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ff15980 1 --2- 172.21.15.133:0/13546021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a366190 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ff15980 1 -- 172.21.15.133:0/13546021 >> 172.21.15.133:0/13546021 conn(0x56459a358a50 msgr2=0x56459a35ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ff15980 1 -- 172.21.15.133:0/13546021 shutdown_connections 2024-02-15T23:30:57.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.743+0000 7fa44ff15980 1 -- 172.21.15.133:0/13546021 wait complete. 2024-02-15T23:30:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.755+0000 7fa44ff15980 1 Processor -- start 2024-02-15T23:30:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.755+0000 7fa44ff15980 1 -- start start 2024-02-15T23:30:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.755+0000 7fa44ff15980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a449500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.755+0000 7fa44ff15980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459a26d6b0 con 0x56459a2d1e20 2024-02-15T23:30:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a449500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a449500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35838/0 (socket says 172.21.15.133:35838) 2024-02-15T23:30:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 -- 172.21.15.133:0/258906559 learned_addr learned my addr 172.21.15.133:0/258906559 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 -- 172.21.15.133:0/258906559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa444005df0 con 0x56459a2d1e20 2024-02-15T23:30:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 --2- 172.21.15.133:0/258906559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a449500 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa440001d40 tx=0x7fa44000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf2181b3653d86d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa33be07640 1 -- 172.21.15.133:0/258906559 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa440014070 con 0x56459a2d1e20 2024-02-15T23:30:57.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa33be07640 1 -- 172.21.15.133:0/258906559 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44000f590 con 0x56459a2d1e20 2024-02-15T23:30:57.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa33be07640 1 -- 172.21.15.133:0/258906559 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa440007040 con 0x56459a2d1e20 2024-02-15T23:30:57.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 -- 172.21.15.133:0/258906559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 msgr2=0x56459a449500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 --2- 172.21.15.133:0/258906559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a449500 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa440001d40 tx=0x7fa44000b610 comp rx=0 tx=0).stop 2024-02-15T23:30:57.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 -- 172.21.15.133:0/258906559 shutdown_connections 2024-02-15T23:30:57.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 --2- 172.21.15.133:0/258906559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a449500 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 -- 172.21.15.133:0/258906559 >> 172.21.15.133:0/258906559 conn(0x56459a358a50 msgr2=0x56459a445090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 -- 172.21.15.133:0/258906559 shutdown_connections 2024-02-15T23:30:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 -- 172.21.15.133:0/258906559 wait complete. 2024-02-15T23:30:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 Processor -- start 2024-02-15T23:30:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 -- start start 2024-02-15T23:30:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a450370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44ff15980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459a268e90 con 0x56459a2d1e20 2024-02-15T23:30:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a450370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a450370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35852/0 (socket says 172.21.15.133:35852) 2024-02-15T23:30:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 -- 172.21.15.133:0/758336338 learned_addr learned my addr 172.21.15.133:0/758336338 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.759+0000 7fa44da30640 1 -- 172.21.15.133:0/758336338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459a2a94d0 con 0x56459a2d1e20 2024-02-15T23:30:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44da30640 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a450370 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x56459a44a390 tx=0x7fa440000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa33a604640 1 -- 172.21.15.133:0/758336338 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa440014030 con 0x56459a2d1e20 2024-02-15T23:30:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56459a4508b0 con 0x56459a2d1e20 2024-02-15T23:30:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa33a604640 1 -- 172.21.15.133:0/758336338 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440001530 con 0x56459a2d1e20 2024-02-15T23:30:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa33a604640 1 -- 172.21.15.133:0/758336338 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa44000ead0 con 0x56459a2d1e20 2024-02-15T23:30:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56459a450d00 con 0x56459a2d1e20 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa33a604640 1 -- 172.21.15.133:0/758336338 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa44000ec30 con 0x56459a2d1e20 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa33a604640 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa3340342b0 0x7fa334036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa33a604640 1 -- 172.21.15.133:0/758336338 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa440006070 con 0x56459a2d1e20 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44d22f640 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa3340342b0 0x7fa334036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44ff15980 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a2d3160 0x56459a456fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a457520 con 0x56459a2d3160 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44e231640 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a2d3160 0x56459a456fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44d22f640 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa3340342b0 0x7fa334036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa4440ae000 tx=0x7fa4440a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44e231640 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a2d3160 0x56459a456fe0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44e231640 1 -- 172.21.15.133:0/758336338 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa44800a4d0 con 0x56459a2d3160 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a454730 con 0x56459a2d3160 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44e231640 1 -- 172.21.15.133:0/758336338 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa44800a4d0 con 0x56459a2d3160 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.763+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a459250 con 0x56459a2d3160 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44e231640 1 -- 172.21.15.133:0/758336338 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa44800a4d0 con 0x56459a2d3160 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a458450 con 0x56459a2d3160 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44e231640 1 -- 172.21.15.133:0/758336338 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa44800a4d0 con 0x56459a2d3160 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a458860 con 0x56459a2d3160 2024-02-15T23:30:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44e231640 1 -- 172.21.15.133:0/758336338 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa44800a4d0 con 0x56459a2d3160 2024-02-15T23:30:57.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44ff15980 1 Processor -- start 2024-02-15T23:30:57.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44ff15980 1 -- start start 2024-02-15T23:30:57.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44ff15980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a467910 0x56459a467d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44ff15980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459a201f20 con 0x56459a467910 2024-02-15T23:30:57.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44d22f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a467910 0x56459a467d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44d22f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a467910 0x56459a467d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35856/0 (socket says 172.21.15.133:35856) 2024-02-15T23:30:57.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44d22f640 1 -- 172.21.15.133:0/3067072899 learned_addr learned my addr 172.21.15.133:0/3067072899 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44d22f640 1 -- 172.21.15.133:0/3067072899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459a468270 con 0x56459a467910 2024-02-15T23:30:57.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44d22f640 1 --2- 172.21.15.133:0/3067072899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a467910 0x56459a467d30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa444000c10 tx=0x7fa444018100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa3337fe640 1 -- 172.21.15.133:0/3067072899 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440c1460 con 0x56459a467910 2024-02-15T23:30:57.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44ff15980 1 -- 172.21.15.133:0/3067072899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56459a468460 con 0x56459a467910 2024-02-15T23:30:57.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa3337fe640 1 -- 172.21.15.133:0/3067072899 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440c15c0 con 0x56459a467910 2024-02-15T23:30:57.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa3337fe640 1 -- 172.21.15.133:0/3067072899 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440c1860 con 0x56459a467910 2024-02-15T23:30:57.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.767+0000 7fa44ff15980 1 -- 172.21.15.133:0/3067072899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56459a468f50 con 0x56459a467910 2024-02-15T23:30:57.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa3337fe640 1 -- 172.21.15.133:0/3067072899 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa4440b3040 con 0x56459a467910 2024-02-15T23:30:57.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa3337fe640 1 --2- 172.21.15.133:0/3067072899 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa328034300 0x7fa3280367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa3337fe640 1 -- 172.21.15.133:0/3067072899 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa4440bb040 con 0x56459a467910 2024-02-15T23:30:57.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44e231640 1 --2- 172.21.15.133:0/3067072899 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa328034300 0x7fa3280367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 Processor -- start 2024-02-15T23:30:57.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 -- start start 2024-02-15T23:30:57.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44e231640 1 --2- 172.21.15.133:0/3067072899 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa328034300 0x7fa3280367c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x56459a457e90 tx=0x7fa448005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a474d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459a1f5790 con 0x56459a474930 2024-02-15T23:30:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44d22f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a474d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44d22f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a474d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35872/0 (socket says 172.21.15.133:35872) 2024-02-15T23:30:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44d22f640 1 -- 172.21.15.133:0/1000888655 learned_addr learned my addr 172.21.15.133:0/1000888655 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44d22f640 1 -- 172.21.15.133:0/1000888655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459a475320 con 0x56459a474930 2024-02-15T23:30:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44d22f640 1 --2- 172.21.15.133:0/1000888655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a474d50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa4440e4610 tx=0x7fa4440aaad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e493fdb3cf86b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa3317fa640 1 -- 172.21.15.133:0/1000888655 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440bee10 con 0x56459a474930 2024-02-15T23:30:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa3317fa640 1 -- 172.21.15.133:0/1000888655 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440c0cc0 con 0x56459a474930 2024-02-15T23:30:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa3317fa640 1 -- 172.21.15.133:0/1000888655 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440cb7e0 con 0x56459a474930 2024-02-15T23:30:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 -- 172.21.15.133:0/1000888655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 msgr2=0x56459a474d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 --2- 172.21.15.133:0/1000888655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a474d50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa4440e4610 tx=0x7fa4440aaad0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 -- 172.21.15.133:0/1000888655 shutdown_connections 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 --2- 172.21.15.133:0/1000888655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a474d50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 -- 172.21.15.133:0/1000888655 >> 172.21.15.133:0/1000888655 conn(0x56459a470cc0 msgr2=0x56459a46ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 -- 172.21.15.133:0/1000888655 shutdown_connections 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.771+0000 7fa44ff15980 1 -- 172.21.15.133:0/1000888655 wait complete. 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44ff15980 1 Processor -- start 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44ff15980 1 -- start start 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44ff15980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a47b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44ff15980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459a47bda0 con 0x56459a474930 2024-02-15T23:30:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44d22f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a47b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44d22f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a47b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35878/0 (socket says 172.21.15.133:35878) 2024-02-15T23:30:57.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 learned_addr learned my addr 172.21.15.133:0/662603132 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459a468f50 con 0x56459a474930 2024-02-15T23:30:57.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44d22f640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a47b860 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa4440aafb0 tx=0x7fa4440e4570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa31f7fe640 1 -- 172.21.15.133:0/662603132 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440c0e30 con 0x56459a474930 2024-02-15T23:30:57.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56459a47bfa0 con 0x56459a474930 2024-02-15T23:30:57.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa31f7fe640 1 -- 172.21.15.133:0/662603132 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440bee10 con 0x56459a474930 2024-02-15T23:30:57.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56459a47c430 con 0x56459a474930 2024-02-15T23:30:57.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa31f7fe640 1 -- 172.21.15.133:0/662603132 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440be6d0 con 0x56459a474930 2024-02-15T23:30:57.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.775+0000 7fa31f7fe640 1 -- 172.21.15.133:0/662603132 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa4440be880 con 0x56459a474930 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa31f7fe640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa318034300 0x7fa3180367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa31f7fe640 1 -- 172.21.15.133:0/662603132 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa4440f2d20 con 0x56459a474930 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44e231640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa318034300 0x7fa3180367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a486cd0 0x56459a489190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4898e0 con 0x56459a486cd0 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44da30640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a486cd0 0x56459a489190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44e231640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa318034300 0x7fa3180367c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa448011010 tx=0x7fa448020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44da30640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a486cd0 0x56459a489190 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 realm 2024-02-15T23:30:57.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a489c70 con 0x56459a486cd0 2024-02-15T23:30:57.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48a4c0 con 0x56459a486cd0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48a820 con 0x56459a486cd0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48b020 con 0x56459a486cd0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 20 searching for the correct realm 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56459a48ceb0 0x56459a48f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44d22f640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56459a48ceb0 0x56459a48f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44d22f640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56459a48ceb0 0x56459a48f370 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44d22f640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa4440f1020 0x7fa4440d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa4440f1020 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44e231640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa4440f1020 0x7fa4440d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44e231640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa4440f1020 0x7fa4440d5460 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa44800a4d0 con 0x7fa4440f1020 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.779+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa4440f1020 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa44800a4d0 con 0x7fa4440f1020 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a486cd0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a486cd0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa44001c440 0x7fa440017940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa44001c440 2024-02-15T23:30:57.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa44001c440 0x7fa440017940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa44001c440 0x7fa440017940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa44001c440 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa4440f1020 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa44800a4d0 con 0x7fa4440f1020 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a486cd0 2024-02-15T23:30:57.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.783+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa44001c440 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a486cd0 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa4440f1020 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa44001c440 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a486cd0 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a486cd0 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.787+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa44001c440 2024-02-15T23:30:57.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa4440f1020 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a486cd0 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa4440f1020 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa44001c440 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa4440f1020 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a48ceb0 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa44001c440 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x56459a486cd0 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.791+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fa40 con 0x7fa4440f1020 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48b920 con 0x56459a486cd0 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48c120 con 0x56459a486cd0 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fe80 con 0x56459a486cd0 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 zone default found 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 4 Realm: () 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 zonegroup default 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a48fe80 con 0x7fa4440f1020 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a491d00 con 0x56459a48ceb0 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a492060 con 0x56459a48ceb0 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 started sync module instance, tier type = 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4912d0 con 0x7fa4440f1020 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94856941213312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4912d0 con 0x7fa4440f1020 2024-02-15T23:30:57.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.795+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4929d0 con 0x56459a486cd0 2024-02-15T23:30:57.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.799+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94856941213312] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.799+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.799+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94856941211488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4929d0 con 0x56459a486cd0 2024-02-15T23:30:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.799+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a493340 con 0x56459a48ceb0 2024-02-15T23:30:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94856941219488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a493b90 con 0x56459a48ceb0 2024-02-15T23:30:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94856941211488] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a494090 con 0x7fa4440f1020 2024-02-15T23:30:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94856941217072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4948e0 con 0x7fa4440f1020 2024-02-15T23:30:57.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4952d0 con 0x56459a486cd0 2024-02-15T23:30:57.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94856941219488] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.803+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94856941217072] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.807+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.807+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94856941227440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a494440 con 0x56459a486cd0 2024-02-15T23:30:57.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.807+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a495b20 con 0x7fa44001c440 2024-02-15T23:30:57.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.807+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.807+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94856941229696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a494440 con 0x7fa44001c440 2024-02-15T23:30:57.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.807+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a496610 con 0x7fa44001c440 2024-02-15T23:30:57.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.807+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94856941227440] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94856941229696] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94856941232400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4965d0 con 0x7fa44001c440 2024-02-15T23:30:57.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4969f0 con 0x7fa44001c440 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94856941232400] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94856941230752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4969f0 con 0x7fa44001c440 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 20 add_watcher() i=0 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 20 add_watcher() i=1 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 20 add_watcher() i=2 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 20 add_watcher() i=3 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 20 add_watcher() i=4 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 20 add_watcher() i=5 2024-02-15T23:30:57.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.811+0000 7fa44ff15980 20 add_watcher() i=6 2024-02-15T23:30:57.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94856941230752] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 20 add_watcher() i=7 2024-02-15T23:30:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a499ef0 con 0x56459a486cd0 2024-02-15T23:30:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94856941221616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a497280 con 0x56459a486cd0 2024-02-15T23:30:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94856941221616] v33'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa2ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 5 note: GC not initialized 2024-02-15T23:30:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa2fe7fc640 20 reqs_thread_entry: start 2024-02-15T23:30:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 20 Filter name: none 2024-02-15T23:30:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa273fff640 20 reqs_thread_entry: start 2024-02-15T23:30:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-15T23:30:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4bbd60 con 0x7fa4440f1020 2024-02-15T23:30:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(62 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T23:30:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-15T23:30:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T23:30:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.815+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4bf8d0 con 0x7fa44001c440 2024-02-15T23:30:57.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.819+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v33'8 uv7 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.826 INFO:teuthology.orchestra.run.smithi133.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-02-15T23:30:57.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.819+0000 7fa2ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:57.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.819+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94856941221616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4bc930 con 0x56459a486cd0 2024-02-15T23:30:57.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94856941221616] v33'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94856941213312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4936f0 con 0x7fa4440f1020 2024-02-15T23:30:57.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94856941213312] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44ff15980 20 remove_watcher() i=0 2024-02-15T23:30:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44ff15980 2 removed watcher, disabling cache 2024-02-15T23:30:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94856941211488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4936f0 con 0x56459a486cd0 2024-02-15T23:30:57.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94856941211488] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44ff15980 20 remove_watcher() i=1 2024-02-15T23:30:57.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.823+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94856941219488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a490f60 con 0x56459a48ceb0 2024-02-15T23:30:57.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.827+0000 7fa44d22f640 1 -- 172.21.15.133:0/662603132 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94856941219488] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4440ee070 con 0x56459a48ceb0 2024-02-15T23:30:57.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.827+0000 7fa44ff15980 20 remove_watcher() i=2 2024-02-15T23:30:57.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.827+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94856941217072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4936f0 con 0x7fa4440f1020 2024-02-15T23:30:57.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.827+0000 7fa44e231640 1 -- 172.21.15.133:0/662603132 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94856941217072] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa448039060 con 0x7fa4440f1020 2024-02-15T23:30:57.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.827+0000 7fa44ff15980 20 remove_watcher() i=3 2024-02-15T23:30:57.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.827+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94856941227440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a492530 con 0x56459a486cd0 2024-02-15T23:30:57.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.831+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94856941227440] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x56459a486cd0 2024-02-15T23:30:57.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.831+0000 7fa44ff15980 20 remove_watcher() i=4 2024-02-15T23:30:57.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.831+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94856941229696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a4936f0 con 0x7fa44001c440 2024-02-15T23:30:57.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.831+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94856941229696] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.831+0000 7fa44ff15980 20 remove_watcher() i=5 2024-02-15T23:30:57.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.831+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94856941232400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a494db0 con 0x7fa44001c440 2024-02-15T23:30:57.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94856941232400] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 20 remove_watcher() i=6 2024-02-15T23:30:57.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94856941230752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56459a492530 con 0x7fa44001c440 2024-02-15T23:30:57.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94856941230752] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa440016070 con 0x7fa44001c440 2024-02-15T23:30:57.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 20 remove_watcher() i=7 2024-02-15T23:30:57.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa44001c440 msgr2=0x7fa440017940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7fa44001c440 0x7fa440017940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a486cd0 msgr2=0x56459a489190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a486cd0 0x56459a489190 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa4440f1020 msgr2=0x7fa4440d5460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fa4440f1020 0x7fa4440d5460 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56459a48ceb0 msgr2=0x56459a48f370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x56459a48ceb0 0x56459a48f370 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa318034300 msgr2=0x7fa3180367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa318034300 0x7fa3180367c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa448011010 tx=0x7fa448020000 comp rx=0 tx=0).stop 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 msgr2=0x56459a47b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44da30640 1 -- 172.21.15.133:0/662603132 reap_dead start 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a47b860 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa4440aafb0 tx=0x7fa4440e4570 comp rx=0 tx=0).stop 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 shutdown_connections 2024-02-15T23:30:57.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 --2- 172.21.15.133:0/662603132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a474930 0x56459a47b860 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 >> 172.21.15.133:0/662603132 conn(0x56459a470cc0 msgr2=0x56459a46e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 shutdown_connections 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.835+0000 7fa44ff15980 1 -- 172.21.15.133:0/662603132 wait complete. 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/3067072899 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa328034300 msgr2=0x7fa3280367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/3067072899 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa328034300 0x7fa3280367c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x56459a457e90 tx=0x7fa448005850 comp rx=0 tx=0).stop 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/3067072899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a467910 msgr2=0x56459a467d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/3067072899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a467910 0x56459a467d30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa444000c10 tx=0x7fa444018100 comp rx=0 tx=0).stop 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/3067072899 shutdown_connections 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/3067072899 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa328034300 0x7fa3280367c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/3067072899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a467910 0x56459a467d30 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/3067072899 >> 172.21.15.133:0/3067072899 conn(0x56459a45c720 msgr2=0x56459a45d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/3067072899 shutdown_connections 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/3067072899 wait complete. 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a2d3160 msgr2=0x56459a456fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a2d3160 0x56459a456fe0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa3340342b0 msgr2=0x7fa334036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa3340342b0 0x7fa334036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa4440ae000 tx=0x7fa4440a6000 comp rx=0 tx=0).stop 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 msgr2=0x56459a450370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a450370 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x56459a44a390 tx=0x7fa440000ee0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 shutdown_connections 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x56459a2d3160 0x56459a456fe0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa3340342b0 0x7fa334036770 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 --2- 172.21.15.133:0/758336338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56459a2d1e20 0x56459a450370 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 >> 172.21.15.133:0/758336338 conn(0x56459a358a50 msgr2=0x56459a443ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 shutdown_connections 2024-02-15T23:30:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.839+0000 7fa44ff15980 1 -- 172.21.15.133:0/758336338 wait complete. 2024-02-15T23:30:57.855 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-15T23:30:57.862 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:57.862 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-15T23:30:57.867 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-15T23:30:57.867 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-02-15T23:30:57.868 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-15T23:30:57.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-15T23:30:57.868 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-02-15T23:30:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.927+0000 7f1fdf471980 1 Processor -- start 2024-02-15T23:30:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.927+0000 7f1fdf471980 1 -- start start 2024-02-15T23:30:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.927+0000 7f1fdf471980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55dc93a3a8f0 0x55dc93a3cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.927+0000 7f1fdf471980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dc939804d0 con 0x55dc939a80d0 2024-02-15T23:30:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.927+0000 7f1fdf471980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dc93947180 con 0x55dc93a3a8f0 2024-02-15T23:30:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdc78b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55dc93a3a8f0 0x55dc93a3cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdcf8c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55dc939a80d0 0x55dc93a391d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32904/0 (socket says 172.21.15.133:32904) 2024-02-15T23:30:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdc78b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55dc93a3a8f0 0x55dc93a3cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35886/0 (socket says 172.21.15.133:35886) 2024-02-15T23:30:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/963242042 learned_addr learned my addr 172.21.15.133:0/963242042 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdc78b640 1 -- 172.21.15.133:0/963242042 >> v1:172.21.15.131:6789/0 conn(0x55dc939a80d0 legacy=0x55dc93a391d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdc78b640 1 -- 172.21.15.133:0/963242042 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc93a3e230 con 0x55dc93a3a8f0 2024-02-15T23:30:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/963242042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93a3cce0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400a480 tx=0x7f1fc401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941e202e3b32904 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdbf8a640 1 -- 172.21.15.133:0/963242042 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc40ab540 con 0x55dc93a3a8f0 2024-02-15T23:30:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdbf8a640 1 -- 172.21.15.133:0/963242042 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc40ab6a0 con 0x55dc93a3a8f0 2024-02-15T23:30:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdbf8a640 1 -- 172.21.15.133:0/963242042 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc40ab960 con 0x55dc93a3a8f0 2024-02-15T23:30:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdf471980 1 -- 172.21.15.133:0/963242042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 msgr2=0x55dc93a3cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.931+0000 7f1fdf471980 1 --2- 172.21.15.133:0/963242042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93a3cce0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400a480 tx=0x7f1fc401b280 comp rx=0 tx=0).stop 2024-02-15T23:30:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.935+0000 7f1fdf471980 1 -- 172.21.15.133:0/963242042 shutdown_connections 2024-02-15T23:30:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.935+0000 7f1fdf471980 1 --2- 172.21.15.133:0/963242042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93a3cce0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.935+0000 7f1fdf471980 1 -- 172.21.15.133:0/963242042 >> 172.21.15.133:0/963242042 conn(0x55dc93a2e8f0 msgr2=0x55dc93a30d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.935+0000 7f1fdf471980 1 -- 172.21.15.133:0/963242042 shutdown_connections 2024-02-15T23:30:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.935+0000 7f1fdf471980 1 -- 172.21.15.133:0/963242042 wait complete. 2024-02-15T23:30:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.947+0000 7f1fdf471980 1 Processor -- start 2024-02-15T23:30:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.947+0000 7f1fdf471980 1 -- start start 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.947+0000 7f1fdf471980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc939a80d0 0x55dc93b20330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.947+0000 7f1fdf471980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc939446b0 con 0x55dc939a80d0 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.947+0000 7f1fdcf8c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc939a80d0 0x55dc93b20330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.947+0000 7f1fdcf8c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc939a80d0 0x55dc93b20330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35888/0 (socket says 172.21.15.133:35888) 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.947+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/3740071280 learned_addr learned my addr 172.21.15.133:0/3740071280 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.947+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/3740071280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4005d30 con 0x55dc939a80d0 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdcf8c640 1 --2- 172.21.15.133:0/3740071280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc939a80d0 0x55dc93b20330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4006fb0 tx=0x7f1fd4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebaa614e4f228d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1ecae0d640 1 -- 172.21.15.133:0/3740071280 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fd4004530 con 0x55dc939a80d0 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1ecae0d640 1 -- 172.21.15.133:0/3740071280 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4004690 con 0x55dc939a80d0 2024-02-15T23:30:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1ecae0d640 1 -- 172.21.15.133:0/3740071280 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fd40049b0 con 0x55dc939a80d0 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- 172.21.15.133:0/3740071280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc939a80d0 msgr2=0x55dc93b20330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3740071280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc939a80d0 0x55dc93b20330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4006fb0 tx=0x7f1fd4001940 comp rx=0 tx=0).stop 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- 172.21.15.133:0/3740071280 shutdown_connections 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3740071280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc939a80d0 0x55dc93b20330 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- 172.21.15.133:0/3740071280 >> 172.21.15.133:0/3740071280 conn(0x55dc93a2e8f0 msgr2=0x55dc93b1bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- 172.21.15.133:0/3740071280 shutdown_connections 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- 172.21.15.133:0/3740071280 wait complete. 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 Processor -- start 2024-02-15T23:30:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- start start 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93b27470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc9393fe90 con 0x55dc93a3a8f0 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdcf8c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93b27470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdcf8c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93b27470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35898/0 (socket says 172.21.15.133:35898) 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/3090501011 learned_addr learned my addr 172.21.15.133:0/3090501011 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/3090501011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc939804d0 con 0x55dc93a3a8f0 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdcf8c640 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93b27470 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400f000 tx=0x7f1fd4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1ec960a640 1 -- 172.21.15.133:0/3090501011 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fd4013630 con 0x55dc93a3a8f0 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dc93b279b0 con 0x55dc93a3a8f0 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc93b27de0 con 0x55dc93a3a8f0 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1ec960a640 1 -- 172.21.15.133:0/3090501011 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4013790 con 0x55dc93a3a8f0 2024-02-15T23:30:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.951+0000 7f1ec960a640 1 -- 172.21.15.133:0/3090501011 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fd4013a70 con 0x55dc93a3a8f0 2024-02-15T23:30:57.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1ec960a640 1 -- 172.21.15.133:0/3090501011 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fd4013bd0 con 0x55dc93a3a8f0 2024-02-15T23:30:57.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1ec960a640 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec40342b0 0x7f1ec4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1ec960a640 1 -- 172.21.15.133:0/3090501011 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1fd4049450 con 0x55dc93a3a8f0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec40342b0 0x7f1ec4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b2c0a0 0x55dc93b2e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b2e9d0 con 0x55dc93b2c0a0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdd78d640 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b2c0a0 0x55dc93b2e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec40342b0 0x7f1ec4036770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40ad000 tx=0x7f1fc40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdd78d640 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b2c0a0 0x55dc93b2e490 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdd78d640 1 -- 172.21.15.133:0/3090501011 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fcc0083f0 con 0x55dc93b2c0a0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b2ed30 con 0x55dc93b2c0a0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdd78d640 1 -- 172.21.15.133:0/3090501011 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1fcc0083f0 con 0x55dc93b2c0a0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b305c0 con 0x55dc93b2c0a0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdd78d640 1 -- 172.21.15.133:0/3090501011 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1fcc0083f0 con 0x55dc93b2c0a0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b2f7c0 con 0x55dc93b2c0a0 2024-02-15T23:30:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdd78d640 1 -- 172.21.15.133:0/3090501011 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fcc0083f0 con 0x55dc93b2c0a0 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b2fbd0 con 0x55dc93b2c0a0 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdd78d640 1 -- 172.21.15.133:0/3090501011 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1fcc012040 con 0x55dc93b2c0a0 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 Processor -- start 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 -- start start 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b3ec40 0x55dc93b3f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdf471980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc938d8f20 con 0x55dc93b3ec40 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.955+0000 7f1fdc78b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b3ec40 0x55dc93b3f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdc78b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b3ec40 0x55dc93b3f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35908/0 (socket says 172.21.15.133:35908) 2024-02-15T23:30:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdc78b640 1 -- 172.21.15.133:0/3970852718 learned_addr learned my addr 172.21.15.133:0/3970852718 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdc78b640 1 -- 172.21.15.133:0/3970852718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc93b3f5a0 con 0x55dc93b3ec40 2024-02-15T23:30:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/3970852718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b3ec40 0x55dc93b3f060 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4096e80 tx=0x7f1fc4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1ec27fc640 1 -- 172.21.15.133:0/3970852718 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc40bd8a0 con 0x55dc93b3ec40 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1ec27fc640 1 -- 172.21.15.133:0/3970852718 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc40bda00 con 0x55dc93b3ec40 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdf471980 1 -- 172.21.15.133:0/3970852718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dc93b3f790 con 0x55dc93b3ec40 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1ec27fc640 1 -- 172.21.15.133:0/3970852718 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc40bdca0 con 0x55dc93b3ec40 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdf471980 1 -- 172.21.15.133:0/3970852718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc93b402e0 con 0x55dc93b3ec40 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1ec27fc640 1 -- 172.21.15.133:0/3970852718 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fc40be480 con 0x55dc93b3ec40 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1ec27fc640 1 --2- 172.21.15.133:0/3970852718 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb40342b0 0x7f1eb4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1ec27fc640 1 -- 172.21.15.133:0/3970852718 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1fc40e6400 con 0x55dc93b3ec40 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdd78d640 1 --2- 172.21.15.133:0/3970852718 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb40342b0 0x7f1eb4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdf471980 1 Processor -- start 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdf471980 1 -- start start 2024-02-15T23:30:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdd78d640 1 --2- 172.21.15.133:0/3970852718 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb40342b0 0x7f1eb4036770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55dc93b2f200 tx=0x7f1fcc003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdf471980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b4c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdf471980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc938cc790 con 0x55dc93b4bca0 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdc78b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b4c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdc78b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b4c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35922/0 (socket says 172.21.15.133:35922) 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.959+0000 7f1fdc78b640 1 -- 172.21.15.133:0/657451165 learned_addr learned my addr 172.21.15.133:0/657451165 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdc78b640 1 -- 172.21.15.133:0/657451165 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc93b4c670 con 0x55dc93b4bca0 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/657451165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b4c0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40e4780 tx=0x7f1fc40aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815925be8217b4ca server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1eb3fff640 1 -- 172.21.15.133:0/657451165 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc40064c0 con 0x55dc93b4bca0 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1eb3fff640 1 -- 172.21.15.133:0/657451165 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc40be730 con 0x55dc93b4bca0 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1eb3fff640 1 -- 172.21.15.133:0/657451165 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc40b4c50 con 0x55dc93b4bca0 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- 172.21.15.133:0/657451165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 msgr2=0x55dc93b4c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 --2- 172.21.15.133:0/657451165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b4c0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40e4780 tx=0x7f1fc40aae30 comp rx=0 tx=0).stop 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- 172.21.15.133:0/657451165 shutdown_connections 2024-02-15T23:30:57.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 --2- 172.21.15.133:0/657451165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b4c0a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- 172.21.15.133:0/657451165 >> 172.21.15.133:0/657451165 conn(0x55dc93b47fe0 msgr2=0x55dc93b46040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- 172.21.15.133:0/657451165 shutdown_connections 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- 172.21.15.133:0/657451165 wait complete. 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 Processor -- start 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- start start 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b52b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc93b53070 con 0x55dc93b4bca0 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdc78b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b52b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdc78b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b52b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35932/0 (socket says 172.21.15.133:35932) 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 learned_addr learned my addr 172.21.15.133:0/1147735015 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc93b402e0 con 0x55dc93b4bca0 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b52b30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40aae70 tx=0x7f1fc40e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1eb27fc640 1 -- 172.21.15.133:0/1147735015 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc40d5050 con 0x55dc93b4bca0 2024-02-15T23:30:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1eb27fc640 1 -- 172.21.15.133:0/1147735015 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc40d6040 con 0x55dc93b4bca0 2024-02-15T23:30:57.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dc93b53270 con 0x55dc93b4bca0 2024-02-15T23:30:57.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1eb27fc640 1 -- 172.21.15.133:0/1147735015 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fc40068e0 con 0x55dc93b4bca0 2024-02-15T23:30:57.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.963+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc93b53640 con 0x55dc93b4bca0 2024-02-15T23:30:57.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1eb27fc640 1 -- 172.21.15.133:0/1147735015 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1fc40b4c50 con 0x55dc93b4bca0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1eb27fc640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 0x7f1ea8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1eb27fc640 1 -- 172.21.15.133:0/1147735015 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1fc40b6160 con 0x55dc93b4bca0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdd78d640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 0x7f1ea8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b5e170 0x55dc93b60630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b60d80 con 0x55dc93b5e170 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdcf8c640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b5e170 0x55dc93b60630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdd78d640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 0x7f1ea8036770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc008fd0 tx=0x7f1fcc01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdcf8c640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b5e170 0x55dc93b60630 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 realm 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b61150 con 0x55dc93b5e170 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b619a0 con 0x55dc93b5e170 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b61d00 con 0x55dc93b5e170 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b62500 con 0x55dc93b5e170 2024-02-15T23:30:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 20 searching for the correct realm 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55dc93b643c0 0x55dc93b66880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55dc93b643c0 0x55dc93b66880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55dc93b643c0 0x55dc93b66880 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdc78b640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fc40ef070 0x7f1fc40ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x7f1fc40ef070 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.967+0000 7f1fdd78d640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fc40ef070 0x7f1fc40ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdd78d640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fc40ef070 0x7f1fc40ef7b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc02c040 con 0x7f1fc40ef070 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x7f1fc40ef070 2024-02-15T23:30:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc02c040 con 0x7f1fc40ef070 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b5e170 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b5e170 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55dc939a80d0 0x7f1fd4011a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc939a80d0 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55dc939a80d0 0x7f1fd4011a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55dc939a80d0 0x7f1fd4011a30 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc939a80d0 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc939a80d0 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc939a80d0 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x7f1fc40ef070 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc02c040 con 0x7f1fc40ef070 2024-02-15T23:30:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.971+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b5e170 2024-02-15T23:30:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc939a80d0 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc939a80d0 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b5e170 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4024020 con 0x55dc93b5e170 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x7f1fc40ef070 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1fcc02c040 con 0x7f1fc40ef070 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc939a80d0 2024-02-15T23:30:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b5e170 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b5e170 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.975+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc939a80d0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x7f1fc40ef070 2024-02-15T23:30:57.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc02c040 con 0x7f1fc40ef070 2024-02-15T23:30:57.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b5e170 2024-02-15T23:30:57.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:57.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x7f1fc40ef070 2024-02-15T23:30:57.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc02c040 con 0x7f1fc40ef070 2024-02-15T23:30:57.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc939a80d0 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x7f1fc40ef070 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b643c0 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc939a80d0 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x55dc93b5e170 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b66f50 con 0x7f1fc40ef070 2024-02-15T23:30:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdf471980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdf471980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdf471980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdf471980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdf471980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdf471980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.979+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b639a0 con 0x55dc93b5e170 2024-02-15T23:30:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:57.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:57.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b62e50 con 0x55dc93b5e170 2024-02-15T23:30:57.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:57.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:57.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:57.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b632f0 con 0x55dc93b5e170 2024-02-15T23:30:57.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:57.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:57.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 zone default found 2024-02-15T23:30:57.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 4 Realm: () 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 zonegroup default 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b67390 con 0x7f1fc40ef070 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69210 con 0x55dc93b643c0 2024-02-15T23:30:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69570 con 0x55dc93b643c0 2024-02-15T23:30:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 started sync module instance, tier type = 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b687e0 con 0x7f1fc40ef070 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94405859380112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b687e0 con 0x7f1fc40ef070 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69ee0 con 0x55dc93b5e170 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.983+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94405859380112] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.987+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.987+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94405859378256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69ee0 con 0x55dc93b5e170 2024-02-15T23:30:58.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.987+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6a850 con 0x55dc93b643c0 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.987+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94405859378256] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.987+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.987+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94405859383872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69e60 con 0x55dc93b643c0 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.987+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6b580 con 0x7f1fc40ef070 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.991+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.991+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94405859389600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6be00 con 0x7f1fc40ef070 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.991+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6c7b0 con 0x55dc93b5e170 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.991+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94405859383872] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.991+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94405859389600] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.991+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.991+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94405859388416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6b960 con 0x55dc93b5e170 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.991+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6d030 con 0x55dc939a80d0 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.995+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94405859388416] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.995+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.995+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94405859394256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6b960 con 0x55dc939a80d0 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.995+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6d640 con 0x55dc939a80d0 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.995+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94405859394256] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94405859396496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6d640 con 0x55dc939a80d0 2024-02-15T23:30:58.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6de80 con 0x55dc939a80d0 2024-02-15T23:30:58.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94405859396496] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94405859398528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6dd80 con 0x55dc939a80d0 2024-02-15T23:30:58.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 20 add_watcher() i=0 2024-02-15T23:30:58.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 20 add_watcher() i=1 2024-02-15T23:30:58.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 20 add_watcher() i=2 2024-02-15T23:30:58.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 20 add_watcher() i=3 2024-02-15T23:30:58.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 20 add_watcher() i=4 2024-02-15T23:30:58.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 20 add_watcher() i=5 2024-02-15T23:30:58.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:57.999+0000 7f1fdf471980 20 add_watcher() i=6 2024-02-15T23:30:58.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94405859398528] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdf471980 20 add_watcher() i=7 2024-02-15T23:30:58.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdf471980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:58.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b712b0 con 0x55dc93b5e170 2024-02-15T23:30:58.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94405859399712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6e760 con 0x55dc93b5e170 2024-02-15T23:30:58.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94405859399712] v33'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1e92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:58.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdf471980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:58.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdf471980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:58.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.003+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b70c30 con 0x55dc93b5e170 2024-02-15T23:30:58.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.007+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.007+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b70c60 con 0x55dc939a80d0 2024-02-15T23:30:58.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.007+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.007+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b70c20 con 0x55dc93b643c0 2024-02-15T23:30:58.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.007+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.007+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7a980 con 0x55dc93b5e170 2024-02-15T23:30:58.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.011+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'219 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.011+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b79970 con 0x7f1fc40ef070 2024-02-15T23:30:58.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.011+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'68 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.011+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b79970 con 0x55dc93b643c0 2024-02-15T23:30:58.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.011+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'45 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.011+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7bb60 con 0x55dc93b5e170 2024-02-15T23:30:58.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.015+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.015+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7bb60 con 0x55dc939a80d0 2024-02-15T23:30:58.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.015+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.015+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7bb60 con 0x7f1fc40ef070 2024-02-15T23:30:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.019+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.019+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b78960 con 0x55dc93b643c0 2024-02-15T23:30:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.019+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.019+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7c6d0 con 0x7f1fc40ef070 2024-02-15T23:30:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.019+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'69 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.019+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cb70 con 0x55dc939a80d0 2024-02-15T23:30:58.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.023+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'32 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.023+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cb70 con 0x7f1fc40ef070 2024-02-15T23:30:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.023+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.023+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b78f70 con 0x55dc939a80d0 2024-02-15T23:30:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.027+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'51 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.027+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b78f20 con 0x55dc93b5e170 2024-02-15T23:30:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.027+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'220 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.027+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b78f20 con 0x55dc93b643c0 2024-02-15T23:30:58.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.031+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'62 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.031+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b78f20 con 0x7f1fc40ef070 2024-02-15T23:30:58.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.031+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'70 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.031+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7ccf0 con 0x55dc93b643c0 2024-02-15T23:30:58.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.031+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.031+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc90 con 0x55dc93b5e170 2024-02-15T23:30:58.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.035+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.035+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc90 con 0x55dc93b5e170 2024-02-15T23:30:58.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.035+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'221 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.035+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc90 con 0x55dc93b643c0 2024-02-15T23:30:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.035+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'63 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.039+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x7f1fc40ef070 2024-02-15T23:30:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.039+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.039+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc93b643c0 2024-02-15T23:30:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.039+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.039+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc93b643c0 2024-02-15T23:30:58.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.043+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'33 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.043+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc93b643c0 2024-02-15T23:30:58.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.043+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'22 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.043+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc93b643c0 2024-02-15T23:30:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.043+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'46 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.043+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc939a80d0 2024-02-15T23:30:58.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.047+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.047+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc93b643c0 2024-02-15T23:30:58.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.047+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.047+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc939a80d0 2024-02-15T23:30:58.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.051+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.051+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc93b643c0 2024-02-15T23:30:58.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.051+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'64 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.051+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x55dc939a80d0 2024-02-15T23:30:58.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.055+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'52 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.055+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b7cc00 con 0x7f1fc40ef070 2024-02-15T23:30:58.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.055+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.055+0000 7f1e91fe3640 20 reqs_thread_entry: start 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.055+0000 7f1fdf471980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 20 Filter name: none 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1e037fe640 20 reqs_thread_entry: start 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b76c80 con 0x7f1fc40ef070 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(94 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T23:30:58.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-15T23:30:58.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T23:30:58.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:58.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b76c80 con 0x55dc93b5e170 2024-02-15T23:30:58.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-02-15T23:30:58.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-15T23:30:58.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94405859436512 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b996f0 con 0x55dc939a80d0 2024-02-15T23:30:58.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== watch-notify(notify (1) cookie 94405859394256 notify 141733920801 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55dc93b27de0 con 0x55dc939a80d0 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1eb3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94405859394256 notifier 4751 bl.length()=170 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1eb3fff640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1ea0003d60 con 0x55dc939a80d0 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(96 notify.5 [notify cookie 94405859436512 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== watch-notify(notify_complete (2) cookie 94405859436512 notify 141733920801 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1fd402d070 con 0x55dc939a80d0 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b75c70 con 0x55dc93b5e170 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v33'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 removing email index: 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 removing user buckets index 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-02-15T23:30:58.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.059+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94405859436512 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b996f0 con 0x55dc939a80d0 2024-02-15T23:30:58.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== watch-notify(notify (1) cookie 94405859396496 notify 141733920802 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f1fd402d070 con 0x55dc939a80d0 2024-02-15T23:30:58.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1eb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94405859396496 notifier 4751 bl.length()=160 2024-02-15T23:30:58.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1eb37fe640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1e100032c0 con 0x55dc939a80d0 2024-02-15T23:30:58.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(99 notify.6 [notify cookie 94405859436512 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== watch-notify(notify_complete (2) cookie 94405859436512 notify 141733920802 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55dc93b279b0 con 0x55dc939a80d0 2024-02-15T23:30:58.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b75c70 con 0x55dc93b5e170 2024-02-15T23:30:58.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(101 bud.buckets [delete] v33'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdf471980 10 removing user index: bud 2024-02-15T23:30:58.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdf471980 10 removing default.rgw.meta+users.uid+bud from cache 2024-02-15T23:30:58.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdf471980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-15T23:30:58.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94405859432400 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b986e0 con 0x55dc939a80d0 2024-02-15T23:30:58.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== watch-notify(notify (1) cookie 94405859394256 notify 141733920803 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55dc93b279b0 con 0x55dc939a80d0 2024-02-15T23:30:58.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1eb3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94405859394256 notifier 4751 bl.length()=152 2024-02-15T23:30:58.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== osd_op_reply(102 notify.5 [notify cookie 94405859432400 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.063+0000 7f1eb3fff640 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1ea0003d60 con 0x55dc939a80d0 2024-02-15T23:30:58.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.067+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.067+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== watch-notify(notify_complete (2) cookie 94405859432400 notify 141733920803 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55dc939804d0 con 0x55dc939a80d0 2024-02-15T23:30:58.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.067+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b767e0 con 0x7f1fc40ef070 2024-02-15T23:30:58.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.067+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(104 bud [call,call,delete] v33'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.067+0000 7f1e92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:58.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.067+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94405859399712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b77540 con 0x55dc93b5e170 2024-02-15T23:30:58.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.067+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94405859399712] v33'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.067+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94405859380112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6d7e0 con 0x7f1fc40ef070 2024-02-15T23:30:58.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.071+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94405859380112] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.071+0000 7f1fdf471980 20 remove_watcher() i=0 2024-02-15T23:30:58.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.071+0000 7f1fdf471980 2 removed watcher, disabling cache 2024-02-15T23:30:58.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.071+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94405859378256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b68b90 con 0x55dc93b5e170 2024-02-15T23:30:58.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.071+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94405859378256] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.071+0000 7f1fdf471980 20 remove_watcher() i=1 2024-02-15T23:30:58.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.071+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94405859383872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b68b90 con 0x55dc93b643c0 2024-02-15T23:30:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdc78b640 1 -- 172.21.15.133:0/1147735015 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94405859383872] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fc40ec070 con 0x55dc93b643c0 2024-02-15T23:30:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdf471980 20 remove_watcher() i=2 2024-02-15T23:30:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94405859389600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69a40 con 0x7f1fc40ef070 2024-02-15T23:30:58.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdd78d640 1 -- 172.21.15.133:0/1147735015 <== osd.2 v2:172.21.15.133:6808/3615800201 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94405859389600] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fcc03c040 con 0x7f1fc40ef070 2024-02-15T23:30:58.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdf471980 20 remove_watcher() i=3 2024-02-15T23:30:58.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94405859388416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69a40 con 0x55dc93b5e170 2024-02-15T23:30:58.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94405859388416] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc93b5e170 2024-02-15T23:30:58.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdf471980 20 remove_watcher() i=4 2024-02-15T23:30:58.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.075+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94405859394256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69a40 con 0x55dc939a80d0 2024-02-15T23:30:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.079+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94405859394256] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.079+0000 7f1fdf471980 20 remove_watcher() i=5 2024-02-15T23:30:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.079+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94405859396496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b6c2d0 con 0x55dc939a80d0 2024-02-15T23:30:58.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.079+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94405859396496] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.079+0000 7f1fdf471980 20 remove_watcher() i=6 2024-02-15T23:30:58.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.079+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94405859398528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55dc93b69a40 con 0x55dc939a80d0 2024-02-15T23:30:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94405859398528] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fd4052040 con 0x55dc939a80d0 2024-02-15T23:30:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 20 remove_watcher() i=7 2024-02-15T23:30:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55dc939a80d0 msgr2=0x7f1fd4011a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x55dc939a80d0 0x7f1fd4011a30 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b5e170 msgr2=0x55dc93b60630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b5e170 0x55dc93b60630 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fc40ef070 msgr2=0x7f1fc40ef7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f1fc40ef070 0x7f1fc40ef7b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55dc93b643c0 msgr2=0x55dc93b66880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55dc93b643c0 0x55dc93b66880 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 msgr2=0x7f1ea8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ea80342b0 0x7f1ea8036770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc008fd0 tx=0x7f1fcc01c070 comp rx=0 tx=0).stop 2024-02-15T23:30:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 msgr2=0x55dc93b52b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdcf8c640 1 -- 172.21.15.133:0/1147735015 reap_dead start 2024-02-15T23:30:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b52b30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40aae70 tx=0x7f1fc40e46e0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 shutdown_connections 2024-02-15T23:30:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/1147735015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b4bca0 0x55dc93b52b30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 >> 172.21.15.133:0/1147735015 conn(0x55dc93b47fe0 msgr2=0x55dc93b45640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 shutdown_connections 2024-02-15T23:30:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/1147735015 wait complete. 2024-02-15T23:30:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3970852718 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb40342b0 msgr2=0x7f1eb4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3970852718 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb40342b0 0x7f1eb4036770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55dc93b2f200 tx=0x7f1fcc003070 comp rx=0 tx=0).stop 2024-02-15T23:30:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3970852718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b3ec40 msgr2=0x55dc93b3f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3970852718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b3ec40 0x55dc93b3f060 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4096e80 tx=0x7f1fc4018020 comp rx=0 tx=0).stop 2024-02-15T23:30:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3970852718 shutdown_connections 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3970852718 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1eb40342b0 0x7f1eb4036770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3970852718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93b3ec40 0x55dc93b3f060 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3970852718 >> 172.21.15.133:0/3970852718 conn(0x55dc93b33a50 msgr2=0x55dc93b34560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3970852718 shutdown_connections 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3970852718 wait complete. 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b2c0a0 msgr2=0x55dc93b2e490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b2c0a0 0x55dc93b2e490 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec40342b0 msgr2=0x7f1ec4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec40342b0 0x7f1ec4036770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40ad000 tx=0x7f1fc40a5040 comp rx=0 tx=0).stop 2024-02-15T23:30:58.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 msgr2=0x55dc93b27470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93b27470 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400f000 tx=0x7f1fd4000f50 comp rx=0 tx=0).stop 2024-02-15T23:30:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 shutdown_connections 2024-02-15T23:30:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55dc93b2c0a0 0x55dc93b2e490 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1ec40342b0 0x7f1ec4036770 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 --2- 172.21.15.133:0/3090501011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc93a3a8f0 0x55dc93b27470 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 >> 172.21.15.133:0/3090501011 conn(0x55dc93a2e8f0 msgr2=0x55dc93b1a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 shutdown_connections 2024-02-15T23:30:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.083+0000 7f1fdf471980 1 -- 172.21.15.133:0/3090501011 wait complete. 2024-02-15T23:30:58.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-15T23:30:58.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-15T23:30:58.101 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-02-15T23:30:58.179 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:30:58.179 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:30:58.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.171+0000 7f9426c67980 1 Processor -- start 2024-02-15T23:30:58.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f9426c67980 1 -- start start 2024-02-15T23:30:58.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f9426c67980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x559840e29860 0x559840e2bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f9426c67980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559840d6f4d0 con 0x559840e25360 2024-02-15T23:30:58.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f9426c67980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x559840d36180 con 0x559840e29860 2024-02-15T23:30:58.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f941bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x559840e29860 0x559840e2bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f9424782640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x559840e25360 0x559840e25740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32914/0 (socket says 172.21.15.133:32914) 2024-02-15T23:30:58.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f9424782640 1 -- 172.21.15.133:0/2183113666 learned_addr learned my addr 172.21.15.133:0/2183113666 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:30:58.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f941bfff640 1 -- 172.21.15.133:0/2183113666 >> v1:172.21.15.131:6789/0 conn(0x559840e25360 legacy=0x559840e25740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.175+0000 7f941bfff640 1 -- 172.21.15.133:0/2183113666 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559840e2d1a0 con 0x559840e29860 2024-02-15T23:30:58.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f941bfff640 1 --2- 172.21.15.133:0/2183113666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e29860 0x559840e2bc50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f941400a480 tx=0x7f941401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d1529b8dc8ceff server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9423f81640 1 -- 172.21.15.133:0/2183113666 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94140ab540 con 0x559840e29860 2024-02-15T23:30:58.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9423f81640 1 -- 172.21.15.133:0/2183113666 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94140ab6a0 con 0x559840e29860 2024-02-15T23:30:58.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9423f81640 1 -- 172.21.15.133:0/2183113666 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94140ab960 con 0x559840e29860 2024-02-15T23:30:58.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9426c67980 1 -- 172.21.15.133:0/2183113666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e29860 msgr2=0x559840e2bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9426c67980 1 --2- 172.21.15.133:0/2183113666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e29860 0x559840e2bc50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f941400a480 tx=0x7f941401b280 comp rx=0 tx=0).stop 2024-02-15T23:30:58.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9426c67980 1 -- 172.21.15.133:0/2183113666 shutdown_connections 2024-02-15T23:30:58.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9426c67980 1 --2- 172.21.15.133:0/2183113666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e29860 0x559840e2bc50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9426c67980 1 -- 172.21.15.133:0/2183113666 >> 172.21.15.133:0/2183113666 conn(0x559840d98a50 msgr2=0x559840d98e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9426c67980 1 -- 172.21.15.133:0/2183113666 shutdown_connections 2024-02-15T23:30:58.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.179+0000 7f9426c67980 1 -- 172.21.15.133:0/2183113666 wait complete. 2024-02-15T23:30:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.191+0000 7f9426c67980 1 Processor -- start 2024-02-15T23:30:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.191+0000 7f9426c67980 1 -- start start 2024-02-15T23:30:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.191+0000 7f9426c67980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f0f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.191+0000 7f9426c67980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559840d336b0 con 0x559840e25360 2024-02-15T23:30:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.191+0000 7f9424782640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f0f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.191+0000 7f9424782640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f0f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35950/0 (socket says 172.21.15.133:35950) 2024-02-15T23:30:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.191+0000 7f9424782640 1 -- 172.21.15.133:0/4147077595 learned_addr learned my addr 172.21.15.133:0/4147077595 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.191+0000 7f9424782640 1 -- 172.21.15.133:0/4147077595 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414005d30 con 0x559840e25360 2024-02-15T23:30:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9424782640 1 --2- 172.21.15.133:0/4147077595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f0f2b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f940c001c90 tx=0x7f940c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4aa5b0605e9bc9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f931260c640 1 -- 172.21.15.133:0/4147077595 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f940c00e690 con 0x559840e25360 2024-02-15T23:30:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f931260c640 1 -- 172.21.15.133:0/4147077595 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c00e7f0 con 0x559840e25360 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f931260c640 1 -- 172.21.15.133:0/4147077595 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f940c00eaf0 con 0x559840e25360 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- 172.21.15.133:0/4147077595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 msgr2=0x559840f0f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 --2- 172.21.15.133:0/4147077595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f0f2b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f940c001c90 tx=0x7f940c00b6d0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- 172.21.15.133:0/4147077595 shutdown_connections 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 --2- 172.21.15.133:0/4147077595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f0f2b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- 172.21.15.133:0/4147077595 >> 172.21.15.133:0/4147077595 conn(0x559840d98a50 msgr2=0x559840f0ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- 172.21.15.133:0/4147077595 shutdown_connections 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- 172.21.15.133:0/4147077595 wait complete. 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 Processor -- start 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- start start 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f16100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559840d2ee90 con 0x559840e25360 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9424782640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f16100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9424782640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f16100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35966/0 (socket says 172.21.15.133:35966) 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9424782640 1 -- 172.21.15.133:0/2776558801 learned_addr learned my addr 172.21.15.133:0/2776558801 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9424782640 1 -- 172.21.15.133:0/2776558801 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559840d6f4d0 con 0x559840e25360 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9424782640 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f16100 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f940c001ee0 tx=0x7f940c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9310e09640 1 -- 172.21.15.133:0/2776558801 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f940c01f070 con 0x559840e25360 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559840f16640 con 0x559840e25360 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9310e09640 1 -- 172.21.15.133:0/2776558801 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c01a4d0 con 0x559840e25360 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9310e09640 1 -- 172.21.15.133:0/2776558801 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f940c01a770 con 0x559840e25360 2024-02-15T23:30:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.195+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559840f16a90 con 0x559840e25360 2024-02-15T23:30:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9310e09640 1 -- 172.21.15.133:0/2776558801 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f940c00a040 con 0x559840e25360 2024-02-15T23:30:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9310e09640 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f930c0342b0 0x7f930c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9310e09640 1 -- 172.21.15.133:0/2776558801 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f940c0496e0 con 0x559840e25360 2024-02-15T23:30:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f941bfff640 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f930c0342b0 0x7f930c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840e29860 0x559840f1cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f1d2d0 con 0x559840e29860 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9424f83640 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840e29860 0x559840f1cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f941bfff640 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f930c0342b0 0x7f930c036770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f94140ad000 tx=0x7f94140a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9424f83640 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840e29860 0x559840f1cd90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9424f83640 1 -- 172.21.15.133:0/2776558801 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f941c00a4d0 con 0x559840e29860 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f1d670 con 0x559840e29860 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9424f83640 1 -- 172.21.15.133:0/2776558801 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f941c00a4d0 con 0x559840e29860 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f1eef0 con 0x559840e29860 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9424f83640 1 -- 172.21.15.133:0/2776558801 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f941c00a4d0 con 0x559840e29860 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f1e0f0 con 0x559840e29860 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9424f83640 1 -- 172.21.15.133:0/2776558801 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f941c00a4d0 con 0x559840e29860 2024-02-15T23:30:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f1e500 con 0x559840e29860 2024-02-15T23:30:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9424f83640 1 -- 172.21.15.133:0/2776558801 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f941c00a4d0 con 0x559840e29860 2024-02-15T23:30:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 Processor -- start 2024-02-15T23:30:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 -- start start 2024-02-15T23:30:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f2d5f0 0x559840f2da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f9426c67980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559840cc7f20 con 0x559840f2d5f0 2024-02-15T23:30:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f941bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f2d5f0 0x559840f2da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f941bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f2d5f0 0x559840f2da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35982/0 (socket says 172.21.15.133:35982) 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.199+0000 7f941bfff640 1 -- 172.21.15.133:0/2338567416 learned_addr learned my addr 172.21.15.133:0/2338567416 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f941bfff640 1 -- 172.21.15.133:0/2338567416 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559840f2df50 con 0x559840f2d5f0 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f941bfff640 1 --2- 172.21.15.133:0/2338567416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f2d5f0 0x559840f2da10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f94140ab670 tx=0x7f9414018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9309ffb640 1 -- 172.21.15.133:0/2338567416 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94140be7c0 con 0x559840f2d5f0 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9426c67980 1 -- 172.21.15.133:0/2338567416 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559840f2e140 con 0x559840f2d5f0 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9309ffb640 1 -- 172.21.15.133:0/2338567416 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94140be920 con 0x559840f2d5f0 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9426c67980 1 -- 172.21.15.133:0/2338567416 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559840f2ec90 con 0x559840f2d5f0 2024-02-15T23:30:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9309ffb640 1 -- 172.21.15.133:0/2338567416 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94140bebc0 con 0x559840f2d5f0 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9309ffb640 1 -- 172.21.15.133:0/2338567416 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f94140bed20 con 0x559840f2d5f0 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9309ffb640 1 --2- 172.21.15.133:0/2338567416 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92fc0342b0 0x7f92fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9309ffb640 1 -- 172.21.15.133:0/2338567416 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f94140e63a0 con 0x559840f2d5f0 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9424f83640 1 --2- 172.21.15.133:0/2338567416 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92fc0342b0 0x7f92fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9426c67980 1 Processor -- start 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9426c67980 1 -- start start 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9424f83640 1 --2- 172.21.15.133:0/2338567416 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92fc0342b0 0x7f92fc036770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x559840f1db30 tx=0x7f941c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9426c67980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f3a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f9426c67980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559840cbb790 con 0x559840f3a5c0 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f941bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f3a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f941bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f3a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:35986/0 (socket says 172.21.15.133:35986) 2024-02-15T23:30:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f941bfff640 1 -- 172.21.15.133:0/1234095161 learned_addr learned my addr 172.21.15.133:0/1234095161 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.203+0000 7f941bfff640 1 -- 172.21.15.133:0/1234095161 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559840f3afb0 con 0x559840f3a5c0 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f941bfff640 1 --2- 172.21.15.133:0/1234095161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f3a9e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f94140e46f0 tx=0x7f94140bc730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b6052e9f45fd91 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f93037fe640 1 -- 172.21.15.133:0/1234095161 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94140e6200 con 0x559840f3a5c0 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f93037fe640 1 -- 172.21.15.133:0/1234095161 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94140e3250 con 0x559840f3a5c0 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f93037fe640 1 -- 172.21.15.133:0/1234095161 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94140c76d0 con 0x559840f3a5c0 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- 172.21.15.133:0/1234095161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 msgr2=0x559840f3a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 --2- 172.21.15.133:0/1234095161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f3a9e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f94140e46f0 tx=0x7f94140bc730 comp rx=0 tx=0).stop 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- 172.21.15.133:0/1234095161 shutdown_connections 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 --2- 172.21.15.133:0/1234095161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f3a9e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- 172.21.15.133:0/1234095161 >> 172.21.15.133:0/1234095161 conn(0x559840f36950 msgr2=0x559840f349b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- 172.21.15.133:0/1234095161 shutdown_connections 2024-02-15T23:30:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- 172.21.15.133:0/1234095161 wait complete. 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 Processor -- start 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- start start 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f41540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559840f41a80 con 0x559840f3a5c0 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f941bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f41540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f941bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f41540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36000/0 (socket says 172.21.15.133:36000) 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 learned_addr learned my addr 172.21.15.133:0/1983989739 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559840f2ec90 con 0x559840f3a5c0 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f941bfff640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f41540 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f94140b5ec0 tx=0x7f94140e4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9301ffb640 1 -- 172.21.15.133:0/1983989739 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94140bda60 con 0x559840f3a5c0 2024-02-15T23:30:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9301ffb640 1 -- 172.21.15.133:0/1983989739 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94140bdbe0 con 0x559840f3a5c0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559840f41c80 con 0x559840f3a5c0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9301ffb640 1 -- 172.21.15.133:0/1983989739 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94140b4370 con 0x559840f3a5c0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.207+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559840f420b0 con 0x559840f3a5c0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9301ffb640 1 -- 172.21.15.133:0/1983989739 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f94140d8040 con 0x559840f3a5c0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9301ffb640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92f40342b0 0x7f92f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9301ffb640 1 -- 172.21.15.133:0/1983989739 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f94140d1640 con 0x559840f3a5c0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424f83640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92f40342b0 0x7f92f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840f4ca90 0x559840f4ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424782640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840f4ca90 0x559840f4ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f4f6a0 con 0x559840f4ca90 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424f83640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92f40342b0 0x7f92f4036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f941c011010 tx=0x7f941c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424782640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840f4ca90 0x559840f4ef50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 realm 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f4fa70 con 0x559840f4ca90 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f502f0 con 0x559840f4ca90 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f50650 con 0x559840f4ca90 2024-02-15T23:30:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f50e50 con 0x559840f4ca90 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 20 searching for the correct realm 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559840f52ce0 0x559840f551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f941bfff640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559840f52ce0 0x559840f551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f941bfff640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559840f52ce0 0x559840f551a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f941bfff640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f94140ef070 0x7f94140c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f94140ef070 2024-02-15T23:30:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424f83640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f94140ef070 0x7f94140c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424f83640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f94140ef070 0x7f94140c4b20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4d0 con 0x7f94140ef070 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.211+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f94140ef070 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4d0 con 0x7f94140ef070 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f4ca90 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f4ca90 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f940c017050 0x7f940c041a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f940c017050 2024-02-15T23:30:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f940c017050 0x7f940c041a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:30:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f940c017050 0x7f940c041a60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:30:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x7f940c017050 2024-02-15T23:30:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f940c017050 2024-02-15T23:30:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x7f940c017050 2024-02-15T23:30:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f94140ef070 2024-02-15T23:30:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4d0 con 0x7f94140ef070 2024-02-15T23:30:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f4ca90 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.215+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f940c017050 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x7f940c017050 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f4ca90 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f94140ef070 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f940c017050 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x7f940c017050 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f4ca90 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f4ca90 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f940c017050 2024-02-15T23:30:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x7f940c017050 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.219+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f94140ef070 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f4ca90 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x559840f4ca90 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f94140ef070 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f940c017050 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x7f940c017050 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f94140ef070 2024-02-15T23:30:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f52ce0 2024-02-15T23:30:58.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f940c017050 2024-02-15T23:30:58.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f940c014070 con 0x7f940c017050 2024-02-15T23:30:58.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x559840f4ca90 2024-02-15T23:30:58.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55870 con 0x7f94140ef070 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f51750 con 0x559840f4ca90 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.223+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f51f50 con 0x559840f4ca90 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55cb0 con 0x559840f4ca90 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 zone default found 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 4 Realm: () 2024-02-15T23:30:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 zonegroup default 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f55cb0 con 0x7f94140ef070 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f57b30 con 0x559840f52ce0 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f57e90 con 0x559840f52ce0 2024-02-15T23:30:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 started sync module instance, tier type = 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f57100 con 0x7f94140ef070 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94112413218016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f57100 con 0x7f94140ef070 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f58800 con 0x559840f4ca90 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.227+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94112413218016] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.231+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.231+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94112413222000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f57100 con 0x559840f4ca90 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.231+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f591c0 con 0x559840f52ce0 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.231+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94112413222000] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.231+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.231+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94112413215840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f57080 con 0x559840f52ce0 2024-02-15T23:30:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.231+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f59eb0 con 0x7f94140ef070 2024-02-15T23:30:58.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94112413227840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5a700 con 0x7f94140ef070 2024-02-15T23:30:58.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5b160 con 0x559840f4ca90 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94112413227840] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94112413215840] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94112413226352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5a260 con 0x559840f4ca90 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5b9b0 con 0x7f940c017050 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.235+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94112413226352] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.239+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.239+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94112413232208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5a260 con 0x7f940c017050 2024-02-15T23:30:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.239+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5bfc0 con 0x7f940c017050 2024-02-15T23:30:58.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.239+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94112413232208] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.239+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.239+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94112413234448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5bfc0 con 0x7f940c017050 2024-02-15T23:30:58.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.239+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5c820 con 0x7f940c017050 2024-02-15T23:30:58.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94112413234448] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94112413236000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5ca00 con 0x7f940c017050 2024-02-15T23:30:58.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 20 add_watcher() i=0 2024-02-15T23:30:58.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 20 add_watcher() i=1 2024-02-15T23:30:58.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 20 add_watcher() i=2 2024-02-15T23:30:58.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 20 add_watcher() i=3 2024-02-15T23:30:58.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 20 add_watcher() i=4 2024-02-15T23:30:58.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 20 add_watcher() i=5 2024-02-15T23:30:58.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 20 add_watcher() i=6 2024-02-15T23:30:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94112413236000] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 20 add_watcher() i=7 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 2 all 8 watchers are set, enabling cache 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5fdc0 con 0x559840f4ca90 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94112413239536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f5d1b0 con 0x559840f4ca90 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94112413239536] v33'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.243+0000 7f92da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.247+0000 7f9426c67980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.247+0000 7f9426c67980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:30:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.247+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f68230 con 0x559840f4ca90 2024-02-15T23:30:58.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.247+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.247+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f68670 con 0x7f940c017050 2024-02-15T23:30:58.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.251+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.251+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f68b10 con 0x559840f52ce0 2024-02-15T23:30:58.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.251+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.251+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f69310 con 0x559840f4ca90 2024-02-15T23:30:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.251+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'224 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.251+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f663b0 con 0x7f94140ef070 2024-02-15T23:30:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.251+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'71 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.251+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f663b0 con 0x559840f52ce0 2024-02-15T23:30:58.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.255+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'47 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.255+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a4f0 con 0x559840f4ca90 2024-02-15T23:30:58.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.255+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.255+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a4f0 con 0x7f940c017050 2024-02-15T23:30:58.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.259+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.259+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a4f0 con 0x7f94140ef070 2024-02-15T23:30:58.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.259+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.259+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f65310 con 0x559840f52ce0 2024-02-15T23:30:58.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.259+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.259+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6b060 con 0x7f94140ef070 2024-02-15T23:30:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.259+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'72 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.259+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6b590 con 0x7f940c017050 2024-02-15T23:30:58.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.263+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'33 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.263+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6b590 con 0x7f94140ef070 2024-02-15T23:30:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.263+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.263+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x7f940c017050 2024-02-15T23:30:58.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.267+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'53 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.267+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6b060 con 0x559840f4ca90 2024-02-15T23:30:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.267+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'225 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.267+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6b060 con 0x559840f52ce0 2024-02-15T23:30:58.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.271+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'65 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.271+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x7f94140ef070 2024-02-15T23:30:58.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.271+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'73 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.271+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f52ce0 2024-02-15T23:30:58.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.271+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.271+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f4ca90 2024-02-15T23:30:58.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.271+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.271+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f4ca90 2024-02-15T23:30:58.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.275+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'226 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.275+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f52ce0 2024-02-15T23:30:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.275+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'66 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.275+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x7f94140ef070 2024-02-15T23:30:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.279+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.279+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f52ce0 2024-02-15T23:30:58.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.279+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.279+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f52ce0 2024-02-15T23:30:58.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.279+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'34 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.279+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f52ce0 2024-02-15T23:30:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.279+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'23 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.279+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f52ce0 2024-02-15T23:30:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.283+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'48 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.283+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x7f940c017050 2024-02-15T23:30:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.283+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.283+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f52ce0 2024-02-15T23:30:58.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.283+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.283+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x7f940c017050 2024-02-15T23:30:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.287+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.287+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x559840f52ce0 2024-02-15T23:30:58.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.287+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'67 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.287+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x7f940c017050 2024-02-15T23:30:58.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'54 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6ba30 con 0x7f94140ef070 2024-02-15T23:30:58.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f92d97e2640 20 reqs_thread_entry: start 2024-02-15T23:30:58.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f9426c67980 20 init_complete bucket index max shards: 11 2024-02-15T23:30:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f9426c67980 20 Filter name: none 2024-02-15T23:30:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f924affd640 20 reqs_thread_entry: start 2024-02-15T23:30:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f9426c67980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T23:30:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.291+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f63630 con 0x7f940c017050 2024-02-15T23:30:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T23:30:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T23:30:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T23:30:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f63630 con 0x7f940c017050 2024-02-15T23:30:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 : miss 2024-02-15T23:30:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:96 8.c 8:35ca080d:root::.bucket.meta.myfoo7%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f87610 con 0x559840f4ca90 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(96 .bucket.meta.myfoo7:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv14 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 20 rados_obj.operate() r=0 bl.length=355 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 info.flags=0x17 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 to cache LRU end 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:97 4.22 4:45c25ae1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004ed0 con 0x559840f4ca90 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(97 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:98 4.4 4:2159f283:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004f10 con 0x7f940c017050 2024-02-15T23:30:58.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(98 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.1 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.295+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:99 4.11 4:8b0bfc4e:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004f10 con 0x7f940c017050 2024-02-15T23:30:58.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(99 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.2 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:100 4.5 4:a1437444:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004f10 con 0x559840f52ce0 2024-02-15T23:30:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(100 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.3 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:101 4.f 4:f028f797:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004f10 con 0x559840f4ca90 2024-02-15T23:30:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(101 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.4 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:102 4.2 4:41e44bc2:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004f10 con 0x559840f4ca90 2024-02-15T23:30:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(102 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5 [call out=377b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+377 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 10 cls_bucket_list_unordered: got fourteen 2024-02-15T23:30:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:103 4.d 4:b0405e6c:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004f10 con 0x559840f52ce0 2024-02-15T23:30:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(103 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:104 4.10 4:0a32a445:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004ed0 con 0x559840f52ce0 2024-02-15T23:30:58.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(104 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.7 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:105 4.29 4:951e9ee1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004ed0 con 0x559840f52ce0 2024-02-15T23:30:58.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== osd_op_reply(105 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:106 4.16 4:69286ac8:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004ed0 con 0x559840f52ce0 2024-02-15T23:30:58.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(106 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.9 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:107 4.32 4:4dd1dc8a:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559841004ed0 con 0x559840f4ca90 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(107 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.10 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 20 get_obj_state: octx=0x7f940c016d20 obj=myfoo7:fourteen state=0x559840f88868 s->prefetch_data=0 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:108 3.37s0 3:ed95f74e:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f89680 con 0x559840f4ca90 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(108 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+872 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 10 manifest: total_size = 8 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 20 get_obj_state: setting s->obj_tag to cd69b486-4810-48ae-b5d4-5bce307169d4.4227.9245654823681684298 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 20 get_obj_state: octx=0x7f940c016d20 obj=myfoo7:fourteen state=0x559840f88868 s->prefetch_data=0 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 20 prepare_atomic_modification: state is not atomic. state=0x559840f88868 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.299+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:109 4.2 4:41e44bc2:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f8df30 con 0x559840f4ca90 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(109 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5 [stat,call,call] v33'9 uv9 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:110 3.37s0 3:ed95f74e:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f8bf10 con 0x559840f4ca90 2024-02-15T23:30:58.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(110 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10_fourteen [call] v33'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:111 4.2 4:41e44bc2:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f8df30 con 0x559840f4ca90 2024-02-15T23:30:58.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 20 list_objects_ordered: starting attempt 1 2024-02-15T23:30:58.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-15T23:30:58.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:112 4.22 4:45c25ae1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f8df30 con 0x559840f4ca90 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:113 4.4 4:2159f283:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f92130 con 0x7f940c017050 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:114 4.11 4:8b0bfc4e:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f94a40 con 0x7f940c017050 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:115 4.5 4:a1437444:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97770 con 0x559840f52ce0 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:116 4.f 4:f028f797:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f9a520 con 0x559840f4ca90 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:117 4.2 4:41e44bc2:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f9d320 con 0x559840f4ca90 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:118 4.d 4:b0405e6c:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f9fc80 con 0x559840f52ce0 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:119 4.10 4:0a32a445:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa2a60 con 0x559840f52ce0 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:120 4.29 4:951e9ee1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa5890 con 0x559840f52ce0 2024-02-15T23:30:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:121 4.16 4:69286ac8:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa8670 con 0x559840f52ce0 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:122 4.32 4:4dd1dc8a:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fab450 con 0x559840f4ca90 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.303+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 31 ==== osd_op_reply(115 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.3 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 32 ==== osd_op_reply(118 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(112 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 33 ==== osd_op_reply(119 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.7 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 34 ==== osd_op_reply(120 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 35 ==== osd_op_reply(121 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.9 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 38 ==== osd_op_reply(116 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.4 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 39 ==== osd_op_reply(122 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.10 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 40 ==== osd_op_reply(111 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5 [stat,call,call] v33'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f93037fe640 20 handle_completion(): completion ok for obj=fourteen 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(113 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.1 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(114 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.2 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 41 ==== osd_op_reply(117 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10])"; uploads.size()=0; is_truncated=0 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:123 4.22 4:45c25ae1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa2a60 con 0x559840f4ca90 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:124 4.4 4:2159f283:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f9fc80 con 0x7f940c017050 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:125 4.11 4:8b0bfc4e:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa5890 con 0x7f940c017050 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:126 4.5 4:a1437444:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa2a60 con 0x559840f52ce0 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:127 4.f 4:f028f797:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f9fc80 con 0x559840f4ca90 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:128 4.2 4:41e44bc2:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa5890 con 0x559840f4ca90 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:129 4.d 4:b0405e6c:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa85f0 con 0x559840f52ce0 2024-02-15T23:30:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:130 4.10 4:0a32a445:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f9fc80 con 0x559840f52ce0 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:131 4.29 4:951e9ee1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa2a60 con 0x559840f52ce0 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:132 4.16 4:69286ac8:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa5890 con 0x559840f52ce0 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:133 4.32 4:4dd1dc8a:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fab4a0 con 0x559840f4ca90 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 42 ==== osd_op_reply(123 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 43 ==== osd_op_reply(127 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.4 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 44 ==== osd_op_reply(128 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 45 ==== osd_op_reply(133 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.10 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 36 ==== osd_op_reply(126 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.3 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 37 ==== osd_op_reply(129 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 38 ==== osd_op_reply(130 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.7 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 39 ==== osd_op_reply(132 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.9 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 40 ==== osd_op_reply(131 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(125 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.2 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(124 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.1 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.307+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa5890 con 0x7f940c017050 2024-02-15T23:30:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(134 fud.buckets [call] v33'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-02-15T23:30:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa29b0 con 0x7f94140ef070 2024-02-15T23:30:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 20 rados_obj.operate() r=0 bl.length=168 2024-02-15T23:30:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94112413524752 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa29b0 con 0x7f94140ef070 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== watch-notify(notify (1) cookie 94112413227840 notify 141733920788 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7f941c0269c0 con 0x7f94140ef070 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f93037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 94112413227840 notifier 4758 bl.length()=150 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f93037fe640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f92e8003d60 con 0x7f94140ef070 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(136 notify.3 [notify cookie 94112413524752 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 24 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 25 ==== watch-notify(notify_complete (2) cookie 94112413524752 notify 141733920788 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f941c026b50 con 0x7f94140ef070 2024-02-15T23:30:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa29b0 con 0x7f94140ef070 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 26 ==== osd_op_reply(138 myfoo7 [call,call,delete] v33'45 uv45 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 from cache 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10, ofs0, ns] 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:139 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94112413524752 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa29b0 con 0x7f940c017050 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== watch-notify(notify (1) cookie 94112413234448 notify 141733920804 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x7f940c062060 con 0x7f940c017050 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.311+0000 7f9302ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94112413234448 notifier 4758 bl.length()=208 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9302ffd640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f9258003320 con 0x7f940c017050 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(139 notify.6 [notify cookie 94112413524752 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== osd_op_reply(140 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== watch-notify(notify_complete (2) cookie 94112413524752 notify 141733920804 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f940c04d040 con 0x7f940c017050 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:141 8.c 8:35ca080d:root::.bucket.meta.myfoo7%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x559840f4ca90 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 46 ==== osd_op_reply(141 .bucket.meta.myfoo7:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 [call,call,delete] v33'15 uv15 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:142 4.22 4:45c25ae1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x559840f4ca90 2024-02-15T23:30:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:143 4.4 4:2159f283:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f64310 con 0x7f940c017050 2024-02-15T23:30:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:144 4.11 4:8b0bfc4e:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa04c0 con 0x7f940c017050 2024-02-15T23:30:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:145 4.5 4:a1437444:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa0d40 con 0x559840f52ce0 2024-02-15T23:30:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:146 4.f 4:f028f797:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x559840f4ca90 2024-02-15T23:30:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:147 4.2 4:41e44bc2:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f64310 con 0x559840f4ca90 2024-02-15T23:30:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:148 4.d 4:b0405e6c:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa04c0 con 0x559840f52ce0 2024-02-15T23:30:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:149 4.10 4:0a32a445:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x559840f52ce0 2024-02-15T23:30:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:150 4.29 4:951e9ee1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa0d40 con 0x559840f52ce0 2024-02-15T23:30:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:151 4.16 4:69286ac8:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f64310 con 0x559840f52ce0 2024-02-15T23:30:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.315+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:152 4.32 4:4dd1dc8a:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa04c0 con 0x559840f4ca90 2024-02-15T23:30:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(143 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.1 [delete] v33'13 uv13 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 47 ==== osd_op_reply(147 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.5 [delete] v33'11 uv11 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 48 ==== osd_op_reply(152 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.10 [delete] v33'7 uv7 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 49 ==== osd_op_reply(146 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.4 [delete] v33'12 uv12 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 41 ==== osd_op_reply(149 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.7 [delete] v33'9 uv9 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 42 ==== osd_op_reply(145 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.3 [delete] v33'12 uv12 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 43 ==== osd_op_reply(150 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.8 [delete] v33'3 uv3 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 50 ==== osd_op_reply(142 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.0 [delete] v33'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== osd_op_reply(144 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.2 [delete] v33'9 uv9 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 44 ==== osd_op_reply(148 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.6 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 45 ==== osd_op_reply(151 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10.9 [delete] v33'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 : miss 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 20 rados->read ofs=0 len=0 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:153 6.e 6:736b29b1:::pubsub..bucket.myfoo7%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f64310 con 0x559840f4ca90 2024-02-15T23:30:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 51 ==== osd_op_reply(153 pubsub..bucket.myfoo7/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 info.flags=0x0 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 10 adding default.rgw.log++pubsub..bucket.myfoo7/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 to cache LRU end 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 10 removing default.rgw.log++pubsub..bucket.myfoo7/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 from cache 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10, ofs0, ns] 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 94112413517920 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840fa0d40 con 0x7f94140ef070 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 27 ==== watch-notify(notify (1) cookie 94112413227840 notify 141733920789 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x7f941c026b50 con 0x7f94140ef070 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f93037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94112413227840 notifier 4758 bl.length()=205 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f93037fe640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f92e8003d60 con 0x7f94140ef070 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 28 ==== osd_op_reply(154 notify.3 [notify cookie 94112413517920 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 29 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 30 ==== watch-notify(notify_complete (2) cookie 94112413517920 notify 141733920789 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f941c015430 con 0x7f94140ef070 2024-02-15T23:30:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.319+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:156 6.e 6:736b29b1:::pubsub..bucket.myfoo7%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x559840f4ca90 2024-02-15T23:30:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 52 ==== osd_op_reply(156 pubsub..bucket.myfoo7/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.10 [delete] v33'30 uv23 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x7f940c017050 2024-02-15T23:30:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(157 fud.buckets [call] v33'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9426c67980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-15T23:30:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9426c67980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T23:30:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94112413266320 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x559840f52ce0 2024-02-15T23:30:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 46 ==== watch-notify(notify (1) cookie 94112413215840 notify 141733920775 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x559840f420b0 con 0x559840f52ce0 2024-02-15T23:30:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9302ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94112413215840 notifier 4758 bl.length()=170 2024-02-15T23:30:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 47 ==== osd_op_reply(158 notify.2 [notify cookie 94112413266320 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9302ffd640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f92580032c0 con 0x559840f52ce0 2024-02-15T23:30:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 48 ==== watch-notify(notify_complete (2) cookie 94112413266320 notify 141733920775 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559840f41c80 con 0x559840f52ce0 2024-02-15T23:30:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 49 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.323+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x7f940c017050 2024-02-15T23:30:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v33'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9426c67980 10 removing email index: 2024-02-15T23:30:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9426c67980 10 removing user buckets index 2024-02-15T23:30:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9426c67980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-15T23:30:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94112413266320 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x7f940c017050 2024-02-15T23:30:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== watch-notify(notify (1) cookie 94112413234448 notify 141733920805 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f940c04d040 con 0x7f940c017050 2024-02-15T23:30:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9302ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94112413234448 notifier 4758 bl.length()=160 2024-02-15T23:30:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9302ffd640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f92580032c0 con 0x7f940c017050 2024-02-15T23:30:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== osd_op_reply(161 notify.6 [notify cookie 94112413266320 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 40 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 41 ==== watch-notify(notify_complete (2) cookie 94112413266320 notify 141733920805 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559840f16a90 con 0x7f940c017050 2024-02-15T23:30:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.327+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x7f940c017050 2024-02-15T23:30:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 42 ==== osd_op_reply(163 fud.buckets [delete] v33'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9426c67980 10 removing user index: fud 2024-02-15T23:30:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9426c67980 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-15T23:30:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9426c67980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-15T23:30:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94112413266320 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x7f940c017050 2024-02-15T23:30:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 43 ==== watch-notify(notify (1) cookie 94112413232208 notify 141733920806 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x559840f16a90 con 0x7f940c017050 2024-02-15T23:30:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f93037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94112413232208 notifier 4758 bl.length()=152 2024-02-15T23:30:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 44 ==== osd_op_reply(164 notify.5 [notify cookie 94112413266320 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f93037fe640 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f92e8003d60 con 0x7f940c017050 2024-02-15T23:30:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 45 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 46 ==== watch-notify(notify_complete (2) cookie 94112413266320 notify 141733920806 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559840f16640 con 0x7f940c017050 2024-02-15T23:30:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.331+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f97020 con 0x7f940c017050 2024-02-15T23:30:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 47 ==== osd_op_reply(166 fud [call,call,delete] v33'9 uv9 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f92da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:30:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94112413239536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x559840f4ca90 2024-02-15T23:30:58.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 53 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94112413239536] v33'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94112413218016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x7f94140ef070 2024-02-15T23:30:58.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 31 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94112413218016] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f9426c67980 20 remove_watcher() i=0 2024-02-15T23:30:58.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f9426c67980 2 removed watcher, disabling cache 2024-02-15T23:30:58.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.335+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94112413222000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x559840f4ca90 2024-02-15T23:30:58.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.339+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 54 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94112413222000] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.339+0000 7f9426c67980 20 remove_watcher() i=1 2024-02-15T23:30:58.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.339+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94112413215840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x559840f52ce0 2024-02-15T23:30:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.339+0000 7f941bfff640 1 -- 172.21.15.133:0/1983989739 <== osd.3 v2:172.21.15.133:6816/1056376173 50 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94112413215840] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94140dbd90 con 0x559840f52ce0 2024-02-15T23:30:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.339+0000 7f9426c67980 20 remove_watcher() i=2 2024-02-15T23:30:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.339+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94112413227840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x7f94140ef070 2024-02-15T23:30:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.343+0000 7f9424f83640 1 -- 172.21.15.133:0/1983989739 <== osd.2 v2:172.21.15.133:6808/3615800201 32 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94112413227840] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f941c039060 con 0x7f94140ef070 2024-02-15T23:30:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.343+0000 7f9426c67980 20 remove_watcher() i=3 2024-02-15T23:30:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.343+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94112413226352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x559840f4ca90 2024-02-15T23:30:58.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.343+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.1 v2:172.21.15.133:6800/2918336019 55 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94112413226352] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x559840f4ca90 2024-02-15T23:30:58.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.343+0000 7f9426c67980 20 remove_watcher() i=4 2024-02-15T23:30:58.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.343+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94112413232208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x7f940c017050 2024-02-15T23:30:58.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.347+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 48 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94112413232208] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.347+0000 7f9426c67980 20 remove_watcher() i=5 2024-02-15T23:30:58.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.347+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94112413234448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x7f940c017050 2024-02-15T23:30:58.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.347+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 49 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94112413234448] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.347+0000 7f9426c67980 20 remove_watcher() i=6 2024-02-15T23:30:58.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.347+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94112413236000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559840f6a460 con 0x7f940c017050 2024-02-15T23:30:58.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 <== osd.0 v2:172.21.15.131:6800/31994139 50 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94112413236000] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f940c058080 con 0x7f940c017050 2024-02-15T23:30:58.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 20 remove_watcher() i=7 2024-02-15T23:30:58.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f940c017050 msgr2=0x7f940c041a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f940c017050 0x7f940c041a60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840f4ca90 msgr2=0x559840f4ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840f4ca90 0x559840f4ef50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f94140ef070 msgr2=0x7f94140c4b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f94140ef070 0x7f94140c4b20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559840f52ce0 msgr2=0x559840f551a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559840f52ce0 0x559840f551a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92f40342b0 msgr2=0x7f92f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92f40342b0 0x7f92f4036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f941c011010 tx=0x7f941c020000 comp rx=0 tx=0).stop 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 msgr2=0x559840f41540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f41540 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f94140b5ec0 tx=0x7f94140e4680 comp rx=0 tx=0).stop 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9424782640 1 -- 172.21.15.133:0/1983989739 reap_dead start 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 shutdown_connections 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/1983989739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f3a5c0 0x559840f41540 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 >> 172.21.15.133:0/1983989739 conn(0x559840f36950 msgr2=0x559840f33fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 shutdown_connections 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/1983989739 wait complete. 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2338567416 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92fc0342b0 msgr2=0x7f92fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2338567416 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92fc0342b0 0x7f92fc036770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x559840f1db30 tx=0x7f941c005850 comp rx=0 tx=0).stop 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2338567416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f2d5f0 msgr2=0x559840f2da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2338567416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f2d5f0 0x559840f2da10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f94140ab670 tx=0x7f9414018020 comp rx=0 tx=0).stop 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2338567416 shutdown_connections 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2338567416 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f92fc0342b0 0x7f92fc036770 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2338567416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840f2d5f0 0x559840f2da10 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2338567416 >> 172.21.15.133:0/2338567416 conn(0x559840f22400 msgr2=0x559840f22f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2338567416 shutdown_connections 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2338567416 wait complete. 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840e29860 msgr2=0x559840f1cd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840e29860 0x559840f1cd90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f930c0342b0 msgr2=0x7f930c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f930c0342b0 0x7f930c036770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f94140ad000 tx=0x7f94140a5040 comp rx=0 tx=0).stop 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 msgr2=0x559840f16100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f16100 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f940c001ee0 tx=0x7f940c000ee0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 shutdown_connections 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559840e29860 0x559840f1cd90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f930c0342b0 0x7f930c036770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 --2- 172.21.15.133:0/2776558801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559840e25360 0x559840f16100 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 >> 172.21.15.133:0/2776558801 conn(0x559840d98a50 msgr2=0x559840f09950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 shutdown_connections 2024-02-15T23:30:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:30:58.351+0000 7f9426c67980 1 -- 172.21.15.133:0/2776558801 wait complete. 2024-02-15T23:31:03.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-02-15T23:31:03.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-02-15T23:31:03.368 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-02-15T23:31:03.406 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:03.407 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f296a2aa980 1 Processor -- start 2024-02-15T23:31:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f296a2aa980 1 -- start start 2024-02-15T23:31:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f296a2aa980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556f80cac850 0x556f80caec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f296a2aa980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556f80bf24c0 con 0x556f80ca8350 2024-02-15T23:31:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f296a2aa980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x556f80bb9180 con 0x556f80cac850 2024-02-15T23:31:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f29675c4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556f80cac850 0x556f80caec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f2967dc5640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x556f80ca8350 0x556f80ca8730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32922/0 (socket says 172.21.15.133:32922) 2024-02-15T23:31:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f2967dc5640 1 -- 172.21.15.133:0/4197626037 learned_addr learned my addr 172.21.15.133:0/4197626037 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:31:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f29675c4640 1 -- 172.21.15.133:0/4197626037 >> v1:172.21.15.131:6789/0 conn(0x556f80ca8350 legacy=0x556f80ca8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f29675c4640 1 -- 172.21.15.133:0/4197626037 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f80cb0190 con 0x556f80cac850 2024-02-15T23:31:03.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.403+0000 7f29675c4640 1 --2- 172.21.15.133:0/4197626037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80cac850 0x556f80caec40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f295000a480 tx=0x7f295001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803293ea7051ceae server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f2966dc3640 1 -- 172.21.15.133:0/4197626037 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29500ab540 con 0x556f80cac850 2024-02-15T23:31:03.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f2966dc3640 1 -- 172.21.15.133:0/4197626037 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500ab6a0 con 0x556f80cac850 2024-02-15T23:31:03.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f2966dc3640 1 -- 172.21.15.133:0/4197626037 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29500ab960 con 0x556f80cac850 2024-02-15T23:31:03.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f296a2aa980 1 -- 172.21.15.133:0/4197626037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80cac850 msgr2=0x556f80caec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f296a2aa980 1 --2- 172.21.15.133:0/4197626037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80cac850 0x556f80caec40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f295000a480 tx=0x7f295001b280 comp rx=0 tx=0).stop 2024-02-15T23:31:03.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f296a2aa980 1 -- 172.21.15.133:0/4197626037 shutdown_connections 2024-02-15T23:31:03.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f296a2aa980 1 --2- 172.21.15.133:0/4197626037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80cac850 0x556f80caec40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f296a2aa980 1 -- 172.21.15.133:0/4197626037 >> 172.21.15.133:0/4197626037 conn(0x556f80c1ba40 msgr2=0x556f80c1be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f296a2aa980 1 -- 172.21.15.133:0/4197626037 shutdown_connections 2024-02-15T23:31:03.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.407+0000 7f296a2aa980 1 -- 172.21.15.133:0/4197626037 wait complete. 2024-02-15T23:31:03.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 Processor -- start 2024-02-15T23:31:03.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 -- start start 2024-02-15T23:31:03.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d922a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f80bb66b0 con 0x556f80ca8350 2024-02-15T23:31:03.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f2967dc5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f2967dc5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d922a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36014/0 (socket says 172.21.15.133:36014) 2024-02-15T23:31:03.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f2967dc5640 1 -- 172.21.15.133:0/256031974 learned_addr learned my addr 172.21.15.133:0/256031974 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f2967dc5640 1 -- 172.21.15.133:0/256031974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950005d30 con 0x556f80ca8350 2024-02-15T23:31:03.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f2967dc5640 1 --2- 172.21.15.133:0/256031974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d922a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2960001590 tx=0x7f2960001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a525280bc1ea2c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f2855e0b640 1 -- 172.21.15.133:0/256031974 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2960004530 con 0x556f80ca8350 2024-02-15T23:31:03.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f2855e0b640 1 -- 172.21.15.133:0/256031974 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960004690 con 0x556f80ca8350 2024-02-15T23:31:03.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f2855e0b640 1 -- 172.21.15.133:0/256031974 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2960004950 con 0x556f80ca8350 2024-02-15T23:31:03.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 -- 172.21.15.133:0/256031974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 msgr2=0x556f80d922a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 --2- 172.21.15.133:0/256031974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d922a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2960001590 tx=0x7f2960001a50 comp rx=0 tx=0).stop 2024-02-15T23:31:03.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 -- 172.21.15.133:0/256031974 shutdown_connections 2024-02-15T23:31:03.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 --2- 172.21.15.133:0/256031974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d922a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 -- 172.21.15.133:0/256031974 >> 172.21.15.133:0/256031974 conn(0x556f80c1ba40 msgr2=0x556f80d8de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 -- 172.21.15.133:0/256031974 shutdown_connections 2024-02-15T23:31:03.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.423+0000 7f296a2aa980 1 -- 172.21.15.133:0/256031974 wait complete. 2024-02-15T23:31:03.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f296a2aa980 1 Processor -- start 2024-02-15T23:31:03.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f296a2aa980 1 -- start start 2024-02-15T23:31:03.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f296a2aa980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f296a2aa980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f80bb1e90 con 0x556f80ca8350 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f2967dc5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f2967dc5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36032/0 (socket says 172.21.15.133:36032) 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f2967dc5640 1 -- 172.21.15.133:0/3640606969 learned_addr learned my addr 172.21.15.133:0/3640606969 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f2967dc5640 1 -- 172.21.15.133:0/3640606969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f80bf24c0 con 0x556f80ca8350 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f2967dc5640 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d990f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2960001a90 tx=0x7f2960001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f284ffff640 1 -- 172.21.15.133:0/3640606969 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2960013760 con 0x556f80ca8350 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556f80d99630 con 0x556f80ca8350 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f284ffff640 1 -- 172.21.15.133:0/3640606969 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29600138c0 con 0x556f80ca8350 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f284ffff640 1 -- 172.21.15.133:0/3640606969 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2960013ba0 con 0x556f80ca8350 2024-02-15T23:31:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f80d99a80 con 0x556f80ca8350 2024-02-15T23:31:03.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f284ffff640 1 -- 172.21.15.133:0/3640606969 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2960013d00 con 0x556f80ca8350 2024-02-15T23:31:03.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f284ffff640 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28500342b0 0x7f2850036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f284ffff640 1 -- 172.21.15.133:0/3640606969 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2960049680 con 0x556f80ca8350 2024-02-15T23:31:03.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f296a2aa980 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80cac850 0x556f80d9fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80da02c0 con 0x556f80cac850 2024-02-15T23:31:03.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f29675c4640 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28500342b0 0x7f2850036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.427+0000 7f29685c6640 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80cac850 0x556f80d9fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29685c6640 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80cac850 0x556f80d9fd80 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29675c4640 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28500342b0 0x7f2850036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f29500ad000 tx=0x7f29500a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29685c6640 1 -- 172.21.15.133:0/3640606969 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29580083f0 con 0x556f80cac850 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80d9d480 con 0x556f80cac850 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29685c6640 1 -- 172.21.15.133:0/3640606969 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f29580083f0 con 0x556f80cac850 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80da1fc0 con 0x556f80cac850 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29685c6640 1 -- 172.21.15.133:0/3640606969 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f29580083f0 con 0x556f80cac850 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80da11c0 con 0x556f80cac850 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29685c6640 1 -- 172.21.15.133:0/3640606969 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f29580083f0 con 0x556f80cac850 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80da15d0 con 0x556f80cac850 2024-02-15T23:31:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29685c6640 1 -- 172.21.15.133:0/3640606969 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f29580121d0 con 0x556f80cac850 2024-02-15T23:31:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f296a2aa980 1 Processor -- start 2024-02-15T23:31:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f296a2aa980 1 -- start start 2024-02-15T23:31:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f296a2aa980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80db0600 0x556f80db0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f296a2aa980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f80b4af20 con 0x556f80db0600 2024-02-15T23:31:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29675c4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80db0600 0x556f80db0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29675c4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80db0600 0x556f80db0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36040/0 (socket says 172.21.15.133:36040) 2024-02-15T23:31:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29675c4640 1 -- 172.21.15.133:0/564995245 learned_addr learned my addr 172.21.15.133:0/564995245 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29675c4640 1 -- 172.21.15.133:0/564995245 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f80db0f60 con 0x556f80db0600 2024-02-15T23:31:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.431+0000 7f29675c4640 1 --2- 172.21.15.133:0/564995245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80db0600 0x556f80db0a20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f29500ab670 tx=0x7f2950018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f284d7fa640 1 -- 172.21.15.133:0/564995245 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29500be7c0 con 0x556f80db0600 2024-02-15T23:31:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f284d7fa640 1 -- 172.21.15.133:0/564995245 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500be920 con 0x556f80db0600 2024-02-15T23:31:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f296a2aa980 1 -- 172.21.15.133:0/564995245 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556f80db1150 con 0x556f80db0600 2024-02-15T23:31:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f284d7fa640 1 -- 172.21.15.133:0/564995245 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29500bebc0 con 0x556f80db0600 2024-02-15T23:31:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f296a2aa980 1 -- 172.21.15.133:0/564995245 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f80db1ca0 con 0x556f80db0600 2024-02-15T23:31:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f284d7fa640 1 -- 172.21.15.133:0/564995245 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f29500bd3e0 con 0x556f80db0600 2024-02-15T23:31:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f284d7fa640 1 --2- 172.21.15.133:0/564995245 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2840034300 0x7f28400367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f284d7fa640 1 -- 172.21.15.133:0/564995245 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f29500e6460 con 0x556f80db0600 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f29685c6640 1 --2- 172.21.15.133:0/564995245 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2840034300 0x7f28400367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f296a2aa980 1 Processor -- start 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f296a2aa980 1 -- start start 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f29685c6640 1 --2- 172.21.15.133:0/564995245 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2840034300 0x7f28400367c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x556f80da0c60 tx=0x7f2958003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f296a2aa980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dbd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f296a2aa980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f80b3e790 con 0x556f80dbd5a0 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f29675c4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dbd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f29675c4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dbd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36056/0 (socket says 172.21.15.133:36056) 2024-02-15T23:31:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f29675c4640 1 -- 172.21.15.133:0/2503591266 learned_addr learned my addr 172.21.15.133:0/2503591266 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f29675c4640 1 -- 172.21.15.133:0/2503591266 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f80dbdf90 con 0x556f80dbd5a0 2024-02-15T23:31:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f29675c4640 1 --2- 172.21.15.133:0/2503591266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dbd9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f29500e4720 tx=0x7f29500b4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68de32b3042df48e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f2846ffd640 1 -- 172.21.15.133:0/2503591266 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29500e3380 con 0x556f80dbd5a0 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.435+0000 7f2846ffd640 1 -- 172.21.15.133:0/2503591266 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500bccd0 con 0x556f80dbd5a0 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f2846ffd640 1 -- 172.21.15.133:0/2503591266 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29500bd690 con 0x556f80dbd5a0 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- 172.21.15.133:0/2503591266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 msgr2=0x556f80dbd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 --2- 172.21.15.133:0/2503591266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dbd9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f29500e4720 tx=0x7f29500b4d20 comp rx=0 tx=0).stop 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- 172.21.15.133:0/2503591266 shutdown_connections 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 --2- 172.21.15.133:0/2503591266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dbd9c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- 172.21.15.133:0/2503591266 >> 172.21.15.133:0/2503591266 conn(0x556f80db9930 msgr2=0x556f80db7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- 172.21.15.133:0/2503591266 shutdown_connections 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- 172.21.15.133:0/2503591266 wait complete. 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 Processor -- start 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- start start 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dc4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f80dc4a60 con 0x556f80dbd5a0 2024-02-15T23:31:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f29675c4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dc4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f29675c4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dc4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36062/0 (socket says 172.21.15.133:36062) 2024-02-15T23:31:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 learned_addr learned my addr 172.21.15.133:0/1362681284 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f80db1ca0 con 0x556f80dbd5a0 2024-02-15T23:31:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f29675c4640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dc4520 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f29500b5ec0 tx=0x7f29500e4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f28457fa640 1 -- 172.21.15.133:0/1362681284 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29500bce40 con 0x556f80dbd5a0 2024-02-15T23:31:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f28457fa640 1 -- 172.21.15.133:0/1362681284 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500bc740 con 0x556f80dbd5a0 2024-02-15T23:31:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f28457fa640 1 -- 172.21.15.133:0/1362681284 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29500bc9e0 con 0x556f80dbd5a0 2024-02-15T23:31:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556f80dc4c60 con 0x556f80dbd5a0 2024-02-15T23:31:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.439+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f80dc5090 con 0x556f80dbd5a0 2024-02-15T23:31:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f28457fa640 1 -- 172.21.15.133:0/1362681284 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f29500aaa30 con 0x556f80dbd5a0 2024-02-15T23:31:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f28457fa640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2830034350 0x7f2830036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f28457fa640 1 -- 172.21.15.133:0/1362681284 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f29500dcd50 con 0x556f80dbd5a0 2024-02-15T23:31:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f29685c6640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2830034350 0x7f2830036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80dcf950 0x556f80dd1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd2540 con 0x556f80dcf950 2024-02-15T23:31:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f2967dc5640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80dcf950 0x556f80dd1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f29685c6640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2830034350 0x7f2830036810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2958008fd0 tx=0x7f295801d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f2967dc5640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80dcf950 0x556f80dd1df0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 realm 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd2910 con 0x556f80dcf950 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd3160 con 0x556f80dcf950 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd34c0 con 0x556f80dcf950 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd3cc0 con 0x556f80dcf950 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 20 searching for the correct realm 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556f80dd5c10 0x556f80dd8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.443+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29675c4640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556f80dd5c10 0x556f80dd8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29675c4640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556f80dd5c10 0x556f80dd8040 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29675c4640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f29500ef070 0x7f29500c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f29500ef070 2024-02-15T23:31:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29685c6640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f29500ef070 0x7f29500c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29685c6640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f29500ef070 0x7f29500c7670 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f295802d040 con 0x7f29500ef070 2024-02-15T23:31:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f29500ef070 2024-02-15T23:31:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f295802d040 con 0x7f29500ef070 2024-02-15T23:31:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dcf950 2024-02-15T23:31:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dcf950 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f2967dc5640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2960003ed0 0x7f29600490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f2960003ed0 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f2967dc5640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2960003ed0 0x7f29600490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.447+0000 7f2967dc5640 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2960003ed0 0x7f29600490b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f2960003ed0 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f29500ef070 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f295802d040 con 0x7f29500ef070 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dcf950 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f2960003ed0 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dcf950 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f29500ef070 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f295802d040 con 0x7f29500ef070 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.451+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f2960003ed0 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dcf950 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dcf950 2024-02-15T23:31:03.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f2960003ed0 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f29500ef070 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f295802d040 con 0x7f29500ef070 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dcf950 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f29500ef070 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f295802d040 con 0x7f29500ef070 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.455+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f2960003ed0 2024-02-15T23:31:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f29500ef070 2024-02-15T23:31:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dd5c10 2024-02-15T23:31:03.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f2960003ed0 2024-02-15T23:31:03.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x556f80dcf950 2024-02-15T23:31:03.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd86c0 con 0x7f29500ef070 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd4680 con 0x556f80dcf950 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd4300 con 0x556f80dcf950 2024-02-15T23:31:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd5050 con 0x556f80dcf950 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 zone default found 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 4 Realm: () 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 zonegroup default 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.459+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd8b00 con 0x7f29500ef070 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dda980 con 0x556f80dd5c10 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddace0 con 0x556f80dd5c10 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 20 started sync module instance, tier type = 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:31:03.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd9f50 con 0x7f29500ef070 2024-02-15T23:31:03.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93937391739648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd9f50 con 0x7f29500ef070 2024-02-15T23:31:03.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddb650 con 0x556f80dcf950 2024-02-15T23:31:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.463+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93937391739648] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.467+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.467+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93937391743680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd9f50 con 0x556f80dcf950 2024-02-15T23:31:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.467+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddc010 con 0x556f80dd5c10 2024-02-15T23:31:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.467+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93937391743680] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.467+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.467+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93937391737520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd9ed0 con 0x556f80dd5c10 2024-02-15T23:31:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.467+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddcd40 con 0x7f29500ef070 2024-02-15T23:31:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.471+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.471+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93937391749216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddd590 con 0x7f29500ef070 2024-02-15T23:31:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.471+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dddf80 con 0x556f80dcf950 2024-02-15T23:31:03.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.471+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93937391737520] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.471+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93937391749216] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.471+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.471+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93937391753824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddd0f0 con 0x556f80dcf950 2024-02-15T23:31:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.471+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dde7d0 con 0x7f2960003ed0 2024-02-15T23:31:03.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.475+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93937391753824] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.475+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.475+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93937391748032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddd0f0 con 0x7f2960003ed0 2024-02-15T23:31:03.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.475+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dded10 con 0x7f2960003ed0 2024-02-15T23:31:03.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.475+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93937391748032] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.475+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.475+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93937391756080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddecd0 con 0x7f2960003ed0 2024-02-15T23:31:03.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.475+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddf640 con 0x7f2960003ed0 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93937391759776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddfaa0 con 0x7f2960003ed0 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 20 add_watcher() i=0 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 20 add_watcher() i=1 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 20 add_watcher() i=2 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 20 add_watcher() i=3 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 20 add_watcher() i=4 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 20 add_watcher() i=5 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93937391756080] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 20 add_watcher() i=6 2024-02-15T23:31:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93937391759776] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 20 add_watcher() i=7 2024-02-15T23:31:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 2 all 8 watchers are set, enabling cache 2024-02-15T23:31:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dde750 con 0x556f80dcf950 2024-02-15T23:31:03.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.479+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93937391760832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dde750 con 0x556f80dcf950 2024-02-15T23:31:03.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93937391760832] v33'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f281dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:03.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:03.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:03.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 5 note: GC not initialized 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f281cfe1640 20 reqs_thread_entry: start 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 20 init_complete bucket index max shards: 11 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 20 Filter name: none 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f27967fc640 20 reqs_thread_entry: start 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80e04a20 con 0x556f80dcf950 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:31:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.483+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80e06e60 con 0x7f2960003ed0 2024-02-15T23:31:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.487+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 usage.10 [call] v33'34 uv34 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.487+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80e06e60 con 0x7f2960003ed0 2024-02-15T23:31:03.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.487+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(64 usage.10 [call] v33'35 uv34 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.491+0000 7f281dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:03.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.491+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93937391760832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80de4dd0 con 0x556f80dcf950 2024-02-15T23:31:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.491+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93937391760832] v33'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.491+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93937391739648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddf5c0 con 0x7f29500ef070 2024-02-15T23:31:03.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.491+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93937391739648] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.491+0000 7f296a2aa980 20 remove_watcher() i=0 2024-02-15T23:31:03.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.491+0000 7f296a2aa980 2 removed watcher, disabling cache 2024-02-15T23:31:03.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.491+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93937391743680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddf5c0 con 0x556f80dcf950 2024-02-15T23:31:03.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.495+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93937391743680] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.495+0000 7f296a2aa980 20 remove_watcher() i=1 2024-02-15T23:31:03.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.495+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93937391737520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddf5c0 con 0x556f80dd5c10 2024-02-15T23:31:03.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.495+0000 7f29675c4640 1 -- 172.21.15.133:0/1362681284 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93937391737520] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29500e6d70 con 0x556f80dd5c10 2024-02-15T23:31:03.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.495+0000 7f296a2aa980 20 remove_watcher() i=2 2024-02-15T23:31:03.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.495+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93937391749216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd9ab0 con 0x7f29500ef070 2024-02-15T23:31:03.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.499+0000 7f29685c6640 1 -- 172.21.15.133:0/1362681284 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93937391749216] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f295803d040 con 0x7f29500ef070 2024-02-15T23:31:03.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.499+0000 7f296a2aa980 20 remove_watcher() i=3 2024-02-15T23:31:03.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.499+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93937391753824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd9ab0 con 0x556f80dcf950 2024-02-15T23:31:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.499+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93937391753824] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x556f80dcf950 2024-02-15T23:31:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.499+0000 7f296a2aa980 20 remove_watcher() i=4 2024-02-15T23:31:03.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.499+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93937391748032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddda60 con 0x7f2960003ed0 2024-02-15T23:31:03.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.503+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93937391748032] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.503+0000 7f296a2aa980 20 remove_watcher() i=5 2024-02-15T23:31:03.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.503+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93937391756080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80dd9ab0 con 0x7f2960003ed0 2024-02-15T23:31:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.503+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93937391756080] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.503+0000 7f296a2aa980 20 remove_watcher() i=6 2024-02-15T23:31:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.503+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93937391759776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556f80ddc3c0 con 0x7f2960003ed0 2024-02-15T23:31:03.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93937391759776] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2960024020 con 0x7f2960003ed0 2024-02-15T23:31:03.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 20 remove_watcher() i=7 2024-02-15T23:31:03.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2960003ed0 msgr2=0x7f29600490b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f2960003ed0 0x7f29600490b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80dcf950 msgr2=0x556f80dd1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80dcf950 0x556f80dd1df0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f29500ef070 msgr2=0x7f29500c7670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f29500ef070 0x7f29500c7670 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556f80dd5c10 msgr2=0x556f80dd8040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556f80dd5c10 0x556f80dd8040 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2830034350 msgr2=0x7f2830036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2830034350 0x7f2830036810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2958008fd0 tx=0x7f295801d070 comp rx=0 tx=0).stop 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 msgr2=0x556f80dc4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/1362681284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80dbd5a0 0x556f80dc4520 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f29500b5ec0 tx=0x7f29500e4680 comp rx=0 tx=0).stop 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 reap_dead start 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f2967dc5640 1 -- 172.21.15.133:0/1362681284 reap_dead start 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 shutdown_connections 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 >> 172.21.15.133:0/1362681284 conn(0x556f80db9930 msgr2=0x556f80db6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 shutdown_connections 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/1362681284 wait complete. 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/564995245 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2840034300 msgr2=0x7f28400367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/564995245 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2840034300 0x7f28400367c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x556f80da0c60 tx=0x7f2958003070 comp rx=0 tx=0).stop 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/564995245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80db0600 msgr2=0x556f80db0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/564995245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80db0600 0x556f80db0a20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f29500ab670 tx=0x7f2950018020 comp rx=0 tx=0).stop 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/564995245 shutdown_connections 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/564995245 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2840034300 0x7f28400367c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/564995245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80db0600 0x556f80db0a20 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/564995245 >> 172.21.15.133:0/564995245 conn(0x556f80da5410 msgr2=0x556f80da5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/564995245 shutdown_connections 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/564995245 wait complete. 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80cac850 msgr2=0x556f80d9fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80cac850 0x556f80d9fd80 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28500342b0 msgr2=0x7f2850036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28500342b0 0x7f2850036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f29500ad000 tx=0x7f29500a5040 comp rx=0 tx=0).stop 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 msgr2=0x556f80d990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d990f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2960001a90 tx=0x7f2960001260 comp rx=0 tx=0).stop 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 shutdown_connections 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556f80cac850 0x556f80d9fd80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f28500342b0 0x7f2850036770 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 --2- 172.21.15.133:0/3640606969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f80ca8350 0x556f80d990f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 >> 172.21.15.133:0/3640606969 conn(0x556f80c1ba40 msgr2=0x556f80d8c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 shutdown_connections 2024-02-15T23:31:03.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.507+0000 7f296a2aa980 1 -- 172.21.15.133:0/3640606969 wait complete. 2024-02-15T23:31:03.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-15T23:31:03.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-15T23:31:03.524 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-15T23:31:03.599 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:03.599 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.591+0000 7f0c7fbaf980 1 Processor -- start 2024-02-15T23:31:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7fbaf980 1 -- start start 2024-02-15T23:31:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7fbaf980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x562579a81130 0x562579a81510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7fbaf980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5625799cd4c0 con 0x562579a81a50 2024-02-15T23:31:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7fbaf980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x562579994180 con 0x562579a81130 2024-02-15T23:31:03.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7d6ca640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x562579a81130 0x562579a81510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7cec9640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x562579a81a50 0x562579a82410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32934/0 (socket says 172.21.15.133:32934) 2024-02-15T23:31:03.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7cec9640 1 -- 172.21.15.133:0/3273172829 learned_addr learned my addr 172.21.15.133:0/3273172829 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:31:03.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/3273172829 >> v1:172.21.15.131:6789/0 conn(0x562579a81a50 legacy=0x562579a82410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/3273172829 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562579a82c40 con 0x562579a81130 2024-02-15T23:31:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.595+0000 7f0c7d6ca640 1 --2- 172.21.15.133:0/3273172829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579a81510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800a420 tx=0x7f0c7801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a48509efa2b0459 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c6ffff640 1 -- 172.21.15.133:0/3273172829 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c780aa530 con 0x562579a81130 2024-02-15T23:31:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c6ffff640 1 -- 172.21.15.133:0/3273172829 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c780a6050 con 0x562579a81130 2024-02-15T23:31:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c6ffff640 1 -- 172.21.15.133:0/3273172829 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c780aa800 con 0x562579a81130 2024-02-15T23:31:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/3273172829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 msgr2=0x562579a81510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/3273172829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579a81510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800a420 tx=0x7f0c7801afd0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/3273172829 shutdown_connections 2024-02-15T23:31:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/3273172829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579a81510 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/3273172829 >> 172.21.15.133:0/3273172829 conn(0x562579a7ca00 msgr2=0x562579a7ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/3273172829 shutdown_connections 2024-02-15T23:31:03.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.599+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/3273172829 wait complete. 2024-02-15T23:31:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 Processor -- start 2024-02-15T23:31:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- start start 2024-02-15T23:31:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579b6b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625799916b0 con 0x562579a81130 2024-02-15T23:31:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7d6ca640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579b6b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7d6ca640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579b6b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36072/0 (socket says 172.21.15.133:36072) 2024-02-15T23:31:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/1695991171 learned_addr learned my addr 172.21.15.133:0/1695991171 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/1695991171 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7800a100 con 0x562579a81130 2024-02-15T23:31:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7d6ca640 1 --2- 172.21.15.133:0/1695991171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579b6b610 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0c780ad040 tx=0x7f0c780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653f9953cfd9bcbc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0b6b606640 1 -- 172.21.15.133:0/1695991171 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c780aa6c0 con 0x562579a81130 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0b6b606640 1 -- 172.21.15.133:0/1695991171 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c780aa820 con 0x562579a81130 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0b6b606640 1 -- 172.21.15.133:0/1695991171 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c780aaac0 con 0x562579a81130 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1695991171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 msgr2=0x562579b6b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1695991171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579b6b610 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0c780ad040 tx=0x7f0c780033b0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1695991171 shutdown_connections 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1695991171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x562579b6b610 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1695991171 >> 172.21.15.133:0/1695991171 conn(0x562579a7ca00 msgr2=0x562579b671a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1695991171 shutdown_connections 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1695991171 wait complete. 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 Processor -- start 2024-02-15T23:31:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- start start 2024-02-15T23:31:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x5625799f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7fbaf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257998ce90 con 0x562579a81130 2024-02-15T23:31:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7d6ca640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x5625799f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7d6ca640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x5625799f7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36080/0 (socket says 172.21.15.133:36080) 2024-02-15T23:31:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.615+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/1486436755 learned_addr learned my addr 172.21.15.133:0/1486436755 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/1486436755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562579a82c40 con 0x562579a81130 2024-02-15T23:31:03.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7d6ca640 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x5625799f7780 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0c78003430 tx=0x7f0c78019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0b69e03640 1 -- 172.21.15.133:0/1486436755 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c780b6950 con 0x562579a81130 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625799f7cc0 con 0x562579a81130 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0b69e03640 1 -- 172.21.15.133:0/1486436755 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c780b6ab0 con 0x562579a81130 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0b69e03640 1 -- 172.21.15.133:0/1486436755 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c780b6d50 con 0x562579a81130 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625799f61f0 con 0x562579a81130 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0b69e03640 1 -- 172.21.15.133:0/1486436755 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0c780c0450 con 0x562579a81130 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0b69e03640 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b640342b0 0x7f0b64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0b69e03640 1 -- 172.21.15.133:0/1486436755 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0c780e4040 con 0x562579a81130 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7cec9640 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b640342b0 0x7f0b64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579a81a50 0x562579b7b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579b7b750 con 0x562579a81a50 2024-02-15T23:31:03.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7decb640 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579a81a50 0x562579b7b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7cec9640 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b640342b0 0x7f0b64036770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0c74000f70 tx=0x7f0c740012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7decb640 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579a81a50 0x562579b7b210 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7decb640 1 -- 172.21.15.133:0/1486436755 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c700083f0 con 0x562579a81a50 2024-02-15T23:31:03.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.619+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579b7bab0 con 0x562579a81a50 2024-02-15T23:31:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7decb640 1 -- 172.21.15.133:0/1486436755 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0c700083f0 con 0x562579a81a50 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579b7d340 con 0x562579a81a50 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7decb640 1 -- 172.21.15.133:0/1486436755 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0c700083f0 con 0x562579a81a50 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579b7c540 con 0x562579a81a50 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7decb640 1 -- 172.21.15.133:0/1486436755 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0c700083f0 con 0x562579a81a50 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579b7c950 con 0x562579a81a50 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7decb640 1 -- 172.21.15.133:0/1486436755 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0c70012040 con 0x562579a81a50 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 Processor -- start 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 -- start start 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b8ba00 0x562579b8be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562579925f20 con 0x562579b8ba00 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7cec9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b8ba00 0x562579b8be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7cec9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b8ba00 0x562579b8be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36082/0 (socket says 172.21.15.133:36082) 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7cec9640 1 -- 172.21.15.133:0/1619963480 learned_addr learned my addr 172.21.15.133:0/1619963480 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7cec9640 1 -- 172.21.15.133:0/1619963480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562579b8c360 con 0x562579b8ba00 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7cec9640 1 --2- 172.21.15.133:0/1619963480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b8ba00 0x562579b8be20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0c74001ee0 tx=0x7f0c7400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0b62ffd640 1 -- 172.21.15.133:0/1619963480 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c74020070 con 0x562579b8ba00 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0b62ffd640 1 -- 172.21.15.133:0/1619963480 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7400c770 con 0x562579b8ba00 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1619963480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562579b8c5b0 con 0x562579b8ba00 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0b62ffd640 1 -- 172.21.15.133:0/1619963480 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c74013040 con 0x562579b8ba00 2024-02-15T23:31:03.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.623+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1619963480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562579b8d100 con 0x562579b8ba00 2024-02-15T23:31:03.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0b62ffd640 1 -- 172.21.15.133:0/1619963480 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0c7400a040 con 0x562579b8ba00 2024-02-15T23:31:03.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0b62ffd640 1 --2- 172.21.15.133:0/1619963480 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b540342b0 0x7f0b54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0b62ffd640 1 -- 172.21.15.133:0/1619963480 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0c7404b810 con 0x562579b8ba00 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7decb640 1 --2- 172.21.15.133:0/1619963480 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b540342b0 0x7f0b54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 Processor -- start 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 -- start start 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b98dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7decb640 1 --2- 172.21.15.133:0/1619963480 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b540342b0 0x7f0b54036770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x562579b7bf80 tx=0x7f0c70003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562579919790 con 0x562579b989e0 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7cec9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b98dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7cec9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b98dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36084/0 (socket says 172.21.15.133:36084) 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7cec9640 1 -- 172.21.15.133:0/1537502370 learned_addr learned my addr 172.21.15.133:0/1537502370 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7cec9640 1 -- 172.21.15.133:0/1537502370 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562579b99390 con 0x562579b989e0 2024-02-15T23:31:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7cec9640 1 --2- 172.21.15.133:0/1537502370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b98dc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0c74049aa0 tx=0x7f0c740198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df816a7ad4e92e4e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0b60ff9640 1 -- 172.21.15.133:0/1537502370 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c74048070 con 0x562579b989e0 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0b60ff9640 1 -- 172.21.15.133:0/1537502370 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7401bac0 con 0x562579b989e0 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0b60ff9640 1 -- 172.21.15.133:0/1537502370 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c7403a2b0 con 0x562579b989e0 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1537502370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 msgr2=0x562579b98dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1537502370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b98dc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0c74049aa0 tx=0x7f0c740198d0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1537502370 shutdown_connections 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1537502370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b98dc0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1537502370 >> 172.21.15.133:0/1537502370 conn(0x562579b94d20 msgr2=0x562579b92d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1537502370 shutdown_connections 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1537502370 wait complete. 2024-02-15T23:31:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 Processor -- start 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.627+0000 7f0c7fbaf980 1 -- start start 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7fbaf980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b9f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7fbaf980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562579b9fdd0 con 0x562579b989e0 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7cec9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b9f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7cec9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b9f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36092/0 (socket says 172.21.15.133:36092) 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 learned_addr learned my addr 172.21.15.133:0/2465883641 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562579b8d100 con 0x562579b989e0 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7cec9640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b9f890 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0c740199a0 tx=0x7f0c74049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0b52ffd640 1 -- 172.21.15.133:0/2465883641 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c74019e20 con 0x562579b989e0 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0b52ffd640 1 -- 172.21.15.133:0/2465883641 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7404b610 con 0x562579b989e0 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0b52ffd640 1 -- 172.21.15.133:0/2465883641 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c740481a0 con 0x562579b989e0 2024-02-15T23:31:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562579b9ffd0 con 0x562579b989e0 2024-02-15T23:31:03.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562579ba0460 con 0x562579b989e0 2024-02-15T23:31:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0b52ffd640 1 -- 172.21.15.133:0/2465883641 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0c74048300 con 0x562579b989e0 2024-02-15T23:31:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0b52ffd640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b480342b0 0x7f0b48036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0b52ffd640 1 -- 172.21.15.133:0/2465883641 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0c74039d70 con 0x562579b989e0 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7decb640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b480342b0 0x7f0b48036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579baae40 0x562579bad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bada50 con 0x562579baae40 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7d6ca640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579baae40 0x562579bad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7decb640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b480342b0 0x7f0b48036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0c70008fd0 tx=0x7f0c7001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.631+0000 7f0c7d6ca640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579baae40 0x562579bad300 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 realm 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bade20 con 0x562579baae40 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bae670 con 0x562579baae40 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bae9d0 con 0x562579baae40 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bae310 con 0x562579baae40 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 20 searching for the correct realm 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562579bb0c20 0x562579bb3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7cec9640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562579bb0c20 0x562579bb3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7cec9640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562579bb0c20 0x562579bb3050 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7cec9640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0c74055040 0x7f0c740129a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c74055040 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7decb640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0c74055040 0x7f0c740129a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7decb640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0c74055040 0x7f0c740129a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c7002c040 con 0x7f0c74055040 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c74055040 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c7002c040 con 0x7f0c74055040 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579baae40 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579baae40 2024-02-15T23:31:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0c780c9020 0x7f0c780c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.635+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c780c9020 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0c780c9020 0x7f0c780c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0c780c9020 0x7f0c780c83b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x7f0c780c9020 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c780c9020 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x7f0c780c9020 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c74055040 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c7002c040 con 0x7f0c74055040 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579baae40 2024-02-15T23:31:03.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c780c9020 2024-02-15T23:31:03.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x7f0c780c9020 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.639+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579baae40 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c74055040 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0c7002c040 con 0x7f0c74055040 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c780c9020 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x7f0c780c9020 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579baae40 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579baae40 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c780c9020 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x7f0c780c9020 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.643+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c74055040 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c7002c040 con 0x7f0c74055040 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579baae40 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780c6070 con 0x562579baae40 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c74055040 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c7002c040 con 0x7f0c74055040 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c780c9020 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c74055040 2024-02-15T23:31:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579bb0c20 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c780c9020 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x562579baae40 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3720 con 0x7f0c74055040 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7fbaf980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7fbaf980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:31:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7fbaf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7fbaf980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7fbaf980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7fbaf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.647+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579baf840 con 0x562579baae40 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579baf4c0 con 0x562579baae40 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb0180 con 0x562579baae40 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 zone default found 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 4 Realm: () 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 zonegroup default 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb3b60 con 0x7f0c74055040 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb59e0 con 0x562579bb0c20 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb5d40 con 0x562579bb0c20 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 started sync module instance, tier type = 2024-02-15T23:31:03.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:31:03.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb4fb0 con 0x7f0c74055040 2024-02-15T23:31:03.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94718956098400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb4fb0 con 0x7f0c74055040 2024-02-15T23:31:03.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.651+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb66b0 con 0x562579baae40 2024-02-15T23:31:03.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.655+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94718956098400] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.655+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.655+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94718956102432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb4fb0 con 0x562579baae40 2024-02-15T23:31:03.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.655+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb70d0 con 0x562579bb0c20 2024-02-15T23:31:03.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.655+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94718956102432] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.655+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.655+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94718956096272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb4f30 con 0x562579bb0c20 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.655+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb7e00 con 0x7f0c74055040 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.659+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.659+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94718956108064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb8650 con 0x7f0c74055040 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.659+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb9050 con 0x562579baae40 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.659+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94718956096272] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.659+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94718956108064] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.659+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.659+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94718956112720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb81b0 con 0x562579baae40 2024-02-15T23:31:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.659+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb98a0 con 0x7f0c780c9020 2024-02-15T23:31:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.663+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94718956112720] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.663+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.663+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94718956106880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb81b0 con 0x7f0c780c9020 2024-02-15T23:31:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.663+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb9df0 con 0x7f0c780c9020 2024-02-15T23:31:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.663+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94718956106880] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94718956114512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb9df0 con 0x7f0c780c9020 2024-02-15T23:31:03.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bba7c0 con 0x7f0c780c9020 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(58 notify.7 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94718956118720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bbac20 con 0x7f0c780c9020 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 20 add_watcher() i=0 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 20 add_watcher() i=1 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 20 add_watcher() i=2 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 20 add_watcher() i=3 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 20 add_watcher() i=4 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 20 add_watcher() i=5 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94718956114512] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.667+0000 7f0c7fbaf980 20 add_watcher() i=6 2024-02-15T23:31:03.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94718956118720] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 20 add_watcher() i=7 2024-02-15T23:31:03.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 2 all 8 watchers are set, enabling cache 2024-02-15T23:31:03.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bbac20 con 0x562579baae40 2024-02-15T23:31:03.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94718956119936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bbaba0 con 0x562579baae40 2024-02-15T23:31:03.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94718956119936] v33'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0b337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:03.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:03.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:03.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 5 note: GC not initialized 2024-02-15T23:31:03.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0b327e4640 20 reqs_thread_entry: start 2024-02-15T23:31:03.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 20 init_complete bucket index max shards: 11 2024-02-15T23:31:03.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 20 Filter name: none 2024-02-15T23:31:03.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0aa3fff640 20 reqs_thread_entry: start 2024-02-15T23:31:03.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bdf6b0 con 0x562579baae40 2024-02-15T23:31:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.671+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.675+0000 7f0c7fbaf980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:31:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.675+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bdf6b0 con 0x7f0c780c9020 2024-02-15T23:31:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.675+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.675+0000 7f0b337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:03.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.675+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94718956119936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bdf6b0 con 0x562579baae40 2024-02-15T23:31:03.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.675+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94718956119936] v33'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.675+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94718956098400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bdf6b0 con 0x7f0c74055040 2024-02-15T23:31:03.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.679+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94718956098400] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.679+0000 7f0c7fbaf980 20 remove_watcher() i=0 2024-02-15T23:31:03.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.679+0000 7f0c7fbaf980 2 removed watcher, disabling cache 2024-02-15T23:31:03.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.679+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94718956102432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bdf6b0 con 0x562579baae40 2024-02-15T23:31:03.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.679+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94718956102432] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.679+0000 7f0c7fbaf980 20 remove_watcher() i=1 2024-02-15T23:31:03.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.679+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94718956096272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bdf6b0 con 0x562579bb0c20 2024-02-15T23:31:03.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7cec9640 1 -- 172.21.15.133:0/2465883641 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94718956096272] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c74022070 con 0x562579bb0c20 2024-02-15T23:31:03.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7fbaf980 20 remove_watcher() i=2 2024-02-15T23:31:03.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94718956108064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb5360 con 0x7f0c74055040 2024-02-15T23:31:03.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7decb640 1 -- 172.21.15.133:0/2465883641 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94718956108064] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c7003c040 con 0x7f0c74055040 2024-02-15T23:31:03.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7fbaf980 20 remove_watcher() i=3 2024-02-15T23:31:03.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94718956112720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb6320 con 0x562579baae40 2024-02-15T23:31:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94718956112720] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x562579baae40 2024-02-15T23:31:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7fbaf980 20 remove_watcher() i=4 2024-02-15T23:31:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.683+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94718956106880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb4b10 con 0x7f0c780c9020 2024-02-15T23:31:03.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.687+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94718956106880] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.687+0000 7f0c7fbaf980 20 remove_watcher() i=5 2024-02-15T23:31:03.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.687+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94718956114512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb6320 con 0x7f0c780c9020 2024-02-15T23:31:03.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.687+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94718956114512] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.687+0000 7f0c7fbaf980 20 remove_watcher() i=6 2024-02-15T23:31:03.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.687+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94718956118720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562579bb6320 con 0x7f0c780c9020 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94718956118720] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c780f6040 con 0x7f0c780c9020 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 20 remove_watcher() i=7 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0c780c9020 msgr2=0x7f0c780c83b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f0c780c9020 0x7f0c780c83b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579baae40 msgr2=0x562579bad300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579baae40 0x562579bad300 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0c74055040 msgr2=0x7f0c740129a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f0c74055040 0x7f0c740129a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562579bb0c20 msgr2=0x562579bb3050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x562579bb0c20 0x562579bb3050 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b480342b0 msgr2=0x7f0b48036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b480342b0 0x7f0b48036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0c70008fd0 tx=0x7f0c7001c070 comp rx=0 tx=0).stop 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7d6ca640 1 -- 172.21.15.133:0/2465883641 reap_dead start 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 msgr2=0x562579b9f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b9f890 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0c740199a0 tx=0x7f0c74049a30 comp rx=0 tx=0).stop 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 shutdown_connections 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/2465883641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b989e0 0x562579b9f890 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 >> 172.21.15.133:0/2465883641 conn(0x562579b94d20 msgr2=0x562579b923a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 shutdown_connections 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/2465883641 wait complete. 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1619963480 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b540342b0 msgr2=0x7f0b54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1619963480 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b540342b0 0x7f0b54036770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x562579b7bf80 tx=0x7f0c70003070 comp rx=0 tx=0).stop 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1619963480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b8ba00 msgr2=0x562579b8be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1619963480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b8ba00 0x562579b8be20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0c74001ee0 tx=0x7f0c7400da30 comp rx=0 tx=0).stop 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1619963480 shutdown_connections 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1619963480 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b540342b0 0x7f0b54036770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1619963480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579b8ba00 0x562579b8be20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1619963480 >> 172.21.15.133:0/1619963480 conn(0x562579b80810 msgr2=0x562579b81320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1619963480 shutdown_connections 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1619963480 wait complete. 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579a81a50 msgr2=0x562579b7b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579a81a50 0x562579b7b210 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b640342b0 msgr2=0x7f0b64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b640342b0 0x7f0b64036770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0c74000f70 tx=0x7f0c740012c0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 msgr2=0x5625799f7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x5625799f7780 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0c78003430 tx=0x7f0c78019810 comp rx=0 tx=0).stop 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 shutdown_connections 2024-02-15T23:31:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x562579a81a50 0x562579b7b210 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0b640342b0 0x7f0b64036770 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 --2- 172.21.15.133:0/1486436755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562579a81130 0x5625799f7780 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 >> 172.21.15.133:0/1486436755 conn(0x562579a7ca00 msgr2=0x562579b65cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 shutdown_connections 2024-02-15T23:31:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.691+0000 7f0c7fbaf980 1 -- 172.21.15.133:0/1486436755 wait complete. 2024-02-15T23:31:03.710 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[],"summary":[]} 2024-02-15T23:31:03.710 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-15T23:31:03.711 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-15T23:31:03.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-15T23:31:03.711 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-02-15T23:31:03.783 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:03.783 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:03.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5065403980 1 Processor -- start 2024-02-15T23:31:03.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5065403980 1 -- start start 2024-02-15T23:31:03.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5065403980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556e97af8090 0x556e97b89210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5065403980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556e97ad04d0 con 0x556e97b89750 2024-02-15T23:31:03.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5065403980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x556e97a97180 con 0x556e97af8090 2024-02-15T23:31:03.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5062f1e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556e97af8090 0x556e97b89210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5062f1e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556e97af8090 0x556e97b89210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36096/0 (socket says 172.21.15.133:36096) 2024-02-15T23:31:03.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f506271d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x556e97b89750 0x556e97b8bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32944/0 (socket says 172.21.15.133:32944) 2024-02-15T23:31:03.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5062f1e640 1 -- 172.21.15.133:0/4018638398 learned_addr learned my addr 172.21.15.133:0/4018638398 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5062f1e640 1 -- 172.21.15.133:0/4018638398 >> v1:172.21.15.131:6789/0 conn(0x556e97b89750 legacy=0x556e97b8bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.779+0000 7f5062f1e640 1 -- 172.21.15.133:0/4018638398 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e97b8e270 con 0x556e97af8090 2024-02-15T23:31:03.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5062f1e640 1 --2- 172.21.15.133:0/4018638398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97b89210 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f505400a5c0 tx=0x7f505401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09a26da4e748189 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5061f1c640 1 -- 172.21.15.133:0/4018638398 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540aa470 con 0x556e97af8090 2024-02-15T23:31:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5061f1c640 1 -- 172.21.15.133:0/4018638398 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540aa5d0 con 0x556e97af8090 2024-02-15T23:31:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5061f1c640 1 -- 172.21.15.133:0/4018638398 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540aa890 con 0x556e97af8090 2024-02-15T23:31:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5065403980 1 -- 172.21.15.133:0/4018638398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 msgr2=0x556e97b89210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5065403980 1 --2- 172.21.15.133:0/4018638398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97b89210 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f505400a5c0 tx=0x7f505401b340 comp rx=0 tx=0).stop 2024-02-15T23:31:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5065403980 1 -- 172.21.15.133:0/4018638398 shutdown_connections 2024-02-15T23:31:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5065403980 1 --2- 172.21.15.133:0/4018638398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97b89210 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5065403980 1 -- 172.21.15.133:0/4018638398 >> 172.21.15.133:0/4018638398 conn(0x556e97b7e8f0 msgr2=0x556e97b80d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5065403980 1 -- 172.21.15.133:0/4018638398 shutdown_connections 2024-02-15T23:31:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.783+0000 7f5065403980 1 -- 172.21.15.133:0/4018638398 wait complete. 2024-02-15T23:31:03.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 Processor -- start 2024-02-15T23:31:03.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 -- start start 2024-02-15T23:31:03.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c70370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e97a946b0 con 0x556e97af8090 2024-02-15T23:31:03.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5062f1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c70370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5062f1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c70370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36110/0 (socket says 172.21.15.133:36110) 2024-02-15T23:31:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5062f1e640 1 -- 172.21.15.133:0/2516941766 learned_addr learned my addr 172.21.15.133:0/2516941766 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5062f1e640 1 -- 172.21.15.133:0/2516941766 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5054005df0 con 0x556e97af8090 2024-02-15T23:31:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5062f1e640 1 --2- 172.21.15.133:0/2516941766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c70370 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50540ac040 tx=0x7f5054003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3713bf350bb34 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f4f50e09640 1 -- 172.21.15.133:0/2516941766 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540aa9b0 con 0x556e97af8090 2024-02-15T23:31:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f4f50e09640 1 -- 172.21.15.133:0/2516941766 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540aab30 con 0x556e97af8090 2024-02-15T23:31:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f4f50e09640 1 -- 172.21.15.133:0/2516941766 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540aae10 con 0x556e97af8090 2024-02-15T23:31:03.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 -- 172.21.15.133:0/2516941766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 msgr2=0x556e97c70370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 --2- 172.21.15.133:0/2516941766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c70370 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50540ac040 tx=0x7f5054003030 comp rx=0 tx=0).stop 2024-02-15T23:31:03.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 -- 172.21.15.133:0/2516941766 shutdown_connections 2024-02-15T23:31:03.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 --2- 172.21.15.133:0/2516941766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c70370 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 -- 172.21.15.133:0/2516941766 >> 172.21.15.133:0/2516941766 conn(0x556e97b7e8f0 msgr2=0x556e97c6be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 -- 172.21.15.133:0/2516941766 shutdown_connections 2024-02-15T23:31:03.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 -- 172.21.15.133:0/2516941766 wait complete. 2024-02-15T23:31:03.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.799+0000 7f5065403980 1 Processor -- start 2024-02-15T23:31:03.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5065403980 1 -- start start 2024-02-15T23:31:03.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5065403980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5065403980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e97a8fe90 con 0x556e97af8090 2024-02-15T23:31:03.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5062f1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5062f1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c771c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36124/0 (socket says 172.21.15.133:36124) 2024-02-15T23:31:03.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5062f1e640 1 -- 172.21.15.133:0/3196556709 learned_addr learned my addr 172.21.15.133:0/3196556709 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5062f1e640 1 -- 172.21.15.133:0/3196556709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e97b8e270 con 0x556e97af8090 2024-02-15T23:31:03.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5062f1e640 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c771c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5054005940 tx=0x7f50540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f4f4f606640 1 -- 172.21.15.133:0/3196556709 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540c6750 con 0x556e97af8090 2024-02-15T23:31:03.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556e97c77700 con 0x556e97af8090 2024-02-15T23:31:03.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f4f4f606640 1 -- 172.21.15.133:0/3196556709 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540c68b0 con 0x556e97af8090 2024-02-15T23:31:03.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f4f4f606640 1 -- 172.21.15.133:0/3196556709 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540c6b70 con 0x556e97af8090 2024-02-15T23:31:03.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e97c77b50 con 0x556e97af8090 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f4f4f606640 1 -- 172.21.15.133:0/3196556709 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f50540c6cd0 con 0x556e97af8090 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f4f4f606640 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f480342b0 0x7f4f48036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f4f4f606640 1 -- 172.21.15.133:0/3196556709 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f50540e4440 con 0x556e97af8090 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f506271d640 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f480342b0 0x7f4f48036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5065403980 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97b89750 0x556e97c7de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97c7e390 con 0x556e97b89750 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f506371f640 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97b89750 0x556e97c7de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f506271d640 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f480342b0 0x7f4f48036770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5058000f70 tx=0x7f5058001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.803+0000 7f506371f640 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97b89750 0x556e97c7de50 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506371f640 1 -- 172.21.15.133:0/3196556709 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f505c00a4d0 con 0x556e97b89750 2024-02-15T23:31:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97c7e770 con 0x556e97b89750 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506371f640 1 -- 172.21.15.133:0/3196556709 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f505c00a4d0 con 0x556e97b89750 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97c80020 con 0x556e97b89750 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506371f640 1 -- 172.21.15.133:0/3196556709 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f505c00a4d0 con 0x556e97b89750 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97c7f220 con 0x556e97b89750 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506371f640 1 -- 172.21.15.133:0/3196556709 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f505c00a4d0 con 0x556e97b89750 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97c7f630 con 0x556e97b89750 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506371f640 1 -- 172.21.15.133:0/3196556709 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f505c00a4d0 con 0x556e97b89750 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 Processor -- start 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 -- start start 2024-02-15T23:31:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c8e700 0x556e97c8eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e97a28f20 con 0x556e97c8e700 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506271d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c8e700 0x556e97c8eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506271d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c8e700 0x556e97c8eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36134/0 (socket says 172.21.15.133:36134) 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506271d640 1 -- 172.21.15.133:0/1994915488 learned_addr learned my addr 172.21.15.133:0/1994915488 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506271d640 1 -- 172.21.15.133:0/1994915488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e97c8f060 con 0x556e97c8e700 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f506271d640 1 --2- 172.21.15.133:0/1994915488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c8e700 0x556e97c8eb20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5058001ee0 tx=0x7f505800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f4f4ce01640 1 -- 172.21.15.133:0/1994915488 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5058007040 con 0x556e97c8e700 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f4f4ce01640 1 -- 172.21.15.133:0/1994915488 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800d660 con 0x556e97c8e700 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.807+0000 7f5065403980 1 -- 172.21.15.133:0/1994915488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556e97c8f2b0 con 0x556e97c8e700 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f4f4ce01640 1 -- 172.21.15.133:0/1994915488 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f505800d900 con 0x556e97c8e700 2024-02-15T23:31:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f5065403980 1 -- 172.21.15.133:0/1994915488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e97c8fe00 con 0x556e97c8e700 2024-02-15T23:31:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f4f4ce01640 1 -- 172.21.15.133:0/1994915488 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f505801a070 con 0x556e97c8e700 2024-02-15T23:31:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f4f4ce01640 1 --2- 172.21.15.133:0/1994915488 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f3c0342b0 0x7f4f3c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f4f4ce01640 1 -- 172.21.15.133:0/1994915488 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5058017050 con 0x556e97c8e700 2024-02-15T23:31:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f506371f640 1 --2- 172.21.15.133:0/1994915488 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f3c0342b0 0x7f4f3c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f5065403980 1 Processor -- start 2024-02-15T23:31:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f5065403980 1 -- start start 2024-02-15T23:31:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f506371f640 1 --2- 172.21.15.133:0/1994915488 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f3c0342b0 0x7f4f3c036770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x556e97c7ec60 tx=0x7f505c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f5065403980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97c9ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f5065403980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e97a1c790 con 0x556e97c9b680 2024-02-15T23:31:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f506271d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97c9ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f506271d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97c9ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36140/0 (socket says 172.21.15.133:36140) 2024-02-15T23:31:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f506271d640 1 -- 172.21.15.133:0/1183030054 learned_addr learned my addr 172.21.15.133:0/1183030054 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f506271d640 1 -- 172.21.15.133:0/1183030054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e97c9c030 con 0x556e97c9b680 2024-02-15T23:31:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f506271d640 1 --2- 172.21.15.133:0/1183030054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97c9ba60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5058027030 tx=0x7f505800df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735faa86cdec1e9d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f4f467fc640 1 -- 172.21.15.133:0/1183030054 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5058039440 con 0x556e97c9b680 2024-02-15T23:31:03.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f4f467fc640 1 -- 172.21.15.133:0/1183030054 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50580395c0 con 0x556e97c9b680 2024-02-15T23:31:03.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f4f467fc640 1 -- 172.21.15.133:0/1183030054 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f505803ac80 con 0x556e97c9b680 2024-02-15T23:31:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.811+0000 7f5065403980 1 -- 172.21.15.133:0/1183030054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 msgr2=0x556e97c9ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 --2- 172.21.15.133:0/1183030054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97c9ba60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5058027030 tx=0x7f505800df20 comp rx=0 tx=0).stop 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- 172.21.15.133:0/1183030054 shutdown_connections 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 --2- 172.21.15.133:0/1183030054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97c9ba60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- 172.21.15.133:0/1183030054 >> 172.21.15.133:0/1183030054 conn(0x556e97c979c0 msgr2=0x556e97c95a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- 172.21.15.133:0/1183030054 shutdown_connections 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- 172.21.15.133:0/1183030054 wait complete. 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 Processor -- start 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- start start 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97ca2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e97ca2a80 con 0x556e97c9b680 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f506271d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97ca2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f506271d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97ca2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36154/0 (socket says 172.21.15.133:36154) 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 learned_addr learned my addr 172.21.15.133:0/3452867917 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e97c8fe00 con 0x556e97c9b680 2024-02-15T23:31:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f506271d640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97ca2540 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5058027030 tx=0x7f5058048b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f4f44ff9640 1 -- 172.21.15.133:0/3452867917 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f505801a6f0 con 0x556e97c9b680 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f4f44ff9640 1 -- 172.21.15.133:0/3452867917 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505801a870 con 0x556e97c9b680 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556e97ca2c80 con 0x556e97c9b680 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e97ca30b0 con 0x556e97c9b680 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f4f44ff9640 1 -- 172.21.15.133:0/3452867917 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f505804ab10 con 0x556e97c9b680 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f4f44ff9640 1 -- 172.21.15.133:0/3452867917 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f505804ac70 con 0x556e97c9b680 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f4f44ff9640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f2c0342b0 0x7f4f2c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f4f44ff9640 1 -- 172.21.15.133:0/3452867917 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5058035d30 con 0x556e97c9b680 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f506371f640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f2c0342b0 0x7f4f2c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97cadac0 0x556e97caff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb06d0 con 0x556e97cadac0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.815+0000 7f5062f1e640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97cadac0 0x556e97caff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506371f640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f2c0342b0 0x7f4f2c036770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f505c011010 tx=0x7f505c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5062f1e640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97cadac0 0x556e97caff80 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 realm 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb0aa0 con 0x556e97cadac0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb1320 con 0x556e97cadac0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb1680 con 0x556e97cadac0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb1e80 con 0x556e97cadac0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 20 searching for the correct realm 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556e97cb3d50 0x556e97cb6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506271d640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556e97cb3d50 0x556e97cb6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506271d640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556e97cb3d50 0x556e97cb6210 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5058024900 con 0x556e97cb3d50 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506271d640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5058027060 0x7f505803a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f5058027060 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506371f640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5058027060 0x7f505803a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506371f640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5058027060 0x7f505803a480 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c00a4d0 con 0x7f5058027060 2024-02-15T23:31:03.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f5058027060 2024-02-15T23:31:03.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c00a4d0 con 0x7f5058027060 2024-02-15T23:31:03.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cadac0 2024-02-15T23:31:03.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.819+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cadac0 2024-02-15T23:31:03.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f50540d0060 0x7f50540aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f50540d0060 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f50540d0060 0x7f50540aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f50540d0060 0x7f50540aca60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x7f50540d0060 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f50540d0060 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x7f50540d0060 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f5058027060 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c00a4d0 con 0x7f5058027060 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5058024900 con 0x556e97cb3d50 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cadac0 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.823+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f50540d0060 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x7f50540d0060 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cadac0 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f5058027060 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5058024900 con 0x556e97cb3d50 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f50540d0060 2024-02-15T23:31:03.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x7f50540d0060 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cadac0 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cadac0 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.827+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f50540d0060 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x7f50540d0060 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f5058027060 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cadac0 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x556e97cadac0 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f5058027060 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f50540d0060 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x7f50540d0060 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f5058027060 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cb3d50 2024-02-15T23:31:03.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f50540d0060 2024-02-15T23:31:03.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540b0020 con 0x7f50540d0060 2024-02-15T23:31:03.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.831+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x556e97cadac0 2024-02-15T23:31:03.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb6890 con 0x7f5058027060 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb2780 con 0x556e97cadac0 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb2400 con 0x556e97cadac0 2024-02-15T23:31:03.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb3050 con 0x556e97cadac0 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 zone default found 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 4 Realm: () 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 zonegroup default 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb3050 con 0x7f5058027060 2024-02-15T23:31:03.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb86b0 con 0x556e97cb3d50 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb8a40 con 0x556e97cb3d50 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 started sync module instance, tier type = 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb7f90 con 0x7f5058027060 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93933481458416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb8340 con 0x7f5058027060 2024-02-15T23:31:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.835+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb9780 con 0x556e97cadac0 2024-02-15T23:31:03.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.839+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93933481458416] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.839+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.839+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93933481463360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb9700 con 0x556e97cadac0 2024-02-15T23:31:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.839+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cba1b0 con 0x556e97cb3d50 2024-02-15T23:31:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.839+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93933481463360] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93933481464416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cb9680 con 0x556e97cb3d50 2024-02-15T23:31:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbaea0 con 0x7f5058027060 2024-02-15T23:31:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93933481470736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbb6f0 con 0x7f5058027060 2024-02-15T23:31:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbc0f0 con 0x556e97cadac0 2024-02-15T23:31:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93933481464416] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93933481470736] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93933481475056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbb250 con 0x556e97cadac0 2024-02-15T23:31:03.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.843+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbc940 con 0x7f50540d0060 2024-02-15T23:31:03.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.847+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93933481475056] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.847+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.847+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93933481469280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbb250 con 0x7f50540d0060 2024-02-15T23:31:03.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.847+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbce80 con 0x7f50540d0060 2024-02-15T23:31:03.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.847+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93933481469280] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.847+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.847+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93933481477280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbce40 con 0x7f50540d0060 2024-02-15T23:31:03.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.847+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbd7b0 con 0x7f50540d0060 2024-02-15T23:31:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93933481477280] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93933481478336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbd7b0 con 0x7f50540d0060 2024-02-15T23:31:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5065403980 20 add_watcher() i=0 2024-02-15T23:31:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5065403980 20 add_watcher() i=1 2024-02-15T23:31:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5065403980 20 add_watcher() i=2 2024-02-15T23:31:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5065403980 20 add_watcher() i=3 2024-02-15T23:31:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5065403980 20 add_watcher() i=4 2024-02-15T23:31:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5065403980 20 add_watcher() i=5 2024-02-15T23:31:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.851+0000 7f5065403980 20 add_watcher() i=6 2024-02-15T23:31:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93933481478336] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5065403980 20 add_watcher() i=7 2024-02-15T23:31:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5065403980 2 all 8 watchers are set, enabling cache 2024-02-15T23:31:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc0ba0 con 0x556e97cadac0 2024-02-15T23:31:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93933481481440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cbe040 con 0x556e97cadac0 2024-02-15T23:31:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93933481481440] v33'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f4f197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5065403980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5065403980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.855+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc91f0 con 0x556e97cadac0 2024-02-15T23:31:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.859+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.859+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc9270 con 0x7f50540d0060 2024-02-15T23:31:03.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.859+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.859+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc98a0 con 0x556e97cb3d50 2024-02-15T23:31:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.859+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.859+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cca270 con 0x556e97cadac0 2024-02-15T23:31:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.863+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'233 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.863+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc7260 con 0x7f5058027060 2024-02-15T23:31:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.863+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'74 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.863+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc7260 con 0x556e97cb3d50 2024-02-15T23:31:03.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.863+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'49 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.863+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccb450 con 0x556e97cadac0 2024-02-15T23:31:03.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.867+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.867+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccb450 con 0x7f50540d0060 2024-02-15T23:31:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.867+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.867+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccb450 con 0x7f5058027060 2024-02-15T23:31:03.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.871+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.871+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccba00 con 0x556e97cb3d50 2024-02-15T23:31:03.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.871+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.871+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccbea0 con 0x7f5058027060 2024-02-15T23:31:03.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.871+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'75 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.871+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc6250 con 0x7f50540d0060 2024-02-15T23:31:03.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.875+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'36 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.875+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc6840 con 0x7f5058027060 2024-02-15T23:31:03.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.875+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.875+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc6840 con 0x7f50540d0060 2024-02-15T23:31:03.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.879+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'55 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.879+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc6080 con 0x556e97cadac0 2024-02-15T23:31:03.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.879+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'234 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.879+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc6080 con 0x556e97cb3d50 2024-02-15T23:31:03.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.879+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'68 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.879+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc6080 con 0x7f5058027060 2024-02-15T23:31:03.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.883+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'76 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.883+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cb3d50 2024-02-15T23:31:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.883+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.883+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cadac0 2024-02-15T23:31:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.883+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.883+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cadac0 2024-02-15T23:31:03.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.883+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'235 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.883+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cb3d50 2024-02-15T23:31:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.887+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'69 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.887+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x7f5058027060 2024-02-15T23:31:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.887+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.887+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cb3d50 2024-02-15T23:31:03.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.887+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.891+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cb3d50 2024-02-15T23:31:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.891+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'35 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.891+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cb3d50 2024-02-15T23:31:03.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.891+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'24 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.891+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cb3d50 2024-02-15T23:31:03.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.891+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'50 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.891+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x7f50540d0060 2024-02-15T23:31:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.895+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.895+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cb3d50 2024-02-15T23:31:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.895+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.895+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x7f50540d0060 2024-02-15T23:31:03.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.899+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.899+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x556e97cb3d50 2024-02-15T23:31:03.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.899+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'70 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.899+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x7f50540d0060 2024-02-15T23:31:03.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'56 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc990 con 0x7f5058027060 2024-02-15T23:31:03.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f4e93fff640 20 reqs_thread_entry: start 2024-02-15T23:31:03.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f5065403980 20 init_complete bucket index max shards: 11 2024-02-15T23:31:03.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f5065403980 20 Filter name: none 2024-02-15T23:31:03.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f4e91ffb640 20 reqs_thread_entry: start 2024-02-15T23:31:03.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f5065403980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T23:31:03.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.903+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccb980 con 0x556e97cadac0 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccbda0 con 0x7f5058027060 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 : miss 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:96 8.f 8:f27a45b7:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ccc7c0 con 0x556e97cb3d50 2024-02-15T23:31:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(96 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T23:31:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 info.flags=0x17 2024-02-15T23:31:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 to cache LRU end 2024-02-15T23:31:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T23:31:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T23:31:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:97 4.32 4:4e9b2879:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d65eb0 con 0x556e97cadac0 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(97 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:98 4.1d 4:b94ed41d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d65eb0 con 0x556e97cb3d50 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(98 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:99 4.1 4:81f194d5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d65eb0 con 0x7f5058027060 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(99 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:100 4.3c 4:3ec6f455:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d65eb0 con 0x556e97cadac0 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(100 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:101 4.7 4:e03ee749:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d65eb0 con 0x7f50540d0060 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(101 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-02-15T23:31:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:102 4.25 4:a5b786d4:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d65eb0 con 0x556e97cb3d50 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(102 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.907+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:103 4.4 4:20de93a3:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d65eb0 con 0x7f50540d0060 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(103 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:104 4.20 4:06b455f3:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d664b0 con 0x556e97cadac0 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(104 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:105 4.24 4:2707aa99:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d664b0 con 0x7f50540d0060 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(105 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:106 4.9 4:903c07b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d664b0 con 0x556e97cadac0 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(106 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:107 4.23 4:c67dffec:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d664b0 con 0x7f50540d0060 2024-02-15T23:31:03.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(107 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 20 get_obj_state: octx=0x7f50540e2990 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556e97d64268 s->prefetch_data=0 2024-02-15T23:31:03.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:108 3.2s0 3:42fe5d14:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d65080 con 0x556e97cb3d50 2024-02-15T23:31:03.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== osd_op_reply(108 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 10 manifest: total_size = 6 2024-02-15T23:31:03.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 20 get_obj_state: setting s->obj_tag to cd69b486-4810-48ae-b5d4-5bce307169d4.4227.8797696934448181498 2024-02-15T23:31:03.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 20 get_obj_state: octx=0x7f50540e2990 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556e97d64268 s->prefetch_data=0 2024-02-15T23:31:03.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 20 prepare_atomic_modification: state is not atomic. state=0x556e97d64268 2024-02-15T23:31:03.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 20 bucket index object: :.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4 2024-02-15T23:31:03.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.911+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:109 4.7 4:e03ee749:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ced2c0 con 0x7f50540d0060 2024-02-15T23:31:03.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.915+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(109 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.915+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:110 3.2s0 3:42fe5d14:::cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ceb2a0 con 0x556e97cb3d50 2024-02-15T23:31:03.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(110 cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7_15f6f8dc036519d7fe15b39338f6e5db [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:111 4.7 4:e03ee749:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ced2c0 con 0x7f50540d0060 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 20 list_objects_ordered: starting attempt 1 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:112 4.32 4:4e9b2879:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ceeaa0 con 0x556e97cadac0 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:113 4.1d 4:b94ed41d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cf1340 con 0x556e97cb3d50 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:114 4.1 4:81f194d5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cf3c90 con 0x7f5058027060 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:115 4.3c 4:3ec6f455:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cf6780 con 0x556e97cadac0 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:116 4.7 4:e03ee749:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cf90a0 con 0x7f50540d0060 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:117 4.25 4:a5b786d4:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfba10 con 0x556e97cb3d50 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:118 4.4 4:20de93a3:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x7f50540d0060 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:119 4.20 4:06b455f3:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d01540 con 0x556e97cadac0 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:120 4.24 4:2707aa99:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d04000 con 0x7f50540d0060 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:121 4.9 4:903c07b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d06dc0 con 0x556e97cadac0 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:122 4.23 4:c67dffec:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d09ba0 con 0x7f50540d0060 2024-02-15T23:31:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(114 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(112 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 31 ==== osd_op_reply(113 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(115 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 32 ==== osd_op_reply(117 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(119 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(121 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(120 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(118 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(122 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(111 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f4f45ffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== osd_op_reply(116 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7])"; uploads.size()=0; is_truncated=0 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:123 4.32 4:4e9b2879:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x556e97cadac0 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:124 4.1d 4:b94ed41d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97ceeaa0 con 0x556e97cb3d50 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:125 4.1 4:81f194d5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cf90a0 con 0x7f5058027060 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:126 4.3c 4:3ec6f455:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfba10 con 0x556e97cadac0 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:127 4.7 4:e03ee749:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x7f50540d0060 2024-02-15T23:31:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:128 4.25 4:a5b786d4:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfba10 con 0x556e97cb3d50 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 38 ==== osd_op_reply(123 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.919+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 33 ==== osd_op_reply(124 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:129 4.4 4:20de93a3:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x7f50540d0060 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 34 ==== osd_op_reply(128 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:130 4.20 4:06b455f3:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfba10 con 0x556e97cadac0 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:131 4.24 4:2707aa99:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cf90a0 con 0x7f50540d0060 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:132 4.9 4:903c07b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x556e97cadac0 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:133 4.23 4:c67dffec:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d01000 con 0x7f50540d0060 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 39 ==== osd_op_reply(126 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 24 ==== osd_op_reply(125 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 40 ==== osd_op_reply(130 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 41 ==== osd_op_reply(132 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(127 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== osd_op_reply(129 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(131 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(133 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x7f5058027060 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 25 ==== osd_op_reply(134 foo.buckets [call] v33'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x7f5058027060 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 26 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.923+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93933481724176 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x7f50540d0060 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== watch-notify(notify (1) cookie 93933481477280 notify 141733920807 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f5054113060 con 0x7f50540d0060 2024-02-15T23:31:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f4f467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 93933481477280 notifier 4779 bl.length()=149 2024-02-15T23:31:03.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f4f467fc640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f4f28003d60 con 0x7f50540d0060 2024-02-15T23:31:03.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(136 notify.6 [notify cookie 93933481724176 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== watch-notify(notify_complete (2) cookie 93933481724176 notify 141733920807 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556e97c77b50 con 0x7f50540d0060 2024-02-15T23:31:03.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x7f5058027060 2024-02-15T23:31:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 27 ==== osd_op_reply(138 myfoo [call,call,delete] v33'47 uv47 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5065403980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 from cache 2024-02-15T23:31:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5065403980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7, ofs0, ns] 2024-02-15T23:31:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:139 7.d 7:b4812045:::notify.4:head [notify cookie 93933482169920 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cfe840 con 0x556e97cadac0 2024-02-15T23:31:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 42 ==== watch-notify(notify (1) cookie 93933481475056 notify 141733920801 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x556e97c77b50 con 0x556e97cadac0 2024-02-15T23:31:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f4f45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 93933481475056 notifier 4779 bl.length()=206 2024-02-15T23:31:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f4f45ffb640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f4e980032c0 con 0x556e97cadac0 2024-02-15T23:31:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 43 ==== osd_op_reply(139 notify.4 [notify cookie 93933482169920 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 44 ==== watch-notify(notify_complete (2) cookie 93933482169920 notify 141733920801 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556e97c77700 con 0x556e97cadac0 2024-02-15T23:31:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 45 ==== osd_op_reply(140 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.927+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:141 8.f 8:f27a45b7:root::.bucket.meta.myfoo%3acd69b486-4810-48ae-b5d4-5bce307169d4.4227.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d06640 con 0x556e97cb3d50 2024-02-15T23:31:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 35 ==== osd_op_reply(141 .bucket.meta.myfoo:cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 [call,call,delete] v33'2 uv2 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:142 4.32 4:4e9b2879:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d06640 con 0x556e97cadac0 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:143 4.1d 4:b94ed41d:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d04470 con 0x556e97cb3d50 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:144 4.1 4:81f194d5:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d04c70 con 0x7f5058027060 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:145 4.3c 4:3ec6f455:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d05050 con 0x556e97cadac0 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:146 4.7 4:e03ee749:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee3d0 con 0x7f50540d0060 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:147 4.25 4:a5b786d4:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d06640 con 0x556e97cb3d50 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:148 4.4 4:20de93a3:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d04470 con 0x7f50540d0060 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:149 4.20 4:06b455f3:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d05050 con 0x556e97cadac0 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:150 4.24 4:2707aa99:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d06640 con 0x7f50540d0060 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:151 4.9 4:903c07b1:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee3d0 con 0x556e97cadac0 2024-02-15T23:31:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:152 4.23 4:c67dffec:::.dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97d04c70 con 0x7f50540d0060 2024-02-15T23:31:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.931+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 28 ==== osd_op_reply(144 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.2 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 46 ==== osd_op_reply(142 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.0 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 36 ==== osd_op_reply(143 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.1 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 47 ==== osd_op_reply(149 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.7 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== osd_op_reply(148 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.6 [delete] v33'14 uv14 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 40 ==== osd_op_reply(146 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.4 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 41 ==== osd_op_reply(152 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.10 [delete] v33'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 48 ==== osd_op_reply(151 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.9 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 42 ==== osd_op_reply(150 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.8 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 37 ==== osd_op_reply(147 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.5 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 49 ==== osd_op_reply(145 .dir.cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7.3 [delete] v33'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 : miss 2024-02-15T23:31:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 20 rados->read ofs=0 len=0 2024-02-15T23:31:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:153 6.e 6:73096a07:::pubsub..bucket.myfoo%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x556e97cadac0 2024-02-15T23:31:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 50 ==== osd_op_reply(153 pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 info.flags=0x0 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 10 adding default.rgw.log++pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 to cache LRU end 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 10 removing default.rgw.log++pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 from cache 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7, ofs0, ns] 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 93933482169920 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x7f5058027060 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 29 ==== watch-notify(notify (1) cookie 93933481470736 notify 141733920790 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f505c026c10 con 0x7f5058027060 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 30 ==== osd_op_reply(154 notify.3 [notify cookie 93933482169920 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f4f467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 93933481470736 notifier 4779 bl.length()=203 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f4f467fc640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f4f28003d60 con 0x7f5058027060 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 31 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 32 ==== watch-notify(notify_complete (2) cookie 93933482169920 notify 141733920790 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f505c026da0 con 0x7f5058027060 2024-02-15T23:31:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.935+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:156 6.e 6:73096a07:::pubsub..bucket.myfoo%2fcd69b486-4810-48ae-b5d4-5bce307169d4.4227.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x556e97cadac0 2024-02-15T23:31:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 51 ==== osd_op_reply(156 pubsub..bucket.myfoo/cd69b486-4810-48ae-b5d4-5bce307169d4.4227.7 [delete] v33'32 uv23 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x7f5058027060 2024-02-15T23:31:03.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 33 ==== osd_op_reply(157 foo.buckets [call] v33'48 uv48 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f5065403980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-02-15T23:31:03.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f5065403980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-15T23:31:03.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 93933482169920 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x7f5058027060 2024-02-15T23:31:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 34 ==== watch-notify(notify (1) cookie 93933481470736 notify 141733920791 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f505c026da0 con 0x7f5058027060 2024-02-15T23:31:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f4f467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 93933481470736 notifier 4779 bl.length()=170 2024-02-15T23:31:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 35 ==== osd_op_reply(158 notify.3 [notify cookie 93933482169920 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f4f467fc640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f4f28003d60 con 0x7f5058027060 2024-02-15T23:31:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 36 ==== watch-notify(notify_complete (2) cookie 93933482169920 notify 141733920791 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f505c015570 con 0x7f5058027060 2024-02-15T23:31:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 37 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.939+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x7f50540d0060 2024-02-15T23:31:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 43 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v33'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f5065403980 10 removing email index: foo@foo.com 2024-02-15T23:31:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f5065403980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-15T23:31:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 93933482169920 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x7f5058027060 2024-02-15T23:31:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 38 ==== watch-notify(notify (1) cookie 93933481470736 notify 141733920792 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x7f505c015570 con 0x7f5058027060 2024-02-15T23:31:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f4f45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 93933481470736 notifier 4779 bl.length()=162 2024-02-15T23:31:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f4f45ffb640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f4e980032c0 con 0x7f5058027060 2024-02-15T23:31:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 39 ==== osd_op_reply(161 notify.3 [notify cookie 93933482169920 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 40 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 41 ==== watch-notify(notify_complete (2) cookie 93933482169920 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f505c015700 con 0x7f5058027060 2024-02-15T23:31:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.943+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x556e97cadac0 2024-02-15T23:31:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 52 ==== osd_op_reply(163 foo@foo.com [delete] v33'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5065403980 10 removing user buckets index 2024-02-15T23:31:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5065403980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-02-15T23:31:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 93933482169920 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x7f50540d0060 2024-02-15T23:31:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 44 ==== watch-notify(notify (1) cookie 93933481469280 notify 141733920808 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x556e97c77700 con 0x7f50540d0060 2024-02-15T23:31:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f4f467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 93933481469280 notifier 4779 bl.length()=160 2024-02-15T23:31:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f4f467fc640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f4f28003d60 con 0x7f50540d0060 2024-02-15T23:31:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 45 ==== osd_op_reply(164 notify.5 [notify cookie 93933482169920 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 46 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 47 ==== watch-notify(notify_complete (2) cookie 93933482169920 notify 141733920808 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556e97b8e270 con 0x7f50540d0060 2024-02-15T23:31:03.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.947+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x7f5058027060 2024-02-15T23:31:03.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 42 ==== osd_op_reply(166 foo.buckets [delete] v33'49 uv49 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5065403980 10 removing user index: foo 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5065403980 10 removing default.rgw.meta+users.uid+foo from cache 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5065403980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 93933482169920 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x556e97cadac0 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 53 ==== watch-notify(notify (1) cookie 93933481475056 notify 141733920802 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x556e97b8e270 con 0x556e97cadac0 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f4f45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 93933481475056 notifier 4779 bl.length()=152 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f4f45ffb640 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f4e980032c0 con 0x556e97cadac0 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 54 ==== osd_op_reply(167 notify.4 [notify cookie 93933482169920 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 55 ==== watch-notify(notify_complete (2) cookie 93933482169920 notify 141733920802 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5054005df0 con 0x556e97cadac0 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 56 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cee800 con 0x556e97cadac0 2024-02-15T23:31:03.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 57 ==== osd_op_reply(169 foo [call,call,delete] v33'17 uv17 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f4f197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:03.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93933481481440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x556e97cadac0 2024-02-15T23:31:03.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 58 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93933481481440] v33'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.951+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93933481458416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x7f5058027060 2024-02-15T23:31:03.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.955+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 43 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93933481458416] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.955+0000 7f5065403980 20 remove_watcher() i=0 2024-02-15T23:31:03.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.955+0000 7f5065403980 2 removed watcher, disabling cache 2024-02-15T23:31:03.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.955+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93933481463360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x556e97cadac0 2024-02-15T23:31:03.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.955+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 59 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93933481463360] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.955+0000 7f5065403980 20 remove_watcher() i=1 2024-02-15T23:31:03.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.955+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93933481464416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x556e97cb3d50 2024-02-15T23:31:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.959+0000 7f506271d640 1 -- 172.21.15.133:0/3452867917 <== osd.3 v2:172.21.15.133:6816/1056376173 38 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93933481464416] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505805f040 con 0x556e97cb3d50 2024-02-15T23:31:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.959+0000 7f5065403980 20 remove_watcher() i=2 2024-02-15T23:31:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.959+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93933481470736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x7f5058027060 2024-02-15T23:31:03.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.959+0000 7f506371f640 1 -- 172.21.15.133:0/3452867917 <== osd.2 v2:172.21.15.133:6808/3615800201 44 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93933481470736] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c039060 con 0x7f5058027060 2024-02-15T23:31:03.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.959+0000 7f5065403980 20 remove_watcher() i=3 2024-02-15T23:31:03.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.959+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93933481475056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x556e97cadac0 2024-02-15T23:31:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.963+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.1 v2:172.21.15.133:6800/2918336019 60 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93933481475056] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x556e97cadac0 2024-02-15T23:31:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.963+0000 7f5065403980 20 remove_watcher() i=4 2024-02-15T23:31:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.963+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93933481469280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x7f50540d0060 2024-02-15T23:31:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.963+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 48 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93933481469280] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.963+0000 7f5065403980 20 remove_watcher() i=5 2024-02-15T23:31:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.963+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93933481477280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x7f50540d0060 2024-02-15T23:31:03.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 49 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93933481477280] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 20 remove_watcher() i=6 2024-02-15T23:31:03.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93933481478336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556e97cc8a40 con 0x7f50540d0060 2024-02-15T23:31:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 <== osd.0 v2:172.21.15.131:6800/31994139 50 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93933481478336] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540fb080 con 0x7f50540d0060 2024-02-15T23:31:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 20 remove_watcher() i=7 2024-02-15T23:31:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f50540d0060 msgr2=0x7f50540aca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f50540d0060 0x7f50540aca60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97cadac0 msgr2=0x556e97caff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97cadac0 0x556e97caff80 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5058027060 msgr2=0x7f505803a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5058027060 0x7f505803a480 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556e97cb3d50 msgr2=0x556e97cb6210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x556e97cb3d50 0x556e97cb6210 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f2c0342b0 msgr2=0x7f4f2c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f2c0342b0 0x7f4f2c036770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f505c011010 tx=0x7f505c020000 comp rx=0 tx=0).stop 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5062f1e640 1 -- 172.21.15.133:0/3452867917 reap_dead start 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 msgr2=0x556e97ca2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97ca2540 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5058027030 tx=0x7f5058048b70 comp rx=0 tx=0).stop 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 shutdown_connections 2024-02-15T23:31:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3452867917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c9b680 0x556e97ca2540 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 >> 172.21.15.133:0/3452867917 conn(0x556e97c979c0 msgr2=0x556e97c95020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 shutdown_connections 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3452867917 wait complete. 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/1994915488 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f3c0342b0 msgr2=0x7f4f3c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/1994915488 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f3c0342b0 0x7f4f3c036770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x556e97c7ec60 tx=0x7f505c005850 comp rx=0 tx=0).stop 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/1994915488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c8e700 msgr2=0x556e97c8eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/1994915488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c8e700 0x556e97c8eb20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5058001ee0 tx=0x7f505800ea10 comp rx=0 tx=0).stop 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/1994915488 shutdown_connections 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/1994915488 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f3c0342b0 0x7f4f3c036770 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/1994915488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97c8e700 0x556e97c8eb20 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/1994915488 >> 172.21.15.133:0/1994915488 conn(0x556e97c83510 msgr2=0x556e97c84020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/1994915488 shutdown_connections 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/1994915488 wait complete. 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97b89750 msgr2=0x556e97c7de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97b89750 0x556e97c7de50 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f480342b0 msgr2=0x7f4f48036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f480342b0 0x7f4f48036770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5058000f70 tx=0x7f5058001380 comp rx=0 tx=0).stop 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 msgr2=0x556e97c771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c771c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5054005940 tx=0x7f50540180e0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 shutdown_connections 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556e97b89750 0x556e97c7de50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4f480342b0 0x7f4f48036770 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 --2- 172.21.15.133:0/3196556709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e97af8090 0x556e97c771c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.967+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 >> 172.21.15.133:0/3196556709 conn(0x556e97b7e8f0 msgr2=0x556e97c6a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.971+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 shutdown_connections 2024-02-15T23:31:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:03.971+0000 7f5065403980 1 -- 172.21.15.133:0/3196556709 wait complete. 2024-02-15T23:31:03.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T23:31:03.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T23:31:03.989 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T23:31:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:04.065 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:04.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff97a3980 1 Processor -- start 2024-02-15T23:31:04.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff97a3980 1 -- start start 2024-02-15T23:31:04.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff97a3980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x560594a580c0 0x560594ae4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff97a3980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560594a304c0 con 0x560594ae50f0 2024-02-15T23:31:04.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff97a3980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5605949f7180 con 0x560594a580c0 2024-02-15T23:31:04.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff72be640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x560594a580c0 0x560594ae4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff6abd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x560594ae50f0 0x560594ae7510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32956/0 (socket says 172.21.15.133:32956) 2024-02-15T23:31:04.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff6abd640 1 -- 172.21.15.133:0/908029465 learned_addr learned my addr 172.21.15.133:0/908029465 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:31:04.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff72be640 1 -- 172.21.15.133:0/908029465 >> v1:172.21.15.131:6789/0 conn(0x560594ae50f0 legacy=0x560594ae7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.059+0000 7f5ff72be640 1 -- 172.21.15.133:0/908029465 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560594ae8cc0 con 0x560594a580c0 2024-02-15T23:31:04.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff72be640 1 --2- 172.21.15.133:0/908029465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594ae4bb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000a420 tx=0x7f5ff001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b440f09f55f36fb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff62bc640 1 -- 172.21.15.133:0/908029465 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff00aa530 con 0x560594a580c0 2024-02-15T23:31:04.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff62bc640 1 -- 172.21.15.133:0/908029465 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff00a6050 con 0x560594a580c0 2024-02-15T23:31:04.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff62bc640 1 -- 172.21.15.133:0/908029465 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff00aa800 con 0x560594a580c0 2024-02-15T23:31:04.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff97a3980 1 -- 172.21.15.133:0/908029465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 msgr2=0x560594ae4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/908029465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594ae4bb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000a420 tx=0x7f5ff001afd0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff97a3980 1 -- 172.21.15.133:0/908029465 shutdown_connections 2024-02-15T23:31:04.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/908029465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594ae4bb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff97a3980 1 -- 172.21.15.133:0/908029465 >> 172.21.15.133:0/908029465 conn(0x560594ade8e0 msgr2=0x560594ae0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff97a3980 1 -- 172.21.15.133:0/908029465 shutdown_connections 2024-02-15T23:31:04.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.063+0000 7f5ff97a3980 1 -- 172.21.15.133:0/908029465 wait complete. 2024-02-15T23:31:04.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff97a3980 1 Processor -- start 2024-02-15T23:31:04.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff97a3980 1 -- start start 2024-02-15T23:31:04.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff97a3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bd48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff97a3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605949f46b0 con 0x560594a580c0 2024-02-15T23:31:04.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff72be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bd48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff72be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bd48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36182/0 (socket says 172.21.15.133:36182) 2024-02-15T23:31:04.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff72be640 1 -- 172.21.15.133:0/2522587619 learned_addr learned my addr 172.21.15.133:0/2522587619 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff72be640 1 -- 172.21.15.133:0/2522587619 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff000a100 con 0x560594a580c0 2024-02-15T23:31:04.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ff72be640 1 --2- 172.21.15.133:0/2522587619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bd48d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00ad040 tx=0x7f5ff00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd372e58aeae6421 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ee560a640 1 -- 172.21.15.133:0/2522587619 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff00aa6c0 con 0x560594a580c0 2024-02-15T23:31:04.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ee560a640 1 -- 172.21.15.133:0/2522587619 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff00aa820 con 0x560594a580c0 2024-02-15T23:31:04.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.079+0000 7f5ee560a640 1 -- 172.21.15.133:0/2522587619 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff00aaac0 con 0x560594a580c0 2024-02-15T23:31:04.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- 172.21.15.133:0/2522587619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 msgr2=0x560594bd48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/2522587619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bd48d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00ad040 tx=0x7f5ff00033b0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- 172.21.15.133:0/2522587619 shutdown_connections 2024-02-15T23:31:04.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/2522587619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bd48d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- 172.21.15.133:0/2522587619 >> 172.21.15.133:0/2522587619 conn(0x560594ade8e0 msgr2=0x560594bd0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- 172.21.15.133:0/2522587619 shutdown_connections 2024-02-15T23:31:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- 172.21.15.133:0/2522587619 wait complete. 2024-02-15T23:31:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 Processor -- start 2024-02-15T23:31:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- start start 2024-02-15T23:31:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bdb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605949efe90 con 0x560594a580c0 2024-02-15T23:31:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff72be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bdb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff72be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bdb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36186/0 (socket says 172.21.15.133:36186) 2024-02-15T23:31:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff72be640 1 -- 172.21.15.133:0/1961217607 learned_addr learned my addr 172.21.15.133:0/1961217607 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff72be640 1 -- 172.21.15.133:0/1961217607 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560594ae8cc0 con 0x560594a580c0 2024-02-15T23:31:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff72be640 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bdb590 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0003430 tx=0x7f5ff0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ee3e07640 1 -- 172.21.15.133:0/1961217607 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff00b6950 con 0x560594a580c0 2024-02-15T23:31:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560594bdbad0 con 0x560594a580c0 2024-02-15T23:31:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ee3e07640 1 -- 172.21.15.133:0/1961217607 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff00b6ab0 con 0x560594a580c0 2024-02-15T23:31:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ee3e07640 1 -- 172.21.15.133:0/1961217607 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff00b6d50 con 0x560594a580c0 2024-02-15T23:31:04.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560594bdbf80 con 0x560594a580c0 2024-02-15T23:31:04.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ee3e07640 1 -- 172.21.15.133:0/1961217607 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5ff00c0450 con 0x560594a580c0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ee3e07640 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5edc0342b0 0x7f5edc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.083+0000 7f5ee3e07640 1 -- 172.21.15.133:0/1961217607 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5ff00e4070 con 0x560594a580c0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff6abd640 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5edc0342b0 0x7f5edc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594ae50f0 0x560594be2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594be26d0 con 0x560594ae50f0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff7abf640 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594ae50f0 0x560594be2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff6abd640 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5edc0342b0 0x7f5edc036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0001da0 tx=0x7f5fe0001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff7abf640 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594ae50f0 0x560594be2190 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1961217607 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5fe80083f0 con 0x560594ae50f0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594bdf8c0 con 0x560594ae50f0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1961217607 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5fe80083f0 con 0x560594ae50f0 2024-02-15T23:31:04.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594be4420 con 0x560594ae50f0 2024-02-15T23:31:04.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1961217607 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5fe80083f0 con 0x560594ae50f0 2024-02-15T23:31:04.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594be3620 con 0x560594ae50f0 2024-02-15T23:31:04.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1961217607 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5fe80083f0 con 0x560594ae50f0 2024-02-15T23:31:04.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594be3a30 con 0x560594ae50f0 2024-02-15T23:31:04.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1961217607 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5fe8012040 con 0x560594ae50f0 2024-02-15T23:31:04.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 Processor -- start 2024-02-15T23:31:04.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 -- start start 2024-02-15T23:31:04.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bf2ae0 0x560594bf2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff97a3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560594988f20 con 0x560594bf2ae0 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff6abd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bf2ae0 0x560594bf2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff6abd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bf2ae0 0x560594bf2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36200/0 (socket says 172.21.15.133:36200) 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1213309132 learned_addr learned my addr 172.21.15.133:0/1213309132 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1213309132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560594bf3440 con 0x560594bf2ae0 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.087+0000 7f5ff6abd640 1 --2- 172.21.15.133:0/1213309132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bf2ae0 0x560594bf2f00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000d660 tx=0x7f5fe000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ee1602640 1 -- 172.21.15.133:0/1213309132 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0020070 con 0x560594bf2ae0 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ee1602640 1 -- 172.21.15.133:0/1213309132 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe000c770 con 0x560594bf2ae0 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1213309132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560594bf3690 con 0x560594bf2ae0 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ee1602640 1 -- 172.21.15.133:0/1213309132 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0013040 con 0x560594bf2ae0 2024-02-15T23:31:04.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1213309132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560594bf41e0 con 0x560594bf2ae0 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ee1602640 1 -- 172.21.15.133:0/1213309132 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5fe000a040 con 0x560594bf2ae0 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ee1602640 1 --2- 172.21.15.133:0/1213309132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ed00342b0 0x7f5ed0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ee1602640 1 -- 172.21.15.133:0/1213309132 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5fe004b670 con 0x560594bf2ae0 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff7abf640 1 --2- 172.21.15.133:0/1213309132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ed00342b0 0x7f5ed0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff97a3980 1 Processor -- start 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff97a3980 1 -- start start 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff7abf640 1 --2- 172.21.15.133:0/1213309132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ed00342b0 0x7f5ed0036770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x560594be3060 tx=0x7f5fe8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff97a3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594bfff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff97a3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059497c790 con 0x560594bffb00 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff6abd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594bfff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff6abd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594bfff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36206/0 (socket says 172.21.15.133:36206) 2024-02-15T23:31:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1683985632 learned_addr learned my addr 172.21.15.133:0/1683985632 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1683985632 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560594c004d0 con 0x560594bffb00 2024-02-15T23:31:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5ff6abd640 1 --2- 172.21.15.133:0/1683985632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594bfff00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5fe001aab0 tx=0x7f5fe000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68252b0f9fc9140d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5edaffd640 1 -- 172.21.15.133:0/1683985632 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fe001b7a0 con 0x560594bffb00 2024-02-15T23:31:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5edaffd640 1 -- 172.21.15.133:0/1683985632 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe001b900 con 0x560594bffb00 2024-02-15T23:31:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.091+0000 7f5edaffd640 1 -- 172.21.15.133:0/1683985632 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fe001ae10 con 0x560594bffb00 2024-02-15T23:31:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1683985632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 msgr2=0x560594bfff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1683985632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594bfff00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5fe001aab0 tx=0x7f5fe000ce50 comp rx=0 tx=0).stop 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1683985632 shutdown_connections 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1683985632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594bfff00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1683985632 >> 172.21.15.133:0/1683985632 conn(0x560594bfbe40 msgr2=0x560594bf9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1683985632 shutdown_connections 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1683985632 wait complete. 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 Processor -- start 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- start start 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594c06a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560594c06fa0 con 0x560594bffb00 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff6abd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594c06a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff6abd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594c06a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36220/0 (socket says 172.21.15.133:36220) 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 learned_addr learned my addr 172.21.15.133:0/1167553588 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560594bf41e0 con 0x560594bffb00 2024-02-15T23:31:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff6abd640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594c06a60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0019fd0 tx=0x7f5fe0049950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ed97fa640 1 -- 172.21.15.133:0/1167553588 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0048590 con 0x560594bffb00 2024-02-15T23:31:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ed97fa640 1 -- 172.21.15.133:0/1167553588 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe0034070 con 0x560594bffb00 2024-02-15T23:31:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560594c071a0 con 0x560594bffb00 2024-02-15T23:31:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ed97fa640 1 -- 172.21.15.133:0/1167553588 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fe001a4f0 con 0x560594bffb00 2024-02-15T23:31:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560594c07630 con 0x560594bffb00 2024-02-15T23:31:04.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ed97fa640 1 -- 172.21.15.133:0/1167553588 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5fe001a650 con 0x560594bffb00 2024-02-15T23:31:04.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ed97fa640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ec00342b0 0x7f5ec0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ed97fa640 1 -- 172.21.15.133:0/1167553588 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5fe0040020 con 0x560594bffb00 2024-02-15T23:31:04.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff7abf640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ec00342b0 0x7f5ec0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594c12040 0x560594c144e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c14c30 con 0x560594c12040 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.095+0000 7f5ff72be640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594c12040 0x560594c144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff7abf640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ec00342b0 0x7f5ec0036770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x560594be3120 tx=0x7f5fe801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594c12040 0x560594c144e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 realm 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c15000 con 0x560594c12040 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:31:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c15850 con 0x560594c12040 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c15bb0 con 0x560594c12040 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c154f0 con 0x560594c12040 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 20 searching for the correct realm 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560594c17e00 0x560594c1a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff6abd640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560594c17e00 0x560594c1a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff6abd640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560594c17e00 0x560594c1a250 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff6abd640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5fe003a5e0 0x7f5fe004b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5fe003a5e0 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff7abf640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5fe003a5e0 0x7f5fe004b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff7abf640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5fe003a5e0 0x7f5fe004b980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe802c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5fe003a5e0 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe802c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c12040 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c12040 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f5ff00c9020 0x7f5ff00a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.099+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5ff00c9020 2024-02-15T23:31:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f5ff00c9020 0x7f5ff00a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f5ff00c9020 0x7f5ff00a95c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x7f5ff00c9020 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5ff00c9020 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x7f5ff00c9020 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5fe003a5e0 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe802c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c12040 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5ff00c9020 2024-02-15T23:31:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x7f5ff00c9020 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c12040 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5fe003a5e0 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5fe802c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.103+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5ff00c9020 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x7f5ff00c9020 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c12040 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c12040 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5ff00c9020 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x7f5ff00c9020 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5fe003a5e0 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe802c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c12040 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00c6070 con 0x560594c12040 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5fe003a5e0 2024-02-15T23:31:04.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe802c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.107+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5ff00c9020 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5fe003a5e0 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c17e00 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5ff00c9020 2024-02-15T23:31:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x560594c12040 2024-02-15T23:31:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1a920 con 0x7f5fe003a5e0 2024-02-15T23:31:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:31:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c16a20 con 0x560594c12040 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c166a0 con 0x560594c12040 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c17360 con 0x560594c12040 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 zone default found 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 4 Realm: () 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 zonegroup default 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1ad60 con 0x7f5fe003a5e0 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1cbe0 con 0x560594c17e00 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.111+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1cf40 con 0x560594c17e00 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff97a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff97a3980 20 started sync module instance, tier type = 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff97a3980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1c1b0 con 0x7f5fe003a5e0 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94581970552160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1c1b0 con 0x7f5fe003a5e0 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1d8b0 con 0x560594c12040 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94581970552160] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94581970556192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1c1b0 con 0x560594c12040 2024-02-15T23:31:04.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.115+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1e2b0 con 0x560594c17e00 2024-02-15T23:31:04.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.119+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94581970556192] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.119+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.119+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94581970550032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1c130 con 0x560594c17e00 2024-02-15T23:31:04.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.119+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1efa0 con 0x7f5fe003a5e0 2024-02-15T23:31:04.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.119+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.119+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94581970562096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1f7f0 con 0x7f5fe003a5e0 2024-02-15T23:31:04.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.119+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c20250 con 0x560594c12040 2024-02-15T23:31:04.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.123+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94581970562096] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.123+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94581970550032] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.123+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.123+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94581970560608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1f350 con 0x560594c12040 2024-02-15T23:31:04.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.123+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c20aa0 con 0x7f5ff00c9020 2024-02-15T23:31:04.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.123+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94581970560608] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.127+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.127+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94581970566464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1f350 con 0x7f5ff00c9020 2024-02-15T23:31:04.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.127+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c21010 con 0x7f5ff00c9020 2024-02-15T23:31:04.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94581970566464] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94581970569968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c20fd0 con 0x7f5ff00c9020 2024-02-15T23:31:04.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c219f0 con 0x7f5ff00c9020 2024-02-15T23:31:04.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94581970569968] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94581970572496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c219b0 con 0x7f5ff00c9020 2024-02-15T23:31:04.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 20 add_watcher() i=0 2024-02-15T23:31:04.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 20 add_watcher() i=1 2024-02-15T23:31:04.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 20 add_watcher() i=2 2024-02-15T23:31:04.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 20 add_watcher() i=3 2024-02-15T23:31:04.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 20 add_watcher() i=4 2024-02-15T23:31:04.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 20 add_watcher() i=5 2024-02-15T23:31:04.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.131+0000 7f5ff97a3980 20 add_watcher() i=6 2024-02-15T23:31:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94581970572496] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 20 add_watcher() i=7 2024-02-15T23:31:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 2 all 8 watchers are set, enabling cache 2024-02-15T23:31:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c24e30 con 0x560594c12040 2024-02-15T23:31:04.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94581970568160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c22340 con 0x560594c12040 2024-02-15T23:31:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94581970568160] v33'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5eae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 5 note: GC not initialized 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ead7e2640 20 reqs_thread_entry: start 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 20 init_complete bucket index max shards: 11 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 20 Filter name: none 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ea67fc640 20 reqs_thread_entry: start 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 20 rados->read ofs=0 len=0 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c468b0 con 0x560594c12040 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.135+0000 7f5ff97a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:could not fetch user info: no user info saved 2024-02-15T23:31:04.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.139+0000 7f5eae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:04.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.139+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94581970568160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c46870 con 0x560594c12040 2024-02-15T23:31:04.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.139+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94581970568160] v33'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.139+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94581970552160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c46870 con 0x7f5fe003a5e0 2024-02-15T23:31:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.139+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94581970552160] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.139+0000 7f5ff97a3980 20 remove_watcher() i=0 2024-02-15T23:31:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.139+0000 7f5ff97a3980 2 removed watcher, disabling cache 2024-02-15T23:31:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.139+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94581970556192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c46870 con 0x560594c12040 2024-02-15T23:31:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94581970556192] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff97a3980 20 remove_watcher() i=1 2024-02-15T23:31:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94581970550032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c46870 con 0x560594c17e00 2024-02-15T23:31:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff6abd640 1 -- 172.21.15.133:0/1167553588 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94581970550032] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe0022070 con 0x560594c17e00 2024-02-15T23:31:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff97a3980 20 remove_watcher() i=2 2024-02-15T23:31:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94581970562096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1d520 con 0x7f5fe003a5e0 2024-02-15T23:31:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff7abf640 1 -- 172.21.15.133:0/1167553588 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94581970562096] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5fe803c040 con 0x7f5fe003a5e0 2024-02-15T23:31:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff97a3980 20 remove_watcher() i=3 2024-02-15T23:31:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.143+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94581970560608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1bd10 con 0x560594c12040 2024-02-15T23:31:04.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.147+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94581970560608] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x560594c12040 2024-02-15T23:31:04.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.147+0000 7f5ff97a3980 20 remove_watcher() i=4 2024-02-15T23:31:04.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.147+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94581970566464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1d520 con 0x7f5ff00c9020 2024-02-15T23:31:04.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.147+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94581970566464] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.147+0000 7f5ff97a3980 20 remove_watcher() i=5 2024-02-15T23:31:04.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.147+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94581970569968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1bd10 con 0x7f5ff00c9020 2024-02-15T23:31:04.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94581970569968] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 20 remove_watcher() i=6 2024-02-15T23:31:04.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94581970572496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560594c1fd40 con 0x7f5ff00c9020 2024-02-15T23:31:04.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94581970572496] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ff00f7040 con 0x7f5ff00c9020 2024-02-15T23:31:04.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 20 remove_watcher() i=7 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f5ff00c9020 msgr2=0x7f5ff00a95c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f5ff00c9020 0x7f5ff00a95c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594c12040 msgr2=0x560594c144e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594c12040 0x560594c144e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5fe003a5e0 msgr2=0x7f5fe004b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f5fe003a5e0 0x7f5fe004b980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560594c17e00 msgr2=0x560594c1a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x560594c17e00 0x560594c1a250 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ec00342b0 msgr2=0x7f5ec0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.151+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ec00342b0 0x7f5ec0036770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x560594be3120 tx=0x7f5fe801c070 comp rx=0 tx=0).stop 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff72be640 1 -- 172.21.15.133:0/1167553588 reap_dead start 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 msgr2=0x560594c06a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594c06a60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0019fd0 tx=0x7f5fe0049950 comp rx=0 tx=0).stop 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 shutdown_connections 2024-02-15T23:31:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1167553588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bffb00 0x560594c06a60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 >> 172.21.15.133:0/1167553588 conn(0x560594bfbe40 msgr2=0x560594bf94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 shutdown_connections 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1167553588 wait complete. 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1213309132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ed00342b0 msgr2=0x7f5ed0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1213309132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ed00342b0 0x7f5ed0036770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x560594be3060 tx=0x7f5fe8003070 comp rx=0 tx=0).stop 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1213309132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bf2ae0 msgr2=0x560594bf2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1213309132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bf2ae0 0x560594bf2f00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000d660 tx=0x7f5fe000da60 comp rx=0 tx=0).stop 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1213309132 shutdown_connections 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1213309132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5ed00342b0 0x7f5ed0036770 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1213309132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594bf2ae0 0x560594bf2f00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1213309132 >> 172.21.15.133:0/1213309132 conn(0x560594be78f0 msgr2=0x560594be8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1213309132 shutdown_connections 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1213309132 wait complete. 2024-02-15T23:31:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594ae50f0 msgr2=0x560594be2190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594ae50f0 0x560594be2190 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5edc0342b0 msgr2=0x7f5edc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5edc0342b0 0x7f5edc036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0001da0 tx=0x7f5fe0001300 comp rx=0 tx=0).stop 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 msgr2=0x560594bdb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bdb590 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0003430 tx=0x7f5ff0019810 comp rx=0 tx=0).stop 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 shutdown_connections 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x560594ae50f0 0x560594be2190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f5edc0342b0 0x7f5edc036770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 --2- 172.21.15.133:0/1961217607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560594a580c0 0x560594bdb590 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 >> 172.21.15.133:0/1961217607 conn(0x560594ade8e0 msgr2=0x560594bcef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 shutdown_connections 2024-02-15T23:31:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.155+0000 7f5ff97a3980 1 -- 172.21.15.133:0/1961217607 wait complete. 2024-02-15T23:31:04.169 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-15T23:31:04.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-02-15T23:31:04.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-02-15T23:31:04.170 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-02-15T23:31:04.238 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:04.238 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:04.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.231+0000 7f0448f8c980 1 Processor -- start 2024-02-15T23:31:04.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.231+0000 7f0448f8c980 1 -- start start 2024-02-15T23:31:04.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.231+0000 7f0448f8c980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556dbfce9070 0x556dbfce9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.231+0000 7f0448f8c980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556dbfc364c0 con 0x556dbfce9990 2024-02-15T23:31:04.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.231+0000 7f0448f8c980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x556dbfbfd180 con 0x556dbfce9070 2024-02-15T23:31:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.231+0000 7f0446aa7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556dbfce9070 0x556dbfce9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f0446aa7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x556dbfce9070 0x556dbfce9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36232/0 (socket says 172.21.15.133:36232) 2024-02-15T23:31:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f04462a6640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x556dbfce9990 0x556dbfcea3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32968/0 (socket says 172.21.15.133:32968) 2024-02-15T23:31:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f0446aa7640 1 -- 172.21.15.133:0/3852941390 learned_addr learned my addr 172.21.15.133:0/3852941390 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f0446aa7640 1 -- 172.21.15.133:0/3852941390 >> v1:172.21.15.131:6789/0 conn(0x556dbfce9990 legacy=0x556dbfcea3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f0446aa7640 1 -- 172.21.15.133:0/3852941390 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dbfceabd0 con 0x556dbfce9070 2024-02-15T23:31:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f0446aa7640 1 --2- 172.21.15.133:0/3852941390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfce9450 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f043800a5c0 tx=0x7f043801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fcf80ff61354b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f0445aa5640 1 -- 172.21.15.133:0/3852941390 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04380aa470 con 0x556dbfce9070 2024-02-15T23:31:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f0445aa5640 1 -- 172.21.15.133:0/3852941390 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380aa5d0 con 0x556dbfce9070 2024-02-15T23:31:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.235+0000 7f0445aa5640 1 -- 172.21.15.133:0/3852941390 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04380aa890 con 0x556dbfce9070 2024-02-15T23:31:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.239+0000 7f0448f8c980 1 -- 172.21.15.133:0/3852941390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 msgr2=0x556dbfce9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.239+0000 7f0448f8c980 1 --2- 172.21.15.133:0/3852941390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfce9450 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f043800a5c0 tx=0x7f043801b340 comp rx=0 tx=0).stop 2024-02-15T23:31:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.239+0000 7f0448f8c980 1 -- 172.21.15.133:0/3852941390 shutdown_connections 2024-02-15T23:31:04.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.239+0000 7f0448f8c980 1 --2- 172.21.15.133:0/3852941390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfce9450 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.239+0000 7f0448f8c980 1 -- 172.21.15.133:0/3852941390 >> 172.21.15.133:0/3852941390 conn(0x556dbfce4940 msgr2=0x556dbfce6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.239+0000 7f0448f8c980 1 -- 172.21.15.133:0/3852941390 shutdown_connections 2024-02-15T23:31:04.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.239+0000 7f0448f8c980 1 -- 172.21.15.133:0/3852941390 wait complete. 2024-02-15T23:31:04.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 Processor -- start 2024-02-15T23:31:04.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 -- start start 2024-02-15T23:31:04.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfc5d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbfbfa6b0 con 0x556dbfce9070 2024-02-15T23:31:04.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0446aa7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfc5d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0446aa7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfc5d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36234/0 (socket says 172.21.15.133:36234) 2024-02-15T23:31:04.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0446aa7640 1 -- 172.21.15.133:0/167225916 learned_addr learned my addr 172.21.15.133:0/167225916 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0446aa7640 1 -- 172.21.15.133:0/167225916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0438005df0 con 0x556dbfce9070 2024-02-15T23:31:04.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0446aa7640 1 --2- 172.21.15.133:0/167225916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfc5d8e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0438018f70 tx=0x7f0438003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cb51faafbc080 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0334e09640 1 -- 172.21.15.133:0/167225916 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04380aa9c0 con 0x556dbfce9070 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0334e09640 1 -- 172.21.15.133:0/167225916 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380aab20 con 0x556dbfce9070 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0334e09640 1 -- 172.21.15.133:0/167225916 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04380aadc0 con 0x556dbfce9070 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 -- 172.21.15.133:0/167225916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 msgr2=0x556dbfc5d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 --2- 172.21.15.133:0/167225916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfc5d8e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0438018f70 tx=0x7f0438003030 comp rx=0 tx=0).stop 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 -- 172.21.15.133:0/167225916 shutdown_connections 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 --2- 172.21.15.133:0/167225916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfc5d8e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 -- 172.21.15.133:0/167225916 >> 172.21.15.133:0/167225916 conn(0x556dbfce4940 msgr2=0x556dbfdcf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 -- 172.21.15.133:0/167225916 shutdown_connections 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 -- 172.21.15.133:0/167225916 wait complete. 2024-02-15T23:31:04.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.251+0000 7f0448f8c980 1 Processor -- start 2024-02-15T23:31:04.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 -- start start 2024-02-15T23:31:04.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfdd4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbfbf5e90 con 0x556dbfce9070 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0446aa7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfdd4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0446aa7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfdd4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36246/0 (socket says 172.21.15.133:36246) 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0446aa7640 1 -- 172.21.15.133:0/918598779 learned_addr learned my addr 172.21.15.133:0/918598779 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0446aa7640 1 -- 172.21.15.133:0/918598779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dbfceabd0 con 0x556dbfce9070 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0446aa7640 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfdd4c90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0438018f70 tx=0x7f04380180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0333606640 1 -- 172.21.15.133:0/918598779 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04380cb070 con 0x556dbfce9070 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556dbfdd51d0 con 0x556dbfce9070 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0333606640 1 -- 172.21.15.133:0/918598779 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380c6690 con 0x556dbfce9070 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dbfdd36b0 con 0x556dbfce9070 2024-02-15T23:31:04.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0333606640 1 -- 172.21.15.133:0/918598779 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04380c6930 con 0x556dbfce9070 2024-02-15T23:31:04.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 Processor -- start 2024-02-15T23:31:04.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 -- start start 2024-02-15T23:31:04.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdeee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0448f8c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbfb8ef20 con 0x556dbfdeea70 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f04472a8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdeee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0333606640 1 -- 172.21.15.133:0/918598779 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f04380c6a90 con 0x556dbfce9070 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f04472a8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdeee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36258/0 (socket says 172.21.15.133:36258) 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f04472a8640 1 -- 172.21.15.133:0/3331584525 learned_addr learned my addr 172.21.15.133:0/3331584525 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0333606640 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f032c0342b0 0x7f032c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0333606640 1 -- 172.21.15.133:0/918598779 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f04380e4b00 con 0x556dbfce9070 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0446aa7640 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f032c0342b0 0x7f032c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f04472a8640 1 -- 172.21.15.133:0/3331584525 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dbfdef3d0 con 0x556dbfdeea70 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0446aa7640 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f032c0342b0 0x7f032c036770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f04380c5fd0 tx=0x7f04380c5f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f04472a8640 1 --2- 172.21.15.133:0/3331584525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdeee90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f044000a430 tx=0x7f044000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd229f8ca3b3f47 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0331602640 1 -- 172.21.15.133:0/3331584525 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f044000f6e0 con 0x556dbfdeea70 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0331602640 1 -- 172.21.15.133:0/3331584525 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044000f860 con 0x556dbfdeea70 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.255+0000 7f0331602640 1 -- 172.21.15.133:0/3331584525 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f044000fb40 con 0x556dbfdeea70 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- 172.21.15.133:0/3331584525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 msgr2=0x556dbfdeee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 --2- 172.21.15.133:0/3331584525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdeee90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f044000a430 tx=0x7f044000a8f0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- 172.21.15.133:0/3331584525 shutdown_connections 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 --2- 172.21.15.133:0/3331584525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdeee90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- 172.21.15.133:0/3331584525 >> 172.21.15.133:0/3331584525 conn(0x556dbfce9990 msgr2=0x556dbfde9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- 172.21.15.133:0/3331584525 shutdown_connections 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- 172.21.15.133:0/3331584525 wait complete. 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 Processor -- start 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- start start 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdf59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbfb82790 con 0x556dbfdeea70 2024-02-15T23:31:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f04472a8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdf59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f04472a8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdf59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36270/0 (socket says 172.21.15.133:36270) 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f04472a8640 1 -- 172.21.15.133:0/2932062224 learned_addr learned my addr 172.21.15.133:0/2932062224 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f04472a8640 1 -- 172.21.15.133:0/2932062224 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044000a0e0 con 0x556dbfdeea70 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f04472a8640 1 --2- 172.21.15.133:0/2932062224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdf59e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x556dbfdef850 tx=0x7f0440003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f032b7fe640 1 -- 172.21.15.133:0/2932062224 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0440010a20 con 0x556dbfdeea70 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- 172.21.15.133:0/2932062224 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556dbfdf5f20 con 0x556dbfdeea70 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f032b7fe640 1 -- 172.21.15.133:0/2932062224 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440010b80 con 0x556dbfdeea70 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f032b7fe640 1 -- 172.21.15.133:0/2932062224 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f044001a480 con 0x556dbfdeea70 2024-02-15T23:31:04.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- 172.21.15.133:0/2932062224 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dbfdf63b0 con 0x556dbfdeea70 2024-02-15T23:31:04.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:04.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:04.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f032b7fe640 1 -- 172.21.15.133:0/2932062224 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f044001a6f0 con 0x556dbfdeea70 2024-02-15T23:31:04.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 Processor -- start 2024-02-15T23:31:04.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f032b7fe640 1 --2- 172.21.15.133:0/2932062224 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f03200342b0 0x7f0320036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- start start 2024-02-15T23:31:04.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f032b7fe640 1 -- 172.21.15.133:0/2932062224 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0440049db0 con 0x556dbfdeea70 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f04472a8640 1 --2- 172.21.15.133:0/2932062224 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f03200342b0 0x7f0320036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfe0f790 0x556dbfe0fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.259+0000 7f0448f8c980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbfe100f0 con 0x556dbfe0f790 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f04472a8640 1 --2- 172.21.15.133:0/2932062224 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f03200342b0 0x7f0320036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f044000cfd0 tx=0x7f044002e950 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0446aa7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfe0f790 0x556dbfe0fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0446aa7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfe0f790 0x556dbfe0fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36284/0 (socket says 172.21.15.133:36284) 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0446aa7640 1 -- 172.21.15.133:0/2469063188 learned_addr learned my addr 172.21.15.133:0/2469063188 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0446aa7640 1 -- 172.21.15.133:0/2469063188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dbfe10230 con 0x556dbfe0f790 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0446aa7640 1 --2- 172.21.15.133:0/2469063188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfe0f790 0x556dbfe0fbb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f043801b360 tx=0x7f04380e2d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0306ffd640 1 -- 172.21.15.133:0/2469063188 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04380c38c0 con 0x556dbfe0f790 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0448f8c980 1 -- 172.21.15.133:0/2469063188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556dbfe10b80 con 0x556dbfe0f790 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0306ffd640 1 -- 172.21.15.133:0/2469063188 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380de070 con 0x556dbfe0f790 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0306ffd640 1 -- 172.21.15.133:0/2469063188 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04380d0930 con 0x556dbfe0f790 2024-02-15T23:31:04.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0448f8c980 1 -- 172.21.15.133:0/2469063188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dbfe11010 con 0x556dbfe0f790 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0306ffd640 1 -- 172.21.15.133:0/2469063188 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f04380e0030 con 0x556dbfe0f790 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0306ffd640 1 --2- 172.21.15.133:0/2469063188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0280034300 0x7f02800367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0306ffd640 1 -- 172.21.15.133:0/2469063188 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f04380f8d60 con 0x556dbfe0f790 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f04462a6640 1 --2- 172.21.15.133:0/2469063188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0280034300 0x7f02800367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0304ff9640 20 reqs_thread_entry: start 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f04462a6640 1 --2- 172.21.15.133:0/2469063188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0280034300 0x7f02800367c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f043c000f70 tx=0x7f043c001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0448f8c980 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556dbfdddaf0 0x556dbfe16770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556dbfe16d60 con 0x556dbfdddaf0 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f04472a8640 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556dbfdddaf0 0x556dbfe16770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f04472a8640 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556dbfdddaf0 0x556dbfe16770 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f04472a8640 1 -- 172.21.15.133:0/918598779 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0440016020 con 0x556dbfdddaf0 2024-02-15T23:31:04.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.263+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556dbfe185c0 con 0x556dbfdddaf0 2024-02-15T23:31:04.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f04472a8640 1 -- 172.21.15.133:0/918598779 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0440016020 con 0x556dbfdddaf0 2024-02-15T23:31:04.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2932062224 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f03200342b0 msgr2=0x7f0320036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/2932062224 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f03200342b0 0x7f0320036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f044000cfd0 tx=0x7f044002e950 comp rx=0 tx=0).stop 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2932062224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 msgr2=0x556dbfdf59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/2932062224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdf59e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x556dbfdef850 tx=0x7f0440003380 comp rx=0 tx=0).stop 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2932062224 shutdown_connections 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/2932062224 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f03200342b0 0x7f0320036770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/2932062224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfdeea70 0x556dbfdf59e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2932062224 >> 172.21.15.133:0/2932062224 conn(0x556dbfce9990 msgr2=0x556dbfde8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2932062224 shutdown_connections 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2932062224 wait complete. 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2469063188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0280034300 msgr2=0x7f02800367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/2469063188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0280034300 0x7f02800367c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f043c000f70 tx=0x7f043c001300 comp rx=0 tx=0).stop 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2469063188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfe0f790 msgr2=0x556dbfe0fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/2469063188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfe0f790 0x556dbfe0fbb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f043801b360 tx=0x7f04380e2d40 comp rx=0 tx=0).stop 2024-02-15T23:31:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2469063188 shutdown_connections 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/2469063188 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f0280034300 0x7f02800367c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/2469063188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfe0f790 0x556dbfe0fbb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2469063188 >> 172.21.15.133:0/2469063188 conn(0x556dbfe044b0 msgr2=0x556dbfe04ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2469063188 shutdown_connections 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/2469063188 wait complete. 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556dbfdddaf0 msgr2=0x556dbfe16770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556dbfdddaf0 0x556dbfe16770 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f032c0342b0 msgr2=0x7f032c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f032c0342b0 0x7f032c036770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f04380c5fd0 tx=0x7f04380c5f60 comp rx=0 tx=0).stop 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 msgr2=0x556dbfdd4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfdd4c90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0438018f70 tx=0x7f04380180e0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 shutdown_connections 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x556dbfdddaf0 0x556dbfe16770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f032c0342b0 0x7f032c036770 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 --2- 172.21.15.133:0/918598779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dbfce9070 0x556dbfdd4c90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 >> 172.21.15.133:0/918598779 conn(0x556dbfce4940 msgr2=0x556dbfdcdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 shutdown_connections 2024-02-15T23:31:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.267+0000 7f0448f8c980 1 -- 172.21.15.133:0/918598779 wait complete. 2024-02-15T23:31:04.283 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"cd69b486-4810-48ae-b5d4-5bce307169d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T23:31:04.283 DEBUG:tasks.util.rgw: json result: {'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T23:31:04.283 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-02-15T23:31:04.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-02-15T23:31:04.284 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-02-15T23:31:04.354 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:04.354 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:04.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.347+0000 7f419380b980 1 Processor -- start 2024-02-15T23:31:04.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.347+0000 7f419380b980 1 -- start start 2024-02-15T23:31:04.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.347+0000 7f419380b980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55cd41de9140 0x55cd41de76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.347+0000 7f419380b980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cd41dbf4b0 con 0x55cd41de7c30 2024-02-15T23:31:04.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.347+0000 7f419380b980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cd41d86180 con 0x55cd41de9140 2024-02-15T23:31:04.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4191326640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55cd41de9140 0x55cd41de76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4190b25640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55cd41de7c30 0x55cd41e7b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32984/0 (socket says 172.21.15.133:32984) 2024-02-15T23:31:04.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4191326640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55cd41de9140 0x55cd41de76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36298/0 (socket says 172.21.15.133:36298) 2024-02-15T23:31:04.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4190b25640 1 -- 172.21.15.133:0/924533595 learned_addr learned my addr 172.21.15.133:0/924533595 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:31:04.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4191326640 1 -- 172.21.15.133:0/924533595 >> v1:172.21.15.131:6789/0 conn(0x55cd41de7c30 legacy=0x55cd41e7b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4191326640 1 -- 172.21.15.133:0/924533595 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd41de8040 con 0x55cd41de9140 2024-02-15T23:31:04.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4191326640 1 --2- 172.21.15.133:0/924533595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de9140 0x55cd41de76f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f418400a480 tx=0x7f418401b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb3a343227b39bb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4183fff640 1 -- 172.21.15.133:0/924533595 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41840aa400 con 0x55cd41de9140 2024-02-15T23:31:04.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4183fff640 1 -- 172.21.15.133:0/924533595 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840a6050 con 0x55cd41de9140 2024-02-15T23:31:04.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f4183fff640 1 -- 172.21.15.133:0/924533595 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41840aa6b0 con 0x55cd41de9140 2024-02-15T23:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f419380b980 1 -- 172.21.15.133:0/924533595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de9140 msgr2=0x55cd41de76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f419380b980 1 --2- 172.21.15.133:0/924533595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de9140 0x55cd41de76f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f418400a480 tx=0x7f418401b220 comp rx=0 tx=0).stop 2024-02-15T23:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f419380b980 1 -- 172.21.15.133:0/924533595 shutdown_connections 2024-02-15T23:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f419380b980 1 --2- 172.21.15.133:0/924533595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de9140 0x55cd41de76f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f419380b980 1 -- 172.21.15.133:0/924533595 >> 172.21.15.133:0/924533595 conn(0x55cd41e6ea30 msgr2=0x55cd41e70e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f419380b980 1 -- 172.21.15.133:0/924533595 shutdown_connections 2024-02-15T23:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.351+0000 7f419380b980 1 -- 172.21.15.133:0/924533595 wait complete. 2024-02-15T23:31:04.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 Processor -- start 2024-02-15T23:31:04.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- start start 2024-02-15T23:31:04.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd41d836b0 con 0x55cd41de7c30 2024-02-15T23:31:04.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f4191326640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f4191326640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f5f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36308/0 (socket says 172.21.15.133:36308) 2024-02-15T23:31:04.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f4191326640 1 -- 172.21.15.133:0/230292226 learned_addr learned my addr 172.21.15.133:0/230292226 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f4191326640 1 -- 172.21.15.133:0/230292226 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184005d30 con 0x55cd41de7c30 2024-02-15T23:31:04.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f4191326640 1 --2- 172.21.15.133:0/230292226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f5f760 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f41840ad040 tx=0x7f4184003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47680215dd22ea8e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f407f606640 1 -- 172.21.15.133:0/230292226 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41840aa6f0 con 0x55cd41de7c30 2024-02-15T23:31:04.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f407f606640 1 -- 172.21.15.133:0/230292226 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840aa850 con 0x55cd41de7c30 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f407f606640 1 -- 172.21.15.133:0/230292226 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41840aaaf0 con 0x55cd41de7c30 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- 172.21.15.133:0/230292226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 msgr2=0x55cd41f5f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 --2- 172.21.15.133:0/230292226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f5f760 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f41840ad040 tx=0x7f4184003030 comp rx=0 tx=0).stop 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- 172.21.15.133:0/230292226 shutdown_connections 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 --2- 172.21.15.133:0/230292226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f5f760 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- 172.21.15.133:0/230292226 >> 172.21.15.133:0/230292226 conn(0x55cd41e6ea30 msgr2=0x55cd41f5b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- 172.21.15.133:0/230292226 shutdown_connections 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- 172.21.15.133:0/230292226 wait complete. 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 Processor -- start 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- start start 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f66410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.367+0000 7f419380b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd41d7ee90 con 0x55cd41de7c30 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191326640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f66410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191326640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f66410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36314/0 (socket says 172.21.15.133:36314) 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 learned_addr learned my addr 172.21.15.133:0/1820453669 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd41de8040 con 0x55cd41de7c30 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191326640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f66410 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4184018eb0 tx=0x7f4184018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f407de03640 1 -- 172.21.15.133:0/1820453669 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41840b4b20 con 0x55cd41de7c30 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd41f66950 con 0x55cd41de7c30 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd41f66e00 con 0x55cd41de7c30 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f407de03640 1 -- 172.21.15.133:0/1820453669 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840b4c80 con 0x55cd41de7c30 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f407de03640 1 -- 172.21.15.133:0/1820453669 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41840c6470 con 0x55cd41de7c30 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f419380b980 1 Processor -- start 2024-02-15T23:31:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f419380b980 1 -- start start 2024-02-15T23:31:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f419380b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f738c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f419380b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd41d17f20 con 0x55cd41f734a0 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191b27640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191b27640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f738c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36328/0 (socket says 172.21.15.133:36328) 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191b27640 1 -- 172.21.15.133:0/2851533508 learned_addr learned my addr 172.21.15.133:0/2851533508 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f407de03640 1 -- 172.21.15.133:0/1820453669 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f41840c3070 con 0x55cd41de7c30 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f407de03640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 0x7f4078036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f407de03640 1 -- 172.21.15.133:0/1820453669 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f41840e40f0 con 0x55cd41de7c30 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191326640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 0x7f4078036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191b27640 1 -- 172.21.15.133:0/2851533508 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd41f73e00 con 0x55cd41f734a0 2024-02-15T23:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191326640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 0x7f4078036770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4184005780 tx=0x7f4184005710 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f4191b27640 1 --2- 172.21.15.133:0/2851533508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f738c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f418c00a430 tx=0x7f418c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818a28a224bcf53f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f40777fe640 1 -- 172.21.15.133:0/2851533508 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c00f6e0 con 0x55cd41f734a0 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f40777fe640 1 -- 172.21.15.133:0/2851533508 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00f860 con 0x55cd41f734a0 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.371+0000 7f40777fe640 1 -- 172.21.15.133:0/2851533508 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c00fb40 con 0x55cd41f734a0 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- 172.21.15.133:0/2851533508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 msgr2=0x55cd41f738c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 --2- 172.21.15.133:0/2851533508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f738c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f418c00a430 tx=0x7f418c00a8f0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- 172.21.15.133:0/2851533508 shutdown_connections 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 --2- 172.21.15.133:0/2851533508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f738c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- 172.21.15.133:0/2851533508 >> 172.21.15.133:0/2851533508 conn(0x55cd41de9140 msgr2=0x55cd41f6e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- 172.21.15.133:0/2851533508 shutdown_connections 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- 172.21.15.133:0/2851533508 wait complete. 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 Processor -- start 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- start start 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f7a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd41d0b790 con 0x55cd41f734a0 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191b27640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f7a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191b27640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f7a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36332/0 (socket says 172.21.15.133:36332) 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191b27640 1 -- 172.21.15.133:0/2184915974 learned_addr learned my addr 172.21.15.133:0/2184915974 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191b27640 1 -- 172.21.15.133:0/2184915974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c00a0e0 con 0x55cd41f734a0 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191b27640 1 --2- 172.21.15.133:0/2184915974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f7a3b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x55cd41f74280 tx=0x7f418c003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4075ffb640 1 -- 172.21.15.133:0/2184915974 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c010a20 con 0x55cd41f734a0 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- 172.21.15.133:0/2184915974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd41f7a8f0 con 0x55cd41f734a0 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4075ffb640 1 -- 172.21.15.133:0/2184915974 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c010b80 con 0x55cd41f734a0 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4075ffb640 1 -- 172.21.15.133:0/2184915974 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f418c01a480 con 0x55cd41f734a0 2024-02-15T23:31:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- 172.21.15.133:0/2184915974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd41f7ad80 con 0x55cd41f734a0 2024-02-15T23:31:04.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:04.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:04.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4075ffb640 1 -- 172.21.15.133:0/2184915974 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f418c01a6f0 con 0x55cd41f734a0 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 Processor -- start 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4075ffb640 1 --2- 172.21.15.133:0/2184915974 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40680342b0 0x7f4068036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4075ffb640 1 -- 172.21.15.133:0/2184915974 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f418c049f90 con 0x55cd41f734a0 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- start start 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191b27640 1 --2- 172.21.15.133:0/2184915974 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40680342b0 0x7f4068036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41e73090 0x55cd41e734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f419380b980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd41e739f0 con 0x55cd41e73090 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191b27640 1 --2- 172.21.15.133:0/2184915974 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40680342b0 0x7f4068036770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f418c0184f0 tx=0x7f418c018400 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191326640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41e73090 0x55cd41e734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191326640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41e73090 0x55cd41e734b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36346/0 (socket says 172.21.15.133:36346) 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.375+0000 7f4191326640 1 -- 172.21.15.133:0/2120176214 learned_addr learned my addr 172.21.15.133:0/2120176214 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4191326640 1 -- 172.21.15.133:0/2120176214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd41e73b30 con 0x55cd41e73090 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4191326640 1 --2- 172.21.15.133:0/2120176214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41e73090 0x55cd41e734b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4184005670 tx=0x7f41840bcdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4055fe3640 1 -- 172.21.15.133:0/2120176214 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41840e9070 con 0x55cd41e73090 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f419380b980 1 -- 172.21.15.133:0/2120176214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd41e744c0 con 0x55cd41e73090 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4055fe3640 1 -- 172.21.15.133:0/2120176214 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840bbe20 con 0x55cd41e73090 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4055fe3640 1 -- 172.21.15.133:0/2120176214 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41840cfba0 con 0x55cd41e73090 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f419380b980 1 -- 172.21.15.133:0/2120176214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd41e74950 con 0x55cd41e73090 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4055fe3640 1 -- 172.21.15.133:0/2120176214 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f41840b1070 con 0x55cd41e73090 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4055fe3640 1 --2- 172.21.15.133:0/2120176214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3fd4034290 0x7f3fd4036750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4055fe3640 1 -- 172.21.15.133:0/2120176214 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f41840e7400 con 0x55cd41e73090 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4190b25640 1 --2- 172.21.15.133:0/2120176214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3fd4034290 0x7f3fd4036750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f3fcf7fe640 20 reqs_thread_entry: start 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f419380b980 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55cd41e75c10 0x55cd41e76090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41e76660 con 0x55cd41e75c10 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4190b25640 1 --2- 172.21.15.133:0/2120176214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3fd4034290 0x7f3fd4036750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55cd41f6f550 tx=0x7f4188001280 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4191b27640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55cd41e75c10 0x55cd41e76090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4191b27640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55cd41e75c10 0x55cd41e76090 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41e76ad0 con 0x55cd41e75c10 2024-02-15T23:31:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.379+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fa1530 con 0x55cd41e75c10 2024-02-15T23:31:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fa7340 con 0x55cd41e75c10 2024-02-15T23:31:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:NOTICE: set zone's realm_id= 2024-02-15T23:31:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f419380b980 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55cd41fa1890 0x55cd41fa6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191326640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55cd41fa1890 0x55cd41fa6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191326640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55cd41fa1890 0x55cd41fa6bd0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(5 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41840c2030 con 0x55cd41fa1890 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191326640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4184009040 0x7f41840ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f4184009040 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4190b25640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4184009040 0x7f41840ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4190b25640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4184009040 0x7f41840ed7e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418800e620 con 0x7f4184009040 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f4184009040 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418800e620 con 0x7f4184009040 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41e75c10 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(8 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41e75c10 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f418c00d830 0x7f418c0435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f418c00d830 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f418c00d830 0x7f418c0435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.383+0000 7f4191b27640 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f418c00d830 0x7f418c0435e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x7f418c00d830 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f418c00d830 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x7f418c00d830 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f4184009040 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418800e620 con 0x7f4184009040 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41840c2030 con 0x55cd41fa1890 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41e75c10 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(14 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f418c00d830 2024-02-15T23:31:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x7f418c00d830 2024-02-15T23:31:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41e75c10 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f4184009040 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(17 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f418800e620 con 0x7f4184009040 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f41840c2030 con 0x55cd41fa1890 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4184103040 con 0x55cd41fa1890 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f418c00d830 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x7f418c00d830 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.387+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4184103040 con 0x55cd41fa1890 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4184103040 con 0x55cd41fa1890 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41e75c10 2024-02-15T23:31:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41e75c10 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f418c00d830 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x7f418c00d830 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4184103040 con 0x55cd41fa1890 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f4184009040 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418800e620 con 0x7f4184009040 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41e75c10 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f4184009040 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418800e620 con 0x7f4184009040 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4184103040 con 0x55cd41fa1890 2024-02-15T23:31:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f418c00d830 2024-02-15T23:31:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x7f418c00d830 2024-02-15T23:31:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f4184009040 2024-02-15T23:31:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418800e620 con 0x7f4184009040 2024-02-15T23:31:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.391+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41fa1890 2024-02-15T23:31:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4184103040 con 0x55cd41fa1890 2024-02-15T23:31:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191326640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f418c00d830 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418c016020 con 0x7f418c00d830 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x55cd41e75c10 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(35 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fab370 con 0x7f4184009040 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4190b25640 1 -- 172.21.15.133:0/1820453669 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(36 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f418800e620 con 0x7f4184009040 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fa8940 con 0x55cd41e75c10 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fa4440 con 0x55cd41e75c10 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [create,call version.set in=58b,writefull 0~1037 in=1037b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fa6700 con 0x55cd41e75c10 2024-02-15T23:31:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [create,call,writefull 0~1037] v33'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.395+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fa6700 con 0x55cd41e75c10 2024-02-15T23:31:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v33'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cd41fa47a0 con 0x55cd41e75c10 2024-02-15T23:31:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v33'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7f418c016020 con 0x55cd41e75c10 2024-02-15T23:31:04.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2184915974 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40680342b0 msgr2=0x7f4068036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 --2- 172.21.15.133:0/2184915974 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40680342b0 0x7f4068036770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f418c0184f0 tx=0x7f418c018400 comp rx=0 tx=0).stop 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2184915974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 msgr2=0x55cd41f7a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 --2- 172.21.15.133:0/2184915974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f7a3b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x55cd41f74280 tx=0x7f418c003380 comp rx=0 tx=0).stop 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2184915974 shutdown_connections 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 --2- 172.21.15.133:0/2184915974 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40680342b0 0x7f4068036770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 --2- 172.21.15.133:0/2184915974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41f734a0 0x55cd41f7a3b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2184915974 >> 172.21.15.133:0/2184915974 conn(0x55cd41de9140 msgr2=0x55cd41f6e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2184915974 shutdown_connections 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2184915974 wait complete. 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2120176214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3fd4034290 msgr2=0x7f3fd4036750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 --2- 172.21.15.133:0/2120176214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3fd4034290 0x7f3fd4036750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55cd41f6f550 tx=0x7f4188001280 comp rx=0 tx=0).stop 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2120176214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41e73090 msgr2=0x55cd41e734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 --2- 172.21.15.133:0/2120176214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41e73090 0x55cd41e734b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4184005670 tx=0x7f41840bcdc0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2120176214 shutdown_connections 2024-02-15T23:31:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 --2- 172.21.15.133:0/2120176214 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f3fd4034290 0x7f3fd4036750 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 --2- 172.21.15.133:0/2120176214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41e73090 0x55cd41e734b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2120176214 >> 172.21.15.133:0/2120176214 conn(0x55cd41f88e60 msgr2=0x55cd41f89880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2120176214 shutdown_connections 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.399+0000 7f419380b980 1 -- 172.21.15.133:0/2120176214 wait complete. 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f418c00d830 msgr2=0x7f418c0435e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f418c00d830 0x7f418c0435e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55cd41e75c10 msgr2=0x55cd41e76090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55cd41e75c10 0x55cd41e76090 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4184009040 msgr2=0x7f41840ed7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4184009040 0x7f41840ed7e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55cd41fa1890 msgr2=0x55cd41fa6bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x55cd41fa1890 0x55cd41fa6bd0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 msgr2=0x7f4078036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f40780342b0 0x7f4078036770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4184005780 tx=0x7f4184005710 comp rx=0 tx=0).stop 2024-02-15T23:31:04.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 msgr2=0x55cd41f66410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 --2- 172.21.15.133:0/1820453669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cd41de7c30 0x55cd41f66410 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4184018eb0 tx=0x7f4184018020 comp rx=0 tx=0).stop 2024-02-15T23:31:04.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 reap_dead start 2024-02-15T23:31:04.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f4191b27640 1 -- 172.21.15.133:0/1820453669 reap_dead start 2024-02-15T23:31:04.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 shutdown_connections 2024-02-15T23:31:04.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 >> 172.21.15.133:0/1820453669 conn(0x55cd41e6ea30 msgr2=0x55cd41f59e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 shutdown_connections 2024-02-15T23:31:04.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.403+0000 7f419380b980 1 -- 172.21.15.133:0/1820453669 wait complete. 2024-02-15T23:31:04.417 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"cd69b486-4810-48ae-b5d4-5bce307169d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T23:31:04.418 DEBUG:tasks.util.rgw: json result: {'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T23:31:04.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-02-15T23:31:04.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-02-15T23:31:04.418 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-02-15T23:31:04.491 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:04.491 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:04.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb451bff980 1 Processor -- start 2024-02-15T23:31:04.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb451bff980 1 -- start start 2024-02-15T23:31:04.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb451bff980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55feae123670 0x55feae125a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb451bff980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55feae06b4b0 con 0x55feae11f160 2024-02-15T23:31:04.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb451bff980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55feae032180 con 0x55feae123670 2024-02-15T23:31:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44ef19640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55feae123670 0x55feae125a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44ef19640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55feae123670 0x55feae125a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36356/0 (socket says 172.21.15.133:36356) 2024-02-15T23:31:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44f71a640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55feae11f160 0x55feae11f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:32998/0 (socket says 172.21.15.133:32998) 2024-02-15T23:31:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44ef19640 1 -- 172.21.15.133:0/1346891033 learned_addr learned my addr 172.21.15.133:0/1346891033 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44ef19640 1 -- 172.21.15.133:0/1346891033 >> v1:172.21.15.131:6789/0 conn(0x55feae11f160 legacy=0x55feae11f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44ef19640 1 -- 172.21.15.133:0/1346891033 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55feae126fb0 con 0x55feae123670 2024-02-15T23:31:04.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44ef19640 1 --2- 172.21.15.133:0/1346891033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae123670 0x55feae125a60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb43800a5c0 tx=0x7fb43801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acda7942c336d337 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44e718640 1 -- 172.21.15.133:0/1346891033 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4380aa470 con 0x55feae123670 2024-02-15T23:31:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44e718640 1 -- 172.21.15.133:0/1346891033 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380aa5d0 con 0x55feae123670 2024-02-15T23:31:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.487+0000 7fb44e718640 1 -- 172.21.15.133:0/1346891033 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4380aa890 con 0x55feae123670 2024-02-15T23:31:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.491+0000 7fb451bff980 1 -- 172.21.15.133:0/1346891033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae123670 msgr2=0x55feae125a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.491+0000 7fb451bff980 1 --2- 172.21.15.133:0/1346891033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae123670 0x55feae125a60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb43800a5c0 tx=0x7fb43801b340 comp rx=0 tx=0).stop 2024-02-15T23:31:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.491+0000 7fb451bff980 1 -- 172.21.15.133:0/1346891033 shutdown_connections 2024-02-15T23:31:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.491+0000 7fb451bff980 1 --2- 172.21.15.133:0/1346891033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae123670 0x55feae125a60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.491+0000 7fb451bff980 1 -- 172.21.15.133:0/1346891033 >> 172.21.15.133:0/1346891033 conn(0x55feae11aa30 msgr2=0x55feae11ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.491+0000 7fb451bff980 1 -- 172.21.15.133:0/1346891033 shutdown_connections 2024-02-15T23:31:04.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.491+0000 7fb451bff980 1 -- 172.21.15.133:0/1346891033 wait complete. 2024-02-15T23:31:04.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb451bff980 1 Processor -- start 2024-02-15T23:31:04.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb451bff980 1 -- start start 2024-02-15T23:31:04.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb451bff980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae209180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb451bff980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feae02f6b0 con 0x55feae11f160 2024-02-15T23:31:04.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb44f71a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae209180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb44f71a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae209180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36364/0 (socket says 172.21.15.133:36364) 2024-02-15T23:31:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb44f71a640 1 -- 172.21.15.133:0/849357515 learned_addr learned my addr 172.21.15.133:0/849357515 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb44f71a640 1 -- 172.21.15.133:0/849357515 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438005df0 con 0x55feae11f160 2024-02-15T23:31:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb44f71a640 1 --2- 172.21.15.133:0/849357515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae209180 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb448006fb0 tx=0x7fb448001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2d01ffeb0af268 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb33d60a640 1 -- 172.21.15.133:0/849357515 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb448013420 con 0x55feae11f160 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb33d60a640 1 -- 172.21.15.133:0/849357515 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448013580 con 0x55feae11f160 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.503+0000 7fb33d60a640 1 -- 172.21.15.133:0/849357515 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb448013860 con 0x55feae11f160 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- 172.21.15.133:0/849357515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 msgr2=0x55feae209180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 --2- 172.21.15.133:0/849357515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae209180 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb448006fb0 tx=0x7fb448001940 comp rx=0 tx=0).stop 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- 172.21.15.133:0/849357515 shutdown_connections 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 --2- 172.21.15.133:0/849357515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae209180 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- 172.21.15.133:0/849357515 >> 172.21.15.133:0/849357515 conn(0x55feae11aa30 msgr2=0x55feae204c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- 172.21.15.133:0/849357515 shutdown_connections 2024-02-15T23:31:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- 172.21.15.133:0/849357515 wait complete. 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 Processor -- start 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- start start 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae210010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feae02ae90 con 0x55feae11f160 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb44f71a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae210010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb44f71a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae210010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36376/0 (socket says 172.21.15.133:36376) 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb44f71a640 1 -- 172.21.15.133:0/1006502456 learned_addr learned my addr 172.21.15.133:0/1006502456 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb44f71a640 1 -- 172.21.15.133:0/1006502456 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55feae06b4b0 con 0x55feae11f160 2024-02-15T23:31:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb44f71a640 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae210010 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55feae20a010 tx=0x7fb448000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb33be07640 1 -- 172.21.15.133:0/1006502456 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4480037a0 con 0x55feae11f160 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55feae210550 con 0x55feae11f160 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb33be07640 1 -- 172.21.15.133:0/1006502456 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448003900 con 0x55feae11f160 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55feae2109a0 con 0x55feae11f160 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb33be07640 1 -- 172.21.15.133:0/1006502456 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb448003ba0 con 0x55feae11f160 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 Processor -- start 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- start start 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae21dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb451bff980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feadfc3f20 con 0x55feae21d8c0 2024-02-15T23:31:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb44ff1b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae21dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb44ff1b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae21dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36392/0 (socket says 172.21.15.133:36392) 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.507+0000 7fb44ff1b640 1 -- 172.21.15.133:0/3163119044 learned_addr learned my addr 172.21.15.133:0/3163119044 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb33be07640 1 -- 172.21.15.133:0/1006502456 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb448003d00 con 0x55feae11f160 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb33be07640 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb334034300 0x7fb3340367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb33be07640 1 -- 172.21.15.133:0/1006502456 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb4480496d0 con 0x55feae11f160 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44ff1b640 1 -- 172.21.15.133:0/3163119044 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55feae21e220 con 0x55feae21d8c0 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44f71a640 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb334034300 0x7fb3340367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44ff1b640 1 --2- 172.21.15.133:0/3163119044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae21dce0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb44000a440 tx=0x7fb44000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27a178e115b3d4f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44f71a640 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb334034300 0x7fb3340367c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb448012fd0 tx=0x7fb448012f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb339e03640 1 -- 172.21.15.133:0/3163119044 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb440008850 con 0x55feae21d8c0 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb339e03640 1 -- 172.21.15.133:0/3163119044 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4400089d0 con 0x55feae21d8c0 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb339e03640 1 -- 172.21.15.133:0/3163119044 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb440008cb0 con 0x55feae21d8c0 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- 172.21.15.133:0/3163119044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 msgr2=0x55feae21dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 --2- 172.21.15.133:0/3163119044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae21dce0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb44000a440 tx=0x7fb44000a900 comp rx=0 tx=0).stop 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- 172.21.15.133:0/3163119044 shutdown_connections 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 --2- 172.21.15.133:0/3163119044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae21dce0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- 172.21.15.133:0/3163119044 >> 172.21.15.133:0/3163119044 conn(0x55feae2184e0 msgr2=0x55feae2193c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- 172.21.15.133:0/3163119044 shutdown_connections 2024-02-15T23:31:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- 172.21.15.133:0/3163119044 wait complete. 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 Processor -- start 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- start start 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae095050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feadfb7790 con 0x55feae21d8c0 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44ff1b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae095050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44ff1b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae095050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36400/0 (socket says 172.21.15.133:36400) 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44ff1b640 1 -- 172.21.15.133:0/2825232965 learned_addr learned my addr 172.21.15.133:0/2825232965 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44ff1b640 1 -- 172.21.15.133:0/2825232965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440005cd0 con 0x55feae21d8c0 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb44ff1b640 1 --2- 172.21.15.133:0/2825232965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae095050 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55feae21a010 tx=0x7fb440003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb32bfff640 1 -- 172.21.15.133:0/2825232965 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb440013aa0 con 0x55feae21d8c0 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- 172.21.15.133:0/2825232965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55feae095590 con 0x55feae21d8c0 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb32bfff640 1 -- 172.21.15.133:0/2825232965 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb440013c00 con 0x55feae21d8c0 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb451bff980 1 -- 172.21.15.133:0/2825232965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55feae0939b0 con 0x55feae21d8c0 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.511+0000 7fb32bfff640 1 -- 172.21.15.133:0/2825232965 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb440013ea0 con 0x55feae21d8c0 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb32bfff640 1 -- 172.21.15.133:0/2825232965 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb440028460 con 0x55feae21d8c0 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb451bff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb451bff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb32bfff640 1 --2- 172.21.15.133:0/2825232965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb3300342b0 0x7fb330036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb32bfff640 1 -- 172.21.15.133:0/2825232965 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb4400499a0 con 0x55feae21d8c0 2024-02-15T23:31:04.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb44ef19640 1 --2- 172.21.15.133:0/2825232965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb3300342b0 0x7fb330036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb451bff980 1 Processor -- start 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb451bff980 1 -- start start 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb451bff980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae240270 0x55feae240670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb451bff980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feae240bb0 con 0x55feae240270 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb44ef19640 1 --2- 172.21.15.133:0/2825232965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb3300342b0 0x7fb330036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4380ae000 tx=0x7fb4380a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb44f71a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae240270 0x55feae240670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb44f71a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae240270 0x55feae240670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36402/0 (socket says 172.21.15.133:36402) 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb44f71a640 1 -- 172.21.15.133:0/3233287423 learned_addr learned my addr 172.21.15.133:0/3233287423 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb44f71a640 1 -- 172.21.15.133:0/3233287423 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55feae240cf0 con 0x55feae240270 2024-02-15T23:31:04.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb44f71a640 1 --2- 172.21.15.133:0/3233287423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae240270 0x55feae240670 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb448027990 tx=0x7fb4480479b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb2c7fff640 1 -- 172.21.15.133:0/3233287423 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb448011de0 con 0x55feae240270 2024-02-15T23:31:04.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb451bff980 1 -- 172.21.15.133:0/3233287423 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55feae241670 con 0x55feae240270 2024-02-15T23:31:04.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb2c7fff640 1 -- 172.21.15.133:0/3233287423 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448011780 con 0x55feae240270 2024-02-15T23:31:04.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb2c7fff640 1 -- 172.21.15.133:0/3233287423 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb448023220 con 0x55feae240270 2024-02-15T23:31:04.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb451bff980 1 -- 172.21.15.133:0/3233287423 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55feae241b00 con 0x55feae240270 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb2c7fff640 1 -- 172.21.15.133:0/3233287423 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb44803c070 con 0x55feae240270 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb2c7fff640 1 --2- 172.21.15.133:0/3233287423 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb2900342b0 0x7fb290036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.515+0000 7fb2c7fff640 1 -- 172.21.15.133:0/3233287423 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb44804da80 con 0x55feae240270 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb44ef19640 1 --2- 172.21.15.133:0/3233287423 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb2900342b0 0x7fb290036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb2c5ffb640 20 reqs_thread_entry: start 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55feae244db0 0x55feae2471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55feae2476e0 con 0x55feae244db0 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb44ef19640 1 --2- 172.21.15.133:0/3233287423 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb2900342b0 0x7fb290036770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb438018f70 tx=0x7fb438005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb44ff1b640 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55feae244db0 0x55feae2471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb44ff1b640 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55feae244db0 0x55feae2471a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb44ff1b640 1 -- 172.21.15.133:0/1006502456 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb440024020 con 0x55feae244db0 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55feae247b20 con 0x55feae244db0 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb44ff1b640 1 -- 172.21.15.133:0/1006502456 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb440024020 con 0x55feae244db0 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55feae2493d0 con 0x55feae244db0 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb44ff1b640 1 -- 172.21.15.133:0/1006502456 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~1037 out=1037b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7fb440024020 con 0x55feae244db0 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/2825232965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb3300342b0 msgr2=0x7fb330036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/2825232965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb3300342b0 0x7fb330036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4380ae000 tx=0x7fb4380a6000 comp rx=0 tx=0).stop 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/2825232965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 msgr2=0x55feae095050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/2825232965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae095050 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55feae21a010 tx=0x7fb440003000 comp rx=0 tx=0).stop 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/2825232965 shutdown_connections 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/2825232965 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb3300342b0 0x7fb330036770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/2825232965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae21d8c0 0x55feae095050 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/2825232965 >> 172.21.15.133:0/2825232965 conn(0x55feae2184e0 msgr2=0x55feae2193c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/2825232965 shutdown_connections 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/2825232965 wait complete. 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/3233287423 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb2900342b0 msgr2=0x7fb290036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/3233287423 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb2900342b0 0x7fb290036770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb438018f70 tx=0x7fb438005ad0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/3233287423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae240270 msgr2=0x55feae240670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/3233287423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae240270 0x55feae240670 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb448027990 tx=0x7fb4480479b0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/3233287423 shutdown_connections 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/3233287423 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb2900342b0 0x7fb290036770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/3233287423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae240270 0x55feae240670 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/3233287423 >> 172.21.15.133:0/3233287423 conn(0x55feae234ff0 msgr2=0x55feae235a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/3233287423 shutdown_connections 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/3233287423 wait complete. 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55feae244db0 msgr2=0x55feae2471a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55feae244db0 0x55feae2471a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb334034300 msgr2=0x7fb3340367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb334034300 0x7fb3340367c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb448012fd0 tx=0x7fb448012f20 comp rx=0 tx=0).stop 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 msgr2=0x55feae210010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae210010 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55feae20a010 tx=0x7fb448000f50 comp rx=0 tx=0).stop 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 shutdown_connections 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55feae244db0 0x55feae2471a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb334034300 0x7fb3340367c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 --2- 172.21.15.133:0/1006502456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55feae11f160 0x55feae210010 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 >> 172.21.15.133:0/1006502456 conn(0x55feae11aa30 msgr2=0x55feae203780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 shutdown_connections 2024-02-15T23:31:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.519+0000 7fb451bff980 1 -- 172.21.15.133:0/1006502456 wait complete. 2024-02-15T23:31:04.540 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"cd69b486-4810-48ae-b5d4-5bce307169d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T23:31:04.540 DEBUG:tasks.util.rgw: json result: {'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T23:31:04.540 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-15T23:31:04.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-15T23:31:04.541 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-15T23:31:04.619 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:04.619 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:04.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f453750d980 1 Processor -- start 2024-02-15T23:31:04.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f453750d980 1 -- start start 2024-02-15T23:31:04.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f453750d980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55bc15806870 0x55bc15806c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f453750d980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bc1574f460 con 0x55bc15805390 2024-02-15T23:31:04.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f453750d980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bc15716180 con 0x55bc15806870 2024-02-15T23:31:04.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f4535028640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55bc15806870 0x55bc15806c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f4534827640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55bc15805390 0x55bc158057a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:33006/0 (socket says 172.21.15.133:33006) 2024-02-15T23:31:04.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f4534827640 1 -- 172.21.15.133:0/1007919045 learned_addr learned my addr 172.21.15.133:0/1007919045 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:31:04.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f4535028640 1 -- 172.21.15.133:0/1007919045 >> v1:172.21.15.131:6789/0 conn(0x55bc15805390 legacy=0x55bc158057a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.615+0000 7f4535028640 1 -- 172.21.15.133:0/1007919045 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc158073a0 con 0x55bc15806870 2024-02-15T23:31:04.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f4535028640 1 --2- 172.21.15.133:0/1007919045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc15806c50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f452800a480 tx=0x7f452801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218c41edf8483cdc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f4527fff640 1 -- 172.21.15.133:0/1007919045 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45280ab540 con 0x55bc15806870 2024-02-15T23:31:04.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f4527fff640 1 -- 172.21.15.133:0/1007919045 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45280ab6a0 con 0x55bc15806870 2024-02-15T23:31:04.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f4527fff640 1 -- 172.21.15.133:0/1007919045 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45280ab960 con 0x55bc15806870 2024-02-15T23:31:04.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f453750d980 1 -- 172.21.15.133:0/1007919045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 msgr2=0x55bc15806c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f453750d980 1 --2- 172.21.15.133:0/1007919045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc15806c50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f452800a480 tx=0x7f452801b280 comp rx=0 tx=0).stop 2024-02-15T23:31:04.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f453750d980 1 -- 172.21.15.133:0/1007919045 shutdown_connections 2024-02-15T23:31:04.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f453750d980 1 --2- 172.21.15.133:0/1007919045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc15806c50 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f453750d980 1 -- 172.21.15.133:0/1007919045 >> 172.21.15.133:0/1007919045 conn(0x55bc15778aa0 msgr2=0x55bc15778eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f453750d980 1 -- 172.21.15.133:0/1007919045 shutdown_connections 2024-02-15T23:31:04.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.619+0000 7f453750d980 1 -- 172.21.15.133:0/1007919045 wait complete. 2024-02-15T23:31:04.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.631+0000 7f453750d980 1 Processor -- start 2024-02-15T23:31:04.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.631+0000 7f453750d980 1 -- start start 2024-02-15T23:31:04.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.631+0000 7f453750d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15805390 0x55bc158ef870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.631+0000 7f453750d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc157136b0 con 0x55bc15805390 2024-02-15T23:31:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.631+0000 7f4535028640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15805390 0x55bc158ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.631+0000 7f4535028640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15805390 0x55bc158ef870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36420/0 (socket says 172.21.15.133:36420) 2024-02-15T23:31:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.631+0000 7f4535028640 1 -- 172.21.15.133:0/3032404306 learned_addr learned my addr 172.21.15.133:0/3032404306 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4535028640 1 -- 172.21.15.133:0/3032404306 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528005d30 con 0x55bc15805390 2024-02-15T23:31:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4535028640 1 --2- 172.21.15.133:0/3032404306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15805390 0x55bc158ef870 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f45280ae040 tx=0x7f4528003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea815a83fac91d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4423606640 1 -- 172.21.15.133:0/3032404306 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45280ab810 con 0x55bc15805390 2024-02-15T23:31:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4423606640 1 -- 172.21.15.133:0/3032404306 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45280ab970 con 0x55bc15805390 2024-02-15T23:31:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4423606640 1 -- 172.21.15.133:0/3032404306 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45280abc10 con 0x55bc15805390 2024-02-15T23:31:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- 172.21.15.133:0/3032404306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15805390 msgr2=0x55bc158ef870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 --2- 172.21.15.133:0/3032404306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15805390 0x55bc158ef870 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f45280ae040 tx=0x7f4528003030 comp rx=0 tx=0).stop 2024-02-15T23:31:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- 172.21.15.133:0/3032404306 shutdown_connections 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 --2- 172.21.15.133:0/3032404306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15805390 0x55bc158ef870 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- 172.21.15.133:0/3032404306 >> 172.21.15.133:0/3032404306 conn(0x55bc15778aa0 msgr2=0x55bc158eb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- 172.21.15.133:0/3032404306 shutdown_connections 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- 172.21.15.133:0/3032404306 wait complete. 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 Processor -- start 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- start start 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc158f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1570ee90 con 0x55bc15806870 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4535028640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc158f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4535028640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc158f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36436/0 (socket says 172.21.15.133:36436) 2024-02-15T23:31:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4535028640 1 -- 172.21.15.133:0/2351528056 learned_addr learned my addr 172.21.15.133:0/2351528056 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4535028640 1 -- 172.21.15.133:0/2351528056 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc158073a0 con 0x55bc15806870 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4535028640 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc158f67e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f452801bb20 tx=0x7f4528019ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4421e03640 1 -- 172.21.15.133:0/2351528056 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45280b6a10 con 0x55bc15806870 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc158f6d20 con 0x55bc15806870 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4421e03640 1 -- 172.21.15.133:0/2351528056 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45280b6b70 con 0x55bc15806870 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc158f71b0 con 0x55bc15806870 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.635+0000 7f4421e03640 1 -- 172.21.15.133:0/2351528056 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45280b6e10 con 0x55bc15806870 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 Processor -- start 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- start start 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc159043f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc156a7f20 con 0x55bc15903fd0 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4421e03640 1 -- 172.21.15.133:0/2351528056 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f45280b2070 con 0x55bc15806870 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc159043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc159043f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36452/0 (socket says 172.21.15.133:36452) 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535829640 1 -- 172.21.15.133:0/4017744778 learned_addr learned my addr 172.21.15.133:0/4017744778 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4421e03640 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f441c0342b0 0x7f441c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4421e03640 1 -- 172.21.15.133:0/2351528056 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f45280e3700 con 0x55bc15806870 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535028640 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f441c0342b0 0x7f441c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535829640 1 -- 172.21.15.133:0/4017744778 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc15904930 con 0x55bc15903fd0 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535028640 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f441c0342b0 0x7f441c036770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45280ae040 tx=0x7f45280cdf50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535829640 1 --2- 172.21.15.133:0/4017744778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc159043f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f453000a430 tx=0x7f453000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f75ed28f09d7c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f441b7fe640 1 -- 172.21.15.133:0/4017744778 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f453000f6e0 con 0x55bc15903fd0 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f441b7fe640 1 -- 172.21.15.133:0/4017744778 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453000f860 con 0x55bc15903fd0 2024-02-15T23:31:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f441b7fe640 1 -- 172.21.15.133:0/4017744778 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f453000fb40 con 0x55bc15903fd0 2024-02-15T23:31:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- 172.21.15.133:0/4017744778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 msgr2=0x55bc159043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 --2- 172.21.15.133:0/4017744778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc159043f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f453000a430 tx=0x7f453000a8f0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- 172.21.15.133:0/4017744778 shutdown_connections 2024-02-15T23:31:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 --2- 172.21.15.133:0/4017744778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc159043f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- 172.21.15.133:0/4017744778 >> 172.21.15.133:0/4017744778 conn(0x55bc158febf0 msgr2=0x55bc158ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- 172.21.15.133:0/4017744778 shutdown_connections 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- 172.21.15.133:0/4017744778 wait complete. 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 Processor -- start 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- start start 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc1590ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f453750d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1569b790 con 0x55bc15903fd0 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc1590ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc1590ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36458/0 (socket says 172.21.15.133:36458) 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.639+0000 7f4535829640 1 -- 172.21.15.133:0/3126051061 learned_addr learned my addr 172.21.15.133:0/3126051061 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535829640 1 -- 172.21.15.133:0/3126051061 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453000a0e0 con 0x55bc15903fd0 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535829640 1 --2- 172.21.15.133:0/3126051061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc1590ab70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x55bc15900720 tx=0x7f4530003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4419ffb640 1 -- 172.21.15.133:0/3126051061 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4530010a20 con 0x55bc15903fd0 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 1 -- 172.21.15.133:0/3126051061 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc1590b0b0 con 0x55bc15903fd0 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4419ffb640 1 -- 172.21.15.133:0/3126051061 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530010b80 con 0x55bc15903fd0 2024-02-15T23:31:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 1 -- 172.21.15.133:0/3126051061 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc1590b540 con 0x55bc15903fd0 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4419ffb640 1 -- 172.21.15.133:0/3126051061 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4530010ea0 con 0x55bc15903fd0 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4419ffb640 1 -- 172.21.15.133:0/3126051061 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f453001a480 con 0x55bc15903fd0 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 1 Processor -- start 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4419ffb640 1 --2- 172.21.15.133:0/3126051061 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f440c0342b0 0x7f440c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4419ffb640 1 -- 172.21.15.133:0/3126051061 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4530049ec0 con 0x55bc15903fd0 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 1 -- start start 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535829640 1 --2- 172.21.15.133:0/3126051061 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f440c0342b0 0x7f440c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15924880 0x55bc15924ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc159251e0 con 0x55bc15924880 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535829640 1 --2- 172.21.15.133:0/3126051061 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f440c0342b0 0x7f440c036770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f453001bfd0 tx=0x7f4530024f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535028640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15924880 0x55bc15924ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535028640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15924880 0x55bc15924ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36472/0 (socket says 172.21.15.133:36472) 2024-02-15T23:31:04.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535028640 1 -- 172.21.15.133:0/3412302668 learned_addr learned my addr 172.21.15.133:0/3412302668 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535028640 1 -- 172.21.15.133:0/3412302668 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc15925320 con 0x55bc15924880 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f4535028640 1 --2- 172.21.15.133:0/3412302668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15924880 0x55bc15924ca0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4528003050 tx=0x7f45280cde20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f43f9fe3640 1 -- 172.21.15.133:0/3412302668 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45280c2260 con 0x55bc15924880 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f43f9fe3640 1 -- 172.21.15.133:0/3412302668 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45280c4e10 con 0x55bc15924880 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 1 -- 172.21.15.133:0/3412302668 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc15925ca0 con 0x55bc15924880 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f43f9fe3640 1 -- 172.21.15.133:0/3412302668 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45280cd830 con 0x55bc15924880 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.643+0000 7f453750d980 1 -- 172.21.15.133:0/3412302668 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc15926130 con 0x55bc15924880 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f43f9fe3640 1 -- 172.21.15.133:0/3412302668 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f45280c2630 con 0x55bc15924880 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f43f9fe3640 1 --2- 172.21.15.133:0/3412302668 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4378034300 0x7f43780367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f43f9fe3640 1 -- 172.21.15.133:0/3412302668 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f45280eed60 con 0x55bc15924880 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f4534827640 1 --2- 172.21.15.133:0/3412302668 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4378034300 0x7f43780367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f43737fe640 20 reqs_thread_entry: start 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f453750d980 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55bc15929880 0x55bc1592bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f4534827640 1 --2- 172.21.15.133:0/3412302668 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4378034300 0x7f43780367c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f452c000f70 tx=0x7f452c001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bc1592c1b0 con 0x55bc15929880 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f4535829640 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55bc15929880 0x55bc1592bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f4535829640 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55bc15929880 0x55bc1592bc70 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f4535829640 1 -- 172.21.15.133:0/2351528056 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4530016020 con 0x55bc15929880 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bc1592d5a0 con 0x55bc15929880 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f4535829640 1 -- 172.21.15.133:0/2351528056 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~1037 out=1037b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7f4530016020 con 0x55bc15929880 2024-02-15T23:31:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.647+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bc159320d0 con 0x55bc15929880 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f4535829640 1 -- 172.21.15.133:0/2351528056 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [stat,call,call,writefull 0~875] v33'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f4530016020 con 0x55bc15929880 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3126051061 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f440c0342b0 msgr2=0x7f440c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/3126051061 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f440c0342b0 0x7f440c036770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f453001bfd0 tx=0x7f4530024f20 comp rx=0 tx=0).stop 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3126051061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 msgr2=0x55bc1590ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/3126051061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc1590ab70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x55bc15900720 tx=0x7f4530003380 comp rx=0 tx=0).stop 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3126051061 shutdown_connections 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/3126051061 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f440c0342b0 0x7f440c036770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/3126051061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15903fd0 0x55bc1590ab70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3126051061 >> 172.21.15.133:0/3126051061 conn(0x55bc158febf0 msgr2=0x55bc158ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3126051061 shutdown_connections 2024-02-15T23:31:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3126051061 wait complete. 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3412302668 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4378034300 msgr2=0x7f43780367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/3412302668 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4378034300 0x7f43780367c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f452c000f70 tx=0x7f452c001240 comp rx=0 tx=0).stop 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3412302668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15924880 msgr2=0x55bc15924ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/3412302668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15924880 0x55bc15924ca0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4528003050 tx=0x7f45280cde20 comp rx=0 tx=0).stop 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3412302668 shutdown_connections 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/3412302668 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4378034300 0x7f43780367c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/3412302668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15924880 0x55bc15924ca0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3412302668 >> 172.21.15.133:0/3412302668 conn(0x55bc159195a0 msgr2=0x55bc15919fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3412302668 shutdown_connections 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/3412302668 wait complete. 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55bc15929880 msgr2=0x55bc1592bc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55bc15929880 0x55bc1592bc70 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f441c0342b0 msgr2=0x7f441c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f441c0342b0 0x7f441c036770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45280ae040 tx=0x7f45280cdf50 comp rx=0 tx=0).stop 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 msgr2=0x55bc158f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc158f67e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f452801bb20 tx=0x7f4528019ac0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 shutdown_connections 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55bc15929880 0x55bc1592bc70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f441c0342b0 0x7f441c036770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 --2- 172.21.15.133:0/2351528056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc15806870 0x55bc158f67e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 >> 172.21.15.133:0/2351528056 conn(0x55bc15778aa0 msgr2=0x55bc158e9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 shutdown_connections 2024-02-15T23:31:04.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.651+0000 7f453750d980 1 -- 172.21.15.133:0/2351528056 wait complete. 2024-02-15T23:31:04.667 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"cd69b486-4810-48ae-b5d4-5bce307169d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T23:31:04.667 DEBUG:tasks.util.rgw: json result: {'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T23:31:04.667 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-02-15T23:31:04.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-02-15T23:31:04.667 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-02-15T23:31:04.733 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:04.733 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:04.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34476c9980 1 Processor -- start 2024-02-15T23:31:04.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34476c9980 1 -- start start 2024-02-15T23:31:04.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34476c9980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5604671ab340 0x5604671ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34476c9980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5604670f54b0 con 0x5604671abc60 2024-02-15T23:31:04.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34476c9980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x5604670bc180 con 0x5604671ab340 2024-02-15T23:31:04.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34451e4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5604671ab340 0x5604671ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34451e4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x5604671ab340 0x5604671ab720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36484/0 (socket says 172.21.15.133:36484) 2024-02-15T23:31:04.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34451e4640 1 -- 172.21.15.133:0/523542935 learned_addr learned my addr 172.21.15.133:0/523542935 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34451e4640 1 -- 172.21.15.133:0/523542935 >> v1:172.21.15.131:6789/0 conn(0x5604671abc60 legacy=0x5604671ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.727+0000 7f34451e4640 1 -- 172.21.15.133:0/523542935 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604671ace40 con 0x5604671ab340 2024-02-15T23:31:04.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f34451e4640 1 --2- 172.21.15.133:0/523542935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604671ab720 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f343000a5c0 tx=0x7f343001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7223c9f14ee3fb6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f343ffff640 1 -- 172.21.15.133:0/523542935 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300aa470 con 0x5604671ab340 2024-02-15T23:31:04.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f343ffff640 1 -- 172.21.15.133:0/523542935 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34300aa5d0 con 0x5604671ab340 2024-02-15T23:31:04.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f343ffff640 1 -- 172.21.15.133:0/523542935 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300aa890 con 0x5604671ab340 2024-02-15T23:31:04.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f34476c9980 1 -- 172.21.15.133:0/523542935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 msgr2=0x5604671ab720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f34476c9980 1 --2- 172.21.15.133:0/523542935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604671ab720 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f343000a5c0 tx=0x7f343001b340 comp rx=0 tx=0).stop 2024-02-15T23:31:04.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f34476c9980 1 -- 172.21.15.133:0/523542935 shutdown_connections 2024-02-15T23:31:04.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f34476c9980 1 --2- 172.21.15.133:0/523542935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604671ab720 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f34476c9980 1 -- 172.21.15.133:0/523542935 >> 172.21.15.133:0/523542935 conn(0x56046711ea30 msgr2=0x56046711ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f34476c9980 1 -- 172.21.15.133:0/523542935 shutdown_connections 2024-02-15T23:31:04.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.731+0000 7f34476c9980 1 -- 172.21.15.133:0/523542935 wait complete. 2024-02-15T23:31:04.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.743+0000 7f34476c9980 1 Processor -- start 2024-02-15T23:31:04.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.743+0000 7f34476c9980 1 -- start start 2024-02-15T23:31:04.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.743+0000 7f34476c9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604672957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.743+0000 7f34476c9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604670b96b0 con 0x5604671ab340 2024-02-15T23:31:04.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604672957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604672957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36488/0 (socket says 172.21.15.133:36488) 2024-02-15T23:31:04.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 -- 172.21.15.133:0/1758652754 learned_addr learned my addr 172.21.15.133:0/1758652754 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 -- 172.21.15.133:0/1758652754 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430005df0 con 0x5604671ab340 2024-02-15T23:31:04.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 --2- 172.21.15.133:0/1758652754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604672957e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3430018f70 tx=0x7f3430003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d52f561edc082c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f3333606640 1 -- 172.21.15.133:0/1758652754 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300aa9c0 con 0x5604671ab340 2024-02-15T23:31:04.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f3333606640 1 -- 172.21.15.133:0/1758652754 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34300aab20 con 0x5604671ab340 2024-02-15T23:31:04.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f3333606640 1 -- 172.21.15.133:0/1758652754 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300aadc0 con 0x5604671ab340 2024-02-15T23:31:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 -- 172.21.15.133:0/1758652754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 msgr2=0x5604672957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 --2- 172.21.15.133:0/1758652754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604672957e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3430018f70 tx=0x7f3430003030 comp rx=0 tx=0).stop 2024-02-15T23:31:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 -- 172.21.15.133:0/1758652754 shutdown_connections 2024-02-15T23:31:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 --2- 172.21.15.133:0/1758652754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x5604672957e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 -- 172.21.15.133:0/1758652754 >> 172.21.15.133:0/1758652754 conn(0x56046711ea30 msgr2=0x560467291370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 -- 172.21.15.133:0/1758652754 shutdown_connections 2024-02-15T23:31:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 -- 172.21.15.133:0/1758652754 wait complete. 2024-02-15T23:31:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 Processor -- start 2024-02-15T23:31:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 -- start start 2024-02-15T23:31:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x56046729c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34476c9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604670b4e90 con 0x5604671ab340 2024-02-15T23:31:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x56046729c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x56046729c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36504/0 (socket says 172.21.15.133:36504) 2024-02-15T23:31:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 -- 172.21.15.133:0/3325456912 learned_addr learned my addr 172.21.15.133:0/3325456912 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 -- 172.21.15.133:0/3325456912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604671ace40 con 0x5604671ab340 2024-02-15T23:31:04.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.747+0000 7f34451e4640 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x56046729c4c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3430018f70 tx=0x7f34300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f3331e03640 1 -- 172.21.15.133:0/3325456912 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300cb070 con 0x5604671ab340 2024-02-15T23:31:04.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56046729ca00 con 0x5604671ab340 2024-02-15T23:31:04.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f3331e03640 1 -- 172.21.15.133:0/3325456912 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34300c6690 con 0x5604671ab340 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f3331e03640 1 -- 172.21.15.133:0/3325456912 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300c6930 con 0x5604671ab340 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56046729ce30 con 0x5604671ab340 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 Processor -- start 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- start start 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046704df20 con 0x5604672a94c0 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34459e5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34459e5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36510/0 (socket says 172.21.15.133:36510) 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34459e5640 1 -- 172.21.15.133:0/843140053 learned_addr learned my addr 172.21.15.133:0/843140053 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f3331e03640 1 -- 172.21.15.133:0/3325456912 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f34300c6a90 con 0x5604671ab340 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f3331e03640 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f332c0342b0 0x7f332c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f3331e03640 1 -- 172.21.15.133:0/3325456912 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f34300e4b00 con 0x5604671ab340 2024-02-15T23:31:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34451e4640 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f332c0342b0 0x7f332c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34459e5640 1 -- 172.21.15.133:0/843140053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604672a9e20 con 0x5604672a94c0 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34459e5640 1 --2- 172.21.15.133:0/843140053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672a98e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f344000a430 tx=0x7f344000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8944dac3ea18a7b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34451e4640 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f332c0342b0 0x7f332c036770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f34300bfff0 tx=0x7f34300c5ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f332b7fe640 1 -- 172.21.15.133:0/843140053 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f344000f6e0 con 0x5604672a94c0 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f332b7fe640 1 -- 172.21.15.133:0/843140053 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344000f860 con 0x5604672a94c0 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f332b7fe640 1 -- 172.21.15.133:0/843140053 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f344000fb40 con 0x5604672a94c0 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- 172.21.15.133:0/843140053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 msgr2=0x5604672a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 --2- 172.21.15.133:0/843140053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672a98e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f344000a430 tx=0x7f344000a8f0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- 172.21.15.133:0/843140053 shutdown_connections 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 --2- 172.21.15.133:0/843140053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672a98e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- 172.21.15.133:0/843140053 >> 172.21.15.133:0/843140053 conn(0x5604671abc60 msgr2=0x5604672a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- 172.21.15.133:0/843140053 shutdown_connections 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- 172.21.15.133:0/843140053 wait complete. 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 Processor -- start 2024-02-15T23:31:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- start start 2024-02-15T23:31:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34476c9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560467041790 con 0x5604672a94c0 2024-02-15T23:31:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34459e5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34459e5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36514/0 (socket says 172.21.15.133:36514) 2024-02-15T23:31:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.751+0000 7f34459e5640 1 -- 172.21.15.133:0/4013583511 learned_addr learned my addr 172.21.15.133:0/4013583511 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34459e5640 1 -- 172.21.15.133:0/4013583511 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344000a0e0 con 0x5604672a94c0 2024-02-15T23:31:04.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34459e5640 1 --2- 172.21.15.133:0/4013583511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672b0410 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5604672aa2a0 tx=0x7f3440003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f3329ffb640 1 -- 172.21.15.133:0/4013583511 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3440010a20 con 0x5604672a94c0 2024-02-15T23:31:04.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34476c9980 1 -- 172.21.15.133:0/4013583511 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5604672b0950 con 0x5604672a94c0 2024-02-15T23:31:04.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34476c9980 1 -- 172.21.15.133:0/4013583511 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604672b0de0 con 0x5604672a94c0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f3329ffb640 1 -- 172.21.15.133:0/4013583511 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440010b80 con 0x5604672a94c0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f3329ffb640 1 -- 172.21.15.133:0/4013583511 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3440010ea0 con 0x5604672a94c0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34476c9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34476c9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f3329ffb640 1 -- 172.21.15.133:0/4013583511 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f344001a480 con 0x5604672a94c0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f3329ffb640 1 --2- 172.21.15.133:0/4013583511 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f331c0342b0 0x7f331c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34476c9980 1 Processor -- start 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f3329ffb640 1 -- 172.21.15.133:0/4013583511 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3440049d80 con 0x5604672a94c0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34459e5640 1 --2- 172.21.15.133:0/4013583511 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f331c0342b0 0x7f331c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34476c9980 1 -- start start 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34476c9980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672ca1a0 0x5604672ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34476c9980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604672cab00 con 0x5604672ca1a0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34459e5640 1 --2- 172.21.15.133:0/4013583511 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f331c0342b0 0x7f331c036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f344000cfd0 tx=0x7f344002e7b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34451e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672ca1a0 0x5604672ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34451e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672ca1a0 0x5604672ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36518/0 (socket says 172.21.15.133:36518) 2024-02-15T23:31:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34451e4640 1 -- 172.21.15.133:0/1399617868 learned_addr learned my addr 172.21.15.133:0/1399617868 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.755+0000 7f34451e4640 1 -- 172.21.15.133:0/1399617868 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604672cac40 con 0x5604672ca1a0 2024-02-15T23:31:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34451e4640 1 --2- 172.21.15.133:0/1399617868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672ca1a0 0x5604672ca5c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c10 tx=0x7f34300cf4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f3309fe3640 1 -- 172.21.15.133:0/1399617868 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300e9070 con 0x5604672ca1a0 2024-02-15T23:31:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34476c9980 1 -- 172.21.15.133:0/1399617868 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5604672cb590 con 0x5604672ca1a0 2024-02-15T23:31:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f3309fe3640 1 -- 172.21.15.133:0/1399617868 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34300c77a0 con 0x5604672ca1a0 2024-02-15T23:31:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f3309fe3640 1 -- 172.21.15.133:0/1399617868 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300c73f0 con 0x5604672ca1a0 2024-02-15T23:31:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34476c9980 1 -- 172.21.15.133:0/1399617868 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604672cba20 con 0x5604672ca1a0 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f3309fe3640 1 -- 172.21.15.133:0/1399617868 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f34300cf9c0 con 0x5604672ca1a0 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f3309fe3640 1 --2- 172.21.15.133:0/1399617868 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f32880342b0 0x7f3288036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f3309fe3640 1 -- 172.21.15.133:0/1399617868 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f34300f9d60 con 0x5604672ca1a0 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34449e3640 1 --2- 172.21.15.133:0/1399617868 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f32880342b0 0x7f3288036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f32837fe640 20 reqs_thread_entry: start 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34476c9980 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5604672a0370 0x5604672d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34449e3640 1 --2- 172.21.15.133:0/1399617868 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f32880342b0 0x7f3288036770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3438000f70 tx=0x7f34380013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5604672d1700 con 0x5604672a0370 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34459e5640 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5604672a0370 0x5604672d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34459e5640 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5604672a0370 0x5604672d1180 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34459e5640 1 -- 172.21.15.133:0/3325456912 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3440016020 con 0x5604672a0370 2024-02-15T23:31:04.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5604672d1f00 con 0x5604672a0370 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34459e5640 1 -- 172.21.15.133:0/3325456912 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3440016020 con 0x5604672a0370 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5604672d3270 con 0x5604672a0370 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.759+0000 7f34459e5640 1 -- 172.21.15.133:0/3325456912 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3440016020 con 0x5604672a0370 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/4013583511 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f331c0342b0 msgr2=0x7f331c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/4013583511 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f331c0342b0 0x7f331c036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f344000cfd0 tx=0x7f344002e7b0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/4013583511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 msgr2=0x5604672b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/4013583511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672b0410 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5604672aa2a0 tx=0x7f3440003380 comp rx=0 tx=0).stop 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/4013583511 shutdown_connections 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/4013583511 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f331c0342b0 0x7f331c036770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/4013583511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672a94c0 0x5604672b0410 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/4013583511 >> 172.21.15.133:0/4013583511 conn(0x5604671abc60 msgr2=0x5604672a3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/4013583511 shutdown_connections 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/4013583511 wait complete. 2024-02-15T23:31:04.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/1399617868 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f32880342b0 msgr2=0x7f3288036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/1399617868 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f32880342b0 0x7f3288036770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3438000f70 tx=0x7f34380013a0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/1399617868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672ca1a0 msgr2=0x5604672ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/1399617868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672ca1a0 0x5604672ca5c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c10 tx=0x7f34300cf4f0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/1399617868 shutdown_connections 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/1399617868 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f32880342b0 0x7f3288036770 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/1399617868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604672ca1a0 0x5604672ca5c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/1399617868 >> 172.21.15.133:0/1399617868 conn(0x5604672beec0 msgr2=0x5604672bf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/1399617868 shutdown_connections 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/1399617868 wait complete. 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5604672a0370 msgr2=0x5604672d1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5604672a0370 0x5604672d1180 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f332c0342b0 msgr2=0x7f332c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f332c0342b0 0x7f332c036770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f34300bfff0 tx=0x7f34300c5ee0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 msgr2=0x56046729c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x56046729c4c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3430018f70 tx=0x7f34300180e0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 shutdown_connections 2024-02-15T23:31:04.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x5604672a0370 0x5604672d1180 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f332c0342b0 0x7f332c036770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 --2- 172.21.15.133:0/3325456912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604671ab340 0x56046729c4c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 >> 172.21.15.133:0/3325456912 conn(0x56046711ea30 msgr2=0x56046728fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 shutdown_connections 2024-02-15T23:31:04.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.763+0000 7f34476c9980 1 -- 172.21.15.133:0/3325456912 wait complete. 2024-02-15T23:31:04.778 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"deea0f97-f899-4036-a460-801d53f243a7","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"cd69b486-4810-48ae-b5d4-5bce307169d4","zones":[{"id":"cd69b486-4810-48ae-b5d4-5bce307169d4","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-02-15T23:31:04.778 DEBUG:tasks.util.rgw: json result: {'id': 'deea0f97-f899-4036-a460-801d53f243a7', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'cd69b486-4810-48ae-b5d4-5bce307169d4', 'zones': [{'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-02-15T23:31:04.778 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-15T23:31:04.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-15T23:31:04.778 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zonegroup default --placement-id default-placement --storage-class GLACIER 2024-02-15T23:31:04.851 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:04.851 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccd4ab980 1 Processor -- start 2024-02-15T23:31:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccd4ab980 1 -- start start 2024-02-15T23:31:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccd4ab980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f8ba3d3b60 0x55f8ba3d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccd4ab980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f8ba3a9460 con 0x55f8ba3d2650 2024-02-15T23:31:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccd4ab980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f8ba370180 con 0x55f8ba3d3b60 2024-02-15T23:31:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccafc6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f8ba3d3b60 0x55f8ba3d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccafc6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x55f8ba3d3b60 0x55f8ba3d2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36528/0 (socket says 172.21.15.133:36528) 2024-02-15T23:31:04.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7cca7c5640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x55f8ba3d2650 0x55f8ba4651e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:33014/0 (socket says 172.21.15.133:33014) 2024-02-15T23:31:04.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccafc6640 1 -- 172.21.15.133:0/1033918539 learned_addr learned my addr 172.21.15.133:0/1033918539 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccafc6640 1 -- 172.21.15.133:0/1033918539 >> v1:172.21.15.131:6789/0 conn(0x55f8ba3d2650 legacy=0x55f8ba4651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.847+0000 7f7ccafc6640 1 -- 172.21.15.133:0/1033918539 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ba3d2a60 con 0x55f8ba3d3b60 2024-02-15T23:31:04.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7ccafc6640 1 --2- 172.21.15.133:0/1033918539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d3b60 0x55f8ba3d2110 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000a5c0 tx=0x7f7cc001b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30da2428bf902443 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7cc9fc4640 1 -- 172.21.15.133:0/1033918539 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00aa530 con 0x55f8ba3d3b60 2024-02-15T23:31:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7cc9fc4640 1 -- 172.21.15.133:0/1033918539 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00a6050 con 0x55f8ba3d3b60 2024-02-15T23:31:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7cc9fc4640 1 -- 172.21.15.133:0/1033918539 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00aa7e0 con 0x55f8ba3d3b60 2024-02-15T23:31:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1033918539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d3b60 msgr2=0x55f8ba3d2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/1033918539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d3b60 0x55f8ba3d2110 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000a5c0 tx=0x7f7cc001b2e0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1033918539 shutdown_connections 2024-02-15T23:31:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/1033918539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d3b60 0x55f8ba3d2110 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1033918539 >> 172.21.15.133:0/1033918539 conn(0x55f8ba458ab0 msgr2=0x55f8ba45aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1033918539 shutdown_connections 2024-02-15T23:31:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.851+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1033918539 wait complete. 2024-02-15T23:31:04.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.863+0000 7f7ccd4ab980 1 Processor -- start 2024-02-15T23:31:04.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.863+0000 7f7ccd4ab980 1 -- start start 2024-02-15T23:31:04.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.863+0000 7f7ccd4ab980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba549960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.863+0000 7f7ccd4ab980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ba36d6b0 con 0x55f8ba3d2650 2024-02-15T23:31:04.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.863+0000 7f7ccafc6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba549960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.863+0000 7f7ccafc6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba549960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36542/0 (socket says 172.21.15.133:36542) 2024-02-15T23:31:04.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.863+0000 7f7ccafc6640 1 -- 172.21.15.133:0/2012945969 learned_addr learned my addr 172.21.15.133:0/2012945969 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.863+0000 7f7ccafc6640 1 -- 172.21.15.133:0/2012945969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0005df0 con 0x55f8ba3d2650 2024-02-15T23:31:04.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccafc6640 1 --2- 172.21.15.133:0/2012945969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba549960 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0018f70 tx=0x7f7cc0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e65a6bb2dee69b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7bb8e09640 1 -- 172.21.15.133:0/2012945969 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00aa800 con 0x55f8ba3d2650 2024-02-15T23:31:04.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7bb8e09640 1 -- 172.21.15.133:0/2012945969 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00aa960 con 0x55f8ba3d2650 2024-02-15T23:31:04.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7bb8e09640 1 -- 172.21.15.133:0/2012945969 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00aac20 con 0x55f8ba3d2650 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2012945969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 msgr2=0x55f8ba549960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/2012945969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba549960 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0018f70 tx=0x7f7cc0003030 comp rx=0 tx=0).stop 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2012945969 shutdown_connections 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/2012945969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba549960 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2012945969 >> 172.21.15.133:0/2012945969 conn(0x55f8ba458ab0 msgr2=0x55f8ba5454f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2012945969 shutdown_connections 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2012945969 wait complete. 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 Processor -- start 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- start start 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba550610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ba368e90 con 0x55f8ba3d2650 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccafc6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba550610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccafc6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba550610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36552/0 (socket says 172.21.15.133:36552) 2024-02-15T23:31:04.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccafc6640 1 -- 172.21.15.133:0/4236090745 learned_addr learned my addr 172.21.15.133:0/4236090745 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccafc6640 1 -- 172.21.15.133:0/4236090745 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ba3d2a60 con 0x55f8ba3d2650 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccafc6640 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba550610 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7cc001bb80 tx=0x7f7cc00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7bb7606640 1 -- 172.21.15.133:0/4236090745 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00c2070 con 0x55f8ba3d2650 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8ba550b50 con 0x55f8ba3d2650 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7bb7606640 1 -- 172.21.15.133:0/4236090745 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00bdaf0 con 0x55f8ba3d2650 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7bb7606640 1 -- 172.21.15.133:0/4236090745 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00bdd90 con 0x55f8ba3d2650 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8ba550f40 con 0x55f8ba3d2650 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 Processor -- start 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.867+0000 7f7ccd4ab980 1 -- start start 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba55da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ba301f20 con 0x55f8ba55d600 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba55da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7bb7606640 1 -- 172.21.15.133:0/4236090745 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cc00b1070 con 0x55f8ba3d2650 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba55da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36564/0 (socket says 172.21.15.133:36564) 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 -- 172.21.15.133:0/2397948935 learned_addr learned my addr 172.21.15.133:0/2397948935 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7bb7606640 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7bb00342b0 0x7f7bb0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7bb7606640 1 -- 172.21.15.133:0/4236090745 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7cc00e3850 con 0x55f8ba3d2650 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccafc6640 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7bb00342b0 0x7f7bb0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 -- 172.21.15.133:0/2397948935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ba55df60 con 0x55f8ba55d600 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccafc6640 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7bb00342b0 0x7f7bb0036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00c6fd0 tx=0x7f7cc00cfef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 --2- 172.21.15.133:0/2397948935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba55da20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400a430 tx=0x7f7cc400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac31fffb5c9bab4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7bb5602640 1 -- 172.21.15.133:0/2397948935 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc400f6e0 con 0x55f8ba55d600 2024-02-15T23:31:04.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7bb5602640 1 -- 172.21.15.133:0/2397948935 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc400f860 con 0x55f8ba55d600 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7bb5602640 1 -- 172.21.15.133:0/2397948935 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc400fb40 con 0x55f8ba55d600 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2397948935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 msgr2=0x55f8ba55da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/2397948935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba55da20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400a430 tx=0x7f7cc400a8f0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2397948935 shutdown_connections 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/2397948935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba55da20 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2397948935 >> 172.21.15.133:0/2397948935 conn(0x55f8ba3d3b60 msgr2=0x55f8ba558a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2397948935 shutdown_connections 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2397948935 wait complete. 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 Processor -- start 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- start start 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba564570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ba2f5790 con 0x55f8ba55d600 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba564570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba564570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36574/0 (socket says 172.21.15.133:36574) 2024-02-15T23:31:04.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 -- 172.21.15.133:0/2593895873 learned_addr learned my addr 172.21.15.133:0/2593895873 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 -- 172.21.15.133:0/2593895873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc400a0e0 con 0x55f8ba55d600 2024-02-15T23:31:04.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccb7c7640 1 --2- 172.21.15.133:0/2593895873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba564570 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55f8ba55e3e0 tx=0x7f7cc4003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7baf7fe640 1 -- 172.21.15.133:0/2593895873 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc4010a20 con 0x55f8ba55d600 2024-02-15T23:31:04.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2593895873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8ba564ab0 con 0x55f8ba55d600 2024-02-15T23:31:04.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7baf7fe640 1 -- 172.21.15.133:0/2593895873 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc4010b80 con 0x55f8ba55d600 2024-02-15T23:31:04.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2593895873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8ba564f40 con 0x55f8ba55d600 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.871+0000 7f7baf7fe640 1 -- 172.21.15.133:0/2593895873 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc4010ea0 con 0x55f8ba55d600 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccd4ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccd4ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7baf7fe640 1 -- 172.21.15.133:0/2593895873 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cc401a480 con 0x55f8ba55d600 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7baf7fe640 1 --2- 172.21.15.133:0/2593895873 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ba40342b0 0x7f7ba4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccd4ab980 1 Processor -- start 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7baf7fe640 1 -- 172.21.15.133:0/2593895873 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7cc4049ec0 con 0x55f8ba55d600 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccb7c7640 1 --2- 172.21.15.133:0/2593895873 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ba40342b0 0x7f7ba4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccd4ab980 1 -- start start 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccd4ab980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba57e300 0x55f8ba57e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccd4ab980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ba57ec60 con 0x55f8ba57e300 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccb7c7640 1 --2- 172.21.15.133:0/2593895873 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ba40342b0 0x7f7ba4036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7cc402dce0 tx=0x7f7cc402df70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccafc6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba57e300 0x55f8ba57e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccafc6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba57e300 0x55f8ba57e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36588/0 (socket says 172.21.15.133:36588) 2024-02-15T23:31:04.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccafc6640 1 -- 172.21.15.133:0/1222551132 learned_addr learned my addr 172.21.15.133:0/1222551132 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:04.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccafc6640 1 -- 172.21.15.133:0/1222551132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ba57eda0 con 0x55f8ba57e300 2024-02-15T23:31:04.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccafc6640 1 --2- 172.21.15.133:0/1222551132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba57e300 0x55f8ba57e720 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00e1b10 tx=0x7f7cc00c7250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7b8affd640 1 -- 172.21.15.133:0/1222551132 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00c73f0 con 0x55f8ba57e300 2024-02-15T23:31:04.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1222551132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8ba57f6f0 con 0x55f8ba57e300 2024-02-15T23:31:04.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7b8affd640 1 -- 172.21.15.133:0/1222551132 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00cea10 con 0x55f8ba57e300 2024-02-15T23:31:04.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7b8affd640 1 -- 172.21.15.133:0/1222551132 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00e3ae0 con 0x55f8ba57e300 2024-02-15T23:31:04.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.875+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1222551132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8ba57fb80 con 0x55f8ba57e300 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7b8affd640 1 -- 172.21.15.133:0/1222551132 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cc00e3c40 con 0x55f8ba57e300 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7b8affd640 1 --2- 172.21.15.133:0/1222551132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7b04034260 0x7f7b04036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7b8affd640 1 -- 172.21.15.133:0/1222551132 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7cc00af0f0 con 0x55f8ba57e300 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7cca7c5640 1 --2- 172.21.15.133:0/1222551132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7b04034260 0x7f7b04036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7b88ff9640 20 reqs_thread_entry: start 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7cca7c5640 1 --2- 172.21.15.133:0/1222551132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7b04034260 0x7f7b04036720 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55f8ba5596b0 tx=0x7f7cbc001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f8ba5832d0 0x55f8ba5856c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8ba585c00 con 0x55f8ba5832d0 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7ccb7c7640 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f8ba5832d0 0x55f8ba5856c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7ccb7c7640 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f8ba5832d0 0x55f8ba5856c0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7ccb7c7640 1 -- 172.21.15.133:0/4236090745 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7cc4016020 con 0x55f8ba5832d0 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8ba586f70 con 0x55f8ba5832d0 2024-02-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7ccb7c7640 1 -- 172.21.15.133:0/4236090745 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7cc4016020 con 0x55f8ba5832d0 2024-02-15T23:31:04.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.879+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~421 in=421b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8ba58b9a0 con 0x55f8ba5832d0 2024-02-15T23:31:04.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccb7c7640 1 -- 172.21.15.133:0/4236090745 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [stat,call,call,writefull 0~421] v33'2 uv2 ondisk = 0) v8 ==== 321+0+0 (crc 0 0 0) 0x7f7cc4016020 con 0x55f8ba5832d0 2024-02-15T23:31:04.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2593895873 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ba40342b0 msgr2=0x7f7ba4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/2593895873 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ba40342b0 0x7f7ba4036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7cc402dce0 tx=0x7f7cc402df70 comp rx=0 tx=0).stop 2024-02-15T23:31:04.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2593895873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 msgr2=0x55f8ba564570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/2593895873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba564570 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55f8ba55e3e0 tx=0x7f7cc4003380 comp rx=0 tx=0).stop 2024-02-15T23:31:04.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2593895873 shutdown_connections 2024-02-15T23:31:04.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/2593895873 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7ba40342b0 0x7f7ba4036770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/2593895873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba55d600 0x55f8ba564570 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2593895873 >> 172.21.15.133:0/2593895873 conn(0x55f8ba3d3b60 msgr2=0x55f8ba557870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2593895873 shutdown_connections 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/2593895873 wait complete. 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1222551132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7b04034260 msgr2=0x7f7b04036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/1222551132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7b04034260 0x7f7b04036720 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55f8ba5596b0 tx=0x7f7cbc001330 comp rx=0 tx=0).stop 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1222551132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba57e300 msgr2=0x55f8ba57e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/1222551132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba57e300 0x55f8ba57e720 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00e1b10 tx=0x7f7cc00c7250 comp rx=0 tx=0).stop 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1222551132 shutdown_connections 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/1222551132 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7b04034260 0x7f7b04036720 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/1222551132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba57e300 0x55f8ba57e720 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1222551132 >> 172.21.15.133:0/1222551132 conn(0x55f8ba573020 msgr2=0x55f8ba573a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1222551132 shutdown_connections 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/1222551132 wait complete. 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f8ba5832d0 msgr2=0x55f8ba5856c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f8ba5832d0 0x55f8ba5856c0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7bb00342b0 msgr2=0x7f7bb0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7bb00342b0 0x7f7bb0036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00c6fd0 tx=0x7f7cc00cfef0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 msgr2=0x55f8ba550610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba550610 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7cc001bb80 tx=0x7f7cc00180e0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 shutdown_connections 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x55f8ba5832d0 0x55f8ba5856c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7bb00342b0 0x7f7bb0036770 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 --2- 172.21.15.133:0/4236090745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8ba3d2650 0x55f8ba550610 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 >> 172.21.15.133:0/4236090745 conn(0x55f8ba458ab0 msgr2=0x55f8ba544000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 shutdown_connections 2024-02-15T23:31:04.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.883+0000 7f7ccd4ab980 1 -- 172.21.15.133:0/4236090745 wait complete. 2024-02-15T23:31:04.898 INFO:teuthology.orchestra.run.smithi133.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["GLACIER","STANDARD"]}}] 2024-02-15T23:31:04.899 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['GLACIER', 'STANDARD']}}] 2024-02-15T23:31:04.899 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-15T23:31:04.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-15T23:31:04.899 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class GLACIER --data-pool .rgw.buckets.2 2024-02-15T23:31:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8374155980 1 Processor -- start 2024-02-15T23:31:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8374155980 1 -- start start 2024-02-15T23:31:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8374155980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x558d18230290 0x558d1822e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8374155980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558d18206460 con 0x558d1822edd0 2024-02-15T23:31:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8374155980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x558d181cd180 con 0x558d18230290 2024-02-15T23:31:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8371c70640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x558d18230290 0x558d1822e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f837146f640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x558d1822edd0 0x558d182c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:33016/0 (socket says 172.21.15.133:33016) 2024-02-15T23:31:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8371c70640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x558d18230290 0x558d1822e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36590/0 (socket says 172.21.15.133:36590) 2024-02-15T23:31:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f837146f640 1 -- 172.21.15.133:0/1773836129 learned_addr learned my addr 172.21.15.133:0/1773836129 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:31:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8371c70640 1 -- 172.21.15.133:0/1773836129 >> v1:172.21.15.131:6789/0 conn(0x558d1822edd0 legacy=0x558d182c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.975+0000 7f8371c70640 1 -- 172.21.15.133:0/1773836129 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d1822f1e0 con 0x558d18230290 2024-02-15T23:31:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8371c70640 1 --2- 172.21.15.133:0/1773836129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d18230290 0x558d1822e890 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f836400a480 tx=0x7f836401b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f60037fb3972d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8370c6e640 1 -- 172.21.15.133:0/1773836129 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83640aa400 con 0x558d18230290 2024-02-15T23:31:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8370c6e640 1 -- 172.21.15.133:0/1773836129 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640a6050 con 0x558d18230290 2024-02-15T23:31:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8370c6e640 1 -- 172.21.15.133:0/1773836129 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83640aa6b0 con 0x558d18230290 2024-02-15T23:31:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8374155980 1 -- 172.21.15.133:0/1773836129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d18230290 msgr2=0x558d1822e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8374155980 1 --2- 172.21.15.133:0/1773836129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d18230290 0x558d1822e890 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f836400a480 tx=0x7f836401b220 comp rx=0 tx=0).stop 2024-02-15T23:31:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8374155980 1 -- 172.21.15.133:0/1773836129 shutdown_connections 2024-02-15T23:31:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8374155980 1 --2- 172.21.15.133:0/1773836129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d18230290 0x558d1822e890 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8374155980 1 -- 172.21.15.133:0/1773836129 >> 172.21.15.133:0/1773836129 conn(0x558d182b5b00 msgr2=0x558d182b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8374155980 1 -- 172.21.15.133:0/1773836129 shutdown_connections 2024-02-15T23:31:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.979+0000 7f8374155980 1 -- 172.21.15.133:0/1773836129 wait complete. 2024-02-15T23:31:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.991+0000 7f8374155980 1 Processor -- start 2024-02-15T23:31:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.991+0000 7f8374155980 1 -- start start 2024-02-15T23:31:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.991+0000 7f8374155980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.991+0000 7f8374155980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d181ca6b0 con 0x558d1822edd0 2024-02-15T23:31:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.991+0000 7f8371c70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.991+0000 7f8371c70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36606/0 (socket says 172.21.15.133:36606) 2024-02-15T23:31:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.991+0000 7f8371c70640 1 -- 172.21.15.133:0/3092710800 learned_addr learned my addr 172.21.15.133:0/3092710800 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8371c70640 1 -- 172.21.15.133:0/3092710800 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8364005d30 con 0x558d1822edd0 2024-02-15T23:31:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8371c70640 1 --2- 172.21.15.133:0/3092710800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183a6aa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f836401b260 tx=0x7f8364003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d876a56748fb281 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f825fe07640 1 -- 172.21.15.133:0/3092710800 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83640aa630 con 0x558d1822edd0 2024-02-15T23:31:05.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f825fe07640 1 -- 172.21.15.133:0/3092710800 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640aa790 con 0x558d1822edd0 2024-02-15T23:31:05.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f825fe07640 1 -- 172.21.15.133:0/3092710800 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83640aaa50 con 0x558d1822edd0 2024-02-15T23:31:05.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- 172.21.15.133:0/3092710800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 msgr2=0x558d183a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 --2- 172.21.15.133:0/3092710800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183a6aa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f836401b260 tx=0x7f8364003030 comp rx=0 tx=0).stop 2024-02-15T23:31:05.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- 172.21.15.133:0/3092710800 shutdown_connections 2024-02-15T23:31:05.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 --2- 172.21.15.133:0/3092710800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183a6aa0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- 172.21.15.133:0/3092710800 >> 172.21.15.133:0/3092710800 conn(0x558d182b5b00 msgr2=0x558d183a2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- 172.21.15.133:0/3092710800 shutdown_connections 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- 172.21.15.133:0/3092710800 wait complete. 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 Processor -- start 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- start start 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d181c5e90 con 0x558d1822edd0 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8371c70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8371c70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36610/0 (socket says 172.21.15.133:36610) 2024-02-15T23:31:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8371c70640 1 -- 172.21.15.133:0/647271202 learned_addr learned my addr 172.21.15.133:0/647271202 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:05.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8371c70640 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d1822f1e0 con 0x558d1822edd0 2024-02-15T23:31:05.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8371c70640 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183ad7b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f83640a4010 tx=0x7f8364018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f825e604640 1 -- 172.21.15.133:0/647271202 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83640c2070 con 0x558d1822edd0 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d183adcf0 con 0x558d1822edd0 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d183ae1a0 con 0x558d1822edd0 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f825e604640 1 -- 172.21.15.133:0/647271202 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640bd930 con 0x558d1822edd0 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.995+0000 7f825e604640 1 -- 172.21.15.133:0/647271202 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83640bdbd0 con 0x558d1822edd0 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 Processor -- start 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- start start 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1815ef20 con 0x558d183bb030 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f825e604640 1 -- 172.21.15.133:0/647271202 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f83640b1070 con 0x558d1822edd0 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183bb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36618/0 (socket says 172.21.15.133:36618) 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 -- 172.21.15.133:0/4199333014 learned_addr learned my addr 172.21.15.133:0/4199333014 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:05.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f825e604640 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82580342b0 0x7f8258036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:05.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f825e604640 1 -- 172.21.15.133:0/647271202 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f83640e3db0 con 0x558d1822edd0 2024-02-15T23:31:05.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8371c70640 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82580342b0 0x7f8258036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 -- 172.21.15.133:0/4199333014 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d183bb990 con 0x558d183bb030 2024-02-15T23:31:05.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8371c70640 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82580342b0 0x7f8258036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8364018eb0 tx=0x7f83640b0e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 --2- 172.21.15.133:0/4199333014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183bb450 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f836c00a430 tx=0x7f836c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8c071ebc20b603 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8257fff640 1 -- 172.21.15.133:0/4199333014 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f836c00f6e0 con 0x558d183bb030 2024-02-15T23:31:05.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8257fff640 1 -- 172.21.15.133:0/4199333014 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00f860 con 0x558d183bb030 2024-02-15T23:31:05.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8257fff640 1 -- 172.21.15.133:0/4199333014 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f836c00fb40 con 0x558d183bb030 2024-02-15T23:31:05.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- 172.21.15.133:0/4199333014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 msgr2=0x558d183bb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 --2- 172.21.15.133:0/4199333014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183bb450 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f836c00a430 tx=0x7f836c00a8f0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- 172.21.15.133:0/4199333014 shutdown_connections 2024-02-15T23:31:05.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 --2- 172.21.15.133:0/4199333014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183bb450 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- 172.21.15.133:0/4199333014 >> 172.21.15.133:0/4199333014 conn(0x558d183b5c50 msgr2=0x558d183b6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- 172.21.15.133:0/4199333014 shutdown_connections 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- 172.21.15.133:0/4199333014 wait complete. 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 Processor -- start 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- start start 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8374155980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d18152790 con 0x558d183bb030 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36622/0 (socket says 172.21.15.133:36622) 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 -- 172.21.15.133:0/1532509073 learned_addr learned my addr 172.21.15.133:0/1532509073 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:04.999+0000 7f8372471640 1 -- 172.21.15.133:0/1532509073 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c00a0e0 con 0x558d183bb030 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8372471640 1 --2- 172.21.15.133:0/1532509073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183c1b80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f836c00a3d0 tx=0x7f836c003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82567fc640 1 -- 172.21.15.133:0/1532509073 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f836c0109a0 con 0x558d183bb030 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d183c20c0 con 0x558d183bb030 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82567fc640 1 -- 172.21.15.133:0/1532509073 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c010b00 con 0x558d183bb030 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d183c2550 con 0x558d183bb030 2024-02-15T23:31:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82567fc640 1 -- 172.21.15.133:0/1532509073 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f836c010e20 con 0x558d183bb030 2024-02-15T23:31:05.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:05.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:05.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82567fc640 1 -- 172.21.15.133:0/1532509073 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f836c01a480 con 0x558d183bb030 2024-02-15T23:31:05.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 1 Processor -- start 2024-02-15T23:31:05.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82567fc640 1 --2- 172.21.15.133:0/1532509073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f824c0342b0 0x7f824c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:05.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82567fc640 1 -- 172.21.15.133:0/1532509073 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f836c049c20 con 0x558d183bb030 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 1 -- start start 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8372471640 1 --2- 172.21.15.133:0/1532509073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f824c0342b0 0x7f824c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183db8e0 0x558d183dbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d183dc240 con 0x558d183db8e0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8372471640 1 --2- 172.21.15.133:0/1532509073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f824c0342b0 0x7f824c036770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f836c048030 tx=0x7f836c00ae20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8371c70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183db8e0 0x558d183dbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8371c70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183db8e0 0x558d183dbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:36628/0 (socket says 172.21.15.133:36628) 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8371c70640 1 -- 172.21.15.133:0/1836507819 learned_addr learned my addr 172.21.15.133:0/1836507819 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8371c70640 1 -- 172.21.15.133:0/1836507819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d183dc380 con 0x558d183db8e0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8371c70640 1 --2- 172.21.15.133:0/1836507819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183db8e0 0x558d183dbd00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f83640b3b20 tx=0x7f83640e2190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82367e4640 1 -- 172.21.15.133:0/1836507819 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83640b08c0 con 0x558d183db8e0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82367e4640 1 -- 172.21.15.133:0/1836507819 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640a8bd0 con 0x558d183db8e0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 1 -- 172.21.15.133:0/1836507819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d183dcd00 con 0x558d183db8e0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f82367e4640 1 -- 172.21.15.133:0/1836507819 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83640a8300 con 0x558d183db8e0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.003+0000 7f8374155980 1 -- 172.21.15.133:0/1836507819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d183dd190 con 0x558d183db8e0 2024-02-15T23:31:05.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f82367e4640 1 -- 172.21.15.133:0/1836507819 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f83640e3290 con 0x558d183db8e0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f82367e4640 1 --2- 172.21.15.133:0/1836507819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81b40342b0 0x7f81b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f82367e4640 1 -- 172.21.15.133:0/1836507819 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f83640ecd60 con 0x558d183db8e0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f837146f640 1 --2- 172.21.15.133:0/1836507819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81b40342b0 0x7f81b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f81a7fff640 20 reqs_thread_entry: start 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8374155980 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d183b15f0 0x558d183e28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f837146f640 1 --2- 172.21.15.133:0/1836507819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81b40342b0 0x7f81b4036770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8368000f70 tx=0x7f8368001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d183e2f00 con 0x558d183b15f0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8372471640 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d183b15f0 0x558d183e28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8372471640 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d183b15f0 0x558d183e28f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8372471640 1 -- 172.21.15.133:0/647271202 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f836c016020 con 0x558d183b15f0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d183e4710 con 0x558d183b15f0 2024-02-15T23:31:05.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8372471640 1 -- 172.21.15.133:0/647271202 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f836c016020 con 0x558d183b15f0 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d183e3910 con 0x558d183b15f0 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8372471640 1 -- 172.21.15.133:0/647271202 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f836c016020 con 0x558d183b15f0 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d183e3cc0 con 0x558d183b15f0 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8372471640 1 -- 172.21.15.133:0/647271202 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f836c016020 con 0x558d183b15f0 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d183e40a0 con 0x558d183b15f0 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8372471640 1 -- 172.21.15.133:0/647271202 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f836c016020 con 0x558d183b15f0 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x558d1815ed10 con 0x558d183bb030 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f82567fc640 1 -- 172.21.15.133:0/1532509073 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f836c02dc90 con 0x558d183bb030 2024-02-15T23:31:05.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.007+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:6 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~922 in=922b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558d183e9f60 con 0x558d183b15f0 2024-02-15T23:31:05.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8372471640 1 -- 172.21.15.133:0/647271202 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(6 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [stat,call,call,writefull 0~922] v33'5 uv5 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f836c016020 con 0x558d183b15f0 2024-02-15T23:31:05.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f824c0342b0 msgr2=0x7f824c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/1532509073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f824c0342b0 0x7f824c036770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f836c048030 tx=0x7f836c00ae20 comp rx=0 tx=0).stop 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 msgr2=0x558d183c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/1532509073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183c1b80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f836c00a3d0 tx=0x7f836c003380 comp rx=0 tx=0).stop 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 shutdown_connections 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/1532509073 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f824c0342b0 0x7f824c036770 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/1532509073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183bb030 0x558d183c1b80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 >> 172.21.15.133:0/1532509073 conn(0x558d183b5c50 msgr2=0x558d183b6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 shutdown_connections 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1532509073 wait complete. 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1836507819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81b40342b0 msgr2=0x7f81b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/1836507819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81b40342b0 0x7f81b4036770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8368000f70 tx=0x7f8368001240 comp rx=0 tx=0).stop 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1836507819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183db8e0 msgr2=0x558d183dbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/1836507819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183db8e0 0x558d183dbd00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f83640b3b20 tx=0x7f83640e2190 comp rx=0 tx=0).stop 2024-02-15T23:31:05.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1836507819 shutdown_connections 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/1836507819 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f81b40342b0 0x7f81b4036770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/1836507819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d183db8e0 0x558d183dbd00 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1836507819 >> 172.21.15.133:0/1836507819 conn(0x558d183d0600 msgr2=0x558d183d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1836507819 shutdown_connections 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/1836507819 wait complete. 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d183b15f0 msgr2=0x558d183e28f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d183b15f0 0x558d183e28f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82580342b0 msgr2=0x7f8258036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82580342b0 0x7f8258036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8364018eb0 tx=0x7f83640b0e90 comp rx=0 tx=0).stop 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 msgr2=0x558d183ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183ad7b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f83640a4010 tx=0x7f8364018020 comp rx=0 tx=0).stop 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 shutdown_connections 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x558d183b15f0 0x558d183e28f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f82580342b0 0x7f8258036770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 --2- 172.21.15.133:0/647271202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d1822edd0 0x558d183ad7b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 >> 172.21.15.133:0/647271202 conn(0x558d182b5b00 msgr2=0x558d183a10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:05.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 shutdown_connections 2024-02-15T23:31:05.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:05.011+0000 7f8374155980 1 -- 172.21.15.133:0/647271202 wait complete. 2024-02-15T23:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"cd69b486-4810-48ae-b5d4-5bce307169d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"GLACIER":{"data_pool":".rgw.buckets.2"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T23:31:05.028 DEBUG:tasks.util.rgw: json result: {'id': 'cd69b486-4810-48ae-b5d4-5bce307169d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'GLACIER': {'data_pool': '.rgw.buckets.2'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T23:31:05.031 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000001c85fa56cdd5410e-0065ce9eb9-4227-default4227-default-default 2024-02-15T23:31:05.258 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9baf7a73df894a76a25258bbc451c2eb Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000001c85fa56cdd5410e-0065ce9eb9-4227-default4227-default-default 2024-02-15T23:31:05.259 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-02-15T23:31:05.268 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-02-15T23:31:05.268 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T23:31:05.281 INFO:tasks.rgw.client.0.smithi133.stdout:2024-02-15T23:31:05.263+0000 7fee6a58c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28408) UID: 0 2024-02-15T23:31:05.281 INFO:tasks.rgw.client.0.smithi133.stdout:2024-02-15T23:31:05.263+0000 7fee6ddd4a40 -1 shutting down 2024-02-15T23:31:10.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-02-15T23:31:11.370 INFO:tasks.rgw.client.0:Stopped 2024-02-15T23:31:11.370 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-02-15T23:31:11.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/vault-root-token 2024-02-15T23:31:11.436 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-02-15T23:31:11.491 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-02-15T23:31:11.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-02-15T23:31:11.492 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-02-15T23:31:11.571 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T23:31:11.571 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T23:31:11.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc480a980 1 Processor -- start 2024-02-15T23:31:11.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc480a980 1 -- start start 2024-02-15T23:31:11.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc480a980 1 --2- >> v2:172.21.15.131:3300/0 conn(0x559c2aeab040 0x559c2aeab420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc480a980 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559c2adf84c0 con 0x559c2aeab960 2024-02-15T23:31:11.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc480a980 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x559c2adbf180 con 0x559c2aeab040 2024-02-15T23:31:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc2325640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x559c2aeab040 0x559c2aeab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc1b24640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x559c2aeab960 0x559c2aeac320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.133:36306/0 (socket says 172.21.15.133:36306) 2024-02-15T23:31:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc2325640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x559c2aeab040 0x559c2aeab420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:51440/0 (socket says 172.21.15.133:51440) 2024-02-15T23:31:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc1b24640 1 -- 172.21.15.133:0/274334875 learned_addr learned my addr 172.21.15.133:0/274334875 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T23:31:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc2325640 1 -- 172.21.15.133:0/274334875 >> v1:172.21.15.131:6789/0 conn(0x559c2aeab960 legacy=0x559c2aeac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.567+0000 7f4dc2325640 1 -- 172.21.15.133:0/274334875 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c2aeacb50 con 0x559c2aeab040 2024-02-15T23:31:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc2325640 1 --2- 172.21.15.133:0/274334875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2aeab420 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4db400a480 tx=0x7f4db401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af81e6f434d3ea4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc1323640 1 -- 172.21.15.133:0/274334875 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db40ab540 con 0x559c2aeab040 2024-02-15T23:31:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc1323640 1 -- 172.21.15.133:0/274334875 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40ab6a0 con 0x559c2aeab040 2024-02-15T23:31:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc1323640 1 -- 172.21.15.133:0/274334875 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db40ab960 con 0x559c2aeab040 2024-02-15T23:31:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc480a980 1 -- 172.21.15.133:0/274334875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 msgr2=0x559c2aeab420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc480a980 1 --2- 172.21.15.133:0/274334875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2aeab420 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4db400a480 tx=0x7f4db401b280 comp rx=0 tx=0).stop 2024-02-15T23:31:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc480a980 1 -- 172.21.15.133:0/274334875 shutdown_connections 2024-02-15T23:31:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc480a980 1 --2- 172.21.15.133:0/274334875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2aeab420 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc480a980 1 -- 172.21.15.133:0/274334875 >> 172.21.15.133:0/274334875 conn(0x559c2aea6910 msgr2=0x559c2aea8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc480a980 1 -- 172.21.15.133:0/274334875 shutdown_connections 2024-02-15T23:31:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.571+0000 7f4dc480a980 1 -- 172.21.15.133:0/274334875 wait complete. 2024-02-15T23:31:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc480a980 1 Processor -- start 2024-02-15T23:31:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc480a980 1 -- start start 2024-02-15T23:31:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc480a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2af988a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc480a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c2adbc6b0 con 0x559c2aeab040 2024-02-15T23:31:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc2325640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2af988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc2325640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2af988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:51450/0 (socket says 172.21.15.133:51450) 2024-02-15T23:31:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc2325640 1 -- 172.21.15.133:0/2473665783 learned_addr learned my addr 172.21.15.133:0/2473665783 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc2325640 1 -- 172.21.15.133:0/2473665783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4005d30 con 0x559c2aeab040 2024-02-15T23:31:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4dc2325640 1 --2- 172.21.15.133:0/2473665783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2af988a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4db4018eb0 tx=0x7f4db4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5892d8b6bf8f859 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4cb0608640 1 -- 172.21.15.133:0/2473665783 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db40ab810 con 0x559c2aeab040 2024-02-15T23:31:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4cb0608640 1 -- 172.21.15.133:0/2473665783 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40ab970 con 0x559c2aeab040 2024-02-15T23:31:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.587+0000 7f4cb0608640 1 -- 172.21.15.133:0/2473665783 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db40abc30 con 0x559c2aeab040 2024-02-15T23:31:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- 172.21.15.133:0/2473665783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 msgr2=0x559c2af988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 --2- 172.21.15.133:0/2473665783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2af988a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4db4018eb0 tx=0x7f4db4003030 comp rx=0 tx=0).stop 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- 172.21.15.133:0/2473665783 shutdown_connections 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 --2- 172.21.15.133:0/2473665783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab040 0x559c2af988a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- 172.21.15.133:0/2473665783 >> 172.21.15.133:0/2473665783 conn(0x559c2aea6910 msgr2=0x559c2af90020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- 172.21.15.133:0/2473665783 shutdown_connections 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- 172.21.15.133:0/2473665783 wait complete. 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 Processor -- start 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- start start 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab960 0x559c2af9f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c2adb7e90 con 0x559c2aeab960 2024-02-15T23:31:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc2325640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab960 0x559c2af9f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc2325640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab960 0x559c2af9f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:51466/0 (socket says 172.21.15.133:51466) 2024-02-15T23:31:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc2325640 1 -- 172.21.15.133:0/977821252 learned_addr learned my addr 172.21.15.133:0/977821252 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:11.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc2325640 1 -- 172.21.15.133:0/977821252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c2aeacb50 con 0x559c2aeab960 2024-02-15T23:31:11.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc2325640 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab960 0x559c2af9f770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4db401b2c0 tx=0x7f4db4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4caee05640 1 -- 172.21.15.133:0/977821252 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db40c2070 con 0x559c2aeab960 2024-02-15T23:31:11.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c2af9fcb0 con 0x559c2aeab960 2024-02-15T23:31:11.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4caee05640 1 -- 172.21.15.133:0/977821252 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40b6a10 con 0x559c2aeab960 2024-02-15T23:31:11.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4caee05640 1 -- 172.21.15.133:0/977821252 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db40b6cb0 con 0x559c2aeab960 2024-02-15T23:31:11.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c2afa00e0 con 0x559c2aeab960 2024-02-15T23:31:11.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.591+0000 7f4caee05640 1 -- 172.21.15.133:0/977821252 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4db40b2070 con 0x559c2aeab960 2024-02-15T23:31:11.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4caee05640 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4ca80342b0 0x7f4ca8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4caee05640 1 -- 172.21.15.133:0/977821252 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4db40e38b0 con 0x559c2aeab960 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc1b24640 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4ca80342b0 0x7f4ca8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afa43f0 0x559c2afa67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afa6d20 con 0x559c2afa43f0 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc2b26640 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afa43f0 0x559c2afa67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc1b24640 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4ca80342b0 0x7f4ca8036770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4db8000f70 tx=0x7f4db80012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc2b26640 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afa43f0 0x559c2afa67e0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc2b26640 1 -- 172.21.15.133:0/977821252 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dbc00a4d0 con 0x559c2afa43f0 2024-02-15T23:31:11.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afa70e0 con 0x559c2afa43f0 2024-02-15T23:31:11.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc2b26640 1 -- 172.21.15.133:0/977821252 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4dbc00a4d0 con 0x559c2afa43f0 2024-02-15T23:31:11.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afa8990 con 0x559c2afa43f0 2024-02-15T23:31:11.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc2b26640 1 -- 172.21.15.133:0/977821252 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [call out=48b,read 0~922 out=922b] v0'0 uv5 ondisk = 0) v8 ==== 232+0+970 (crc 0 0 0) 0x7f4dbc00a4d0 con 0x559c2afa43f0 2024-02-15T23:31:11.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afa7c50 con 0x559c2afa43f0 2024-02-15T23:31:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc2b26640 1 -- 172.21.15.133:0/977821252 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4dbc00a4d0 con 0x559c2afa43f0 2024-02-15T23:31:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afa8060 con 0x559c2afa43f0 2024-02-15T23:31:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc2b26640 1 -- 172.21.15.133:0/977821252 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f4dbc00a4d0 con 0x559c2afa43f0 2024-02-15T23:31:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 Processor -- start 2024-02-15T23:31:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 -- start start 2024-02-15T23:31:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afb6d80 0x559c2afb71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc480a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c2ad50f20 con 0x559c2afb6d80 2024-02-15T23:31:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc1b24640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afb6d80 0x559c2afb71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.595+0000 7f4dc1b24640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afb6d80 0x559c2afb71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:51478/0 (socket says 172.21.15.133:51478) 2024-02-15T23:31:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc1b24640 1 -- 172.21.15.133:0/1407461085 learned_addr learned my addr 172.21.15.133:0/1407461085 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc1b24640 1 -- 172.21.15.133:0/1407461085 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c2afb76e0 con 0x559c2afb6d80 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc1b24640 1 --2- 172.21.15.133:0/1407461085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afb6d80 0x559c2afb71a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4db8001ee0 tx=0x7f4db800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4ca7fff640 1 -- 172.21.15.133:0/1407461085 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db8020070 con 0x559c2afb6d80 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4ca7fff640 1 -- 172.21.15.133:0/1407461085 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800c770 con 0x559c2afb6d80 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc480a980 1 -- 172.21.15.133:0/1407461085 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c2afb7930 con 0x559c2afb6d80 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4ca7fff640 1 -- 172.21.15.133:0/1407461085 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db8013040 con 0x559c2afb6d80 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc480a980 1 -- 172.21.15.133:0/1407461085 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c2afb8480 con 0x559c2afb6d80 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4ca7fff640 1 -- 172.21.15.133:0/1407461085 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4db800a040 con 0x559c2afb6d80 2024-02-15T23:31:11.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4ca7fff640 1 --2- 172.21.15.133:0/1407461085 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c9c0342b0 0x7f4c9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4ca7fff640 1 -- 172.21.15.133:0/1407461085 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4db804b810 con 0x559c2afb6d80 2024-02-15T23:31:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc2b26640 1 --2- 172.21.15.133:0/1407461085 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c9c0342b0 0x7f4c9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc480a980 1 Processor -- start 2024-02-15T23:31:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc480a980 1 -- start start 2024-02-15T23:31:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc2b26640 1 --2- 172.21.15.133:0/1407461085 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c9c0342b0 0x7f4c9c036770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x559c2afa75d0 tx=0x7f4dbc005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc480a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afc4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc480a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c2ad44790 con 0x559c2afc3d00 2024-02-15T23:31:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc1b24640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afc4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc1b24640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afc4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:51486/0 (socket says 172.21.15.133:51486) 2024-02-15T23:31:11.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.599+0000 7f4dc1b24640 1 -- 172.21.15.133:0/589089598 learned_addr learned my addr 172.21.15.133:0/589089598 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:11.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc1b24640 1 -- 172.21.15.133:0/589089598 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c2afc46f0 con 0x559c2afc3d00 2024-02-15T23:31:11.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc1b24640 1 --2- 172.21.15.133:0/589089598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afc4120 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4db8049aa0 tx=0x7f4db80198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f80ae9a348c4c99 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4ca5ffb640 1 -- 172.21.15.133:0/589089598 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db8048070 con 0x559c2afc3d00 2024-02-15T23:31:11.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4ca5ffb640 1 -- 172.21.15.133:0/589089598 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db801bac0 con 0x559c2afc3d00 2024-02-15T23:31:11.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4ca5ffb640 1 -- 172.21.15.133:0/589089598 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db803a2b0 con 0x559c2afc3d00 2024-02-15T23:31:11.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- 172.21.15.133:0/589089598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 msgr2=0x559c2afc4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 --2- 172.21.15.133:0/589089598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afc4120 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4db8049aa0 tx=0x7f4db80198d0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- 172.21.15.133:0/589089598 shutdown_connections 2024-02-15T23:31:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 --2- 172.21.15.133:0/589089598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afc4120 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- 172.21.15.133:0/589089598 >> 172.21.15.133:0/589089598 conn(0x559c2afc0090 msgr2=0x559c2afbe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- 172.21.15.133:0/589089598 shutdown_connections 2024-02-15T23:31:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- 172.21.15.133:0/589089598 wait complete. 2024-02-15T23:31:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 Processor -- start 2024-02-15T23:31:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- start start 2024-02-15T23:31:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afcabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c2afcb130 con 0x559c2afc3d00 2024-02-15T23:31:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc1b24640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afcabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc1b24640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afcabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.133:51502/0 (socket says 172.21.15.133:51502) 2024-02-15T23:31:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 learned_addr learned my addr 172.21.15.133:0/3598459779 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T23:31:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c2afb8480 con 0x559c2afc3d00 2024-02-15T23:31:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc1b24640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afcabf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4db800df80 tx=0x7f4db8049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4c93fff640 1 -- 172.21.15.133:0/3598459779 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db8019e20 con 0x559c2afc3d00 2024-02-15T23:31:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c2afcb330 con 0x559c2afc3d00 2024-02-15T23:31:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c2afcb7c0 con 0x559c2afc3d00 2024-02-15T23:31:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4c93fff640 1 -- 172.21.15.133:0/3598459779 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db804b610 con 0x559c2afc3d00 2024-02-15T23:31:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.603+0000 7f4c93fff640 1 -- 172.21.15.133:0/3598459779 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db804bc20 con 0x559c2afc3d00 2024-02-15T23:31:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4c93fff640 1 -- 172.21.15.133:0/3598459779 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4db8048070 con 0x559c2afc3d00 2024-02-15T23:31:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4c93fff640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c8c034300 0x7f4c8c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4c93fff640 1 -- 172.21.15.133:0/3598459779 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4db800f070 con 0x559c2afc3d00 2024-02-15T23:31:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2b26640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c8c034300 0x7f4c8c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afd61d0 0x559c2afd8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afd8de0 con 0x559c2afd61d0 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2325640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afd61d0 0x559c2afd8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2b26640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c8c034300 0x7f4c8c0367c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x559c2afa7690 tx=0x7f4dbc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2325640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afd61d0 0x559c2afd8690 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 realm 2024-02-15T23:31:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afd91b0 con 0x559c2afd61d0 2024-02-15T23:31:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T23:31:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afd9a30 con 0x559c2afd61d0 2024-02-15T23:31:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afd9d90 con 0x559c2afd61d0 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:5 5.18 5:1de8faf4:::zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afda590 con 0x559c2afd61d0 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 5 ==== osd_op_reply(5 zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 [read 0~922 out=922b] v0'0 uv5 ondisk = 0) v8 ==== 190+0+922 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 rados_obj.operate() r=0 bl.length=922 2024-02-15T23:31:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 20 searching for the correct realm 2024-02-15T23:31:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559c2afdc4e0 0x559c2afde930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc1b24640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559c2afdc4e0 0x559c2afde930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.607+0000 7f4dc1b24640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559c2afdc4e0 0x559c2afde930 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc1b24640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4db8038070 0x7f4db802e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db8038070 2024-02-15T23:31:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2b26640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4db8038070 0x7f4db802e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2b26640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4db8038070 0x7f4db802e5f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc00a4d0 con 0x7f4db8038070 2024-02-15T23:31:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db8038070 2024-02-15T23:31:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc00a4d0 con 0x7f4db8038070 2024-02-15T23:31:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afd61d0 2024-02-15T23:31:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'5 uv5 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afd61d0 2024-02-15T23:31:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2325640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4db40c6030 0x7f4db40ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db40c6030 2024-02-15T23:31:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2325640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4db40c6030 0x7f4db40ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:11.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2325640 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4db40c6030 0x7f4db40ce390 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:11.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.611+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b4b70 con 0x7f4db40c6030 2024-02-15T23:31:11.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db40c6030 2024-02-15T23:31:11.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b4b70 con 0x7f4db40c6030 2024-02-15T23:31:11.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db8038070 2024-02-15T23:31:11.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc00a4d0 con 0x7f4db8038070 2024-02-15T23:31:11.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afd61d0 2024-02-15T23:31:11.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=112b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db40c6030 2024-02-15T23:31:11.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b4b70 con 0x7f4db40c6030 2024-02-15T23:31:11.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afd61d0 2024-02-15T23:31:11.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db8038070 2024-02-15T23:31:11.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db40c6030 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b4b70 con 0x7f4db40c6030 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.615+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afd61d0 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afd61d0 2024-02-15T23:31:11.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4db40b4b70 con 0x559c2afd61d0 2024-02-15T23:31:11.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db40c6030 2024-02-15T23:31:11.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db8038070 2024-02-15T23:31:11.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afd61d0 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db8038070 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db40c6030 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.619+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db8038070 2024-02-15T23:31:11.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afdc4e0 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db40c6030 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x559c2afd61d0 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf000 con 0x7f4db8038070 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 8 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 RGWRados::pool_iterate: got zone_info.cd69b486-4810-48ae-b5d4-5bce307169d4 2024-02-15T23:31:11.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 RGWRados::pool_iterate: got zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 2024-02-15T23:31:11.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T23:31:11.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T23:31:11.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T23:31:11.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T23:31:11.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdaf50 con 0x559c2afd61d0 2024-02-15T23:31:11.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdb750 con 0x559c2afd61d0 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:40 5.12 5:4857a9d5:::zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf440 con 0x559c2afd61d0 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 16 ==== osd_op_reply(40 zonegroup_info.deea0f97-f899-4036-a460-801d53f243a7 [read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+421 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados_obj.operate() r=0 bl.length=421 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 zone default found 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 4 Realm: () 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 4 ZoneGroup: default (deea0f97-f899-4036-a460-801d53f243a7) 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 4 Zone: default (cd69b486-4810-48ae-b5d4-5bce307169d4) 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 zonegroup default 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afdf440 con 0x7f4db8038070 2024-02-15T23:31:11.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:11.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe12c0 con 0x559c2afdc4e0 2024-02-15T23:31:11.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:11.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados->read ofs=0 len=0 2024-02-15T23:31:11.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe1620 con 0x559c2afdc4e0 2024-02-15T23:31:11.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T23:31:11.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 started sync module instance, tier type = 2024-02-15T23:31:11.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 20 started zone id=cd69b486-4810-48ae-b5d4-5bce307169d4 (name=default) with tier type = 2024-02-15T23:31:11.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.623+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe0890 con 0x7f4db8038070 2024-02-15T23:31:11.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.627+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 10 ==== osd_op_reply(44 notify.0 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.627+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94129224551536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe0890 con 0x7f4db8038070 2024-02-15T23:31:11.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.627+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe1f90 con 0x559c2afd61d0 2024-02-15T23:31:11.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.627+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94129224551536] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.627+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 17 ==== osd_op_reply(46 notify.1 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.627+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94129224555552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe0890 con 0x559c2afd61d0 2024-02-15T23:31:11.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.627+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe2950 con 0x559c2afdc4e0 2024-02-15T23:31:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.631+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94129224555552] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.631+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 12 ==== osd_op_reply(48 notify.2 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.631+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94129224549360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe0810 con 0x559c2afdc4e0 2024-02-15T23:31:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.631+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe3680 con 0x7f4db8038070 2024-02-15T23:31:11.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.631+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 12 ==== osd_op_reply(50 notify.3 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.631+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94129224561056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe3ed0 con 0x7f4db8038070 2024-02-15T23:31:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.631+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe48d0 con 0x559c2afd61d0 2024-02-15T23:31:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.635+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94129224549360] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.635+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94129224561056] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.635+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 19 ==== osd_op_reply(52 notify.4 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.635+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94129224565712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe3a30 con 0x559c2afd61d0 2024-02-15T23:31:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.635+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe5120 con 0x7f4db40c6030 2024-02-15T23:31:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.635+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94129224565712] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.639+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 8 ==== osd_op_reply(54 notify.5 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.639+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94129224559872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe3a30 con 0x7f4db40c6030 2024-02-15T23:31:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.639+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe5730 con 0x7f4db40c6030 2024-02-15T23:31:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.639+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94129224559872] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.639+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 10 ==== osd_op_reply(56 notify.6 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.639+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94129224567936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe5730 con 0x7f4db40c6030 2024-02-15T23:31:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.639+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe60a0 con 0x7f4db40c6030 2024-02-15T23:31:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94129224567936] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 12 ==== osd_op_reply(58 notify.7 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94129224569968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe60a0 con 0x7f4db40c6030 2024-02-15T23:31:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 20 add_watcher() i=0 2024-02-15T23:31:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 20 add_watcher() i=1 2024-02-15T23:31:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 20 add_watcher() i=2 2024-02-15T23:31:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 20 add_watcher() i=3 2024-02-15T23:31:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 20 add_watcher() i=4 2024-02-15T23:31:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 20 add_watcher() i=5 2024-02-15T23:31:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 20 add_watcher() i=6 2024-02-15T23:31:11.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94129224569968] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 20 add_watcher() i=7 2024-02-15T23:31:11.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 2 all 8 watchers are set, enabling cache 2024-02-15T23:31:11.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe9490 con 0x559c2afd61d0 2024-02-15T23:31:11.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.643+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94129224572368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe68d0 con 0x559c2afd61d0 2024-02-15T23:31:11.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.647+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94129224572368] v33'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.647+0000 7f4c78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:11.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.647+0000 7f4dc480a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T23:31:11.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.647+0000 7f4dc480a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T23:31:11.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.647+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff1b30 con 0x559c2afd61d0 2024-02-15T23:31:11.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.647+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.647+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff1f70 con 0x7f4db40c6030 2024-02-15T23:31:11.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.651+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'32 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.651+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff24a0 con 0x559c2afdc4e0 2024-02-15T23:31:11.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.651+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.651+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff2e70 con 0x559c2afd61d0 2024-02-15T23:31:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.655+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'241 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.655+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afefad0 con 0x7f4db8038070 2024-02-15T23:31:11.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.655+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'77 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.655+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afefad0 con 0x559c2afdc4e0 2024-02-15T23:31:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.655+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'51 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.655+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff4050 con 0x559c2afd61d0 2024-02-15T23:31:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.659+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'33 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.659+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff4050 con 0x7f4db40c6030 2024-02-15T23:31:11.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.659+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.659+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff4050 con 0x7f4db8038070 2024-02-15T23:31:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.663+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.663+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff4580 con 0x559c2afdc4e0 2024-02-15T23:31:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.663+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.663+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff3fe0 con 0x7f4db8038070 2024-02-15T23:31:11.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.667+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'78 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.667+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff4f50 con 0x7f4db40c6030 2024-02-15T23:31:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.667+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'37 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.667+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff4f50 con 0x7f4db8038070 2024-02-15T23:31:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.667+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.667+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x7f4db40c6030 2024-02-15T23:31:11.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.671+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'57 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.671+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afd61d0 2024-02-15T23:31:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.671+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'242 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.671+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.675+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'71 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.675+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x7f4db8038070 2024-02-15T23:31:11.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.675+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'79 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.675+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.679+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.679+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afd61d0 2024-02-15T23:31:11.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.679+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.679+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afd61d0 2024-02-15T23:31:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.683+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'243 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.683+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.683+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'72 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.683+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x7f4db8038070 2024-02-15T23:31:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.683+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'39 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.683+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.687+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.687+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.687+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'36 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.687+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.687+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'25 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.687+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.691+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'52 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.691+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x7f4db40c6030 2024-02-15T23:31:11.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.691+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.691+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.695+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.695+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x7f4db40c6030 2024-02-15T23:31:11.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.695+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'53 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.695+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x559c2afdc4e0 2024-02-15T23:31:11.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.699+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'73 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.699+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x7f4db40c6030 2024-02-15T23:31:11.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.703+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'58 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x7f4db40c6030 2024-02-15T23:31:11.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.703+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2aff53f0 con 0x7f4db8038070 2024-02-15T23:31:11.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.703+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.703+0000 7f4bf37fe640 20 reqs_thread_entry: start 2024-02-15T23:31:11.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.703+0000 7f4dc480a980 20 init_complete bucket index max shards: 11 2024-02-15T23:31:11.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 20 Filter name: none 2024-02-15T23:31:11.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4bf17fa640 20 reqs_thread_entry: start 2024-02-15T23:31:11.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-02-15T23:31:11.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:94 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 26 ==== osd_op_reply(94 gc.15 [call] v33'74 uv74 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:95 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 27 ==== osd_op_reply(95 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:96 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 28 ==== osd_op_reply(96 gc.15 [call out=24b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:97 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 29 ==== osd_op_reply(97 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:98 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 30 ==== osd_op_reply(98 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.707+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:99 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 31 ==== osd_op_reply(99 gc.15 [call] v33'75 uv75 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-02-15T23:31:11.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:100 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 21 ==== osd_op_reply(100 gc.16 [call] v33'80 uv80 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:101 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 22 ==== osd_op_reply(101 gc.16 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:102 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.711+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 23 ==== osd_op_reply(102 gc.16 [call out=24b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:103 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 24 ==== osd_op_reply(103 gc.16 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:104 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 25 ==== osd_op_reply(104 gc.16 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:105 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 26 ==== osd_op_reply(105 gc.16 [call] v33'81 uv81 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-02-15T23:31:11.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:106 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 32 ==== osd_op_reply(106 gc.17 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.715+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:107 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 33 ==== osd_op_reply(107 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:108 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 34 ==== osd_op_reply(108 gc.17 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:109 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 35 ==== osd_op_reply(109 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:110 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 36 ==== osd_op_reply(110 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:111 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 37 ==== osd_op_reply(111 gc.17 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-02-15T23:31:11.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.719+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:112 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 29 ==== osd_op_reply(112 gc.18 [call] v33'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:113 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 30 ==== osd_op_reply(113 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:114 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afd61d0 2024-02-15T23:31:11.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 31 ==== osd_op_reply(114 gc.18 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db40f2040 con 0x559c2afd61d0 2024-02-15T23:31:11.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:115 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 32 ==== osd_op_reply(115 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:116 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 33 ==== osd_op_reply(116 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.723+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:117 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 34 ==== osd_op_reply(117 gc.18 [call] v33'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-02-15T23:31:11.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:118 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 35 ==== osd_op_reply(118 gc.19 [call] v33'244 uv244 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:119 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 36 ==== osd_op_reply(119 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:120 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afd61d0 2024-02-15T23:31:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 37 ==== osd_op_reply(120 gc.19 [call out=24b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:121 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 38 ==== osd_op_reply(121 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:122 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 39 ==== osd_op_reply(122 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.727+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:123 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 40 ==== osd_op_reply(123 gc.19 [call] v33'245 uv245 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-02-15T23:31:11.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:124 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 38 ==== osd_op_reply(124 gc.20 [call] v33'76 uv76 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:125 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 39 ==== osd_op_reply(125 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:126 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 40 ==== osd_op_reply(126 gc.20 [call out=24b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:127 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 41 ==== osd_op_reply(127 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:128 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 42 ==== osd_op_reply(128 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.731+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:129 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 43 ==== osd_op_reply(129 gc.20 [call] v33'77 uv77 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-02-15T23:31:11.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:130 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 27 ==== osd_op_reply(130 gc.21 [call] v33'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:131 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 28 ==== osd_op_reply(131 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:132 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 29 ==== osd_op_reply(132 gc.21 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.735+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:133 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 30 ==== osd_op_reply(133 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:134 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 31 ==== osd_op_reply(134 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:135 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 32 ==== osd_op_reply(135 gc.21 [call] v33'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-02-15T23:31:11.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:136 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 44 ==== osd_op_reply(136 gc.22 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:137 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 45 ==== osd_op_reply(137 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:138 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 46 ==== osd_op_reply(138 gc.22 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.739+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:139 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 47 ==== osd_op_reply(139 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:140 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 48 ==== osd_op_reply(140 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:141 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 49 ==== osd_op_reply(141 gc.22 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-02-15T23:31:11.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:142 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 50 ==== osd_op_reply(142 gc.23 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:143 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 51 ==== osd_op_reply(143 gc.23 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:144 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.743+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 52 ==== osd_op_reply(144 gc.23 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:145 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 53 ==== osd_op_reply(145 gc.23 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:146 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 54 ==== osd_op_reply(146 gc.23 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:147 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 55 ==== osd_op_reply(147 gc.23 [call] v33'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-02-15T23:31:11.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:148 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 56 ==== osd_op_reply(148 gc.24 [call] v33'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.747+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:149 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 57 ==== osd_op_reply(149 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:150 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 58 ==== osd_op_reply(150 gc.24 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:151 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 59 ==== osd_op_reply(151 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:152 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 60 ==== osd_op_reply(152 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:153 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 61 ==== osd_op_reply(153 gc.24 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-02-15T23:31:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.751+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:154 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 62 ==== osd_op_reply(154 gc.25 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:155 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 63 ==== osd_op_reply(155 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:156 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 64 ==== osd_op_reply(156 gc.25 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:157 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 65 ==== osd_op_reply(157 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:158 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 66 ==== osd_op_reply(158 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:159 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 67 ==== osd_op_reply(159 gc.25 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-02-15T23:31:11.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.755+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:160 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.759+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 21 ==== osd_op_reply(160 gc.26 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.759+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:161 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.759+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 22 ==== osd_op_reply(161 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.759+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.759+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:162 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db40c6030 2024-02-15T23:31:11.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.759+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 23 ==== osd_op_reply(162 gc.26 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.759+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:163 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.763+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 24 ==== osd_op_reply(163 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.763+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.763+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:164 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.763+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 25 ==== osd_op_reply(164 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.763+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.763+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:165 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 26 ==== osd_op_reply(165 gc.26 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-02-15T23:31:11.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:166 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 68 ==== osd_op_reply(166 gc.27 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:167 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 69 ==== osd_op_reply(167 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:168 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 70 ==== osd_op_reply(168 gc.27 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:169 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 71 ==== osd_op_reply(169 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:170 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 72 ==== osd_op_reply(170 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.767+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:171 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.771+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 73 ==== osd_op_reply(171 gc.27 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.771+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-02-15T23:31:11.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.771+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:172 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 27 ==== osd_op_reply(172 gc.28 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:173 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 28 ==== osd_op_reply(173 gc.28 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:174 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db40c6030 2024-02-15T23:31:11.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 29 ==== osd_op_reply(174 gc.28 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:175 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 30 ==== osd_op_reply(175 gc.28 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:176 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 31 ==== osd_op_reply(176 gc.28 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.775+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:177 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.779+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 32 ==== osd_op_reply(177 gc.28 [call] v33'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.779+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.779+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:178 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.779+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 74 ==== osd_op_reply(178 gc.29 [call] v33'78 uv78 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.779+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:179 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.779+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 75 ==== osd_op_reply(179 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.779+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.779+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:180 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 76 ==== osd_op_reply(180 gc.29 [call out=24b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 77 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 78 ==== osd_op_reply(182 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 79 ==== osd_op_reply(183 gc.29 [call] v33'79 uv79 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-02-15T23:31:11.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.783+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.787+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 33 ==== osd_op_reply(184 gc.30 [call] v33'59 uv59 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.787+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.787+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 34 ==== osd_op_reply(185 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.787+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.787+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db40c6030 2024-02-15T23:31:11.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.787+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 35 ==== osd_op_reply(186 gc.30 [call out=24b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.787+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:187 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.791+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 36 ==== osd_op_reply(187 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.791+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.791+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:188 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.791+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 37 ==== osd_op_reply(188 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.791+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.791+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:189 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 38 ==== osd_op_reply(189 gc.30 [call] v33'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-02-15T23:31:11.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:190 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 33 ==== osd_op_reply(190 gc.31 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:191 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 34 ==== osd_op_reply(191 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:192 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 35 ==== osd_op_reply(192 gc.31 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.795+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:193 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 36 ==== osd_op_reply(193 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:194 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 37 ==== osd_op_reply(194 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:195 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 38 ==== osd_op_reply(195 gc.31 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-02-15T23:31:11.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.799+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:196 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 41 ==== osd_op_reply(196 gc.0 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:197 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 42 ==== osd_op_reply(197 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:198 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afd61d0 2024-02-15T23:31:11.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 43 ==== osd_op_reply(198 gc.0 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:199 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 44 ==== osd_op_reply(199 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:200 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 45 ==== osd_op_reply(200 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.803+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:201 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.807+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 46 ==== osd_op_reply(201 gc.0 [call] v33'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.807+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-02-15T23:31:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.807+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:202 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 39 ==== osd_op_reply(202 gc.1 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:203 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 40 ==== osd_op_reply(203 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:204 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db40c6030 2024-02-15T23:31:11.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 41 ==== osd_op_reply(204 gc.1 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:205 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 42 ==== osd_op_reply(205 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.811+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:206 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.815+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 43 ==== osd_op_reply(206 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.815+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.815+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:207 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.815+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 44 ==== osd_op_reply(207 gc.1 [call] v33'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.815+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-02-15T23:31:11.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.815+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:208 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 80 ==== osd_op_reply(208 gc.2 [call] v33'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:209 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 81 ==== osd_op_reply(209 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:210 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 82 ==== osd_op_reply(210 gc.2 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:211 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 83 ==== osd_op_reply(211 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:212 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 84 ==== osd_op_reply(212 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.819+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:213 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 85 ==== osd_op_reply(213 gc.2 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-02-15T23:31:11.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:214 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 47 ==== osd_op_reply(214 gc.3 [call] v33'246 uv246 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:215 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 48 ==== osd_op_reply(215 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:216 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afd61d0 2024-02-15T23:31:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 49 ==== osd_op_reply(216 gc.3 [call out=24b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:217 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 50 ==== osd_op_reply(217 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.823+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:218 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.827+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 51 ==== osd_op_reply(218 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.827+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.827+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:219 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.827+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 52 ==== osd_op_reply(219 gc.3 [call] v33'247 uv247 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.827+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-02-15T23:31:11.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.827+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:220 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 39 ==== osd_op_reply(220 gc.4 [call] v33'82 uv82 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:221 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 40 ==== osd_op_reply(221 gc.4 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:222 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 41 ==== osd_op_reply(222 gc.4 [call out=24b] v0'0 uv82 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:223 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 42 ==== osd_op_reply(223 gc.4 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:224 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 43 ==== osd_op_reply(224 gc.4 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.831+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:225 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.835+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 44 ==== osd_op_reply(225 gc.4 [call] v33'83 uv83 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.835+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-02-15T23:31:11.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.835+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:226 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.835+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 86 ==== osd_op_reply(226 gc.5 [call] v33'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:227 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 87 ==== osd_op_reply(227 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:228 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 88 ==== osd_op_reply(228 gc.5 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:229 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 89 ==== osd_op_reply(229 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:230 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 90 ==== osd_op_reply(230 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:231 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 91 ==== osd_op_reply(231 gc.5 [call] v33'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-02-15T23:31:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.839+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:232 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 53 ==== osd_op_reply(232 gc.6 [call] v33'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:233 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 54 ==== osd_op_reply(233 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:234 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afd61d0 2024-02-15T23:31:11.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 55 ==== osd_op_reply(234 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:235 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 56 ==== osd_op_reply(235 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.843+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:236 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.847+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 57 ==== osd_op_reply(236 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.847+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.847+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:237 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.847+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 58 ==== osd_op_reply(237 gc.6 [call] v33'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.847+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-02-15T23:31:11.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.847+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:238 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.851+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 45 ==== osd_op_reply(238 gc.7 [call] v33'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.851+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:239 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.851+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 46 ==== osd_op_reply(239 gc.7 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.851+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.851+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:240 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db40c6030 2024-02-15T23:31:11.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.851+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 47 ==== osd_op_reply(240 gc.7 [call out=24b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.851+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:241 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 48 ==== osd_op_reply(241 gc.7 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:242 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 49 ==== osd_op_reply(242 gc.7 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:243 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 50 ==== osd_op_reply(243 gc.7 [call] v33'57 uv57 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-02-15T23:31:11.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.855+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:244 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.859+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 45 ==== osd_op_reply(244 gc.8 [call] v33'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.859+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:245 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.859+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 46 ==== osd_op_reply(245 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.859+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.859+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:246 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.859+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 47 ==== osd_op_reply(246 gc.8 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.859+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:247 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.863+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 48 ==== osd_op_reply(247 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.863+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.863+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:248 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.863+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 49 ==== osd_op_reply(248 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.863+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.863+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:249 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.867+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 50 ==== osd_op_reply(249 gc.8 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.867+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-02-15T23:31:11.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.867+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:250 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.867+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 92 ==== osd_op_reply(250 gc.9 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.867+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:251 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.867+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 93 ==== osd_op_reply(251 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.867+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.867+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:252 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afdc4e0 2024-02-15T23:31:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.871+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 94 ==== osd_op_reply(252 gc.9 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.871+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:253 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.871+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 95 ==== osd_op_reply(253 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.871+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.871+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:254 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.871+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 96 ==== osd_op_reply(254 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.871+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.871+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:255 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afdc4e0 2024-02-15T23:31:11.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.875+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 97 ==== osd_op_reply(255 gc.9 [call] v33'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.875+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-02-15T23:31:11.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.875+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:256 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.875+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 51 ==== osd_op_reply(256 gc.10 [call] v33'84 uv84 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.875+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:257 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.875+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 52 ==== osd_op_reply(257 gc.10 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.875+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.875+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:258 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.879+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 53 ==== osd_op_reply(258 gc.10 [call out=24b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.879+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:259 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.879+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 54 ==== osd_op_reply(259 gc.10 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.879+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.879+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:260 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.879+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 55 ==== osd_op_reply(260 gc.10 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.879+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.879+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:261 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.883+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 56 ==== osd_op_reply(261 gc.10 [call] v33'85 uv85 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.883+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-02-15T23:31:11.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.883+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:262 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.883+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 51 ==== osd_op_reply(262 gc.11 [call] v33'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.883+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:263 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 52 ==== osd_op_reply(263 gc.11 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:264 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db40c6030 2024-02-15T23:31:11.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 53 ==== osd_op_reply(264 gc.11 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:265 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 54 ==== osd_op_reply(265 gc.11 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:266 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.887+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 55 ==== osd_op_reply(266 gc.11 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.891+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.891+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:267 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.891+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 56 ==== osd_op_reply(267 gc.11 [call] v33'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.891+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-02-15T23:31:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.891+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:268 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 57 ==== osd_op_reply(268 gc.12 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:269 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 58 ==== osd_op_reply(269 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:270 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db8038070 2024-02-15T23:31:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 59 ==== osd_op_reply(270 gc.12 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:271 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 60 ==== osd_op_reply(271 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.895+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:272 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.899+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 61 ==== osd_op_reply(272 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.899+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.899+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:273 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db8038070 2024-02-15T23:31:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.899+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 62 ==== osd_op_reply(273 gc.12 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.899+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-02-15T23:31:11.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.899+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:274 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.903+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 57 ==== osd_op_reply(274 gc.13 [call] v33'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.903+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:275 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.903+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 58 ==== osd_op_reply(275 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.903+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.903+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:276 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x7f4db40c6030 2024-02-15T23:31:11.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.907+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 59 ==== osd_op_reply(276 gc.13 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.907+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:277 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.907+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 60 ==== osd_op_reply(277 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.907+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.907+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:278 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.907+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 61 ==== osd_op_reply(278 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.907+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.907+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:279 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x7f4db40c6030 2024-02-15T23:31:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.911+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 62 ==== osd_op_reply(279 gc.13 [call] v33'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.911+0000 7f4dc480a980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-02-15T23:31:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.911+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:280 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 59 ==== osd_op_reply(280 gc.14 [call] v33'248 uv248 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:281 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 60 ==== osd_op_reply(281 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:282 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afee400 con 0x559c2afd61d0 2024-02-15T23:31:11.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 61 ==== osd_op_reply(282 gc.14 [call out=24b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:283 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 62 ==== osd_op_reply(283 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T23:31:11.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:284 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 63 ==== osd_op_reply(284 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc480a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T23:31:11.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.915+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:285 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2b010990 con 0x559c2afd61d0 2024-02-15T23:31:11.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.919+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 64 ==== osd_op_reply(285 gc.14 [call] v33'249 uv249 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.923+0000 7f4c78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T23:31:11.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.923+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94129224572368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afd39d0 con 0x559c2afd61d0 2024-02-15T23:31:11.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.923+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 65 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 94129224572368] v33'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.923+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94129224551536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe5da0 con 0x7f4db8038070 2024-02-15T23:31:11.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.927+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 63 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 94129224551536] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.927+0000 7f4dc480a980 20 remove_watcher() i=0 2024-02-15T23:31:11.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.927+0000 7f4dc480a980 2 removed watcher, disabling cache 2024-02-15T23:31:11.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.927+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94129224555552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe0c70 con 0x559c2afd61d0 2024-02-15T23:31:11.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.927+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 66 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 94129224555552] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.927+0000 7f4dc480a980 20 remove_watcher() i=1 2024-02-15T23:31:11.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.927+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94129224549360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe1c20 con 0x559c2afdc4e0 2024-02-15T23:31:11.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.931+0000 7f4dc1b24640 1 -- 172.21.15.133:0/3598459779 <== osd.3 v2:172.21.15.133:6816/1056376173 98 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 94129224549360] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db8022070 con 0x559c2afdc4e0 2024-02-15T23:31:11.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.931+0000 7f4dc480a980 20 remove_watcher() i=2 2024-02-15T23:31:11.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.931+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94129224561056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe03f0 con 0x7f4db8038070 2024-02-15T23:31:11.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.935+0000 7f4dc2b26640 1 -- 172.21.15.133:0/3598459779 <== osd.2 v2:172.21.15.133:6808/3615800201 64 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 94129224561056] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc039060 con 0x7f4db8038070 2024-02-15T23:31:11.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.935+0000 7f4dc480a980 20 remove_watcher() i=3 2024-02-15T23:31:11.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.935+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94129224565712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe03f0 con 0x559c2afd61d0 2024-02-15T23:31:11.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.935+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.1 v2:172.21.15.133:6800/2918336019 67 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 94129224565712] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x559c2afd61d0 2024-02-15T23:31:11.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.935+0000 7f4dc480a980 20 remove_watcher() i=4 2024-02-15T23:31:11.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.935+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94129224559872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe03f0 con 0x7f4db40c6030 2024-02-15T23:31:11.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.939+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 63 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 94129224559872] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.939+0000 7f4dc480a980 20 remove_watcher() i=5 2024-02-15T23:31:11.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.939+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94129224567936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe2d00 con 0x7f4db40c6030 2024-02-15T23:31:11.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 64 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 94129224567936] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 20 remove_watcher() i=6 2024-02-15T23:31:11.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94129224569968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559c2afe03f0 con 0x7f4db40c6030 2024-02-15T23:31:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 <== osd.0 v2:172.21.15.131:6800/31994139 65 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 94129224569968] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40fc040 con 0x7f4db40c6030 2024-02-15T23:31:11.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 20 remove_watcher() i=7 2024-02-15T23:31:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4db40c6030 msgr2=0x7f4db40ce390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f4db40c6030 0x7f4db40ce390 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afd61d0 msgr2=0x559c2afd8690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afd61d0 0x559c2afd8690 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4db8038070 msgr2=0x7f4db802e5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7f4db8038070 0x7f4db802e5f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559c2afdc4e0 msgr2=0x559c2afde930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x559c2afdc4e0 0x559c2afde930 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c8c034300 msgr2=0x7f4c8c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c8c034300 0x7f4c8c0367c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x559c2afa7690 tx=0x7f4dbc020000 comp rx=0 tx=0).stop 2024-02-15T23:31:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc2325640 1 -- 172.21.15.133:0/3598459779 reap_dead start 2024-02-15T23:31:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 msgr2=0x559c2afcabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.943+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afcabf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4db800df80 tx=0x7f4db8049a30 comp rx=0 tx=0).stop 2024-02-15T23:31:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 shutdown_connections 2024-02-15T23:31:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/3598459779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afc3d00 0x559c2afcabf0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 >> 172.21.15.133:0/3598459779 conn(0x559c2afc0090 msgr2=0x559c2afbd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 shutdown_connections 2024-02-15T23:31:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/3598459779 wait complete. 2024-02-15T23:31:11.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/1407461085 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c9c0342b0 msgr2=0x7f4c9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/1407461085 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c9c0342b0 0x7f4c9c036770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x559c2afa75d0 tx=0x7f4dbc005850 comp rx=0 tx=0).stop 2024-02-15T23:31:11.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/1407461085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afb6d80 msgr2=0x559c2afb71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/1407461085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afb6d80 0x559c2afb71a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4db8001ee0 tx=0x7f4db800da30 comp rx=0 tx=0).stop 2024-02-15T23:31:11.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/1407461085 shutdown_connections 2024-02-15T23:31:11.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/1407461085 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4c9c0342b0 0x7f4c9c036770 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/1407461085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2afb6d80 0x559c2afb71a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/1407461085 >> 172.21.15.133:0/1407461085 conn(0x7f4dbc010000 msgr2=0x559c2afaca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/1407461085 shutdown_connections 2024-02-15T23:31:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/1407461085 wait complete. 2024-02-15T23:31:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afa43f0 msgr2=0x559c2afa67e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afa43f0 0x559c2afa67e0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4ca80342b0 msgr2=0x7f4ca8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4ca80342b0 0x7f4ca8036770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4db8000f70 tx=0x7f4db80012c0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab960 msgr2=0x559c2af9f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:11.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab960 0x559c2af9f770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4db401b2c0 tx=0x7f4db4018020 comp rx=0 tx=0).stop 2024-02-15T23:31:11.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 shutdown_connections 2024-02-15T23:31:11.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x559c2afa43f0 0x559c2afa67e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4ca80342b0 0x7f4ca8036770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 --2- 172.21.15.133:0/977821252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c2aeab960 0x559c2af9f770 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:11.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 >> 172.21.15.133:0/977821252 conn(0x559c2aea6910 msgr2=0x559c2af8eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:11.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 shutdown_connections 2024-02-15T23:31:11.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T23:31:11.947+0000 7f4dc480a980 1 -- 172.21.15.133:0/977821252 wait complete. 2024-02-15T23:31:11.973 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-15T23:31:11.983 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-15T23:31:11.983 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:31:12.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdcf18a640 1 Processor -- start 2024-02-15T23:31:12.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdcf18a640 1 -- start start 2024-02-15T23:31:12.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdcf18a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efdc812b000 0x7efdc812b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdcf18a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc8072390 con 0x7efdc806c3f0 2024-02-15T23:31:12.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdcf18a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc809c1e0 con 0x7efdc812b000 2024-02-15T23:31:12.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdccf26640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efdc812b000 0x7efdc812b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdc7fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efdc806c3f0 0x7efdc81210b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36846/0 (socket says 172.21.15.131:36846) 2024-02-15T23:31:12.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdc7fff640 1 -- 172.21.15.131:0/3993718021 learned_addr learned my addr 172.21.15.131:0/3993718021 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:12.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdccf26640 1 -- 172.21.15.131:0/3993718021 >> v1:172.21.15.131:6789/0 conn(0x7efdc806c3f0 legacy=0x7efdc81210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdccf26640 1 -- 172.21.15.131:0/3993718021 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc806d030 con 0x7efdc812b000 2024-02-15T23:31:12.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdc77fe640 1 -- 172.21.15.131:0/3993718021 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233430837 0 0) 0x7efdc8072390 con 0x7efdc806c3f0 2024-02-15T23:31:12.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdccf26640 1 --2- 172.21.15.131:0/3993718021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc812b000 0x7efdc812b3e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009740 tx=0x7efdbc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41586d26a36b8a41 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdc77fe640 1 -- 172.21.15.131:0/3993718021 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdbc0ab530 con 0x7efdc812b000 2024-02-15T23:31:12.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdc77fe640 1 -- 172.21.15.131:0/3993718021 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc0a7050 con 0x7efdc812b000 2024-02-15T23:31:12.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.107+0000 7efdc77fe640 1 -- 172.21.15.131:0/3993718021 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdbc0ab7e0 con 0x7efdc812b000 2024-02-15T23:31:12.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- 172.21.15.131:0/3993718021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc812b000 msgr2=0x7efdc812b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 --2- 172.21.15.131:0/3993718021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc812b000 0x7efdc812b3e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009740 tx=0x7efdbc01c370 comp rx=0 tx=0).stop 2024-02-15T23:31:12.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- 172.21.15.131:0/3993718021 shutdown_connections 2024-02-15T23:31:12.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 --2- 172.21.15.131:0/3993718021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc812b000 0x7efdc812b3e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- 172.21.15.131:0/3993718021 >> 172.21.15.131:0/3993718021 conn(0x7efdc809a2f0 msgr2=0x7efdc809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:12.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- 172.21.15.131:0/3993718021 shutdown_connections 2024-02-15T23:31:12.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- 172.21.15.131:0/3993718021 wait complete. 2024-02-15T23:31:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 Processor -- start 2024-02-15T23:31:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- start start 2024-02-15T23:31:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc806c3f0 0x7efdc81c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8071830 con 0x7efdc806c3f0 2024-02-15T23:31:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdccf26640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc806c3f0 0x7efdc81c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdccf26640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc806c3f0 0x7efdc81c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51144/0 (socket says 172.21.15.131:51144) 2024-02-15T23:31:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdccf26640 1 -- 172.21.15.131:0/3703503529 learned_addr learned my addr 172.21.15.131:0/3703503529 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdccf26640 1 -- 172.21.15.131:0/3703503529 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc009420 con 0x7efdc806c3f0 2024-02-15T23:31:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdccf26640 1 --2- 172.21.15.131:0/3703503529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc806c3f0 0x7efdc81c34a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efdbc018f80 tx=0x7efdbc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdc57fa640 1 -- 172.21.15.131:0/3703503529 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdbc0b7660 con 0x7efdc806c3f0 2024-02-15T23:31:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdc57fa640 1 -- 172.21.15.131:0/3703503529 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc0b77e0 con 0x7efdc806c3f0 2024-02-15T23:31:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc812caf0 con 0x7efdc806c3f0 2024-02-15T23:31:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdc57fa640 1 -- 172.21.15.131:0/3703503529 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdbc0b7ac0 con 0x7efdc806c3f0 2024-02-15T23:31:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc812ce00 con 0x7efdc806c3f0 2024-02-15T23:31:12.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc8067e00 con 0x7efdc806c3f0 2024-02-15T23:31:12.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.111+0000 7efdc57fa640 1 -- 172.21.15.131:0/3703503529 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efdbc0b7c20 con 0x7efdc806c3f0 2024-02-15T23:31:12.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.115+0000 7efdc57fa640 1 --2- 172.21.15.131:0/3703503529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efdb4035a10 0x7efdb4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.115+0000 7efdc57fa640 1 -- 172.21.15.131:0/3703503529 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7efdbc0e3300 con 0x7efdc806c3f0 2024-02-15T23:31:12.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.115+0000 7efdc7fff640 1 --2- 172.21.15.131:0/3703503529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efdb4035a10 0x7efdb4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.115+0000 7efdc7fff640 1 --2- 172.21.15.131:0/3703503529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efdb4035a10 0x7efdb4037ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001570 tx=0x7efdc0007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.119+0000 7efdc57fa640 1 -- 172.21.15.131:0/3703503529 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efdbc0c79f0 con 0x7efdc806c3f0 2024-02-15T23:31:12.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.271+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdc8093e10 con 0x7efdb4035a10 2024-02-15T23:31:12.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.323+0000 7efdc57fa640 1 -- 172.21.15.131:0/3703503529 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673439 (secure 0 0 0) 0x7efdc8093e10 con 0x7efdb4035a10 2024-02-15T23:31:12.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:31:12.345 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:31:12.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efdb4035a10 msgr2=0x7efdb4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 --2- 172.21.15.131:0/3703503529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efdb4035a10 0x7efdb4037ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001570 tx=0x7efdc0007cc0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc806c3f0 msgr2=0x7efdc81c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 --2- 172.21.15.131:0/3703503529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc806c3f0 0x7efdc81c34a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efdbc018f80 tx=0x7efdbc01abb0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 shutdown_connections 2024-02-15T23:31:12.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 --2- 172.21.15.131:0/3703503529 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7efdb4035a10 0x7efdb4037ed0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 --2- 172.21.15.131:0/3703503529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdc806c3f0 0x7efdc81c34a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 >> 172.21.15.131:0/3703503529 conn(0x7efdc809a2f0 msgr2=0x7efdc8094a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:12.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 shutdown_connections 2024-02-15T23:31:12.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.327+0000 7efdcf18a640 1 -- 172.21.15.131:0/3703503529 wait complete. 2024-02-15T23:31:12.354 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-15T23:31:11.540744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1179,"num_objects":-18,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":381,"num_read_kb":364,"num_write":117,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005607"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780958+0000","last_change":"2024-02-15T23:29:29.730549+0000","last_active":"2024-02-15T23:30:10.780958+0000","last_peered":"2024-02-15T23:30:10.780958+0000","last_clean":"2024-02-15T23:30:10.780958+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:30:10.780958+0000","last_undegraded":"2024-02-15T23:30:10.780958+0000","last_fullsized":"2024-02-15T23:30:10.780958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785328+0000","last_change":"2024-02-15T23:29:31.691386+0000","last_active":"2024-02-15T23:30:10.785328+0000","last_peered":"2024-02-15T23:30:10.785328+0000","last_clean":"2024-02-15T23:30:10.785328+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:30:10.785328+0000","last_undegraded":"2024-02-15T23:30:10.785328+0000","last_fullsized":"2024-02-15T23:30:10.785328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790667+0000","last_change":"2024-02-15T23:29:29.719743+0000","last_active":"2024-02-15T23:30:10.790667+0000","last_peered":"2024-02-15T23:30:10.790667+0000","last_clean":"2024-02-15T23:30:10.790667+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:30:10.790667+0000","last_undegraded":"2024-02-15T23:30:10.790667+0000","last_fullsized":"2024-02-15T23:30:10.790667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:39.453929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798345+0000","last_change":"2024-02-15T23:29:31.701574+0000","last_active":"2024-02-15T23:30:10.798345+0000","last_peered":"2024-02-15T23:30:10.798345+0000","last_clean":"2024-02-15T23:30:10.798345+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:30:10.798345+0000","last_undegraded":"2024-02-15T23:30:10.798345+0000","last_fullsized":"2024-02-15T23:30:10.798345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:10.584779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812824+0000","last_change":"2024-02-15T23:29:29.725919+0000","last_active":"2024-02-15T23:30:10.812824+0000","last_peered":"2024-02-15T23:30:10.812824+0000","last_clean":"2024-02-15T23:30:10.812824+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:30:10.812824+0000","last_undegraded":"2024-02-15T23:30:10.812824+0000","last_fullsized":"2024-02-15T23:30:10.812824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:47.717202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806961+0000","last_change":"2024-02-15T23:29:31.701595+0000","last_active":"2024-02-15T23:30:10.806961+0000","last_peered":"2024-02-15T23:30:10.806961+0000","last_clean":"2024-02-15T23:30:10.806961+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:30:10.806961+0000","last_undegraded":"2024-02-15T23:30:10.806961+0000","last_fullsized":"2024-02-15T23:30:10.806961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:22.710710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778727+0000","last_change":"2024-02-15T23:29:29.725199+0000","last_active":"2024-02-15T23:30:10.778727+0000","last_peered":"2024-02-15T23:30:10.778727+0000","last_clean":"2024-02-15T23:30:10.778727+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:30:10.778727+0000","last_undegraded":"2024-02-15T23:30:10.778727+0000","last_fullsized":"2024-02-15T23:30:10.778727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807450+0000","last_change":"2024-02-15T23:29:31.703063+0000","last_active":"2024-02-15T23:30:10.807450+0000","last_peered":"2024-02-15T23:30:10.807450+0000","last_clean":"2024-02-15T23:30:10.807450+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:30:10.807450+0000","last_undegraded":"2024-02-15T23:30:10.807450+0000","last_fullsized":"2024-02-15T23:30:10.807450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:01.557444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805914+0000","last_change":"2024-02-15T23:29:29.710832+0000","last_active":"2024-02-15T23:30:10.805914+0000","last_peered":"2024-02-15T23:30:10.805914+0000","last_clean":"2024-02-15T23:30:10.805914+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:30:10.805914+0000","last_undegraded":"2024-02-15T23:30:10.805914+0000","last_fullsized":"2024-02-15T23:30:10.805914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:40.054442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924941+0000","last_change":"2024-02-15T23:29:31.689546+0000","last_active":"2024-02-15T23:31:03.924941+0000","last_peered":"2024-02-15T23:31:03.924941+0000","last_clean":"2024-02-15T23:31:03.924941+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:03.924941+0000","last_undegraded":"2024-02-15T23:31:03.924941+0000","last_fullsized":"2024-02-15T23:31:03.924941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:35.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777097+0000","last_change":"2024-02-15T23:29:29.729934+0000","last_active":"2024-02-15T23:30:10.777097+0000","last_peered":"2024-02-15T23:30:10.777097+0000","last_clean":"2024-02-15T23:30:10.777097+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:30:10.777097+0000","last_undegraded":"2024-02-15T23:30:10.777097+0000","last_fullsized":"2024-02-15T23:30:10.777097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:51:36.207574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808769+0000","last_change":"2024-02-15T23:29:31.705431+0000","last_active":"2024-02-15T23:30:10.808769+0000","last_peered":"2024-02-15T23:30:10.808769+0000","last_clean":"2024-02-15T23:30:10.808769+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:30:10.808769+0000","last_undegraded":"2024-02-15T23:30:10.808769+0000","last_fullsized":"2024-02-15T23:30:10.808769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:20.343794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795719+0000","last_change":"2024-02-15T23:29:29.707555+0000","last_active":"2024-02-15T23:30:10.795719+0000","last_peered":"2024-02-15T23:30:10.795719+0000","last_clean":"2024-02-15T23:30:10.795719+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:30:10.795719+0000","last_undegraded":"2024-02-15T23:30:10.795719+0000","last_fullsized":"2024-02-15T23:30:10.795719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:50:04.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091130+0000","last_change":"2024-02-15T23:29:31.689285+0000","last_active":"2024-02-15T23:30:15.091130+0000","last_peered":"2024-02-15T23:30:15.091130+0000","last_clean":"2024-02-15T23:30:15.091130+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:30:15.091130+0000","last_undegraded":"2024-02-15T23:30:15.091130+0000","last_fullsized":"2024-02-15T23:30:15.091130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784401+0000","last_change":"2024-02-15T23:29:29.720155+0000","last_active":"2024-02-15T23:30:10.784401+0000","last_peered":"2024-02-15T23:30:10.784401+0000","last_clean":"2024-02-15T23:30:10.784401+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:30:10.784401+0000","last_undegraded":"2024-02-15T23:30:10.784401+0000","last_fullsized":"2024-02-15T23:30:10.784401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784463+0000","last_change":"2024-02-15T23:29:31.711090+0000","last_active":"2024-02-15T23:30:10.784463+0000","last_peered":"2024-02-15T23:30:10.784463+0000","last_clean":"2024-02-15T23:30:10.784463+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:30:10.784463+0000","last_undegraded":"2024-02-15T23:30:10.784463+0000","last_fullsized":"2024-02-15T23:30:10.784463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797604+0000","last_change":"2024-02-15T23:29:31.699913+0000","last_active":"2024-02-15T23:30:10.797604+0000","last_peered":"2024-02-15T23:30:10.797604+0000","last_clean":"2024-02-15T23:30:10.797604+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:30:10.797604+0000","last_undegraded":"2024-02-15T23:30:10.797604+0000","last_fullsized":"2024-02-15T23:30:10.797604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:37.069926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.304267+0000","last_change":"2024-02-15T23:29:29.720102+0000","last_active":"2024-02-15T23:30:58.304267+0000","last_peered":"2024-02-15T23:30:58.304267+0000","last_clean":"2024-02-15T23:30:58.304267+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:30:58.304267+0000","last_undegraded":"2024-02-15T23:30:58.304267+0000","last_fullsized":"2024-02-15T23:30:58.304267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.750065+0000","last_change":"2024-02-15T23:29:31.691136+0000","last_active":"2024-02-15T23:30:14.750065+0000","last_peered":"2024-02-15T23:30:14.750065+0000","last_clean":"2024-02-15T23:30:14.750065+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:30:14.750065+0000","last_undegraded":"2024-02-15T23:30:14.750065+0000","last_fullsized":"2024-02-15T23:30:14.750065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:07.483252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781312+0000","last_change":"2024-02-15T23:29:29.734663+0000","last_active":"2024-02-15T23:30:10.781312+0000","last_peered":"2024-02-15T23:30:10.781312+0000","last_clean":"2024-02-15T23:30:10.781312+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:30:10.781312+0000","last_undegraded":"2024-02-15T23:30:10.781312+0000","last_fullsized":"2024-02-15T23:30:10.781312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924741+0000","last_change":"2024-02-15T23:29:31.689924+0000","last_active":"2024-02-15T23:31:03.924741+0000","last_peered":"2024-02-15T23:31:03.924741+0000","last_clean":"2024-02-15T23:31:03.924741+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:03.924741+0000","last_undegraded":"2024-02-15T23:31:03.924741+0000","last_fullsized":"2024-02-15T23:31:03.924741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:43:45.030558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791227+0000","last_change":"2024-02-15T23:29:29.739167+0000","last_active":"2024-02-15T23:30:10.791227+0000","last_peered":"2024-02-15T23:30:10.791227+0000","last_clean":"2024-02-15T23:30:10.791227+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:30:10.791227+0000","last_undegraded":"2024-02-15T23:30:10.791227+0000","last_fullsized":"2024-02-15T23:30:10.791227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.764985+0000","last_change":"2024-02-15T23:29:31.708859+0000","last_active":"2024-02-15T23:30:14.764985+0000","last_peered":"2024-02-15T23:30:14.764985+0000","last_clean":"2024-02-15T23:30:14.764985+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:30:14.764985+0000","last_undegraded":"2024-02-15T23:30:14.764985+0000","last_fullsized":"2024-02-15T23:30:14.764985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:07.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785957+0000","last_change":"2024-02-15T23:29:29.720464+0000","last_active":"2024-02-15T23:30:10.785957+0000","last_peered":"2024-02-15T23:30:10.785957+0000","last_clean":"2024-02-15T23:30:10.785957+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:30:10.785957+0000","last_undegraded":"2024-02-15T23:30:10.785957+0000","last_fullsized":"2024-02-15T23:30:10.785957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784167+0000","last_change":"2024-02-15T23:29:31.703343+0000","last_active":"2024-02-15T23:30:10.784167+0000","last_peered":"2024-02-15T23:30:10.784167+0000","last_clean":"2024-02-15T23:30:10.784167+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:30:10.784167+0000","last_undegraded":"2024-02-15T23:30:10.784167+0000","last_fullsized":"2024-02-15T23:30:10.784167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:21.379451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787886+0000","last_change":"2024-02-15T23:29:29.719436+0000","last_active":"2024-02-15T23:30:10.787886+0000","last_peered":"2024-02-15T23:30:10.787886+0000","last_clean":"2024-02-15T23:30:10.787886+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:30:10.787886+0000","last_undegraded":"2024-02-15T23:30:10.787886+0000","last_fullsized":"2024-02-15T23:30:10.787886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792681+0000","last_change":"2024-02-15T23:29:31.689367+0000","last_active":"2024-02-15T23:30:10.792681+0000","last_peered":"2024-02-15T23:30:10.792681+0000","last_clean":"2024-02-15T23:30:10.792681+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:30:10.792681+0000","last_undegraded":"2024-02-15T23:30:10.792681+0000","last_fullsized":"2024-02-15T23:30:10.792681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:54:16.380534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.800109+0000","last_change":"2024-02-15T23:29:29.717627+0000","last_active":"2024-02-15T23:30:10.800109+0000","last_peered":"2024-02-15T23:30:10.800109+0000","last_clean":"2024-02-15T23:30:10.800109+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:30:10.800109+0000","last_undegraded":"2024-02-15T23:30:10.800109+0000","last_fullsized":"2024-02-15T23:30:10.800109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:39.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'17","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.908865+0000","last_change":"2024-02-15T23:29:39.766173+0000","last_active":"2024-02-15T23:31:03.908865+0000","last_peered":"2024-02-15T23:31:03.908865+0000","last_clean":"2024-02-15T23:31:03.908865+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:03.908865+0000","last_undegraded":"2024-02-15T23:31:03.908865+0000","last_fullsized":"2024-02-15T23:31:03.908865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809014+0000","last_change":"2024-02-15T23:29:31.703049+0000","last_active":"2024-02-15T23:30:10.809014+0000","last_peered":"2024-02-15T23:30:10.809014+0000","last_clean":"2024-02-15T23:30:10.809014+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:30:10.809014+0000","last_undegraded":"2024-02-15T23:30:10.809014+0000","last_fullsized":"2024-02-15T23:30:10.809014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:58:59.538674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.804971+0000","last_change":"2024-02-15T23:29:29.711609+0000","last_active":"2024-02-15T23:30:10.804971+0000","last_peered":"2024-02-15T23:30:10.804971+0000","last_clean":"2024-02-15T23:30:10.804971+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:30:10.804971+0000","last_undegraded":"2024-02-15T23:30:10.804971+0000","last_fullsized":"2024-02-15T23:30:10.804971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:47.247864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808354+0000","last_change":"2024-02-15T23:29:33.713197+0000","last_active":"2024-02-15T23:30:10.808354+0000","last_peered":"2024-02-15T23:30:10.808354+0000","last_clean":"2024-02-15T23:30:10.808354+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:30:10.808354+0000","last_undegraded":"2024-02-15T23:30:10.808354+0000","last_fullsized":"2024-02-15T23:30:10.808354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:59:23.796227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.274861+0000","last_change":"2024-02-15T23:29:35.748567+0000","last_active":"2024-02-15T23:30:58.274861+0000","last_peered":"2024-02-15T23:30:58.274861+0000","last_clean":"2024-02-15T23:30:58.274861+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:30:58.274861+0000","last_undegraded":"2024-02-15T23:30:58.274861+0000","last_fullsized":"2024-02-15T23:30:58.274861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:00:08.530157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792782+0000","last_change":"2024-02-15T23:29:37.761765+0000","last_active":"2024-02-15T23:30:10.792782+0000","last_peered":"2024-02-15T23:30:10.792782+0000","last_clean":"2024-02-15T23:30:10.792782+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:30:10.792782+0000","last_undegraded":"2024-02-15T23:30:10.792782+0000","last_fullsized":"2024-02-15T23:30:10.792782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:20.640463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.446576+0000","last_change":"2024-02-15T23:29:39.772828+0000","last_active":"2024-02-15T23:30:52.446576+0000","last_peered":"2024-02-15T23:30:52.446576+0000","last_clean":"2024-02-15T23:30:52.446576+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:30:52.446576+0000","last_undegraded":"2024-02-15T23:30:52.446576+0000","last_fullsized":"2024-02-15T23:30:52.446576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:46:46.759299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499588+0000","last_change":"2024-02-15T23:29:31.707498+0000","last_active":"2024-02-15T23:30:57.499588+0000","last_peered":"2024-02-15T23:30:57.499588+0000","last_clean":"2024-02-15T23:30:57.499588+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:30:57.499588+0000","last_undegraded":"2024-02-15T23:30:57.499588+0000","last_fullsized":"2024-02-15T23:30:57.499588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:47.182154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776324+0000","last_change":"2024-02-15T23:29:29.722314+0000","last_active":"2024-02-15T23:30:10.776324+0000","last_peered":"2024-02-15T23:30:10.776324+0000","last_clean":"2024-02-15T23:30:10.776324+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:30:10.776324+0000","last_undegraded":"2024-02-15T23:30:10.776324+0000","last_fullsized":"2024-02-15T23:30:10.776324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785649+0000","last_change":"2024-02-15T23:29:33.707309+0000","last_active":"2024-02-15T23:30:10.785649+0000","last_peered":"2024-02-15T23:30:10.785649+0000","last_clean":"2024-02-15T23:30:10.785649+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:30:10.785649+0000","last_undegraded":"2024-02-15T23:30:10.785649+0000","last_fullsized":"2024-02-15T23:30:10.785649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:38:28.615466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791778+0000","last_change":"2024-02-15T23:29:35.731494+0000","last_active":"2024-02-15T23:30:10.791778+0000","last_peered":"2024-02-15T23:30:10.791778+0000","last_clean":"2024-02-15T23:30:10.791778+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:30:10.791778+0000","last_undegraded":"2024-02-15T23:30:10.791778+0000","last_fullsized":"2024-02-15T23:30:10.791778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:29:30.966627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786144+0000","last_change":"2024-02-15T23:29:37.752102+0000","last_active":"2024-02-15T23:30:10.786144+0000","last_peered":"2024-02-15T23:30:10.786144+0000","last_clean":"2024-02-15T23:30:10.786144+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:30:10.786144+0000","last_undegraded":"2024-02-15T23:30:10.786144+0000","last_fullsized":"2024-02-15T23:30:10.786144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:37.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783801+0000","last_change":"2024-02-15T23:29:39.757721+0000","last_active":"2024-02-15T23:30:10.783801+0000","last_peered":"2024-02-15T23:30:10.783801+0000","last_clean":"2024-02-15T23:30:10.783801+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:30:10.783801+0000","last_undegraded":"2024-02-15T23:30:10.783801+0000","last_fullsized":"2024-02-15T23:30:10.783801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:27.441839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310678+0000","last_change":"2024-02-15T23:29:31.705324+0000","last_active":"2024-02-15T23:30:58.310678+0000","last_peered":"2024-02-15T23:30:58.310678+0000","last_clean":"2024-02-15T23:30:58.310678+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:30:58.310678+0000","last_undegraded":"2024-02-15T23:30:58.310678+0000","last_fullsized":"2024-02-15T23:30:58.310678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:52.531050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795098+0000","last_change":"2024-02-15T23:29:29.728584+0000","last_active":"2024-02-15T23:30:10.795098+0000","last_peered":"2024-02-15T23:30:10.795098+0000","last_clean":"2024-02-15T23:30:10.795098+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:30:10.795098+0000","last_undegraded":"2024-02-15T23:30:10.795098+0000","last_fullsized":"2024-02-15T23:30:10.795098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:16.480977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791658+0000","last_change":"2024-02-15T23:29:33.723876+0000","last_active":"2024-02-15T23:30:10.791658+0000","last_peered":"2024-02-15T23:30:10.791658+0000","last_clean":"2024-02-15T23:30:10.791658+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:30:10.791658+0000","last_undegraded":"2024-02-15T23:30:10.791658+0000","last_fullsized":"2024-02-15T23:30:10.791658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:04.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778396+0000","last_change":"2024-02-15T23:29:35.725059+0000","last_active":"2024-02-15T23:30:10.778396+0000","last_peered":"2024-02-15T23:30:10.778396+0000","last_clean":"2024-02-15T23:30:10.778396+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:30:10.778396+0000","last_undegraded":"2024-02-15T23:30:10.778396+0000","last_fullsized":"2024-02-15T23:30:10.778396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:42.048881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.147419+0000","last_change":"2024-02-15T23:29:37.774111+0000","last_active":"2024-02-15T23:31:04.147419+0000","last_peered":"2024-02-15T23:31:04.147419+0000","last_clean":"2024-02-15T23:31:04.147419+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:04.147419+0000","last_undegraded":"2024-02-15T23:31:04.147419+0000","last_fullsized":"2024-02-15T23:31:04.147419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:25.049564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777264+0000","last_change":"2024-02-15T23:29:39.776305+0000","last_active":"2024-02-15T23:30:10.777264+0000","last_peered":"2024-02-15T23:30:10.777264+0000","last_clean":"2024-02-15T23:30:10.777264+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:30:10.777264+0000","last_undegraded":"2024-02-15T23:30:10.777264+0000","last_fullsized":"2024-02-15T23:30:10.777264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:57.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791795+0000","last_change":"2024-02-15T23:29:31.696768+0000","last_active":"2024-02-15T23:30:10.791795+0000","last_peered":"2024-02-15T23:30:10.791795+0000","last_clean":"2024-02-15T23:30:10.791795+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:30:10.791795+0000","last_undegraded":"2024-02-15T23:30:10.791795+0000","last_fullsized":"2024-02-15T23:30:10.791795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:02.842564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783249+0000","last_change":"2024-02-15T23:29:29.737866+0000","last_active":"2024-02-15T23:30:10.783249+0000","last_peered":"2024-02-15T23:30:10.783249+0000","last_clean":"2024-02-15T23:30:10.783249+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:30:10.783249+0000","last_undegraded":"2024-02-15T23:30:10.783249+0000","last_fullsized":"2024-02-15T23:30:10.783249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:51:36.207574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809941+0000","last_change":"2024-02-15T23:29:33.715302+0000","last_active":"2024-02-15T23:30:10.809941+0000","last_peered":"2024-02-15T23:30:10.809941+0000","last_clean":"2024-02-15T23:30:10.809941+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:30:10.809941+0000","last_undegraded":"2024-02-15T23:30:10.809941+0000","last_fullsized":"2024-02-15T23:30:10.809941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:57.337417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.267498+0000","last_change":"2024-02-15T23:29:35.718792+0000","last_active":"2024-02-15T23:30:58.267498+0000","last_peered":"2024-02-15T23:30:58.267498+0000","last_clean":"2024-02-15T23:30:58.267498+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:30:58.267498+0000","last_undegraded":"2024-02-15T23:30:58.267498+0000","last_fullsized":"2024-02-15T23:30:58.267498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:06.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":330,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.153670+0000","last_change":"2024-02-15T23:29:37.752749+0000","last_active":"2024-02-15T23:31:04.153670+0000","last_peered":"2024-02-15T23:31:04.153670+0000","last_clean":"2024-02-15T23:31:04.153670+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:04.153670+0000","last_undegraded":"2024-02-15T23:31:04.153670+0000","last_fullsized":"2024-02-15T23:31:04.153670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:58.620898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797372+0000","last_change":"2024-02-15T23:29:31.702049+0000","last_active":"2024-02-15T23:30:10.797372+0000","last_peered":"2024-02-15T23:30:10.797372+0000","last_clean":"2024-02-15T23:30:10.797372+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:30:10.797372+0000","last_undegraded":"2024-02-15T23:30:10.797372+0000","last_fullsized":"2024-02-15T23:30:10.797372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:56.628114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780198+0000","last_change":"2024-02-15T23:29:29.731688+0000","last_active":"2024-02-15T23:30:10.780198+0000","last_peered":"2024-02-15T23:30:10.780198+0000","last_clean":"2024-02-15T23:30:10.780198+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:30:10.780198+0000","last_undegraded":"2024-02-15T23:30:10.780198+0000","last_fullsized":"2024-02-15T23:30:10.780198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783045+0000","last_change":"2024-02-15T23:29:33.721207+0000","last_active":"2024-02-15T23:30:10.783045+0000","last_peered":"2024-02-15T23:30:10.783045+0000","last_clean":"2024-02-15T23:30:10.783045+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:30:10.783045+0000","last_undegraded":"2024-02-15T23:30:10.783045+0000","last_fullsized":"2024-02-15T23:30:10.783045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:35.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.280812+0000","last_change":"2024-02-15T23:29:35.722074+0000","last_active":"2024-02-15T23:30:58.280812+0000","last_peered":"2024-02-15T23:30:58.280812+0000","last_clean":"2024-02-15T23:30:58.280812+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:30:58.280812+0000","last_undegraded":"2024-02-15T23:30:58.280812+0000","last_fullsized":"2024-02-15T23:30:58.280812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:37.868310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787088+0000","last_change":"2024-02-15T23:29:37.752862+0000","last_active":"2024-02-15T23:30:10.787088+0000","last_peered":"2024-02-15T23:30:10.787088+0000","last_clean":"2024-02-15T23:30:10.787088+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:30:10.787088+0000","last_undegraded":"2024-02-15T23:30:10.787088+0000","last_fullsized":"2024-02-15T23:30:10.787088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:24.593703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.061346+0000","last_change":"2024-02-15T23:29:39.779875+0000","last_active":"2024-02-15T23:30:58.061346+0000","last_peered":"2024-02-15T23:30:58.061346+0000","last_clean":"2024-02-15T23:30:58.061346+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:30:58.061346+0000","last_undegraded":"2024-02-15T23:30:58.061346+0000","last_fullsized":"2024-02-15T23:30:58.061346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:55.612483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.925206+0000","last_change":"2024-02-15T23:29:31.694940+0000","last_active":"2024-02-15T23:31:03.925206+0000","last_peered":"2024-02-15T23:31:03.925206+0000","last_clean":"2024-02-15T23:31:03.925206+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:31:03.925206+0000","last_undegraded":"2024-02-15T23:31:03.925206+0000","last_fullsized":"2024-02-15T23:31:03.925206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:07.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779830+0000","last_change":"2024-02-15T23:29:29.723619+0000","last_active":"2024-02-15T23:30:10.779830+0000","last_peered":"2024-02-15T23:30:10.779830+0000","last_clean":"2024-02-15T23:30:10.779830+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:30:10.779830+0000","last_undegraded":"2024-02-15T23:30:10.779830+0000","last_fullsized":"2024-02-15T23:30:10.779830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790262+0000","last_change":"2024-02-15T23:30:10.788609+0000","last_active":"2024-02-15T23:30:10.790262+0000","last_peered":"2024-02-15T23:30:10.790262+0000","last_clean":"2024-02-15T23:30:10.790262+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:30:10.790262+0000","last_undegraded":"2024-02-15T23:30:10.790262+0000","last_fullsized":"2024-02-15T23:30:10.790262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:57.337417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.254023+0000","last_change":"2024-02-15T23:29:35.747759+0000","last_active":"2024-02-15T23:30:58.254023+0000","last_peered":"2024-02-15T23:30:58.254023+0000","last_clean":"2024-02-15T23:30:58.254023+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:30:58.254023+0000","last_undegraded":"2024-02-15T23:30:58.254023+0000","last_fullsized":"2024-02-15T23:30:58.254023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:50:15.235598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785044+0000","last_change":"2024-02-15T23:29:37.763519+0000","last_active":"2024-02-15T23:30:10.785044+0000","last_peered":"2024-02-15T23:30:10.785044+0000","last_clean":"2024-02-15T23:30:10.785044+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:30:10.785044+0000","last_undegraded":"2024-02-15T23:30:10.785044+0000","last_fullsized":"2024-02-15T23:30:10.785044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:40.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.305871+0000","last_change":"2024-02-15T23:29:39.781125+0000","last_active":"2024-02-15T23:30:52.305871+0000","last_peered":"2024-02-15T23:30:52.305871+0000","last_clean":"2024-02-15T23:30:52.305871+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:30:52.305871+0000","last_undegraded":"2024-02-15T23:30:52.305871+0000","last_fullsized":"2024-02-15T23:30:52.305871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:11.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.752655+0000","last_change":"2024-02-15T23:29:31.710943+0000","last_active":"2024-02-15T23:30:14.752655+0000","last_peered":"2024-02-15T23:30:14.752655+0000","last_clean":"2024-02-15T23:30:14.752655+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:30:14.752655+0000","last_undegraded":"2024-02-15T23:30:14.752655+0000","last_fullsized":"2024-02-15T23:30:14.752655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:42.071297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810297+0000","last_change":"2024-02-15T23:29:29.725600+0000","last_active":"2024-02-15T23:30:10.810297+0000","last_peered":"2024-02-15T23:30:10.810297+0000","last_clean":"2024-02-15T23:30:10.810297+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:30:10.810297+0000","last_undegraded":"2024-02-15T23:30:10.810297+0000","last_fullsized":"2024-02-15T23:30:10.810297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:05.621720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786043+0000","last_change":"2024-02-15T23:29:33.719603+0000","last_active":"2024-02-15T23:30:10.786043+0000","last_peered":"2024-02-15T23:30:10.786043+0000","last_clean":"2024-02-15T23:30:10.786043+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:30:10.786043+0000","last_undegraded":"2024-02-15T23:30:10.786043+0000","last_fullsized":"2024-02-15T23:30:10.786043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:30:40.574457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'35","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.282736+0000","last_change":"2024-02-15T23:29:35.747042+0000","last_active":"2024-02-15T23:30:58.282736+0000","last_peered":"2024-02-15T23:30:58.282736+0000","last_clean":"2024-02-15T23:30:58.282736+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:30:58.282736+0000","last_undegraded":"2024-02-15T23:30:58.282736+0000","last_fullsized":"2024-02-15T23:30:58.282736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:30.039763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.155605+0000","last_change":"2024-02-15T23:29:37.763712+0000","last_active":"2024-02-15T23:31:04.155605+0000","last_peered":"2024-02-15T23:31:04.155605+0000","last_clean":"2024-02-15T23:31:04.155605+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:04.155605+0000","last_undegraded":"2024-02-15T23:31:04.155605+0000","last_fullsized":"2024-02-15T23:31:04.155605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:37.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.440803+0000","last_change":"2024-02-15T23:29:39.784076+0000","last_active":"2024-02-15T23:30:52.440803+0000","last_peered":"2024-02-15T23:30:52.440803+0000","last_clean":"2024-02-15T23:30:52.440803+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:30:52.440803+0000","last_undegraded":"2024-02-15T23:30:52.440803+0000","last_fullsized":"2024-02-15T23:30:52.440803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:20.743271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780987+0000","last_change":"2024-02-15T23:29:31.682141+0000","last_active":"2024-02-15T23:30:10.780987+0000","last_peered":"2024-02-15T23:30:10.780987+0000","last_clean":"2024-02-15T23:30:10.780987+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:30:10.780987+0000","last_undegraded":"2024-02-15T23:30:10.780987+0000","last_fullsized":"2024-02-15T23:30:10.780987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:04.855243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807634+0000","last_change":"2024-02-15T23:29:29.717855+0000","last_active":"2024-02-15T23:30:10.807634+0000","last_peered":"2024-02-15T23:30:10.807634+0000","last_clean":"2024-02-15T23:30:10.807634+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:30:10.807634+0000","last_undegraded":"2024-02-15T23:30:10.807634+0000","last_fullsized":"2024-02-15T23:30:10.807634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:52.833533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786259+0000","last_change":"2024-02-15T23:29:33.726139+0000","last_active":"2024-02-15T23:30:10.786259+0000","last_peered":"2024-02-15T23:30:10.786259+0000","last_clean":"2024-02-15T23:30:10.786259+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:30:10.786259+0000","last_undegraded":"2024-02-15T23:30:10.786259+0000","last_fullsized":"2024-02-15T23:30:10.786259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:53.253439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.867714+0000","last_change":"2024-02-15T23:29:35.749140+0000","last_active":"2024-02-15T23:31:03.867714+0000","last_peered":"2024-02-15T23:31:03.867714+0000","last_clean":"2024-02-15T23:31:03.867714+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:03.867714+0000","last_undegraded":"2024-02-15T23:31:03.867714+0000","last_fullsized":"2024-02-15T23:31:03.867714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:54:44.162530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784051+0000","last_change":"2024-02-15T23:29:37.740778+0000","last_active":"2024-02-15T23:30:10.784051+0000","last_peered":"2024-02-15T23:30:10.784051+0000","last_clean":"2024-02-15T23:30:10.784051+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:30:10.784051+0000","last_undegraded":"2024-02-15T23:30:10.784051+0000","last_fullsized":"2024-02-15T23:30:10.784051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:26:31.398449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.788113+0000","last_change":"2024-02-15T23:29:39.766366+0000","last_active":"2024-02-15T23:30:10.788113+0000","last_peered":"2024-02-15T23:30:10.788113+0000","last_clean":"2024-02-15T23:30:10.788113+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:30:10.788113+0000","last_undegraded":"2024-02-15T23:30:10.788113+0000","last_fullsized":"2024-02-15T23:30:10.788113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:29.582392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.763860+0000","last_change":"2024-02-15T23:30:10.801846+0000","last_active":"2024-02-15T23:30:15.763860+0000","last_peered":"2024-02-15T23:30:15.763860+0000","last_clean":"2024-02-15T23:30:15.763860+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:30:15.763860+0000","last_undegraded":"2024-02-15T23:30:15.763860+0000","last_fullsized":"2024-02-15T23:30:15.763860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:53:52.065139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.506655+0000","last_change":"2024-02-15T23:29:29.716793+0000","last_active":"2024-02-15T23:30:57.506655+0000","last_peered":"2024-02-15T23:30:57.506655+0000","last_clean":"2024-02-15T23:30:57.506655+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:30:57.506655+0000","last_undegraded":"2024-02-15T23:30:57.506655+0000","last_fullsized":"2024-02-15T23:30:57.506655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780151+0000","last_change":"2024-02-15T23:29:33.705063+0000","last_active":"2024-02-15T23:30:10.780151+0000","last_peered":"2024-02-15T23:30:10.780151+0000","last_clean":"2024-02-15T23:30:10.780151+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:30:10.780151+0000","last_undegraded":"2024-02-15T23:30:10.780151+0000","last_fullsized":"2024-02-15T23:30:10.780151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:20.311560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'32","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.870129+0000","last_change":"2024-02-15T23:29:35.728175+0000","last_active":"2024-02-15T23:31:03.870129+0000","last_peered":"2024-02-15T23:31:03.870129+0000","last_clean":"2024-02-15T23:31:03.870129+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:03.870129+0000","last_undegraded":"2024-02-15T23:31:03.870129+0000","last_fullsized":"2024-02-15T23:31:03.870129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:32.708804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812233+0000","last_change":"2024-02-15T23:29:37.772409+0000","last_active":"2024-02-15T23:30:10.812233+0000","last_peered":"2024-02-15T23:30:10.812233+0000","last_clean":"2024-02-15T23:30:10.812233+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:30:10.812233+0000","last_undegraded":"2024-02-15T23:30:10.812233+0000","last_fullsized":"2024-02-15T23:30:10.812233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:31.227259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794250+0000","last_change":"2024-02-15T23:29:39.775394+0000","last_active":"2024-02-15T23:30:10.794250+0000","last_peered":"2024-02-15T23:30:10.794250+0000","last_clean":"2024-02-15T23:30:10.794250+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:30:10.794250+0000","last_undegraded":"2024-02-15T23:30:10.794250+0000","last_fullsized":"2024-02-15T23:30:10.794250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:42.665101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310584+0000","last_change":"2024-02-15T23:29:31.709643+0000","last_active":"2024-02-15T23:30:58.310584+0000","last_peered":"2024-02-15T23:30:58.310584+0000","last_clean":"2024-02-15T23:30:58.310584+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:30:58.310584+0000","last_undegraded":"2024-02-15T23:30:58.310584+0000","last_fullsized":"2024-02-15T23:30:58.310584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:34:14.575064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807250+0000","last_change":"2024-02-15T23:29:29.725808+0000","last_active":"2024-02-15T23:30:10.807250+0000","last_peered":"2024-02-15T23:30:10.807250+0000","last_clean":"2024-02-15T23:30:10.807250+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:30:10.807250+0000","last_undegraded":"2024-02-15T23:30:10.807250+0000","last_fullsized":"2024-02-15T23:30:10.807250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:52.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785684+0000","last_change":"2024-02-15T23:29:33.719257+0000","last_active":"2024-02-15T23:30:10.785684+0000","last_peered":"2024-02-15T23:30:10.785684+0000","last_clean":"2024-02-15T23:30:10.785684+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:30:10.785684+0000","last_undegraded":"2024-02-15T23:30:10.785684+0000","last_fullsized":"2024-02-15T23:30:10.785684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:38.251929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.295841+0000","last_change":"2024-02-15T23:29:35.714372+0000","last_active":"2024-02-15T23:30:58.295841+0000","last_peered":"2024-02-15T23:30:58.295841+0000","last_clean":"2024-02-15T23:30:58.295841+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:30:58.295841+0000","last_undegraded":"2024-02-15T23:30:58.295841+0000","last_fullsized":"2024-02-15T23:30:58.295841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:41.100143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":332,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.148483+0000","last_change":"2024-02-15T23:29:37.751264+0000","last_active":"2024-02-15T23:31:04.148483+0000","last_peered":"2024-02-15T23:31:04.148483+0000","last_clean":"2024-02-15T23:31:04.148483+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:04.148483+0000","last_undegraded":"2024-02-15T23:31:04.148483+0000","last_fullsized":"2024-02-15T23:31:04.148483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:53.228345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.326564+0000","last_change":"2024-02-15T23:29:39.757713+0000","last_active":"2024-02-15T23:30:58.326564+0000","last_peered":"2024-02-15T23:30:58.326564+0000","last_clean":"2024-02-15T23:30:58.326564+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:30:58.326564+0000","last_undegraded":"2024-02-15T23:30:58.326564+0000","last_fullsized":"2024-02-15T23:30:58.326564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:40.849035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780839+0000","last_change":"2024-02-15T23:29:31.706992+0000","last_active":"2024-02-15T23:30:10.780839+0000","last_peered":"2024-02-15T23:30:10.780839+0000","last_clean":"2024-02-15T23:30:10.780839+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:30:10.780839+0000","last_undegraded":"2024-02-15T23:30:10.780839+0000","last_fullsized":"2024-02-15T23:30:10.780839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798403+0000","last_change":"2024-02-15T23:29:29.720429+0000","last_active":"2024-02-15T23:30:10.798403+0000","last_peered":"2024-02-15T23:30:10.798403+0000","last_clean":"2024-02-15T23:30:10.798403+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:30:10.798403+0000","last_undegraded":"2024-02-15T23:30:10.798403+0000","last_fullsized":"2024-02-15T23:30:10.798403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:55.269267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:05.011086+0000","last_change":"2024-02-15T23:29:33.721567+0000","last_active":"2024-02-15T23:31:05.011086+0000","last_peered":"2024-02-15T23:31:05.011086+0000","last_clean":"2024-02-15T23:31:05.011086+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:05.011086+0000","last_undegraded":"2024-02-15T23:31:05.011086+0000","last_fullsized":"2024-02-15T23:31:05.011086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:24.723502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809385+0000","last_change":"2024-02-15T23:29:35.750907+0000","last_active":"2024-02-15T23:30:10.809385+0000","last_peered":"2024-02-15T23:30:10.809385+0000","last_clean":"2024-02-15T23:30:10.809385+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:30:10.809385+0000","last_undegraded":"2024-02-15T23:30:10.809385+0000","last_fullsized":"2024-02-15T23:30:10.809385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:51.904115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":375,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.150823+0000","last_change":"2024-02-15T23:29:37.734243+0000","last_active":"2024-02-15T23:31:04.150823+0000","last_peered":"2024-02-15T23:31:04.150823+0000","last_clean":"2024-02-15T23:31:04.150823+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:04.150823+0000","last_undegraded":"2024-02-15T23:31:04.150823+0000","last_fullsized":"2024-02-15T23:31:04.150823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:24.593703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780732+0000","last_change":"2024-02-15T23:29:39.767850+0000","last_active":"2024-02-15T23:30:10.780732+0000","last_peered":"2024-02-15T23:30:10.780732+0000","last_clean":"2024-02-15T23:30:10.780732+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:30:10.780732+0000","last_undegraded":"2024-02-15T23:30:10.780732+0000","last_fullsized":"2024-02-15T23:30:10.780732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:09:53.270028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310285+0000","last_change":"2024-02-15T23:29:31.710143+0000","last_active":"2024-02-15T23:30:58.310285+0000","last_peered":"2024-02-15T23:30:58.310285+0000","last_clean":"2024-02-15T23:30:58.310285+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:30:58.310285+0000","last_undegraded":"2024-02-15T23:30:58.310285+0000","last_fullsized":"2024-02-15T23:30:58.310285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:33:08.745254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796597+0000","last_change":"2024-02-15T23:29:29.724689+0000","last_active":"2024-02-15T23:30:10.796597+0000","last_peered":"2024-02-15T23:30:10.796597+0000","last_clean":"2024-02-15T23:30:10.796597+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:30:10.796597+0000","last_undegraded":"2024-02-15T23:30:10.796597+0000","last_fullsized":"2024-02-15T23:30:10.796597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:26.315905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810239+0000","last_change":"2024-02-15T23:29:33.716469+0000","last_active":"2024-02-15T23:30:10.810239+0000","last_peered":"2024-02-15T23:30:10.810239+0000","last_clean":"2024-02-15T23:30:10.810239+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:30:10.810239+0000","last_undegraded":"2024-02-15T23:30:10.810239+0000","last_fullsized":"2024-02-15T23:30:10.810239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:04.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.276589+0000","last_change":"2024-02-15T23:29:35.730918+0000","last_active":"2024-02-15T23:30:58.276589+0000","last_peered":"2024-02-15T23:30:58.276589+0000","last_clean":"2024-02-15T23:30:58.276589+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:30:58.276589+0000","last_undegraded":"2024-02-15T23:30:58.276589+0000","last_fullsized":"2024-02-15T23:30:58.276589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:34:18.605282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778025+0000","last_change":"2024-02-15T23:29:37.767166+0000","last_active":"2024-02-15T23:30:10.778025+0000","last_peered":"2024-02-15T23:30:10.778025+0000","last_clean":"2024-02-15T23:30:10.778025+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:30:10.778025+0000","last_undegraded":"2024-02-15T23:30:10.778025+0000","last_fullsized":"2024-02-15T23:30:10.778025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:01.461141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783831+0000","last_change":"2024-02-15T23:29:39.756802+0000","last_active":"2024-02-15T23:30:10.783831+0000","last_peered":"2024-02-15T23:30:10.783831+0000","last_clean":"2024-02-15T23:30:10.783831+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:30:10.783831+0000","last_undegraded":"2024-02-15T23:30:10.783831+0000","last_fullsized":"2024-02-15T23:30:10.783831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:27.441839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310387+0000","last_change":"2024-02-15T23:29:31.709063+0000","last_active":"2024-02-15T23:30:58.310387+0000","last_peered":"2024-02-15T23:30:58.310387+0000","last_clean":"2024-02-15T23:30:58.310387+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:30:58.310387+0000","last_undegraded":"2024-02-15T23:30:58.310387+0000","last_fullsized":"2024-02-15T23:30:58.310387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:15.455104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782126+0000","last_change":"2024-02-15T23:29:17.391071+0000","last_active":"2024-02-15T23:30:10.782126+0000","last_peered":"2024-02-15T23:30:10.782126+0000","last_clean":"2024-02-15T23:30:10.782126+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:30:10.782126+0000","last_undegraded":"2024-02-15T23:30:10.782126+0000","last_fullsized":"2024-02-15T23:30:10.782126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_clean_scrub_stamp":"2024-02-15T23:29:15.580621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:00.893203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806662+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:30:10.806662+0000","last_peered":"2024-02-15T23:30:10.806662+0000","last_clean":"2024-02-15T23:30:10.806662+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:30:10.806662+0000","last_undegraded":"2024-02-15T23:30:10.806662+0000","last_fullsized":"2024-02-15T23:30:10.806662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:31:39.646588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.916327+0000","last_change":"2024-02-15T23:29:29.725524+0000","last_active":"2024-02-15T23:31:03.916327+0000","last_peered":"2024-02-15T23:31:03.916327+0000","last_clean":"2024-02-15T23:31:03.916327+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:31:03.916327+0000","last_undegraded":"2024-02-15T23:31:03.916327+0000","last_fullsized":"2024-02-15T23:31:03.916327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:58.815157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.801490+0000","last_change":"2024-02-15T23:30:10.801490+0000","last_active":"2024-02-15T23:30:10.801490+0000","last_peered":"2024-02-15T23:30:10.801490+0000","last_clean":"2024-02-15T23:30:10.801490+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:30:10.801490+0000","last_undegraded":"2024-02-15T23:30:10.801490+0000","last_fullsized":"2024-02-15T23:30:10.801490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:55:48.775082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.890716+0000","last_change":"2024-02-15T23:29:35.746233+0000","last_active":"2024-02-15T23:31:03.890716+0000","last_peered":"2024-02-15T23:31:03.890716+0000","last_clean":"2024-02-15T23:31:03.890716+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:03.890716+0000","last_undegraded":"2024-02-15T23:31:03.890716+0000","last_fullsized":"2024-02-15T23:31:03.890716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:56:17.988220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787880+0000","last_change":"2024-02-15T23:29:37.764075+0000","last_active":"2024-02-15T23:30:10.787880+0000","last_peered":"2024-02-15T23:30:10.787880+0000","last_clean":"2024-02-15T23:30:10.787880+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:30:10.787880+0000","last_undegraded":"2024-02-15T23:30:10.787880+0000","last_fullsized":"2024-02-15T23:30:10.787880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:59:27.829626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.943862+0000","last_change":"2024-02-15T23:29:39.777587+0000","last_active":"2024-02-15T23:31:03.943862+0000","last_peered":"2024-02-15T23:31:03.943862+0000","last_clean":"2024-02-15T23:31:03.943862+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:31:03.943862+0000","last_undegraded":"2024-02-15T23:31:03.943862+0000","last_fullsized":"2024-02-15T23:31:03.943862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:50.335386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'13","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499841+0000","last_change":"2024-02-15T23:29:31.705098+0000","last_active":"2024-02-15T23:30:57.499841+0000","last_peered":"2024-02-15T23:30:57.499841+0000","last_clean":"2024-02-15T23:30:57.499841+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:30:57.499841+0000","last_undegraded":"2024-02-15T23:30:57.499841+0000","last_fullsized":"2024-02-15T23:30:57.499841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:15.615348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795289+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:30:10.795289+0000","last_peered":"2024-02-15T23:30:10.795289+0000","last_clean":"2024-02-15T23:30:10.795289+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:30:10.795289+0000","last_undegraded":"2024-02-15T23:30:10.795289+0000","last_fullsized":"2024-02-15T23:30:10.795289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:26.706393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.062516+0000","last_change":"2024-02-15T23:29:29.708594+0000","last_active":"2024-02-15T23:30:15.062516+0000","last_peered":"2024-02-15T23:30:15.062516+0000","last_clean":"2024-02-15T23:30:15.062516+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:30:15.062516+0000","last_undegraded":"2024-02-15T23:30:15.062516+0000","last_fullsized":"2024-02-15T23:30:15.062516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812552+0000","last_change":"2024-02-15T23:29:33.716868+0000","last_active":"2024-02-15T23:30:10.812552+0000","last_peered":"2024-02-15T23:30:10.812552+0000","last_clean":"2024-02-15T23:30:10.812552+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:30:10.812552+0000","last_undegraded":"2024-02-15T23:30:10.812552+0000","last_fullsized":"2024-02-15T23:30:10.812552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:53:54.077930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.142415+0000","last_change":"2024-02-15T23:29:35.724256+0000","last_active":"2024-02-15T23:31:04.142415+0000","last_peered":"2024-02-15T23:31:04.142415+0000","last_clean":"2024-02-15T23:31:04.142415+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:04.142415+0000","last_undegraded":"2024-02-15T23:31:04.142415+0000","last_fullsized":"2024-02-15T23:31:04.142415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:05.587661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807241+0000","last_change":"2024-02-15T23:29:37.769851+0000","last_active":"2024-02-15T23:30:10.807241+0000","last_peered":"2024-02-15T23:30:10.807241+0000","last_clean":"2024-02-15T23:30:10.807241+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:30:10.807241+0000","last_undegraded":"2024-02-15T23:30:10.807241+0000","last_fullsized":"2024-02-15T23:30:10.807241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:49.141465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.462247+0000","last_change":"2024-02-15T23:29:39.779672+0000","last_active":"2024-02-15T23:30:52.462247+0000","last_peered":"2024-02-15T23:30:52.462247+0000","last_clean":"2024-02-15T23:30:52.462247+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:30:52.462247+0000","last_undegraded":"2024-02-15T23:30:52.462247+0000","last_fullsized":"2024-02-15T23:30:52.462247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:40.849035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924349+0000","last_change":"2024-02-15T23:29:31.694236+0000","last_active":"2024-02-15T23:31:03.924349+0000","last_peered":"2024-02-15T23:31:03.924349+0000","last_clean":"2024-02-15T23:31:03.924349+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:03.924349+0000","last_undegraded":"2024-02-15T23:31:03.924349+0000","last_fullsized":"2024-02-15T23:31:03.924349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:49.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777472+0000","last_change":"2024-02-15T23:29:21.622454+0000","last_active":"2024-02-15T23:30:10.777472+0000","last_peered":"2024-02-15T23:30:10.777472+0000","last_clean":"2024-02-15T23:30:10.777472+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:30:10.777472+0000","last_undegraded":"2024-02-15T23:30:10.777472+0000","last_fullsized":"2024-02-15T23:30:10.777472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:05.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783297+0000","last_change":"2024-02-15T23:29:29.718869+0000","last_active":"2024-02-15T23:30:10.783297+0000","last_peered":"2024-02-15T23:30:10.783297+0000","last_clean":"2024-02-15T23:30:10.783297+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:30:10.783297+0000","last_undegraded":"2024-02-15T23:30:10.783297+0000","last_fullsized":"2024-02-15T23:30:10.783297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778385+0000","last_change":"2024-02-15T23:29:33.703250+0000","last_active":"2024-02-15T23:30:10.778385+0000","last_peered":"2024-02-15T23:30:10.778385+0000","last_clean":"2024-02-15T23:30:10.778385+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:30:10.778385+0000","last_undegraded":"2024-02-15T23:30:10.778385+0000","last_fullsized":"2024-02-15T23:30:10.778385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:03.717928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.825449+0000","last_change":"2024-02-15T23:29:35.732833+0000","last_active":"2024-02-15T23:31:03.825449+0000","last_peered":"2024-02-15T23:31:03.825449+0000","last_clean":"2024-02-15T23:31:03.825449+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:03.825449+0000","last_undegraded":"2024-02-15T23:31:03.825449+0000","last_fullsized":"2024-02-15T23:31:03.825449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:23.890835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786334+0000","last_change":"2024-02-15T23:29:37.764209+0000","last_active":"2024-02-15T23:30:10.786334+0000","last_peered":"2024-02-15T23:30:10.786334+0000","last_clean":"2024-02-15T23:30:10.786334+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:30:10.786334+0000","last_undegraded":"2024-02-15T23:30:10.786334+0000","last_fullsized":"2024-02-15T23:30:10.786334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:08.422824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798630+0000","last_change":"2024-02-15T23:29:39.769538+0000","last_active":"2024-02-15T23:30:10.798630+0000","last_peered":"2024-02-15T23:30:10.798630+0000","last_clean":"2024-02-15T23:30:10.798630+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:30:10.798630+0000","last_undegraded":"2024-02-15T23:30:10.798630+0000","last_fullsized":"2024-02-15T23:30:10.798630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:03.906467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924601+0000","last_change":"2024-02-15T23:29:31.691195+0000","last_active":"2024-02-15T23:31:03.924601+0000","last_peered":"2024-02-15T23:31:03.924601+0000","last_clean":"2024-02-15T23:31:03.924601+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:03.924601+0000","last_undegraded":"2024-02-15T23:31:03.924601+0000","last_fullsized":"2024-02-15T23:31:03.924601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799199+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:30:10.799199+0000","last_peered":"2024-02-15T23:30:10.799199+0000","last_clean":"2024-02-15T23:30:10.799199+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:30:10.799199+0000","last_undegraded":"2024-02-15T23:30:10.799199+0000","last_fullsized":"2024-02-15T23:30:10.799199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:56.631774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780471+0000","last_change":"2024-02-15T23:29:29.721410+0000","last_active":"2024-02-15T23:30:10.780471+0000","last_peered":"2024-02-15T23:30:10.780471+0000","last_clean":"2024-02-15T23:30:10.780471+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:30:10.780471+0000","last_undegraded":"2024-02-15T23:30:10.780471+0000","last_fullsized":"2024-02-15T23:30:10.780471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787055+0000","last_change":"2024-02-15T23:29:33.720740+0000","last_active":"2024-02-15T23:30:10.787055+0000","last_peered":"2024-02-15T23:30:10.787055+0000","last_clean":"2024-02-15T23:30:10.787055+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:30:10.787055+0000","last_undegraded":"2024-02-15T23:30:10.787055+0000","last_fullsized":"2024-02-15T23:30:10.787055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:35.850884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809861+0000","last_change":"2024-02-15T23:29:35.749663+0000","last_active":"2024-02-15T23:30:10.809861+0000","last_peered":"2024-02-15T23:30:10.809861+0000","last_clean":"2024-02-15T23:30:10.809861+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:30:10.809861+0000","last_undegraded":"2024-02-15T23:30:10.809861+0000","last_fullsized":"2024-02-15T23:30:10.809861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:55:50.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813015+0000","last_change":"2024-02-15T23:29:37.774191+0000","last_active":"2024-02-15T23:30:10.813015+0000","last_peered":"2024-02-15T23:30:10.813015+0000","last_clean":"2024-02-15T23:30:10.813015+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:30:10.813015+0000","last_undegraded":"2024-02-15T23:30:10.813015+0000","last_fullsized":"2024-02-15T23:30:10.813015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:22.178611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781801+0000","last_change":"2024-02-15T23:29:39.768032+0000","last_active":"2024-02-15T23:30:10.781801+0000","last_peered":"2024-02-15T23:30:10.781801+0000","last_clean":"2024-02-15T23:30:10.781801+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:30:10.781801+0000","last_undegraded":"2024-02-15T23:30:10.781801+0000","last_fullsized":"2024-02-15T23:30:10.781801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:25.706705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'11","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310331+0000","last_change":"2024-02-15T23:30:10.810101+0000","last_active":"2024-02-15T23:30:58.310331+0000","last_peered":"2024-02-15T23:30:58.310331+0000","last_clean":"2024-02-15T23:30:58.310331+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:30:58.310331+0000","last_undegraded":"2024-02-15T23:30:58.310331+0000","last_fullsized":"2024-02-15T23:30:58.310331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:00:04.499939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.071222+0000","last_change":"2024-02-15T23:29:29.733697+0000","last_active":"2024-02-15T23:30:15.071222+0000","last_peered":"2024-02-15T23:30:15.071222+0000","last_clean":"2024-02-15T23:30:15.071222+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:30:15.071222+0000","last_undegraded":"2024-02-15T23:30:15.071222+0000","last_fullsized":"2024-02-15T23:30:15.071222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786022+0000","last_change":"2024-02-15T23:29:21.627861+0000","last_active":"2024-02-15T23:30:10.786022+0000","last_peered":"2024-02-15T23:30:10.786022+0000","last_clean":"2024-02-15T23:30:10.786022+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:30:10.786022+0000","last_undegraded":"2024-02-15T23:30:10.786022+0000","last_fullsized":"2024-02-15T23:30:10.786022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:25:07.064306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.803638+0000","last_change":"2024-02-15T23:30:10.801694+0000","last_active":"2024-02-15T23:30:10.803638+0000","last_peered":"2024-02-15T23:30:10.803638+0000","last_clean":"2024-02-15T23:30:10.803638+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:30:10.803638+0000","last_undegraded":"2024-02-15T23:30:10.803638+0000","last_fullsized":"2024-02-15T23:30:10.803638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:04.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'56","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.879873+0000","last_change":"2024-02-15T23:29:35.740917+0000","last_active":"2024-02-15T23:31:03.879873+0000","last_peered":"2024-02-15T23:31:03.879873+0000","last_clean":"2024-02-15T23:31:03.879873+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:03.879873+0000","last_undegraded":"2024-02-15T23:31:03.879873+0000","last_fullsized":"2024-02-15T23:31:03.879873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:24.374012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.775299+0000","last_change":"2024-02-15T23:29:37.751356+0000","last_active":"2024-02-15T23:30:10.775299+0000","last_peered":"2024-02-15T23:30:10.775299+0000","last_clean":"2024-02-15T23:30:10.775299+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:30:10.775299+0000","last_undegraded":"2024-02-15T23:30:10.775299+0000","last_fullsized":"2024-02-15T23:30:10.775299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:21.661539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.296729+0000","last_change":"2024-02-15T23:29:39.767710+0000","last_active":"2024-02-15T23:30:58.296729+0000","last_peered":"2024-02-15T23:30:58.296729+0000","last_clean":"2024-02-15T23:30:58.296729+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:30:58.296729+0000","last_undegraded":"2024-02-15T23:30:58.296729+0000","last_fullsized":"2024-02-15T23:30:58.296729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:31:07.642735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.804317+0000","last_change":"2024-02-15T23:30:10.804317+0000","last_active":"2024-02-15T23:30:10.804317+0000","last_peered":"2024-02-15T23:30:10.804317+0000","last_clean":"2024-02-15T23:30:10.804317+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:30:10.804317+0000","last_undegraded":"2024-02-15T23:30:10.804317+0000","last_fullsized":"2024-02-15T23:30:10.804317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:30:30.019018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786948+0000","last_change":"2024-02-15T23:29:29.717068+0000","last_active":"2024-02-15T23:30:10.786948+0000","last_peered":"2024-02-15T23:30:10.786948+0000","last_clean":"2024-02-15T23:30:10.786948+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:30:10.786948+0000","last_undegraded":"2024-02-15T23:30:10.786948+0000","last_fullsized":"2024-02-15T23:30:10.786948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809253+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:30:10.809253+0000","last_peered":"2024-02-15T23:30:10.809253+0000","last_clean":"2024-02-15T23:30:10.809253+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:30:10.809253+0000","last_undegraded":"2024-02-15T23:30:10.809253+0000","last_fullsized":"2024-02-15T23:30:10.809253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:34.783207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798441+0000","last_change":"2024-02-15T23:29:33.715626+0000","last_active":"2024-02-15T23:30:10.798441+0000","last_peered":"2024-02-15T23:30:10.798441+0000","last_clean":"2024-02-15T23:30:10.798441+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:30:10.798441+0000","last_undegraded":"2024-02-15T23:30:10.798441+0000","last_fullsized":"2024-02-15T23:30:10.798441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:20.560304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783406+0000","last_change":"2024-02-15T23:29:35.733356+0000","last_active":"2024-02-15T23:30:10.783406+0000","last_peered":"2024-02-15T23:30:10.783406+0000","last_clean":"2024-02-15T23:30:10.783406+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:30:10.783406+0000","last_undegraded":"2024-02-15T23:30:10.783406+0000","last_fullsized":"2024-02-15T23:30:10.783406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:45:43.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":278,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.145436+0000","last_change":"2024-02-15T23:29:37.736088+0000","last_active":"2024-02-15T23:31:04.145436+0000","last_peered":"2024-02-15T23:31:04.145436+0000","last_clean":"2024-02-15T23:31:04.145436+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:04.145436+0000","last_undegraded":"2024-02-15T23:31:04.145436+0000","last_fullsized":"2024-02-15T23:31:04.145436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:40.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.909796+0000","last_change":"2024-02-15T23:29:39.771638+0000","last_active":"2024-02-15T23:31:03.909796+0000","last_peered":"2024-02-15T23:31:03.909796+0000","last_clean":"2024-02-15T23:31:03.909796+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:31:03.909796+0000","last_undegraded":"2024-02-15T23:31:03.909796+0000","last_fullsized":"2024-02-15T23:31:03.909796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:55.181212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796605+0000","last_change":"2024-02-15T23:29:31.701536+0000","last_active":"2024-02-15T23:30:10.796605+0000","last_peered":"2024-02-15T23:30:10.796605+0000","last_clean":"2024-02-15T23:30:10.796605+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:30:10.796605+0000","last_undegraded":"2024-02-15T23:30:10.796605+0000","last_fullsized":"2024-02-15T23:30:10.796605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:01.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.065461+0000","last_change":"2024-02-15T23:29:29.714312+0000","last_active":"2024-02-15T23:30:15.065461+0000","last_peered":"2024-02-15T23:30:15.065461+0000","last_clean":"2024-02-15T23:30:15.065461+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:30:15.065461+0000","last_undegraded":"2024-02-15T23:30:15.065461+0000","last_fullsized":"2024-02-15T23:30:15.065461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:33.379284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.788477+0000","last_change":"2024-02-15T23:29:21.629944+0000","last_active":"2024-02-15T23:30:10.788477+0000","last_peered":"2024-02-15T23:30:10.788477+0000","last_clean":"2024-02-15T23:30:10.788477+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:30:10.788477+0000","last_undegraded":"2024-02-15T23:30:10.788477+0000","last_fullsized":"2024-02-15T23:30:10.788477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:34:24.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794872+0000","last_change":"2024-02-15T23:29:33.715193+0000","last_active":"2024-02-15T23:30:10.794872+0000","last_peered":"2024-02-15T23:30:10.794872+0000","last_clean":"2024-02-15T23:30:10.794872+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:30:10.794872+0000","last_undegraded":"2024-02-15T23:30:10.794872+0000","last_fullsized":"2024-02-15T23:30:10.794872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:04.389424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806532+0000","last_change":"2024-02-15T23:29:35.749284+0000","last_active":"2024-02-15T23:30:10.806532+0000","last_peered":"2024-02-15T23:30:10.806532+0000","last_clean":"2024-02-15T23:30:10.806532+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:30:10.806532+0000","last_undegraded":"2024-02-15T23:30:10.806532+0000","last_fullsized":"2024-02-15T23:30:10.806532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:56.095538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.151818+0000","last_change":"2024-02-15T23:29:37.752616+0000","last_active":"2024-02-15T23:31:04.151818+0000","last_peered":"2024-02-15T23:31:04.151818+0000","last_clean":"2024-02-15T23:31:04.151818+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:04.151818+0000","last_undegraded":"2024-02-15T23:31:04.151818+0000","last_fullsized":"2024-02-15T23:31:04.151818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:51.505644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.298912+0000","last_change":"2024-02-15T23:29:39.760690+0000","last_active":"2024-02-15T23:30:58.298912+0000","last_peered":"2024-02-15T23:30:58.298912+0000","last_clean":"2024-02-15T23:30:58.298912+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:30:58.298912+0000","last_undegraded":"2024-02-15T23:30:58.298912+0000","last_fullsized":"2024-02-15T23:30:58.298912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:11.751170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924945+0000","last_change":"2024-02-15T23:29:31.709896+0000","last_active":"2024-02-15T23:31:03.924945+0000","last_peered":"2024-02-15T23:31:03.924945+0000","last_clean":"2024-02-15T23:31:03.924945+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:03.924945+0000","last_undegraded":"2024-02-15T23:31:03.924945+0000","last_fullsized":"2024-02-15T23:31:03.924945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:18.497832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786236+0000","last_change":"2024-02-15T23:29:29.720515+0000","last_active":"2024-02-15T23:30:10.786236+0000","last_peered":"2024-02-15T23:30:10.786236+0000","last_clean":"2024-02-15T23:30:10.786236+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:30:10.786236+0000","last_undegraded":"2024-02-15T23:30:10.786236+0000","last_fullsized":"2024-02-15T23:30:10.786236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813277+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:30:10.813277+0000","last_peered":"2024-02-15T23:30:10.813277+0000","last_clean":"2024-02-15T23:30:10.813277+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:30:10.813277+0000","last_undegraded":"2024-02-15T23:30:10.813277+0000","last_fullsized":"2024-02-15T23:30:10.813277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:17.587564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795011+0000","last_change":"2024-02-15T23:29:33.710000+0000","last_active":"2024-02-15T23:30:10.795011+0000","last_peered":"2024-02-15T23:30:10.795011+0000","last_clean":"2024-02-15T23:30:10.795011+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:30:10.795011+0000","last_undegraded":"2024-02-15T23:30:10.795011+0000","last_fullsized":"2024-02-15T23:30:10.795011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:36.677573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.875945+0000","last_change":"2024-02-15T23:29:35.717933+0000","last_active":"2024-02-15T23:31:03.875945+0000","last_peered":"2024-02-15T23:31:03.875945+0000","last_clean":"2024-02-15T23:31:03.875945+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:03.875945+0000","last_undegraded":"2024-02-15T23:31:03.875945+0000","last_fullsized":"2024-02-15T23:31:03.875945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:00.658332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784071+0000","last_change":"2024-02-15T23:29:37.739850+0000","last_active":"2024-02-15T23:30:10.784071+0000","last_peered":"2024-02-15T23:30:10.784071+0000","last_clean":"2024-02-15T23:30:10.784071+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:30:10.784071+0000","last_undegraded":"2024-02-15T23:30:10.784071+0000","last_fullsized":"2024-02-15T23:30:10.784071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:09:51.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780548+0000","last_change":"2024-02-15T23:29:39.781085+0000","last_active":"2024-02-15T23:30:10.780548+0000","last_peered":"2024-02-15T23:30:10.780548+0000","last_clean":"2024-02-15T23:30:10.780548+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:30:10.780548+0000","last_undegraded":"2024-02-15T23:30:10.780548+0000","last_fullsized":"2024-02-15T23:30:10.780548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:01.196312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779929+0000","last_change":"2024-02-15T23:29:39.777993+0000","last_active":"2024-02-15T23:30:10.779929+0000","last_peered":"2024-02-15T23:30:10.779929+0000","last_clean":"2024-02-15T23:30:10.779929+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:30:10.779929+0000","last_undegraded":"2024-02-15T23:30:10.779929+0000","last_fullsized":"2024-02-15T23:30:10.779929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:53.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784494+0000","last_change":"2024-02-15T23:29:31.704768+0000","last_active":"2024-02-15T23:30:10.784494+0000","last_peered":"2024-02-15T23:30:10.784494+0000","last_clean":"2024-02-15T23:30:10.784494+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:30:10.784494+0000","last_undegraded":"2024-02-15T23:30:10.784494+0000","last_fullsized":"2024-02-15T23:30:10.784494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:16.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807765+0000","last_change":"2024-02-15T23:29:29.728542+0000","last_active":"2024-02-15T23:30:10.807765+0000","last_peered":"2024-02-15T23:30:10.807765+0000","last_clean":"2024-02-15T23:30:10.807765+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:30:10.807765+0000","last_undegraded":"2024-02-15T23:30:10.807765+0000","last_fullsized":"2024-02-15T23:30:10.807765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:05.901551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.884926+0000","last_change":"2024-02-15T23:29:33.711524+0000","last_active":"2024-02-15T23:31:04.884926+0000","last_peered":"2024-02-15T23:31:04.884926+0000","last_clean":"2024-02-15T23:31:04.884926+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:04.884926+0000","last_undegraded":"2024-02-15T23:31:04.884926+0000","last_fullsized":"2024-02-15T23:31:04.884926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:03.277817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.281776+0000","last_change":"2024-02-15T23:29:35.746240+0000","last_active":"2024-02-15T23:30:58.281776+0000","last_peered":"2024-02-15T23:30:58.281776+0000","last_clean":"2024-02-15T23:30:58.281776+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:30:58.281776+0000","last_undegraded":"2024-02-15T23:30:58.281776+0000","last_fullsized":"2024-02-15T23:30:58.281776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:31:03.614237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797557+0000","last_change":"2024-02-15T23:29:37.765986+0000","last_active":"2024-02-15T23:30:10.797557+0000","last_peered":"2024-02-15T23:30:10.797557+0000","last_clean":"2024-02-15T23:30:10.797557+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:30:10.797557+0000","last_undegraded":"2024-02-15T23:30:10.797557+0000","last_fullsized":"2024-02-15T23:30:10.797557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:38.382170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786394+0000","last_change":"2024-02-15T23:29:39.766083+0000","last_active":"2024-02-15T23:30:10.786394+0000","last_peered":"2024-02-15T23:30:10.786394+0000","last_clean":"2024-02-15T23:30:10.786394+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:30:10.786394+0000","last_undegraded":"2024-02-15T23:30:10.786394+0000","last_fullsized":"2024-02-15T23:30:10.786394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:11.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091281+0000","last_change":"2024-02-15T23:29:31.711705+0000","last_active":"2024-02-15T23:30:15.091281+0000","last_peered":"2024-02-15T23:30:15.091281+0000","last_clean":"2024-02-15T23:30:15.091281+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:30:15.091281+0000","last_undegraded":"2024-02-15T23:30:15.091281+0000","last_fullsized":"2024-02-15T23:30:15.091281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:49.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777397+0000","last_change":"2024-02-15T23:29:29.723948+0000","last_active":"2024-02-15T23:30:10.777397+0000","last_peered":"2024-02-15T23:30:10.777397+0000","last_clean":"2024-02-15T23:30:10.777397+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:30:10.777397+0000","last_undegraded":"2024-02-15T23:30:10.777397+0000","last_fullsized":"2024-02-15T23:30:10.777397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.803790+0000","last_change":"2024-02-15T23:29:33.710951+0000","last_active":"2024-02-15T23:30:10.803790+0000","last_peered":"2024-02-15T23:30:10.803790+0000","last_clean":"2024-02-15T23:30:10.803790+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:30:10.803790+0000","last_undegraded":"2024-02-15T23:30:10.803790+0000","last_fullsized":"2024-02-15T23:30:10.803790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:33.779707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:50.920531+0000","last_change":"2024-02-15T23:29:35.722170+0000","last_active":"2024-02-15T23:30:50.920531+0000","last_peered":"2024-02-15T23:30:50.920531+0000","last_clean":"2024-02-15T23:30:50.920531+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:30:50.920531+0000","last_undegraded":"2024-02-15T23:30:50.920531+0000","last_fullsized":"2024-02-15T23:30:50.920531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:26.740928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776127+0000","last_change":"2024-02-15T23:29:37.766413+0000","last_active":"2024-02-15T23:30:10.776127+0000","last_peered":"2024-02-15T23:30:10.776127+0000","last_clean":"2024-02-15T23:30:10.776127+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:30:10.776127+0000","last_undegraded":"2024-02-15T23:30:10.776127+0000","last_fullsized":"2024-02-15T23:30:10.776127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:58.577241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786018+0000","last_change":"2024-02-15T23:29:39.783805+0000","last_active":"2024-02-15T23:30:10.786018+0000","last_peered":"2024-02-15T23:30:10.786018+0000","last_clean":"2024-02-15T23:30:10.786018+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:30:10.786018+0000","last_undegraded":"2024-02-15T23:30:10.786018+0000","last_fullsized":"2024-02-15T23:30:10.786018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:11.751170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'9","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.309917+0000","last_change":"2024-02-15T23:29:31.709732+0000","last_active":"2024-02-15T23:30:58.309917+0000","last_peered":"2024-02-15T23:30:58.309917+0000","last_clean":"2024-02-15T23:30:58.309917+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:30:58.309917+0000","last_undegraded":"2024-02-15T23:30:58.309917+0000","last_fullsized":"2024-02-15T23:30:58.309917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:04.855243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780146+0000","last_change":"2024-02-15T23:29:29.723953+0000","last_active":"2024-02-15T23:30:10.780146+0000","last_peered":"2024-02-15T23:30:10.780146+0000","last_clean":"2024-02-15T23:30:10.780146+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:30:10.780146+0000","last_undegraded":"2024-02-15T23:30:10.780146+0000","last_fullsized":"2024-02-15T23:30:10.780146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776922+0000","last_change":"2024-02-15T23:29:33.712933+0000","last_active":"2024-02-15T23:30:10.776922+0000","last_peered":"2024-02-15T23:30:10.776922+0000","last_clean":"2024-02-15T23:30:10.776922+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:30:10.776922+0000","last_undegraded":"2024-02-15T23:30:10.776922+0000","last_fullsized":"2024-02-15T23:30:10.776922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:54:18.393325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'36","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.676773+0000","last_change":"2024-02-15T23:29:35.726851+0000","last_active":"2024-02-15T23:31:03.676773+0000","last_peered":"2024-02-15T23:31:03.676773+0000","last_clean":"2024-02-15T23:31:03.676773+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:03.676773+0000","last_undegraded":"2024-02-15T23:31:03.676773+0000","last_fullsized":"2024-02-15T23:31:03.676773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:19.645566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782738+0000","last_change":"2024-02-15T23:29:37.733211+0000","last_active":"2024-02-15T23:30:10.782738+0000","last_peered":"2024-02-15T23:30:10.782738+0000","last_clean":"2024-02-15T23:30:10.782738+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:30:10.782738+0000","last_undegraded":"2024-02-15T23:30:10.782738+0000","last_fullsized":"2024-02-15T23:30:10.782738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:58.620898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806839+0000","last_change":"2024-02-15T23:29:39.784430+0000","last_active":"2024-02-15T23:30:10.806839+0000","last_peered":"2024-02-15T23:30:10.806839+0000","last_clean":"2024-02-15T23:30:10.806839+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:30:10.806839+0000","last_undegraded":"2024-02-15T23:30:10.806839+0000","last_fullsized":"2024-02-15T23:30:10.806839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:55:47.209181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310633+0000","last_change":"2024-02-15T23:29:31.701986+0000","last_active":"2024-02-15T23:30:58.310633+0000","last_peered":"2024-02-15T23:30:58.310633+0000","last_clean":"2024-02-15T23:30:58.310633+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:30:58.310633+0000","last_undegraded":"2024-02-15T23:30:58.310633+0000","last_fullsized":"2024-02-15T23:30:58.310633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:11.385662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792688+0000","last_change":"2024-02-15T23:29:29.736668+0000","last_active":"2024-02-15T23:30:10.792688+0000","last_peered":"2024-02-15T23:30:10.792688+0000","last_clean":"2024-02-15T23:30:10.792688+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:30:10.792688+0000","last_undegraded":"2024-02-15T23:30:10.792688+0000","last_fullsized":"2024-02-15T23:30:10.792688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794825+0000","last_change":"2024-02-15T23:29:33.715292+0000","last_active":"2024-02-15T23:30:10.794825+0000","last_peered":"2024-02-15T23:30:10.794825+0000","last_clean":"2024-02-15T23:30:10.794825+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:30:10.794825+0000","last_undegraded":"2024-02-15T23:30:10.794825+0000","last_fullsized":"2024-02-15T23:30:10.794825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:16.607064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.262617+0000","last_change":"2024-02-15T23:29:35.716431+0000","last_active":"2024-02-15T23:30:58.262617+0000","last_peered":"2024-02-15T23:30:58.262617+0000","last_clean":"2024-02-15T23:30:58.262617+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:30:58.262617+0000","last_undegraded":"2024-02-15T23:30:58.262617+0000","last_fullsized":"2024-02-15T23:30:58.262617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:40.269355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779398+0000","last_change":"2024-02-15T23:29:37.763224+0000","last_active":"2024-02-15T23:30:10.779398+0000","last_peered":"2024-02-15T23:30:10.779398+0000","last_clean":"2024-02-15T23:30:10.779398+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:30:10.779398+0000","last_undegraded":"2024-02-15T23:30:10.779398+0000","last_fullsized":"2024-02-15T23:30:10.779398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:05.584865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.814385+0000","last_change":"2024-02-15T23:29:31.705672+0000","last_active":"2024-02-15T23:30:10.814385+0000","last_peered":"2024-02-15T23:30:10.814385+0000","last_clean":"2024-02-15T23:30:10.814385+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:30:10.814385+0000","last_undegraded":"2024-02-15T23:30:10.814385+0000","last_fullsized":"2024-02-15T23:30:10.814385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:22:55.414951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795287+0000","last_change":"2024-02-15T23:29:29.721645+0000","last_active":"2024-02-15T23:30:10.795287+0000","last_peered":"2024-02-15T23:30:10.795287+0000","last_clean":"2024-02-15T23:30:10.795287+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:30:10.795287+0000","last_undegraded":"2024-02-15T23:30:10.795287+0000","last_fullsized":"2024-02-15T23:30:10.795287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:53:31.617349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790215+0000","last_change":"2024-02-15T23:29:33.720987+0000","last_active":"2024-02-15T23:30:10.790215+0000","last_peered":"2024-02-15T23:30:10.790215+0000","last_clean":"2024-02-15T23:30:10.790215+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:30:10.790215+0000","last_undegraded":"2024-02-15T23:30:10.790215+0000","last_fullsized":"2024-02-15T23:30:10.790215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:40.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'51","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.871106+0000","last_change":"2024-02-15T23:29:35.721819+0000","last_active":"2024-02-15T23:31:03.871106+0000","last_peered":"2024-02-15T23:31:03.871106+0000","last_clean":"2024-02-15T23:31:03.871106+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:03.871106+0000","last_undegraded":"2024-02-15T23:31:03.871106+0000","last_fullsized":"2024-02-15T23:31:03.871106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:56.561268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777783+0000","last_change":"2024-02-15T23:29:37.763301+0000","last_active":"2024-02-15T23:30:10.777783+0000","last_peered":"2024-02-15T23:30:10.777783+0000","last_clean":"2024-02-15T23:30:10.777783+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:30:10.777783+0000","last_undegraded":"2024-02-15T23:30:10.777783+0000","last_fullsized":"2024-02-15T23:30:10.777783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:52:07.386784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.643303+0000","last_change":"2024-02-15T23:29:39.778768+0000","last_active":"2024-02-15T23:30:57.643303+0000","last_peered":"2024-02-15T23:30:57.643303+0000","last_clean":"2024-02-15T23:30:57.643303+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:30:57.643303+0000","last_undegraded":"2024-02-15T23:30:57.643303+0000","last_fullsized":"2024-02-15T23:30:57.643303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.769044+0000","last_change":"2024-02-15T23:29:31.695343+0000","last_active":"2024-02-15T23:30:15.769044+0000","last_peered":"2024-02-15T23:30:15.769044+0000","last_clean":"2024-02-15T23:30:15.769044+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:30:15.769044+0000","last_undegraded":"2024-02-15T23:30:15.769044+0000","last_fullsized":"2024-02-15T23:30:15.769044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:35.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782323+0000","last_change":"2024-02-15T23:29:29.737932+0000","last_active":"2024-02-15T23:30:10.782323+0000","last_peered":"2024-02-15T23:30:10.782323+0000","last_clean":"2024-02-15T23:30:10.782323+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:30:10.782323+0000","last_undegraded":"2024-02-15T23:30:10.782323+0000","last_fullsized":"2024-02-15T23:30:10.782323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781017+0000","last_change":"2024-02-15T23:29:33.704716+0000","last_active":"2024-02-15T23:30:10.781017+0000","last_peered":"2024-02-15T23:30:10.781017+0000","last_clean":"2024-02-15T23:30:10.781017+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:30:10.781017+0000","last_undegraded":"2024-02-15T23:30:10.781017+0000","last_fullsized":"2024-02-15T23:30:10.781017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:43:47.043349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.263598+0000","last_change":"2024-02-15T23:29:35.746767+0000","last_active":"2024-02-15T23:30:58.263598+0000","last_peered":"2024-02-15T23:30:58.263598+0000","last_clean":"2024-02-15T23:30:58.263598+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:30:58.263598+0000","last_undegraded":"2024-02-15T23:30:58.263598+0000","last_fullsized":"2024-02-15T23:30:58.263598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:20.637953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787004+0000","last_change":"2024-02-15T23:29:37.760362+0000","last_active":"2024-02-15T23:30:10.787004+0000","last_peered":"2024-02-15T23:30:10.787004+0000","last_clean":"2024-02-15T23:30:10.787004+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:30:10.787004+0000","last_undegraded":"2024-02-15T23:30:10.787004+0000","last_fullsized":"2024-02-15T23:30:10.787004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:26:31.398449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797516+0000","last_change":"2024-02-15T23:29:39.769995+0000","last_active":"2024-02-15T23:30:10.797516+0000","last_peered":"2024-02-15T23:30:10.797516+0000","last_clean":"2024-02-15T23:30:10.797516+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:30:10.797516+0000","last_undegraded":"2024-02-15T23:30:10.797516+0000","last_fullsized":"2024-02-15T23:30:10.797516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:17.415321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924750+0000","last_change":"2024-02-15T23:29:31.709284+0000","last_active":"2024-02-15T23:31:03.924750+0000","last_peered":"2024-02-15T23:31:03.924750+0000","last_clean":"2024-02-15T23:31:03.924750+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:03.924750+0000","last_undegraded":"2024-02-15T23:31:03.924750+0000","last_fullsized":"2024-02-15T23:31:03.924750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:28.678586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.075644+0000","last_change":"2024-02-15T23:29:29.706515+0000","last_active":"2024-02-15T23:30:15.075644+0000","last_peered":"2024-02-15T23:30:15.075644+0000","last_clean":"2024-02-15T23:30:15.075644+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:30:15.075644+0000","last_undegraded":"2024-02-15T23:30:15.075644+0000","last_fullsized":"2024-02-15T23:30:15.075644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779703+0000","last_change":"2024-02-15T23:29:33.707077+0000","last_active":"2024-02-15T23:30:10.779703+0000","last_peered":"2024-02-15T23:30:10.779703+0000","last_clean":"2024-02-15T23:30:10.779703+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:30:10.779703+0000","last_undegraded":"2024-02-15T23:30:10.779703+0000","last_fullsized":"2024-02-15T23:30:10.779703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:52.708213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.286180+0000","last_change":"2024-02-15T23:29:35.740799+0000","last_active":"2024-02-15T23:30:58.286180+0000","last_peered":"2024-02-15T23:30:58.286180+0000","last_clean":"2024-02-15T23:30:58.286180+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:30:58.286180+0000","last_undegraded":"2024-02-15T23:30:58.286180+0000","last_fullsized":"2024-02-15T23:30:58.286180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:03.568892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787613+0000","last_change":"2024-02-15T23:29:37.765611+0000","last_active":"2024-02-15T23:30:10.787613+0000","last_peered":"2024-02-15T23:30:10.787613+0000","last_clean":"2024-02-15T23:30:10.787613+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:30:10.787613+0000","last_undegraded":"2024-02-15T23:30:10.787613+0000","last_fullsized":"2024-02-15T23:30:10.787613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:20.640463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797644+0000","last_change":"2024-02-15T23:29:39.769430+0000","last_active":"2024-02-15T23:30:10.797644+0000","last_peered":"2024-02-15T23:30:10.797644+0000","last_clean":"2024-02-15T23:30:10.797644+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:30:10.797644+0000","last_undegraded":"2024-02-15T23:30:10.797644+0000","last_fullsized":"2024-02-15T23:30:10.797644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:09:59.883710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791011+0000","last_change":"2024-02-15T23:29:31.691631+0000","last_active":"2024-02-15T23:30:10.791011+0000","last_peered":"2024-02-15T23:30:10.791011+0000","last_clean":"2024-02-15T23:30:10.791011+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:30:10.791011+0000","last_undegraded":"2024-02-15T23:30:10.791011+0000","last_fullsized":"2024-02-15T23:30:10.791011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805500+0000","last_change":"2024-02-15T23:29:29.720236+0000","last_active":"2024-02-15T23:30:10.805500+0000","last_peered":"2024-02-15T23:30:10.805500+0000","last_clean":"2024-02-15T23:30:10.805500+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:30:10.805500+0000","last_undegraded":"2024-02-15T23:30:10.805500+0000","last_fullsized":"2024-02-15T23:30:10.805500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:14.660978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787495+0000","last_change":"2024-02-15T23:29:33.711713+0000","last_active":"2024-02-15T23:30:10.787495+0000","last_peered":"2024-02-15T23:30:10.787495+0000","last_clean":"2024-02-15T23:30:10.787495+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:30:10.787495+0000","last_undegraded":"2024-02-15T23:30:10.787495+0000","last_fullsized":"2024-02-15T23:30:10.787495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:22.356586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810657+0000","last_change":"2024-02-15T23:29:35.751777+0000","last_active":"2024-02-15T23:30:10.810657+0000","last_peered":"2024-02-15T23:30:10.810657+0000","last_clean":"2024-02-15T23:30:10.810657+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:30:10.810657+0000","last_undegraded":"2024-02-15T23:30:10.810657+0000","last_fullsized":"2024-02-15T23:30:10.810657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:30:34.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.143444+0000","last_change":"2024-02-15T23:29:37.767386+0000","last_active":"2024-02-15T23:31:04.143444+0000","last_peered":"2024-02-15T23:31:04.143444+0000","last_clean":"2024-02-15T23:31:04.143444+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:04.143444+0000","last_undegraded":"2024-02-15T23:31:04.143444+0000","last_fullsized":"2024-02-15T23:31:04.143444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:38.436613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.793935+0000","last_change":"2024-02-15T23:29:39.775113+0000","last_active":"2024-02-15T23:30:10.793935+0000","last_peered":"2024-02-15T23:30:10.793935+0000","last_clean":"2024-02-15T23:30:10.793935+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:30:10.793935+0000","last_undegraded":"2024-02-15T23:30:10.793935+0000","last_fullsized":"2024-02-15T23:30:10.793935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:40:43.570670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.765400+0000","last_change":"2024-02-15T23:29:31.684239+0000","last_active":"2024-02-15T23:30:15.765400+0000","last_peered":"2024-02-15T23:30:15.765400+0000","last_clean":"2024-02-15T23:30:15.765400+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:30:15.765400+0000","last_undegraded":"2024-02-15T23:30:15.765400+0000","last_fullsized":"2024-02-15T23:30:15.765400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:57.286122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796635+0000","last_change":"2024-02-15T23:29:29.725067+0000","last_active":"2024-02-15T23:30:10.796635+0000","last_peered":"2024-02-15T23:30:10.796635+0000","last_clean":"2024-02-15T23:30:10.796635+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:30:10.796635+0000","last_undegraded":"2024-02-15T23:30:10.796635+0000","last_fullsized":"2024-02-15T23:30:10.796635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783024+0000","last_change":"2024-02-15T23:29:33.718484+0000","last_active":"2024-02-15T23:30:10.783024+0000","last_peered":"2024-02-15T23:30:10.783024+0000","last_clean":"2024-02-15T23:30:10.783024+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:30:10.783024+0000","last_undegraded":"2024-02-15T23:30:10.783024+0000","last_fullsized":"2024-02-15T23:30:10.783024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:12.597571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.250589+0000","last_change":"2024-02-15T23:29:35.728335+0000","last_active":"2024-02-15T23:30:58.250589+0000","last_peered":"2024-02-15T23:30:58.250589+0000","last_clean":"2024-02-15T23:30:58.250589+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:30:58.250589+0000","last_undegraded":"2024-02-15T23:30:58.250589+0000","last_fullsized":"2024-02-15T23:30:58.250589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:19.485322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783428+0000","last_change":"2024-02-15T23:29:37.763470+0000","last_active":"2024-02-15T23:30:10.783428+0000","last_peered":"2024-02-15T23:30:10.783428+0000","last_clean":"2024-02-15T23:30:10.783428+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:30:10.783428+0000","last_undegraded":"2024-02-15T23:30:10.783428+0000","last_fullsized":"2024-02-15T23:30:10.783428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:48.322860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795923+0000","last_change":"2024-02-15T23:29:39.782265+0000","last_active":"2024-02-15T23:30:10.795923+0000","last_peered":"2024-02-15T23:30:10.795923+0000","last_clean":"2024-02-15T23:30:10.795923+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:30:10.795923+0000","last_undegraded":"2024-02-15T23:30:10.795923+0000","last_fullsized":"2024-02-15T23:30:10.795923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:29.582392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.751269+0000","last_change":"2024-02-15T23:29:31.685467+0000","last_active":"2024-02-15T23:30:14.751269+0000","last_peered":"2024-02-15T23:30:14.751269+0000","last_clean":"2024-02-15T23:30:14.751269+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:30:14.751269+0000","last_undegraded":"2024-02-15T23:30:14.751269+0000","last_fullsized":"2024-02-15T23:30:14.751269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:49.264719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809512+0000","last_change":"2024-02-15T23:29:29.728334+0000","last_active":"2024-02-15T23:30:10.809512+0000","last_peered":"2024-02-15T23:30:10.809512+0000","last_clean":"2024-02-15T23:30:10.809512+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:30:10.809512+0000","last_undegraded":"2024-02-15T23:30:10.809512+0000","last_fullsized":"2024-02-15T23:30:10.809512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:02.838388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785093+0000","last_change":"2024-02-15T23:29:33.707600+0000","last_active":"2024-02-15T23:30:10.785093+0000","last_peered":"2024-02-15T23:30:10.785093+0000","last_clean":"2024-02-15T23:30:10.785093+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:30:10.785093+0000","last_undegraded":"2024-02-15T23:30:10.785093+0000","last_fullsized":"2024-02-15T23:30:10.785093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:35.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'31","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.252201+0000","last_change":"2024-02-15T23:29:35.719654+0000","last_active":"2024-02-15T23:30:58.252201+0000","last_peered":"2024-02-15T23:30:58.252201+0000","last_clean":"2024-02-15T23:30:58.252201+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:30:58.252201+0000","last_undegraded":"2024-02-15T23:30:58.252201+0000","last_fullsized":"2024-02-15T23:30:58.252201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:14.904715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794382+0000","last_change":"2024-02-15T23:29:37.765925+0000","last_active":"2024-02-15T23:30:10.794382+0000","last_peered":"2024-02-15T23:30:10.794382+0000","last_clean":"2024-02-15T23:30:10.794382+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:30:10.794382+0000","last_undegraded":"2024-02-15T23:30:10.794382+0000","last_fullsized":"2024-02-15T23:30:10.794382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:47.006455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813342+0000","last_change":"2024-02-15T23:29:39.784125+0000","last_active":"2024-02-15T23:30:10.813342+0000","last_peered":"2024-02-15T23:30:10.813342+0000","last_clean":"2024-02-15T23:30:10.813342+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:30:10.813342+0000","last_undegraded":"2024-02-15T23:30:10.813342+0000","last_fullsized":"2024-02-15T23:30:10.813342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:38.708272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795106+0000","last_change":"2024-02-15T23:29:31.701274+0000","last_active":"2024-02-15T23:30:10.795106+0000","last_peered":"2024-02-15T23:30:10.795106+0000","last_clean":"2024-02-15T23:30:10.795106+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:30:10.795106+0000","last_undegraded":"2024-02-15T23:30:10.795106+0000","last_fullsized":"2024-02-15T23:30:10.795106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:10.874498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790293+0000","last_change":"2024-02-15T23:29:29.717620+0000","last_active":"2024-02-15T23:30:10.790293+0000","last_peered":"2024-02-15T23:30:10.790293+0000","last_clean":"2024-02-15T23:30:10.790293+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:30:10.790293+0000","last_undegraded":"2024-02-15T23:30:10.790293+0000","last_fullsized":"2024-02-15T23:30:10.790293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:13.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:05.011422+0000","last_change":"2024-02-15T23:29:33.718676+0000","last_active":"2024-02-15T23:31:05.011422+0000","last_peered":"2024-02-15T23:31:05.011422+0000","last_clean":"2024-02-15T23:31:05.011422+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:05.011422+0000","last_undegraded":"2024-02-15T23:31:05.011422+0000","last_fullsized":"2024-02-15T23:31:05.011422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:39.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'24","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.283866+0000","last_change":"2024-02-15T23:29:35.752343+0000","last_active":"2024-02-15T23:30:58.283866+0000","last_peered":"2024-02-15T23:30:58.283866+0000","last_clean":"2024-02-15T23:30:58.283866+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:30:58.283866+0000","last_undegraded":"2024-02-15T23:30:58.283866+0000","last_fullsized":"2024-02-15T23:30:58.283866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:33.613231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798971+0000","last_change":"2024-02-15T23:29:37.770670+0000","last_active":"2024-02-15T23:30:10.798971+0000","last_peered":"2024-02-15T23:30:10.798971+0000","last_clean":"2024-02-15T23:30:10.798971+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:30:10.798971+0000","last_undegraded":"2024-02-15T23:30:10.798971+0000","last_fullsized":"2024-02-15T23:30:10.798971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:36.321730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807623+0000","last_change":"2024-02-15T23:29:39.784728+0000","last_active":"2024-02-15T23:30:10.807623+0000","last_peered":"2024-02-15T23:30:10.807623+0000","last_clean":"2024-02-15T23:30:10.807623+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:30:10.807623+0000","last_undegraded":"2024-02-15T23:30:10.807623+0000","last_fullsized":"2024-02-15T23:30:10.807623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:48.823664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.765342+0000","last_change":"2024-02-15T23:29:31.684323+0000","last_active":"2024-02-15T23:30:15.765342+0000","last_peered":"2024-02-15T23:30:15.765342+0000","last_clean":"2024-02-15T23:30:15.765342+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:30:15.765342+0000","last_undegraded":"2024-02-15T23:30:15.765342+0000","last_fullsized":"2024-02-15T23:30:15.765342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:28.332760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792855+0000","last_change":"2024-02-15T23:29:29.719123+0000","last_active":"2024-02-15T23:30:10.792855+0000","last_peered":"2024-02-15T23:30:10.792855+0000","last_clean":"2024-02-15T23:30:10.792855+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:30:10.792855+0000","last_undegraded":"2024-02-15T23:30:10.792855+0000","last_fullsized":"2024-02-15T23:30:10.792855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783243+0000","last_change":"2024-02-15T23:29:33.718106+0000","last_active":"2024-02-15T23:30:10.783243+0000","last_peered":"2024-02-15T23:30:10.783243+0000","last_clean":"2024-02-15T23:30:10.783243+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:30:10.783243+0000","last_undegraded":"2024-02-15T23:30:10.783243+0000","last_fullsized":"2024-02-15T23:30:10.783243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:13.398453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.899549+0000","last_change":"2024-02-15T23:29:35.748095+0000","last_active":"2024-02-15T23:31:03.899549+0000","last_peered":"2024-02-15T23:31:03.899549+0000","last_clean":"2024-02-15T23:31:03.899549+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:03.899549+0000","last_undegraded":"2024-02-15T23:31:03.899549+0000","last_fullsized":"2024-02-15T23:31:03.899549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:34:58.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785313+0000","last_change":"2024-02-15T23:29:37.764100+0000","last_active":"2024-02-15T23:30:10.785313+0000","last_peered":"2024-02-15T23:30:10.785313+0000","last_clean":"2024-02-15T23:30:10.785313+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:30:10.785313+0000","last_undegraded":"2024-02-15T23:30:10.785313+0000","last_fullsized":"2024-02-15T23:30:10.785313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:59.183786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.051571+0000","last_change":"2024-02-15T23:29:39.784447+0000","last_active":"2024-02-15T23:30:15.051571+0000","last_peered":"2024-02-15T23:30:15.051571+0000","last_clean":"2024-02-15T23:30:15.051571+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:30:15.051571+0000","last_undegraded":"2024-02-15T23:30:15.051571+0000","last_fullsized":"2024-02-15T23:30:15.051571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:42.388138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796691+0000","last_change":"2024-02-15T23:29:31.710180+0000","last_active":"2024-02-15T23:30:10.796691+0000","last_peered":"2024-02-15T23:30:10.796691+0000","last_clean":"2024-02-15T23:30:10.796691+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:30:10.796691+0000","last_undegraded":"2024-02-15T23:30:10.796691+0000","last_fullsized":"2024-02-15T23:30:10.796691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:43.016654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.775086+0000","last_change":"2024-02-15T23:29:29.733523+0000","last_active":"2024-02-15T23:30:10.775086+0000","last_peered":"2024-02-15T23:30:10.775086+0000","last_clean":"2024-02-15T23:30:10.775086+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:30:10.775086+0000","last_undegraded":"2024-02-15T23:30:10.775086+0000","last_fullsized":"2024-02-15T23:30:10.775086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:35.831875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.293732+0000","last_change":"2024-02-15T23:29:31.689326+0000","last_active":"2024-02-15T23:30:14.293732+0000","last_peered":"2024-02-15T23:30:14.293732+0000","last_clean":"2024-02-15T23:30:14.293732+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:30:14.293732+0000","last_undegraded":"2024-02-15T23:30:14.293732+0000","last_fullsized":"2024-02-15T23:30:14.293732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:41.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783852+0000","last_change":"2024-02-15T23:29:29.708496+0000","last_active":"2024-02-15T23:30:10.783852+0000","last_peered":"2024-02-15T23:30:10.783852+0000","last_clean":"2024-02-15T23:30:10.783852+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:30:10.783852+0000","last_undegraded":"2024-02-15T23:30:10.783852+0000","last_fullsized":"2024-02-15T23:30:10.783852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924796+0000","last_change":"2024-02-15T23:29:31.705760+0000","last_active":"2024-02-15T23:31:03.924796+0000","last_peered":"2024-02-15T23:31:03.924796+0000","last_clean":"2024-02-15T23:31:03.924796+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:03.924796+0000","last_undegraded":"2024-02-15T23:31:03.924796+0000","last_fullsized":"2024-02-15T23:31:03.924796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:52:01.340593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799615+0000","last_change":"2024-02-15T23:29:29.728191+0000","last_active":"2024-02-15T23:30:10.799615+0000","last_peered":"2024-02-15T23:30:10.799615+0000","last_clean":"2024-02-15T23:30:10.799615+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:30:10.799615+0000","last_undegraded":"2024-02-15T23:30:10.799615+0000","last_fullsized":"2024-02-15T23:30:10.799615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:21.821782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924754+0000","last_change":"2024-02-15T23:29:31.693908+0000","last_active":"2024-02-15T23:31:03.924754+0000","last_peered":"2024-02-15T23:31:03.924754+0000","last_clean":"2024-02-15T23:31:03.924754+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:03.924754+0000","last_undegraded":"2024-02-15T23:31:03.924754+0000","last_fullsized":"2024-02-15T23:31:03.924754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:49.264719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787153+0000","last_change":"2024-02-15T23:29:29.707236+0000","last_active":"2024-02-15T23:30:10.787153+0000","last_peered":"2024-02-15T23:30:10.787153+0000","last_clean":"2024-02-15T23:30:10.787153+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:30:10.787153+0000","last_undegraded":"2024-02-15T23:30:10.787153+0000","last_fullsized":"2024-02-15T23:30:10.787153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924794+0000","last_change":"2024-02-15T23:29:31.709341+0000","last_active":"2024-02-15T23:31:03.924794+0000","last_peered":"2024-02-15T23:31:03.924794+0000","last_clean":"2024-02-15T23:31:03.924794+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:03.924794+0000","last_undegraded":"2024-02-15T23:31:03.924794+0000","last_fullsized":"2024-02-15T23:31:03.924794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:16.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787213+0000","last_change":"2024-02-15T23:29:29.716033+0000","last_active":"2024-02-15T23:30:10.787213+0000","last_peered":"2024-02-15T23:30:10.787213+0000","last_clean":"2024-02-15T23:30:10.787213+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:30:10.787213+0000","last_undegraded":"2024-02-15T23:30:10.787213+0000","last_fullsized":"2024-02-15T23:30:10.787213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310211+0000","last_change":"2024-02-15T23:29:31.704944+0000","last_active":"2024-02-15T23:30:58.310211+0000","last_peered":"2024-02-15T23:30:58.310211+0000","last_clean":"2024-02-15T23:30:58.310211+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:30:58.310211+0000","last_undegraded":"2024-02-15T23:30:58.310211+0000","last_fullsized":"2024-02-15T23:30:58.310211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:21:12.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787672+0000","last_change":"2024-02-15T23:29:29.738175+0000","last_active":"2024-02-15T23:30:10.787672+0000","last_peered":"2024-02-15T23:30:10.787672+0000","last_clean":"2024-02-15T23:30:10.787672+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:30:10.787672+0000","last_undegraded":"2024-02-15T23:30:10.787672+0000","last_fullsized":"2024-02-15T23:30:10.787672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785339+0000","last_change":"2024-02-15T23:29:31.695350+0000","last_active":"2024-02-15T23:30:10.785339+0000","last_peered":"2024-02-15T23:30:10.785339+0000","last_clean":"2024-02-15T23:30:10.785339+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:30:10.785339+0000","last_undegraded":"2024-02-15T23:30:10.785339+0000","last_fullsized":"2024-02-15T23:30:10.785339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:21.379451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780402+0000","last_change":"2024-02-15T23:29:29.731948+0000","last_active":"2024-02-15T23:30:10.780402+0000","last_peered":"2024-02-15T23:30:10.780402+0000","last_clean":"2024-02-15T23:30:10.780402+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:30:10.780402+0000","last_undegraded":"2024-02-15T23:30:10.780402+0000","last_fullsized":"2024-02-15T23:30:10.780402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.925201+0000","last_change":"2024-02-15T23:29:31.693023+0000","last_active":"2024-02-15T23:31:03.925201+0000","last_peered":"2024-02-15T23:31:03.925201+0000","last_clean":"2024-02-15T23:31:03.925201+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:03.925201+0000","last_undegraded":"2024-02-15T23:31:03.925201+0000","last_fullsized":"2024-02-15T23:31:03.925201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790918+0000","last_change":"2024-02-15T23:29:29.710596+0000","last_active":"2024-02-15T23:30:10.790918+0000","last_peered":"2024-02-15T23:30:10.790918+0000","last_clean":"2024-02-15T23:30:10.790918+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:30:10.790918+0000","last_undegraded":"2024-02-15T23:30:10.790918+0000","last_fullsized":"2024-02-15T23:30:10.790918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796948+0000","last_change":"2024-02-15T23:29:31.689541+0000","last_active":"2024-02-15T23:30:10.796948+0000","last_peered":"2024-02-15T23:30:10.796948+0000","last_clean":"2024-02-15T23:30:10.796948+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:30:10.796948+0000","last_undegraded":"2024-02-15T23:30:10.796948+0000","last_fullsized":"2024-02-15T23:30:10.796948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:51.240648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795824+0000","last_change":"2024-02-15T23:29:29.716896+0000","last_active":"2024-02-15T23:30:10.795824+0000","last_peered":"2024-02-15T23:30:10.795824+0000","last_clean":"2024-02-15T23:30:10.795824+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:30:10.795824+0000","last_undegraded":"2024-02-15T23:30:10.795824+0000","last_fullsized":"2024-02-15T23:30:10.795824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:26:58.454845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.779706+0000","last_change":"2024-02-15T23:30:10.793574+0000","last_active":"2024-02-15T23:30:15.779706+0000","last_peered":"2024-02-15T23:30:15.779706+0000","last_clean":"2024-02-15T23:30:15.779706+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:30:15.779706+0000","last_undegraded":"2024-02-15T23:30:15.779706+0000","last_fullsized":"2024-02-15T23:30:15.779706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:47.873898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784302+0000","last_change":"2024-02-15T23:29:29.719351+0000","last_active":"2024-02-15T23:30:10.784302+0000","last_peered":"2024-02-15T23:30:10.784302+0000","last_clean":"2024-02-15T23:30:10.784302+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:30:10.784302+0000","last_undegraded":"2024-02-15T23:30:10.784302+0000","last_fullsized":"2024-02-15T23:30:10.784302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'21","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499219+0000","last_change":"2024-02-15T23:29:31.713582+0000","last_active":"2024-02-15T23:30:57.499219+0000","last_peered":"2024-02-15T23:30:57.499219+0000","last_clean":"2024-02-15T23:30:57.499219+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:30:57.499219+0000","last_undegraded":"2024-02-15T23:30:57.499219+0000","last_fullsized":"2024-02-15T23:30:57.499219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783783+0000","last_change":"2024-02-15T23:29:29.741437+0000","last_active":"2024-02-15T23:30:10.783783+0000","last_peered":"2024-02-15T23:30:10.783783+0000","last_clean":"2024-02-15T23:30:10.783783+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:30:10.783783+0000","last_undegraded":"2024-02-15T23:30:10.783783+0000","last_fullsized":"2024-02-15T23:30:10.783783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786380+0000","last_change":"2024-02-15T23:29:31.694663+0000","last_active":"2024-02-15T23:30:10.786380+0000","last_peered":"2024-02-15T23:30:10.786380+0000","last_clean":"2024-02-15T23:30:10.786380+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:30:10.786380+0000","last_undegraded":"2024-02-15T23:30:10.786380+0000","last_fullsized":"2024-02-15T23:30:10.786380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:01.705137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790614+0000","last_change":"2024-02-15T23:29:29.720975+0000","last_active":"2024-02-15T23:30:10.790614+0000","last_peered":"2024-02-15T23:30:10.790614+0000","last_clean":"2024-02-15T23:30:10.790614+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:30:10.790614+0000","last_undegraded":"2024-02-15T23:30:10.790614+0000","last_fullsized":"2024-02-15T23:30:10.790614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091043+0000","last_change":"2024-02-15T23:29:31.703991+0000","last_active":"2024-02-15T23:30:15.091043+0000","last_peered":"2024-02-15T23:30:15.091043+0000","last_clean":"2024-02-15T23:30:15.091043+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:30:15.091043+0000","last_undegraded":"2024-02-15T23:30:15.091043+0000","last_fullsized":"2024-02-15T23:30:15.091043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.248593+0000","last_change":"2024-02-15T23:29:29.714331+0000","last_active":"2024-02-15T23:30:14.248593+0000","last_peered":"2024-02-15T23:30:14.248593+0000","last_clean":"2024-02-15T23:30:14.248593+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:30:14.248593+0000","last_undegraded":"2024-02-15T23:30:14.248593+0000","last_fullsized":"2024-02-15T23:30:14.248593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:19.362596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499673+0000","last_change":"2024-02-15T23:29:31.689861+0000","last_active":"2024-02-15T23:30:57.499673+0000","last_peered":"2024-02-15T23:30:57.499673+0000","last_clean":"2024-02-15T23:30:57.499673+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:30:57.499673+0000","last_undegraded":"2024-02-15T23:30:57.499673+0000","last_fullsized":"2024-02-15T23:30:57.499673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:43.878770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810021+0000","last_change":"2024-02-15T23:29:29.720292+0000","last_active":"2024-02-15T23:30:10.810021+0000","last_peered":"2024-02-15T23:30:10.810021+0000","last_clean":"2024-02-15T23:30:10.810021+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:30:10.810021+0000","last_undegraded":"2024-02-15T23:30:10.810021+0000","last_fullsized":"2024-02-15T23:30:10.810021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:29.439315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310693+0000","last_change":"2024-02-15T23:29:31.699375+0000","last_active":"2024-02-15T23:30:58.310693+0000","last_peered":"2024-02-15T23:30:58.310693+0000","last_clean":"2024-02-15T23:30:58.310693+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:30:58.310693+0000","last_undegraded":"2024-02-15T23:30:58.310693+0000","last_fullsized":"2024-02-15T23:30:58.310693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:33.891211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780993+0000","last_change":"2024-02-15T23:29:29.730792+0000","last_active":"2024-02-15T23:30:10.780993+0000","last_peered":"2024-02-15T23:30:10.780993+0000","last_clean":"2024-02-15T23:30:10.780993+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:30:10.780993+0000","last_undegraded":"2024-02-15T23:30:10.780993+0000","last_fullsized":"2024-02-15T23:30:10.780993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.854975+0000","last_change":"2024-02-15T23:29:31.694898+0000","last_active":"2024-02-15T23:30:57.854975+0000","last_peered":"2024-02-15T23:30:57.854975+0000","last_clean":"2024-02-15T23:30:57.854975+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:30:57.854975+0000","last_undegraded":"2024-02-15T23:30:57.854975+0000","last_fullsized":"2024-02-15T23:30:57.854975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:33.539189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.081189+0000","last_change":"2024-02-15T23:29:29.714026+0000","last_active":"2024-02-15T23:30:15.081189+0000","last_peered":"2024-02-15T23:30:15.081189+0000","last_clean":"2024-02-15T23:30:15.081189+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:30:15.081189+0000","last_undegraded":"2024-02-15T23:30:15.081189+0000","last_fullsized":"2024-02-15T23:30:15.081189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:39.963502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796908+0000","last_change":"2024-02-15T23:29:29.714394+0000","last_active":"2024-02-15T23:30:10.796908+0000","last_peered":"2024-02-15T23:30:10.796908+0000","last_clean":"2024-02-15T23:30:10.796908+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:30:10.796908+0000","last_undegraded":"2024-02-15T23:30:10.796908+0000","last_fullsized":"2024-02-15T23:30:10.796908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:36.000311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791872+0000","last_change":"2024-02-15T23:29:31.696441+0000","last_active":"2024-02-15T23:30:10.791872+0000","last_peered":"2024-02-15T23:30:10.791872+0000","last_clean":"2024-02-15T23:30:10.791872+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:30:10.791872+0000","last_undegraded":"2024-02-15T23:30:10.791872+0000","last_fullsized":"2024-02-15T23:30:10.791872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:07.483252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784436+0000","last_change":"2024-02-15T23:29:29.716351+0000","last_active":"2024-02-15T23:30:10.784436+0000","last_peered":"2024-02-15T23:30:10.784436+0000","last_clean":"2024-02-15T23:30:10.784436+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:30:10.784436+0000","last_undegraded":"2024-02-15T23:30:10.784436+0000","last_fullsized":"2024-02-15T23:30:10.784436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091055+0000","last_change":"2024-02-15T23:29:31.709385+0000","last_active":"2024-02-15T23:30:15.091055+0000","last_peered":"2024-02-15T23:30:15.091055+0000","last_clean":"2024-02-15T23:30:15.091055+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:30:15.091055+0000","last_undegraded":"2024-02-15T23:30:15.091055+0000","last_fullsized":"2024-02-15T23:30:15.091055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:02.842564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705692,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52700000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705690,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.622}]},{"osd":3,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.503},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":0.67500000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.755},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.64700000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:31:12.365 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:31:12.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f27d86640 1 Processor -- start 2024-02-15T23:31:12.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f27d86640 1 -- start start 2024-02-15T23:31:12.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f27d86640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6f20128d10 0x7f6f201290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f27d86640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f20095ee0 con 0x7f6f2012bb20 2024-02-15T23:31:12.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f27d86640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f20095b30 con 0x7f6f20128d10 2024-02-15T23:31:12.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f25b22640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6f20128d10 0x7f6f201290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f25321640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6f2012bb20 0x7f6f2012bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36852/0 (socket says 172.21.15.131:36852) 2024-02-15T23:31:12.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f25321640 1 -- 172.21.15.131:0/3858849020 learned_addr learned my addr 172.21.15.131:0/3858849020 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:12.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f25b22640 1 -- 172.21.15.131:0/3858849020 >> v1:172.21.15.131:6789/0 conn(0x7f6f2012bb20 legacy=0x7f6f2012bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f25b22640 1 -- 172.21.15.131:0/3858849020 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20096320 con 0x7f6f20128d10 2024-02-15T23:31:12.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f25b22640 1 --2- 172.21.15.131:0/3858849020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201290f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009740 tx=0x7f6f1001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85de22d4de0b23c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f24b20640 1 -- 172.21.15.131:0/3858849020 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f100ab530 con 0x7f6f20128d10 2024-02-15T23:31:12.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f24b20640 1 -- 172.21.15.131:0/3858849020 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f100a7050 con 0x7f6f20128d10 2024-02-15T23:31:12.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.507+0000 7f6f24b20640 1 -- 172.21.15.131:0/3858849020 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f100ab7e0 con 0x7f6f20128d10 2024-02-15T23:31:12.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- 172.21.15.131:0/3858849020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 msgr2=0x7f6f201290f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 --2- 172.21.15.131:0/3858849020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201290f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009740 tx=0x7f6f1001c400 comp rx=0 tx=0).stop 2024-02-15T23:31:12.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- 172.21.15.131:0/3858849020 shutdown_connections 2024-02-15T23:31:12.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 --2- 172.21.15.131:0/3858849020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201290f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- 172.21.15.131:0/3858849020 >> 172.21.15.131:0/3858849020 conn(0x7f6f2009a2f0 msgr2=0x7f6f2009a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:12.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- 172.21.15.131:0/3858849020 shutdown_connections 2024-02-15T23:31:12.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- 172.21.15.131:0/3858849020 wait complete. 2024-02-15T23:31:12.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 Processor -- start 2024-02-15T23:31:12.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- start start 2024-02-15T23:31:12.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20123400 con 0x7f6f20128d10 2024-02-15T23:31:12.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f25b22640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f25b22640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51168/0 (socket says 172.21.15.131:51168) 2024-02-15T23:31:12.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f25b22640 1 -- 172.21.15.131:0/2677237528 learned_addr learned my addr 172.21.15.131:0/2677237528 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:12.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f25b22640 1 -- 172.21.15.131:0/2677237528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f10009420 con 0x7f6f20128d10 2024-02-15T23:31:12.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f25b22640 1 --2- 172.21.15.131:0/2677237528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201c3ac0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6f100ae040 tx=0x7f6f100191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f167fc640 1 -- 172.21.15.131:0/2677237528 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f100b4750 con 0x7f6f20128d10 2024-02-15T23:31:12.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f167fc640 1 -- 172.21.15.131:0/2677237528 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f100a4e90 con 0x7f6f20128d10 2024-02-15T23:31:12.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f201238d0 con 0x7f6f20128d10 2024-02-15T23:31:12.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f167fc640 1 -- 172.21.15.131:0/2677237528 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f100b49e0 con 0x7f6f20128d10 2024-02-15T23:31:12.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f20130d40 con 0x7f6f20128d10 2024-02-15T23:31:12.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f167fc640 1 -- 172.21.15.131:0/2677237528 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6f100b2040 con 0x7f6f20128d10 2024-02-15T23:31:12.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f20067e00 con 0x7f6f20128d10 2024-02-15T23:31:12.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f167fc640 1 --2- 172.21.15.131:0/2677237528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6f04035a40 0x7f6f04037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.511+0000 7f6f167fc640 1 -- 172.21.15.131:0/2677237528 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f6f100e2e60 con 0x7f6f20128d10 2024-02-15T23:31:12.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.515+0000 7f6f25321640 1 --2- 172.21.15.131:0/2677237528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6f04035a40 0x7f6f04037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.515+0000 7f6f25321640 1 --2- 172.21.15.131:0/2677237528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6f04035a40 0x7f6f04037f00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0012f0 tx=0x7f6f1c001640 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.519+0000 7f6f167fc640 1 -- 172.21.15.131:0/2677237528 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f100bc9a0 con 0x7f6f20128d10 2024-02-15T23:31:12.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.675+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f20095170 con 0x7f6f04035a40 2024-02-15T23:31:12.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.719+0000 7f6f167fc640 1 -- 172.21.15.131:0/2677237528 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673439 (secure 0 0 0) 0x7f6f1c001c70 con 0x7f6f04035a40 2024-02-15T23:31:12.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:31:12.741 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:31:12.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6f04035a40 msgr2=0x7f6f04037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 --2- 172.21.15.131:0/2677237528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6f04035a40 0x7f6f04037f00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0012f0 tx=0x7f6f1c001640 comp rx=0 tx=0).stop 2024-02-15T23:31:12.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 msgr2=0x7f6f201c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 --2- 172.21.15.131:0/2677237528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201c3ac0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6f100ae040 tx=0x7f6f100191a0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 shutdown_connections 2024-02-15T23:31:12.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 --2- 172.21.15.131:0/2677237528 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6f04035a40 0x7f6f04037f00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 --2- 172.21.15.131:0/2677237528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20128d10 0x7f6f201c3ac0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 >> 172.21.15.131:0/2677237528 conn(0x7f6f2009a2f0 msgr2=0x7f6f200971b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:12.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 shutdown_connections 2024-02-15T23:31:12.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.727+0000 7f6f27d86640 1 -- 172.21.15.131:0/2677237528 wait complete. 2024-02-15T23:31:12.754 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-15T23:31:11.540744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1179,"num_objects":-18,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":381,"num_read_kb":364,"num_write":117,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005607"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780958+0000","last_change":"2024-02-15T23:29:29.730549+0000","last_active":"2024-02-15T23:30:10.780958+0000","last_peered":"2024-02-15T23:30:10.780958+0000","last_clean":"2024-02-15T23:30:10.780958+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:30:10.780958+0000","last_undegraded":"2024-02-15T23:30:10.780958+0000","last_fullsized":"2024-02-15T23:30:10.780958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785328+0000","last_change":"2024-02-15T23:29:31.691386+0000","last_active":"2024-02-15T23:30:10.785328+0000","last_peered":"2024-02-15T23:30:10.785328+0000","last_clean":"2024-02-15T23:30:10.785328+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:30:10.785328+0000","last_undegraded":"2024-02-15T23:30:10.785328+0000","last_fullsized":"2024-02-15T23:30:10.785328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790667+0000","last_change":"2024-02-15T23:29:29.719743+0000","last_active":"2024-02-15T23:30:10.790667+0000","last_peered":"2024-02-15T23:30:10.790667+0000","last_clean":"2024-02-15T23:30:10.790667+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:30:10.790667+0000","last_undegraded":"2024-02-15T23:30:10.790667+0000","last_fullsized":"2024-02-15T23:30:10.790667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:39.453929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798345+0000","last_change":"2024-02-15T23:29:31.701574+0000","last_active":"2024-02-15T23:30:10.798345+0000","last_peered":"2024-02-15T23:30:10.798345+0000","last_clean":"2024-02-15T23:30:10.798345+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:30:10.798345+0000","last_undegraded":"2024-02-15T23:30:10.798345+0000","last_fullsized":"2024-02-15T23:30:10.798345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:10.584779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812824+0000","last_change":"2024-02-15T23:29:29.725919+0000","last_active":"2024-02-15T23:30:10.812824+0000","last_peered":"2024-02-15T23:30:10.812824+0000","last_clean":"2024-02-15T23:30:10.812824+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:30:10.812824+0000","last_undegraded":"2024-02-15T23:30:10.812824+0000","last_fullsized":"2024-02-15T23:30:10.812824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:47.717202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806961+0000","last_change":"2024-02-15T23:29:31.701595+0000","last_active":"2024-02-15T23:30:10.806961+0000","last_peered":"2024-02-15T23:30:10.806961+0000","last_clean":"2024-02-15T23:30:10.806961+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:30:10.806961+0000","last_undegraded":"2024-02-15T23:30:10.806961+0000","last_fullsized":"2024-02-15T23:30:10.806961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:22.710710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778727+0000","last_change":"2024-02-15T23:29:29.725199+0000","last_active":"2024-02-15T23:30:10.778727+0000","last_peered":"2024-02-15T23:30:10.778727+0000","last_clean":"2024-02-15T23:30:10.778727+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:30:10.778727+0000","last_undegraded":"2024-02-15T23:30:10.778727+0000","last_fullsized":"2024-02-15T23:30:10.778727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807450+0000","last_change":"2024-02-15T23:29:31.703063+0000","last_active":"2024-02-15T23:30:10.807450+0000","last_peered":"2024-02-15T23:30:10.807450+0000","last_clean":"2024-02-15T23:30:10.807450+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:30:10.807450+0000","last_undegraded":"2024-02-15T23:30:10.807450+0000","last_fullsized":"2024-02-15T23:30:10.807450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:01.557444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805914+0000","last_change":"2024-02-15T23:29:29.710832+0000","last_active":"2024-02-15T23:30:10.805914+0000","last_peered":"2024-02-15T23:30:10.805914+0000","last_clean":"2024-02-15T23:30:10.805914+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:30:10.805914+0000","last_undegraded":"2024-02-15T23:30:10.805914+0000","last_fullsized":"2024-02-15T23:30:10.805914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:40.054442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924941+0000","last_change":"2024-02-15T23:29:31.689546+0000","last_active":"2024-02-15T23:31:03.924941+0000","last_peered":"2024-02-15T23:31:03.924941+0000","last_clean":"2024-02-15T23:31:03.924941+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:03.924941+0000","last_undegraded":"2024-02-15T23:31:03.924941+0000","last_fullsized":"2024-02-15T23:31:03.924941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:35.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777097+0000","last_change":"2024-02-15T23:29:29.729934+0000","last_active":"2024-02-15T23:30:10.777097+0000","last_peered":"2024-02-15T23:30:10.777097+0000","last_clean":"2024-02-15T23:30:10.777097+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:30:10.777097+0000","last_undegraded":"2024-02-15T23:30:10.777097+0000","last_fullsized":"2024-02-15T23:30:10.777097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:51:36.207574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808769+0000","last_change":"2024-02-15T23:29:31.705431+0000","last_active":"2024-02-15T23:30:10.808769+0000","last_peered":"2024-02-15T23:30:10.808769+0000","last_clean":"2024-02-15T23:30:10.808769+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:30:10.808769+0000","last_undegraded":"2024-02-15T23:30:10.808769+0000","last_fullsized":"2024-02-15T23:30:10.808769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:20.343794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795719+0000","last_change":"2024-02-15T23:29:29.707555+0000","last_active":"2024-02-15T23:30:10.795719+0000","last_peered":"2024-02-15T23:30:10.795719+0000","last_clean":"2024-02-15T23:30:10.795719+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:30:10.795719+0000","last_undegraded":"2024-02-15T23:30:10.795719+0000","last_fullsized":"2024-02-15T23:30:10.795719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:50:04.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091130+0000","last_change":"2024-02-15T23:29:31.689285+0000","last_active":"2024-02-15T23:30:15.091130+0000","last_peered":"2024-02-15T23:30:15.091130+0000","last_clean":"2024-02-15T23:30:15.091130+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:30:15.091130+0000","last_undegraded":"2024-02-15T23:30:15.091130+0000","last_fullsized":"2024-02-15T23:30:15.091130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784401+0000","last_change":"2024-02-15T23:29:29.720155+0000","last_active":"2024-02-15T23:30:10.784401+0000","last_peered":"2024-02-15T23:30:10.784401+0000","last_clean":"2024-02-15T23:30:10.784401+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:30:10.784401+0000","last_undegraded":"2024-02-15T23:30:10.784401+0000","last_fullsized":"2024-02-15T23:30:10.784401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784463+0000","last_change":"2024-02-15T23:29:31.711090+0000","last_active":"2024-02-15T23:30:10.784463+0000","last_peered":"2024-02-15T23:30:10.784463+0000","last_clean":"2024-02-15T23:30:10.784463+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:30:10.784463+0000","last_undegraded":"2024-02-15T23:30:10.784463+0000","last_fullsized":"2024-02-15T23:30:10.784463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797604+0000","last_change":"2024-02-15T23:29:31.699913+0000","last_active":"2024-02-15T23:30:10.797604+0000","last_peered":"2024-02-15T23:30:10.797604+0000","last_clean":"2024-02-15T23:30:10.797604+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:30:10.797604+0000","last_undegraded":"2024-02-15T23:30:10.797604+0000","last_fullsized":"2024-02-15T23:30:10.797604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:37.069926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.304267+0000","last_change":"2024-02-15T23:29:29.720102+0000","last_active":"2024-02-15T23:30:58.304267+0000","last_peered":"2024-02-15T23:30:58.304267+0000","last_clean":"2024-02-15T23:30:58.304267+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:30:58.304267+0000","last_undegraded":"2024-02-15T23:30:58.304267+0000","last_fullsized":"2024-02-15T23:30:58.304267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.750065+0000","last_change":"2024-02-15T23:29:31.691136+0000","last_active":"2024-02-15T23:30:14.750065+0000","last_peered":"2024-02-15T23:30:14.750065+0000","last_clean":"2024-02-15T23:30:14.750065+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:30:14.750065+0000","last_undegraded":"2024-02-15T23:30:14.750065+0000","last_fullsized":"2024-02-15T23:30:14.750065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:07.483252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781312+0000","last_change":"2024-02-15T23:29:29.734663+0000","last_active":"2024-02-15T23:30:10.781312+0000","last_peered":"2024-02-15T23:30:10.781312+0000","last_clean":"2024-02-15T23:30:10.781312+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:30:10.781312+0000","last_undegraded":"2024-02-15T23:30:10.781312+0000","last_fullsized":"2024-02-15T23:30:10.781312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924741+0000","last_change":"2024-02-15T23:29:31.689924+0000","last_active":"2024-02-15T23:31:03.924741+0000","last_peered":"2024-02-15T23:31:03.924741+0000","last_clean":"2024-02-15T23:31:03.924741+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:03.924741+0000","last_undegraded":"2024-02-15T23:31:03.924741+0000","last_fullsized":"2024-02-15T23:31:03.924741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:43:45.030558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791227+0000","last_change":"2024-02-15T23:29:29.739167+0000","last_active":"2024-02-15T23:30:10.791227+0000","last_peered":"2024-02-15T23:30:10.791227+0000","last_clean":"2024-02-15T23:30:10.791227+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:30:10.791227+0000","last_undegraded":"2024-02-15T23:30:10.791227+0000","last_fullsized":"2024-02-15T23:30:10.791227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.764985+0000","last_change":"2024-02-15T23:29:31.708859+0000","last_active":"2024-02-15T23:30:14.764985+0000","last_peered":"2024-02-15T23:30:14.764985+0000","last_clean":"2024-02-15T23:30:14.764985+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:30:14.764985+0000","last_undegraded":"2024-02-15T23:30:14.764985+0000","last_fullsized":"2024-02-15T23:30:14.764985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:07.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785957+0000","last_change":"2024-02-15T23:29:29.720464+0000","last_active":"2024-02-15T23:30:10.785957+0000","last_peered":"2024-02-15T23:30:10.785957+0000","last_clean":"2024-02-15T23:30:10.785957+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:30:10.785957+0000","last_undegraded":"2024-02-15T23:30:10.785957+0000","last_fullsized":"2024-02-15T23:30:10.785957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784167+0000","last_change":"2024-02-15T23:29:31.703343+0000","last_active":"2024-02-15T23:30:10.784167+0000","last_peered":"2024-02-15T23:30:10.784167+0000","last_clean":"2024-02-15T23:30:10.784167+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:30:10.784167+0000","last_undegraded":"2024-02-15T23:30:10.784167+0000","last_fullsized":"2024-02-15T23:30:10.784167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:21.379451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787886+0000","last_change":"2024-02-15T23:29:29.719436+0000","last_active":"2024-02-15T23:30:10.787886+0000","last_peered":"2024-02-15T23:30:10.787886+0000","last_clean":"2024-02-15T23:30:10.787886+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:30:10.787886+0000","last_undegraded":"2024-02-15T23:30:10.787886+0000","last_fullsized":"2024-02-15T23:30:10.787886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792681+0000","last_change":"2024-02-15T23:29:31.689367+0000","last_active":"2024-02-15T23:30:10.792681+0000","last_peered":"2024-02-15T23:30:10.792681+0000","last_clean":"2024-02-15T23:30:10.792681+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:30:10.792681+0000","last_undegraded":"2024-02-15T23:30:10.792681+0000","last_fullsized":"2024-02-15T23:30:10.792681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:54:16.380534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.800109+0000","last_change":"2024-02-15T23:29:29.717627+0000","last_active":"2024-02-15T23:30:10.800109+0000","last_peered":"2024-02-15T23:30:10.800109+0000","last_clean":"2024-02-15T23:30:10.800109+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:30:10.800109+0000","last_undegraded":"2024-02-15T23:30:10.800109+0000","last_fullsized":"2024-02-15T23:30:10.800109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:39.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'17","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.908865+0000","last_change":"2024-02-15T23:29:39.766173+0000","last_active":"2024-02-15T23:31:03.908865+0000","last_peered":"2024-02-15T23:31:03.908865+0000","last_clean":"2024-02-15T23:31:03.908865+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:03.908865+0000","last_undegraded":"2024-02-15T23:31:03.908865+0000","last_fullsized":"2024-02-15T23:31:03.908865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809014+0000","last_change":"2024-02-15T23:29:31.703049+0000","last_active":"2024-02-15T23:30:10.809014+0000","last_peered":"2024-02-15T23:30:10.809014+0000","last_clean":"2024-02-15T23:30:10.809014+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:30:10.809014+0000","last_undegraded":"2024-02-15T23:30:10.809014+0000","last_fullsized":"2024-02-15T23:30:10.809014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:58:59.538674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.804971+0000","last_change":"2024-02-15T23:29:29.711609+0000","last_active":"2024-02-15T23:30:10.804971+0000","last_peered":"2024-02-15T23:30:10.804971+0000","last_clean":"2024-02-15T23:30:10.804971+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:30:10.804971+0000","last_undegraded":"2024-02-15T23:30:10.804971+0000","last_fullsized":"2024-02-15T23:30:10.804971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:47.247864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808354+0000","last_change":"2024-02-15T23:29:33.713197+0000","last_active":"2024-02-15T23:30:10.808354+0000","last_peered":"2024-02-15T23:30:10.808354+0000","last_clean":"2024-02-15T23:30:10.808354+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:30:10.808354+0000","last_undegraded":"2024-02-15T23:30:10.808354+0000","last_fullsized":"2024-02-15T23:30:10.808354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:59:23.796227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.274861+0000","last_change":"2024-02-15T23:29:35.748567+0000","last_active":"2024-02-15T23:30:58.274861+0000","last_peered":"2024-02-15T23:30:58.274861+0000","last_clean":"2024-02-15T23:30:58.274861+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:30:58.274861+0000","last_undegraded":"2024-02-15T23:30:58.274861+0000","last_fullsized":"2024-02-15T23:30:58.274861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:00:08.530157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792782+0000","last_change":"2024-02-15T23:29:37.761765+0000","last_active":"2024-02-15T23:30:10.792782+0000","last_peered":"2024-02-15T23:30:10.792782+0000","last_clean":"2024-02-15T23:30:10.792782+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:30:10.792782+0000","last_undegraded":"2024-02-15T23:30:10.792782+0000","last_fullsized":"2024-02-15T23:30:10.792782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:20.640463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.446576+0000","last_change":"2024-02-15T23:29:39.772828+0000","last_active":"2024-02-15T23:30:52.446576+0000","last_peered":"2024-02-15T23:30:52.446576+0000","last_clean":"2024-02-15T23:30:52.446576+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:30:52.446576+0000","last_undegraded":"2024-02-15T23:30:52.446576+0000","last_fullsized":"2024-02-15T23:30:52.446576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:46:46.759299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499588+0000","last_change":"2024-02-15T23:29:31.707498+0000","last_active":"2024-02-15T23:30:57.499588+0000","last_peered":"2024-02-15T23:30:57.499588+0000","last_clean":"2024-02-15T23:30:57.499588+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:30:57.499588+0000","last_undegraded":"2024-02-15T23:30:57.499588+0000","last_fullsized":"2024-02-15T23:30:57.499588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:47.182154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776324+0000","last_change":"2024-02-15T23:29:29.722314+0000","last_active":"2024-02-15T23:30:10.776324+0000","last_peered":"2024-02-15T23:30:10.776324+0000","last_clean":"2024-02-15T23:30:10.776324+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:30:10.776324+0000","last_undegraded":"2024-02-15T23:30:10.776324+0000","last_fullsized":"2024-02-15T23:30:10.776324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785649+0000","last_change":"2024-02-15T23:29:33.707309+0000","last_active":"2024-02-15T23:30:10.785649+0000","last_peered":"2024-02-15T23:30:10.785649+0000","last_clean":"2024-02-15T23:30:10.785649+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:30:10.785649+0000","last_undegraded":"2024-02-15T23:30:10.785649+0000","last_fullsized":"2024-02-15T23:30:10.785649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:38:28.615466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791778+0000","last_change":"2024-02-15T23:29:35.731494+0000","last_active":"2024-02-15T23:30:10.791778+0000","last_peered":"2024-02-15T23:30:10.791778+0000","last_clean":"2024-02-15T23:30:10.791778+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:30:10.791778+0000","last_undegraded":"2024-02-15T23:30:10.791778+0000","last_fullsized":"2024-02-15T23:30:10.791778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:29:30.966627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786144+0000","last_change":"2024-02-15T23:29:37.752102+0000","last_active":"2024-02-15T23:30:10.786144+0000","last_peered":"2024-02-15T23:30:10.786144+0000","last_clean":"2024-02-15T23:30:10.786144+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:30:10.786144+0000","last_undegraded":"2024-02-15T23:30:10.786144+0000","last_fullsized":"2024-02-15T23:30:10.786144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:37.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783801+0000","last_change":"2024-02-15T23:29:39.757721+0000","last_active":"2024-02-15T23:30:10.783801+0000","last_peered":"2024-02-15T23:30:10.783801+0000","last_clean":"2024-02-15T23:30:10.783801+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:30:10.783801+0000","last_undegraded":"2024-02-15T23:30:10.783801+0000","last_fullsized":"2024-02-15T23:30:10.783801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:27.441839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310678+0000","last_change":"2024-02-15T23:29:31.705324+0000","last_active":"2024-02-15T23:30:58.310678+0000","last_peered":"2024-02-15T23:30:58.310678+0000","last_clean":"2024-02-15T23:30:58.310678+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:30:58.310678+0000","last_undegraded":"2024-02-15T23:30:58.310678+0000","last_fullsized":"2024-02-15T23:30:58.310678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:52.531050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795098+0000","last_change":"2024-02-15T23:29:29.728584+0000","last_active":"2024-02-15T23:30:10.795098+0000","last_peered":"2024-02-15T23:30:10.795098+0000","last_clean":"2024-02-15T23:30:10.795098+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:30:10.795098+0000","last_undegraded":"2024-02-15T23:30:10.795098+0000","last_fullsized":"2024-02-15T23:30:10.795098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:16.480977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791658+0000","last_change":"2024-02-15T23:29:33.723876+0000","last_active":"2024-02-15T23:30:10.791658+0000","last_peered":"2024-02-15T23:30:10.791658+0000","last_clean":"2024-02-15T23:30:10.791658+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:30:10.791658+0000","last_undegraded":"2024-02-15T23:30:10.791658+0000","last_fullsized":"2024-02-15T23:30:10.791658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:04.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778396+0000","last_change":"2024-02-15T23:29:35.725059+0000","last_active":"2024-02-15T23:30:10.778396+0000","last_peered":"2024-02-15T23:30:10.778396+0000","last_clean":"2024-02-15T23:30:10.778396+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:30:10.778396+0000","last_undegraded":"2024-02-15T23:30:10.778396+0000","last_fullsized":"2024-02-15T23:30:10.778396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:42.048881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.147419+0000","last_change":"2024-02-15T23:29:37.774111+0000","last_active":"2024-02-15T23:31:04.147419+0000","last_peered":"2024-02-15T23:31:04.147419+0000","last_clean":"2024-02-15T23:31:04.147419+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:04.147419+0000","last_undegraded":"2024-02-15T23:31:04.147419+0000","last_fullsized":"2024-02-15T23:31:04.147419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:25.049564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777264+0000","last_change":"2024-02-15T23:29:39.776305+0000","last_active":"2024-02-15T23:30:10.777264+0000","last_peered":"2024-02-15T23:30:10.777264+0000","last_clean":"2024-02-15T23:30:10.777264+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:30:10.777264+0000","last_undegraded":"2024-02-15T23:30:10.777264+0000","last_fullsized":"2024-02-15T23:30:10.777264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:57.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791795+0000","last_change":"2024-02-15T23:29:31.696768+0000","last_active":"2024-02-15T23:30:10.791795+0000","last_peered":"2024-02-15T23:30:10.791795+0000","last_clean":"2024-02-15T23:30:10.791795+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:30:10.791795+0000","last_undegraded":"2024-02-15T23:30:10.791795+0000","last_fullsized":"2024-02-15T23:30:10.791795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:02.842564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783249+0000","last_change":"2024-02-15T23:29:29.737866+0000","last_active":"2024-02-15T23:30:10.783249+0000","last_peered":"2024-02-15T23:30:10.783249+0000","last_clean":"2024-02-15T23:30:10.783249+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:30:10.783249+0000","last_undegraded":"2024-02-15T23:30:10.783249+0000","last_fullsized":"2024-02-15T23:30:10.783249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:51:36.207574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809941+0000","last_change":"2024-02-15T23:29:33.715302+0000","last_active":"2024-02-15T23:30:10.809941+0000","last_peered":"2024-02-15T23:30:10.809941+0000","last_clean":"2024-02-15T23:30:10.809941+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:30:10.809941+0000","last_undegraded":"2024-02-15T23:30:10.809941+0000","last_fullsized":"2024-02-15T23:30:10.809941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:57.337417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.267498+0000","last_change":"2024-02-15T23:29:35.718792+0000","last_active":"2024-02-15T23:30:58.267498+0000","last_peered":"2024-02-15T23:30:58.267498+0000","last_clean":"2024-02-15T23:30:58.267498+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:30:58.267498+0000","last_undegraded":"2024-02-15T23:30:58.267498+0000","last_fullsized":"2024-02-15T23:30:58.267498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:06.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":330,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.153670+0000","last_change":"2024-02-15T23:29:37.752749+0000","last_active":"2024-02-15T23:31:04.153670+0000","last_peered":"2024-02-15T23:31:04.153670+0000","last_clean":"2024-02-15T23:31:04.153670+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:04.153670+0000","last_undegraded":"2024-02-15T23:31:04.153670+0000","last_fullsized":"2024-02-15T23:31:04.153670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:58.620898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797372+0000","last_change":"2024-02-15T23:29:31.702049+0000","last_active":"2024-02-15T23:30:10.797372+0000","last_peered":"2024-02-15T23:30:10.797372+0000","last_clean":"2024-02-15T23:30:10.797372+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:30:10.797372+0000","last_undegraded":"2024-02-15T23:30:10.797372+0000","last_fullsized":"2024-02-15T23:30:10.797372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:56.628114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780198+0000","last_change":"2024-02-15T23:29:29.731688+0000","last_active":"2024-02-15T23:30:10.780198+0000","last_peered":"2024-02-15T23:30:10.780198+0000","last_clean":"2024-02-15T23:30:10.780198+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:30:10.780198+0000","last_undegraded":"2024-02-15T23:30:10.780198+0000","last_fullsized":"2024-02-15T23:30:10.780198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783045+0000","last_change":"2024-02-15T23:29:33.721207+0000","last_active":"2024-02-15T23:30:10.783045+0000","last_peered":"2024-02-15T23:30:10.783045+0000","last_clean":"2024-02-15T23:30:10.783045+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:30:10.783045+0000","last_undegraded":"2024-02-15T23:30:10.783045+0000","last_fullsized":"2024-02-15T23:30:10.783045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:35.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.280812+0000","last_change":"2024-02-15T23:29:35.722074+0000","last_active":"2024-02-15T23:30:58.280812+0000","last_peered":"2024-02-15T23:30:58.280812+0000","last_clean":"2024-02-15T23:30:58.280812+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:30:58.280812+0000","last_undegraded":"2024-02-15T23:30:58.280812+0000","last_fullsized":"2024-02-15T23:30:58.280812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:37.868310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787088+0000","last_change":"2024-02-15T23:29:37.752862+0000","last_active":"2024-02-15T23:30:10.787088+0000","last_peered":"2024-02-15T23:30:10.787088+0000","last_clean":"2024-02-15T23:30:10.787088+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:30:10.787088+0000","last_undegraded":"2024-02-15T23:30:10.787088+0000","last_fullsized":"2024-02-15T23:30:10.787088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:24.593703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.061346+0000","last_change":"2024-02-15T23:29:39.779875+0000","last_active":"2024-02-15T23:30:58.061346+0000","last_peered":"2024-02-15T23:30:58.061346+0000","last_clean":"2024-02-15T23:30:58.061346+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:30:58.061346+0000","last_undegraded":"2024-02-15T23:30:58.061346+0000","last_fullsized":"2024-02-15T23:30:58.061346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:55.612483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.925206+0000","last_change":"2024-02-15T23:29:31.694940+0000","last_active":"2024-02-15T23:31:03.925206+0000","last_peered":"2024-02-15T23:31:03.925206+0000","last_clean":"2024-02-15T23:31:03.925206+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:31:03.925206+0000","last_undegraded":"2024-02-15T23:31:03.925206+0000","last_fullsized":"2024-02-15T23:31:03.925206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:07.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779830+0000","last_change":"2024-02-15T23:29:29.723619+0000","last_active":"2024-02-15T23:30:10.779830+0000","last_peered":"2024-02-15T23:30:10.779830+0000","last_clean":"2024-02-15T23:30:10.779830+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:30:10.779830+0000","last_undegraded":"2024-02-15T23:30:10.779830+0000","last_fullsized":"2024-02-15T23:30:10.779830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790262+0000","last_change":"2024-02-15T23:30:10.788609+0000","last_active":"2024-02-15T23:30:10.790262+0000","last_peered":"2024-02-15T23:30:10.790262+0000","last_clean":"2024-02-15T23:30:10.790262+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:30:10.790262+0000","last_undegraded":"2024-02-15T23:30:10.790262+0000","last_fullsized":"2024-02-15T23:30:10.790262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:57.337417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.254023+0000","last_change":"2024-02-15T23:29:35.747759+0000","last_active":"2024-02-15T23:30:58.254023+0000","last_peered":"2024-02-15T23:30:58.254023+0000","last_clean":"2024-02-15T23:30:58.254023+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:30:58.254023+0000","last_undegraded":"2024-02-15T23:30:58.254023+0000","last_fullsized":"2024-02-15T23:30:58.254023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:50:15.235598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785044+0000","last_change":"2024-02-15T23:29:37.763519+0000","last_active":"2024-02-15T23:30:10.785044+0000","last_peered":"2024-02-15T23:30:10.785044+0000","last_clean":"2024-02-15T23:30:10.785044+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:30:10.785044+0000","last_undegraded":"2024-02-15T23:30:10.785044+0000","last_fullsized":"2024-02-15T23:30:10.785044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:40.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.305871+0000","last_change":"2024-02-15T23:29:39.781125+0000","last_active":"2024-02-15T23:30:52.305871+0000","last_peered":"2024-02-15T23:30:52.305871+0000","last_clean":"2024-02-15T23:30:52.305871+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:30:52.305871+0000","last_undegraded":"2024-02-15T23:30:52.305871+0000","last_fullsized":"2024-02-15T23:30:52.305871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:11.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.752655+0000","last_change":"2024-02-15T23:29:31.710943+0000","last_active":"2024-02-15T23:30:14.752655+0000","last_peered":"2024-02-15T23:30:14.752655+0000","last_clean":"2024-02-15T23:30:14.752655+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:30:14.752655+0000","last_undegraded":"2024-02-15T23:30:14.752655+0000","last_fullsized":"2024-02-15T23:30:14.752655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:42.071297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810297+0000","last_change":"2024-02-15T23:29:29.725600+0000","last_active":"2024-02-15T23:30:10.810297+0000","last_peered":"2024-02-15T23:30:10.810297+0000","last_clean":"2024-02-15T23:30:10.810297+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:30:10.810297+0000","last_undegraded":"2024-02-15T23:30:10.810297+0000","last_fullsized":"2024-02-15T23:30:10.810297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:05.621720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786043+0000","last_change":"2024-02-15T23:29:33.719603+0000","last_active":"2024-02-15T23:30:10.786043+0000","last_peered":"2024-02-15T23:30:10.786043+0000","last_clean":"2024-02-15T23:30:10.786043+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:30:10.786043+0000","last_undegraded":"2024-02-15T23:30:10.786043+0000","last_fullsized":"2024-02-15T23:30:10.786043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:30:40.574457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'35","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.282736+0000","last_change":"2024-02-15T23:29:35.747042+0000","last_active":"2024-02-15T23:30:58.282736+0000","last_peered":"2024-02-15T23:30:58.282736+0000","last_clean":"2024-02-15T23:30:58.282736+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:30:58.282736+0000","last_undegraded":"2024-02-15T23:30:58.282736+0000","last_fullsized":"2024-02-15T23:30:58.282736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:30.039763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.155605+0000","last_change":"2024-02-15T23:29:37.763712+0000","last_active":"2024-02-15T23:31:04.155605+0000","last_peered":"2024-02-15T23:31:04.155605+0000","last_clean":"2024-02-15T23:31:04.155605+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:04.155605+0000","last_undegraded":"2024-02-15T23:31:04.155605+0000","last_fullsized":"2024-02-15T23:31:04.155605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:37.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.440803+0000","last_change":"2024-02-15T23:29:39.784076+0000","last_active":"2024-02-15T23:30:52.440803+0000","last_peered":"2024-02-15T23:30:52.440803+0000","last_clean":"2024-02-15T23:30:52.440803+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:30:52.440803+0000","last_undegraded":"2024-02-15T23:30:52.440803+0000","last_fullsized":"2024-02-15T23:30:52.440803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:20.743271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780987+0000","last_change":"2024-02-15T23:29:31.682141+0000","last_active":"2024-02-15T23:30:10.780987+0000","last_peered":"2024-02-15T23:30:10.780987+0000","last_clean":"2024-02-15T23:30:10.780987+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:30:10.780987+0000","last_undegraded":"2024-02-15T23:30:10.780987+0000","last_fullsized":"2024-02-15T23:30:10.780987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:04.855243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807634+0000","last_change":"2024-02-15T23:29:29.717855+0000","last_active":"2024-02-15T23:30:10.807634+0000","last_peered":"2024-02-15T23:30:10.807634+0000","last_clean":"2024-02-15T23:30:10.807634+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:30:10.807634+0000","last_undegraded":"2024-02-15T23:30:10.807634+0000","last_fullsized":"2024-02-15T23:30:10.807634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:52.833533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786259+0000","last_change":"2024-02-15T23:29:33.726139+0000","last_active":"2024-02-15T23:30:10.786259+0000","last_peered":"2024-02-15T23:30:10.786259+0000","last_clean":"2024-02-15T23:30:10.786259+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:30:10.786259+0000","last_undegraded":"2024-02-15T23:30:10.786259+0000","last_fullsized":"2024-02-15T23:30:10.786259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:53.253439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.867714+0000","last_change":"2024-02-15T23:29:35.749140+0000","last_active":"2024-02-15T23:31:03.867714+0000","last_peered":"2024-02-15T23:31:03.867714+0000","last_clean":"2024-02-15T23:31:03.867714+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:03.867714+0000","last_undegraded":"2024-02-15T23:31:03.867714+0000","last_fullsized":"2024-02-15T23:31:03.867714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:54:44.162530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784051+0000","last_change":"2024-02-15T23:29:37.740778+0000","last_active":"2024-02-15T23:30:10.784051+0000","last_peered":"2024-02-15T23:30:10.784051+0000","last_clean":"2024-02-15T23:30:10.784051+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:30:10.784051+0000","last_undegraded":"2024-02-15T23:30:10.784051+0000","last_fullsized":"2024-02-15T23:30:10.784051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:26:31.398449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.788113+0000","last_change":"2024-02-15T23:29:39.766366+0000","last_active":"2024-02-15T23:30:10.788113+0000","last_peered":"2024-02-15T23:30:10.788113+0000","last_clean":"2024-02-15T23:30:10.788113+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:30:10.788113+0000","last_undegraded":"2024-02-15T23:30:10.788113+0000","last_fullsized":"2024-02-15T23:30:10.788113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:29.582392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.763860+0000","last_change":"2024-02-15T23:30:10.801846+0000","last_active":"2024-02-15T23:30:15.763860+0000","last_peered":"2024-02-15T23:30:15.763860+0000","last_clean":"2024-02-15T23:30:15.763860+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:30:15.763860+0000","last_undegraded":"2024-02-15T23:30:15.763860+0000","last_fullsized":"2024-02-15T23:30:15.763860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:53:52.065139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.506655+0000","last_change":"2024-02-15T23:29:29.716793+0000","last_active":"2024-02-15T23:30:57.506655+0000","last_peered":"2024-02-15T23:30:57.506655+0000","last_clean":"2024-02-15T23:30:57.506655+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:30:57.506655+0000","last_undegraded":"2024-02-15T23:30:57.506655+0000","last_fullsized":"2024-02-15T23:30:57.506655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780151+0000","last_change":"2024-02-15T23:29:33.705063+0000","last_active":"2024-02-15T23:30:10.780151+0000","last_peered":"2024-02-15T23:30:10.780151+0000","last_clean":"2024-02-15T23:30:10.780151+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:30:10.780151+0000","last_undegraded":"2024-02-15T23:30:10.780151+0000","last_fullsized":"2024-02-15T23:30:10.780151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:20.311560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'32","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.870129+0000","last_change":"2024-02-15T23:29:35.728175+0000","last_active":"2024-02-15T23:31:03.870129+0000","last_peered":"2024-02-15T23:31:03.870129+0000","last_clean":"2024-02-15T23:31:03.870129+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:03.870129+0000","last_undegraded":"2024-02-15T23:31:03.870129+0000","last_fullsized":"2024-02-15T23:31:03.870129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:32.708804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812233+0000","last_change":"2024-02-15T23:29:37.772409+0000","last_active":"2024-02-15T23:30:10.812233+0000","last_peered":"2024-02-15T23:30:10.812233+0000","last_clean":"2024-02-15T23:30:10.812233+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:30:10.812233+0000","last_undegraded":"2024-02-15T23:30:10.812233+0000","last_fullsized":"2024-02-15T23:30:10.812233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:31.227259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794250+0000","last_change":"2024-02-15T23:29:39.775394+0000","last_active":"2024-02-15T23:30:10.794250+0000","last_peered":"2024-02-15T23:30:10.794250+0000","last_clean":"2024-02-15T23:30:10.794250+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:30:10.794250+0000","last_undegraded":"2024-02-15T23:30:10.794250+0000","last_fullsized":"2024-02-15T23:30:10.794250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:42.665101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310584+0000","last_change":"2024-02-15T23:29:31.709643+0000","last_active":"2024-02-15T23:30:58.310584+0000","last_peered":"2024-02-15T23:30:58.310584+0000","last_clean":"2024-02-15T23:30:58.310584+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:30:58.310584+0000","last_undegraded":"2024-02-15T23:30:58.310584+0000","last_fullsized":"2024-02-15T23:30:58.310584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:34:14.575064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807250+0000","last_change":"2024-02-15T23:29:29.725808+0000","last_active":"2024-02-15T23:30:10.807250+0000","last_peered":"2024-02-15T23:30:10.807250+0000","last_clean":"2024-02-15T23:30:10.807250+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:30:10.807250+0000","last_undegraded":"2024-02-15T23:30:10.807250+0000","last_fullsized":"2024-02-15T23:30:10.807250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:52.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785684+0000","last_change":"2024-02-15T23:29:33.719257+0000","last_active":"2024-02-15T23:30:10.785684+0000","last_peered":"2024-02-15T23:30:10.785684+0000","last_clean":"2024-02-15T23:30:10.785684+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:30:10.785684+0000","last_undegraded":"2024-02-15T23:30:10.785684+0000","last_fullsized":"2024-02-15T23:30:10.785684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:38.251929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.295841+0000","last_change":"2024-02-15T23:29:35.714372+0000","last_active":"2024-02-15T23:30:58.295841+0000","last_peered":"2024-02-15T23:30:58.295841+0000","last_clean":"2024-02-15T23:30:58.295841+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:30:58.295841+0000","last_undegraded":"2024-02-15T23:30:58.295841+0000","last_fullsized":"2024-02-15T23:30:58.295841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:41.100143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":332,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.148483+0000","last_change":"2024-02-15T23:29:37.751264+0000","last_active":"2024-02-15T23:31:04.148483+0000","last_peered":"2024-02-15T23:31:04.148483+0000","last_clean":"2024-02-15T23:31:04.148483+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:04.148483+0000","last_undegraded":"2024-02-15T23:31:04.148483+0000","last_fullsized":"2024-02-15T23:31:04.148483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:53.228345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.326564+0000","last_change":"2024-02-15T23:29:39.757713+0000","last_active":"2024-02-15T23:30:58.326564+0000","last_peered":"2024-02-15T23:30:58.326564+0000","last_clean":"2024-02-15T23:30:58.326564+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:30:58.326564+0000","last_undegraded":"2024-02-15T23:30:58.326564+0000","last_fullsized":"2024-02-15T23:30:58.326564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:40.849035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780839+0000","last_change":"2024-02-15T23:29:31.706992+0000","last_active":"2024-02-15T23:30:10.780839+0000","last_peered":"2024-02-15T23:30:10.780839+0000","last_clean":"2024-02-15T23:30:10.780839+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:30:10.780839+0000","last_undegraded":"2024-02-15T23:30:10.780839+0000","last_fullsized":"2024-02-15T23:30:10.780839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798403+0000","last_change":"2024-02-15T23:29:29.720429+0000","last_active":"2024-02-15T23:30:10.798403+0000","last_peered":"2024-02-15T23:30:10.798403+0000","last_clean":"2024-02-15T23:30:10.798403+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:30:10.798403+0000","last_undegraded":"2024-02-15T23:30:10.798403+0000","last_fullsized":"2024-02-15T23:30:10.798403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:55.269267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:05.011086+0000","last_change":"2024-02-15T23:29:33.721567+0000","last_active":"2024-02-15T23:31:05.011086+0000","last_peered":"2024-02-15T23:31:05.011086+0000","last_clean":"2024-02-15T23:31:05.011086+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:05.011086+0000","last_undegraded":"2024-02-15T23:31:05.011086+0000","last_fullsized":"2024-02-15T23:31:05.011086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:24.723502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809385+0000","last_change":"2024-02-15T23:29:35.750907+0000","last_active":"2024-02-15T23:30:10.809385+0000","last_peered":"2024-02-15T23:30:10.809385+0000","last_clean":"2024-02-15T23:30:10.809385+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:30:10.809385+0000","last_undegraded":"2024-02-15T23:30:10.809385+0000","last_fullsized":"2024-02-15T23:30:10.809385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:51.904115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":375,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.150823+0000","last_change":"2024-02-15T23:29:37.734243+0000","last_active":"2024-02-15T23:31:04.150823+0000","last_peered":"2024-02-15T23:31:04.150823+0000","last_clean":"2024-02-15T23:31:04.150823+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:04.150823+0000","last_undegraded":"2024-02-15T23:31:04.150823+0000","last_fullsized":"2024-02-15T23:31:04.150823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:24.593703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780732+0000","last_change":"2024-02-15T23:29:39.767850+0000","last_active":"2024-02-15T23:30:10.780732+0000","last_peered":"2024-02-15T23:30:10.780732+0000","last_clean":"2024-02-15T23:30:10.780732+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:30:10.780732+0000","last_undegraded":"2024-02-15T23:30:10.780732+0000","last_fullsized":"2024-02-15T23:30:10.780732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:09:53.270028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310285+0000","last_change":"2024-02-15T23:29:31.710143+0000","last_active":"2024-02-15T23:30:58.310285+0000","last_peered":"2024-02-15T23:30:58.310285+0000","last_clean":"2024-02-15T23:30:58.310285+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:30:58.310285+0000","last_undegraded":"2024-02-15T23:30:58.310285+0000","last_fullsized":"2024-02-15T23:30:58.310285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:33:08.745254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796597+0000","last_change":"2024-02-15T23:29:29.724689+0000","last_active":"2024-02-15T23:30:10.796597+0000","last_peered":"2024-02-15T23:30:10.796597+0000","last_clean":"2024-02-15T23:30:10.796597+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:30:10.796597+0000","last_undegraded":"2024-02-15T23:30:10.796597+0000","last_fullsized":"2024-02-15T23:30:10.796597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:26.315905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810239+0000","last_change":"2024-02-15T23:29:33.716469+0000","last_active":"2024-02-15T23:30:10.810239+0000","last_peered":"2024-02-15T23:30:10.810239+0000","last_clean":"2024-02-15T23:30:10.810239+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:30:10.810239+0000","last_undegraded":"2024-02-15T23:30:10.810239+0000","last_fullsized":"2024-02-15T23:30:10.810239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:04.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.276589+0000","last_change":"2024-02-15T23:29:35.730918+0000","last_active":"2024-02-15T23:30:58.276589+0000","last_peered":"2024-02-15T23:30:58.276589+0000","last_clean":"2024-02-15T23:30:58.276589+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:30:58.276589+0000","last_undegraded":"2024-02-15T23:30:58.276589+0000","last_fullsized":"2024-02-15T23:30:58.276589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:34:18.605282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778025+0000","last_change":"2024-02-15T23:29:37.767166+0000","last_active":"2024-02-15T23:30:10.778025+0000","last_peered":"2024-02-15T23:30:10.778025+0000","last_clean":"2024-02-15T23:30:10.778025+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:30:10.778025+0000","last_undegraded":"2024-02-15T23:30:10.778025+0000","last_fullsized":"2024-02-15T23:30:10.778025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:01.461141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783831+0000","last_change":"2024-02-15T23:29:39.756802+0000","last_active":"2024-02-15T23:30:10.783831+0000","last_peered":"2024-02-15T23:30:10.783831+0000","last_clean":"2024-02-15T23:30:10.783831+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:30:10.783831+0000","last_undegraded":"2024-02-15T23:30:10.783831+0000","last_fullsized":"2024-02-15T23:30:10.783831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:27.441839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310387+0000","last_change":"2024-02-15T23:29:31.709063+0000","last_active":"2024-02-15T23:30:58.310387+0000","last_peered":"2024-02-15T23:30:58.310387+0000","last_clean":"2024-02-15T23:30:58.310387+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:30:58.310387+0000","last_undegraded":"2024-02-15T23:30:58.310387+0000","last_fullsized":"2024-02-15T23:30:58.310387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:15.455104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782126+0000","last_change":"2024-02-15T23:29:17.391071+0000","last_active":"2024-02-15T23:30:10.782126+0000","last_peered":"2024-02-15T23:30:10.782126+0000","last_clean":"2024-02-15T23:30:10.782126+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:30:10.782126+0000","last_undegraded":"2024-02-15T23:30:10.782126+0000","last_fullsized":"2024-02-15T23:30:10.782126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_clean_scrub_stamp":"2024-02-15T23:29:15.580621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:00.893203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806662+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:30:10.806662+0000","last_peered":"2024-02-15T23:30:10.806662+0000","last_clean":"2024-02-15T23:30:10.806662+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:30:10.806662+0000","last_undegraded":"2024-02-15T23:30:10.806662+0000","last_fullsized":"2024-02-15T23:30:10.806662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:31:39.646588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.916327+0000","last_change":"2024-02-15T23:29:29.725524+0000","last_active":"2024-02-15T23:31:03.916327+0000","last_peered":"2024-02-15T23:31:03.916327+0000","last_clean":"2024-02-15T23:31:03.916327+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:31:03.916327+0000","last_undegraded":"2024-02-15T23:31:03.916327+0000","last_fullsized":"2024-02-15T23:31:03.916327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:58.815157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.801490+0000","last_change":"2024-02-15T23:30:10.801490+0000","last_active":"2024-02-15T23:30:10.801490+0000","last_peered":"2024-02-15T23:30:10.801490+0000","last_clean":"2024-02-15T23:30:10.801490+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:30:10.801490+0000","last_undegraded":"2024-02-15T23:30:10.801490+0000","last_fullsized":"2024-02-15T23:30:10.801490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:55:48.775082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.890716+0000","last_change":"2024-02-15T23:29:35.746233+0000","last_active":"2024-02-15T23:31:03.890716+0000","last_peered":"2024-02-15T23:31:03.890716+0000","last_clean":"2024-02-15T23:31:03.890716+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:03.890716+0000","last_undegraded":"2024-02-15T23:31:03.890716+0000","last_fullsized":"2024-02-15T23:31:03.890716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:56:17.988220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787880+0000","last_change":"2024-02-15T23:29:37.764075+0000","last_active":"2024-02-15T23:30:10.787880+0000","last_peered":"2024-02-15T23:30:10.787880+0000","last_clean":"2024-02-15T23:30:10.787880+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:30:10.787880+0000","last_undegraded":"2024-02-15T23:30:10.787880+0000","last_fullsized":"2024-02-15T23:30:10.787880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:59:27.829626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.943862+0000","last_change":"2024-02-15T23:29:39.777587+0000","last_active":"2024-02-15T23:31:03.943862+0000","last_peered":"2024-02-15T23:31:03.943862+0000","last_clean":"2024-02-15T23:31:03.943862+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:31:03.943862+0000","last_undegraded":"2024-02-15T23:31:03.943862+0000","last_fullsized":"2024-02-15T23:31:03.943862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:50.335386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'13","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499841+0000","last_change":"2024-02-15T23:29:31.705098+0000","last_active":"2024-02-15T23:30:57.499841+0000","last_peered":"2024-02-15T23:30:57.499841+0000","last_clean":"2024-02-15T23:30:57.499841+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:30:57.499841+0000","last_undegraded":"2024-02-15T23:30:57.499841+0000","last_fullsized":"2024-02-15T23:30:57.499841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:15.615348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795289+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:30:10.795289+0000","last_peered":"2024-02-15T23:30:10.795289+0000","last_clean":"2024-02-15T23:30:10.795289+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:30:10.795289+0000","last_undegraded":"2024-02-15T23:30:10.795289+0000","last_fullsized":"2024-02-15T23:30:10.795289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:26.706393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.062516+0000","last_change":"2024-02-15T23:29:29.708594+0000","last_active":"2024-02-15T23:30:15.062516+0000","last_peered":"2024-02-15T23:30:15.062516+0000","last_clean":"2024-02-15T23:30:15.062516+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:30:15.062516+0000","last_undegraded":"2024-02-15T23:30:15.062516+0000","last_fullsized":"2024-02-15T23:30:15.062516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812552+0000","last_change":"2024-02-15T23:29:33.716868+0000","last_active":"2024-02-15T23:30:10.812552+0000","last_peered":"2024-02-15T23:30:10.812552+0000","last_clean":"2024-02-15T23:30:10.812552+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:30:10.812552+0000","last_undegraded":"2024-02-15T23:30:10.812552+0000","last_fullsized":"2024-02-15T23:30:10.812552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:53:54.077930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.142415+0000","last_change":"2024-02-15T23:29:35.724256+0000","last_active":"2024-02-15T23:31:04.142415+0000","last_peered":"2024-02-15T23:31:04.142415+0000","last_clean":"2024-02-15T23:31:04.142415+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:04.142415+0000","last_undegraded":"2024-02-15T23:31:04.142415+0000","last_fullsized":"2024-02-15T23:31:04.142415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:05.587661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807241+0000","last_change":"2024-02-15T23:29:37.769851+0000","last_active":"2024-02-15T23:30:10.807241+0000","last_peered":"2024-02-15T23:30:10.807241+0000","last_clean":"2024-02-15T23:30:10.807241+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:30:10.807241+0000","last_undegraded":"2024-02-15T23:30:10.807241+0000","last_fullsized":"2024-02-15T23:30:10.807241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:49.141465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.462247+0000","last_change":"2024-02-15T23:29:39.779672+0000","last_active":"2024-02-15T23:30:52.462247+0000","last_peered":"2024-02-15T23:30:52.462247+0000","last_clean":"2024-02-15T23:30:52.462247+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:30:52.462247+0000","last_undegraded":"2024-02-15T23:30:52.462247+0000","last_fullsized":"2024-02-15T23:30:52.462247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:40.849035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924349+0000","last_change":"2024-02-15T23:29:31.694236+0000","last_active":"2024-02-15T23:31:03.924349+0000","last_peered":"2024-02-15T23:31:03.924349+0000","last_clean":"2024-02-15T23:31:03.924349+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:03.924349+0000","last_undegraded":"2024-02-15T23:31:03.924349+0000","last_fullsized":"2024-02-15T23:31:03.924349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:49.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777472+0000","last_change":"2024-02-15T23:29:21.622454+0000","last_active":"2024-02-15T23:30:10.777472+0000","last_peered":"2024-02-15T23:30:10.777472+0000","last_clean":"2024-02-15T23:30:10.777472+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:30:10.777472+0000","last_undegraded":"2024-02-15T23:30:10.777472+0000","last_fullsized":"2024-02-15T23:30:10.777472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:05.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783297+0000","last_change":"2024-02-15T23:29:29.718869+0000","last_active":"2024-02-15T23:30:10.783297+0000","last_peered":"2024-02-15T23:30:10.783297+0000","last_clean":"2024-02-15T23:30:10.783297+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:30:10.783297+0000","last_undegraded":"2024-02-15T23:30:10.783297+0000","last_fullsized":"2024-02-15T23:30:10.783297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778385+0000","last_change":"2024-02-15T23:29:33.703250+0000","last_active":"2024-02-15T23:30:10.778385+0000","last_peered":"2024-02-15T23:30:10.778385+0000","last_clean":"2024-02-15T23:30:10.778385+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:30:10.778385+0000","last_undegraded":"2024-02-15T23:30:10.778385+0000","last_fullsized":"2024-02-15T23:30:10.778385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:03.717928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.825449+0000","last_change":"2024-02-15T23:29:35.732833+0000","last_active":"2024-02-15T23:31:03.825449+0000","last_peered":"2024-02-15T23:31:03.825449+0000","last_clean":"2024-02-15T23:31:03.825449+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:03.825449+0000","last_undegraded":"2024-02-15T23:31:03.825449+0000","last_fullsized":"2024-02-15T23:31:03.825449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:23.890835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786334+0000","last_change":"2024-02-15T23:29:37.764209+0000","last_active":"2024-02-15T23:30:10.786334+0000","last_peered":"2024-02-15T23:30:10.786334+0000","last_clean":"2024-02-15T23:30:10.786334+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:30:10.786334+0000","last_undegraded":"2024-02-15T23:30:10.786334+0000","last_fullsized":"2024-02-15T23:30:10.786334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:08.422824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798630+0000","last_change":"2024-02-15T23:29:39.769538+0000","last_active":"2024-02-15T23:30:10.798630+0000","last_peered":"2024-02-15T23:30:10.798630+0000","last_clean":"2024-02-15T23:30:10.798630+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:30:10.798630+0000","last_undegraded":"2024-02-15T23:30:10.798630+0000","last_fullsized":"2024-02-15T23:30:10.798630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:03.906467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924601+0000","last_change":"2024-02-15T23:29:31.691195+0000","last_active":"2024-02-15T23:31:03.924601+0000","last_peered":"2024-02-15T23:31:03.924601+0000","last_clean":"2024-02-15T23:31:03.924601+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:03.924601+0000","last_undegraded":"2024-02-15T23:31:03.924601+0000","last_fullsized":"2024-02-15T23:31:03.924601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799199+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:30:10.799199+0000","last_peered":"2024-02-15T23:30:10.799199+0000","last_clean":"2024-02-15T23:30:10.799199+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:30:10.799199+0000","last_undegraded":"2024-02-15T23:30:10.799199+0000","last_fullsized":"2024-02-15T23:30:10.799199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:56.631774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780471+0000","last_change":"2024-02-15T23:29:29.721410+0000","last_active":"2024-02-15T23:30:10.780471+0000","last_peered":"2024-02-15T23:30:10.780471+0000","last_clean":"2024-02-15T23:30:10.780471+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:30:10.780471+0000","last_undegraded":"2024-02-15T23:30:10.780471+0000","last_fullsized":"2024-02-15T23:30:10.780471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787055+0000","last_change":"2024-02-15T23:29:33.720740+0000","last_active":"2024-02-15T23:30:10.787055+0000","last_peered":"2024-02-15T23:30:10.787055+0000","last_clean":"2024-02-15T23:30:10.787055+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:30:10.787055+0000","last_undegraded":"2024-02-15T23:30:10.787055+0000","last_fullsized":"2024-02-15T23:30:10.787055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:35.850884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809861+0000","last_change":"2024-02-15T23:29:35.749663+0000","last_active":"2024-02-15T23:30:10.809861+0000","last_peered":"2024-02-15T23:30:10.809861+0000","last_clean":"2024-02-15T23:30:10.809861+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:30:10.809861+0000","last_undegraded":"2024-02-15T23:30:10.809861+0000","last_fullsized":"2024-02-15T23:30:10.809861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:55:50.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813015+0000","last_change":"2024-02-15T23:29:37.774191+0000","last_active":"2024-02-15T23:30:10.813015+0000","last_peered":"2024-02-15T23:30:10.813015+0000","last_clean":"2024-02-15T23:30:10.813015+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:30:10.813015+0000","last_undegraded":"2024-02-15T23:30:10.813015+0000","last_fullsized":"2024-02-15T23:30:10.813015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:22.178611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781801+0000","last_change":"2024-02-15T23:29:39.768032+0000","last_active":"2024-02-15T23:30:10.781801+0000","last_peered":"2024-02-15T23:30:10.781801+0000","last_clean":"2024-02-15T23:30:10.781801+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:30:10.781801+0000","last_undegraded":"2024-02-15T23:30:10.781801+0000","last_fullsized":"2024-02-15T23:30:10.781801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:25.706705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'11","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310331+0000","last_change":"2024-02-15T23:30:10.810101+0000","last_active":"2024-02-15T23:30:58.310331+0000","last_peered":"2024-02-15T23:30:58.310331+0000","last_clean":"2024-02-15T23:30:58.310331+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:30:58.310331+0000","last_undegraded":"2024-02-15T23:30:58.310331+0000","last_fullsized":"2024-02-15T23:30:58.310331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:00:04.499939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.071222+0000","last_change":"2024-02-15T23:29:29.733697+0000","last_active":"2024-02-15T23:30:15.071222+0000","last_peered":"2024-02-15T23:30:15.071222+0000","last_clean":"2024-02-15T23:30:15.071222+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:30:15.071222+0000","last_undegraded":"2024-02-15T23:30:15.071222+0000","last_fullsized":"2024-02-15T23:30:15.071222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786022+0000","last_change":"2024-02-15T23:29:21.627861+0000","last_active":"2024-02-15T23:30:10.786022+0000","last_peered":"2024-02-15T23:30:10.786022+0000","last_clean":"2024-02-15T23:30:10.786022+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:30:10.786022+0000","last_undegraded":"2024-02-15T23:30:10.786022+0000","last_fullsized":"2024-02-15T23:30:10.786022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:25:07.064306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.803638+0000","last_change":"2024-02-15T23:30:10.801694+0000","last_active":"2024-02-15T23:30:10.803638+0000","last_peered":"2024-02-15T23:30:10.803638+0000","last_clean":"2024-02-15T23:30:10.803638+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:30:10.803638+0000","last_undegraded":"2024-02-15T23:30:10.803638+0000","last_fullsized":"2024-02-15T23:30:10.803638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:04.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'56","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.879873+0000","last_change":"2024-02-15T23:29:35.740917+0000","last_active":"2024-02-15T23:31:03.879873+0000","last_peered":"2024-02-15T23:31:03.879873+0000","last_clean":"2024-02-15T23:31:03.879873+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:03.879873+0000","last_undegraded":"2024-02-15T23:31:03.879873+0000","last_fullsized":"2024-02-15T23:31:03.879873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:24.374012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.775299+0000","last_change":"2024-02-15T23:29:37.751356+0000","last_active":"2024-02-15T23:30:10.775299+0000","last_peered":"2024-02-15T23:30:10.775299+0000","last_clean":"2024-02-15T23:30:10.775299+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:30:10.775299+0000","last_undegraded":"2024-02-15T23:30:10.775299+0000","last_fullsized":"2024-02-15T23:30:10.775299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:21.661539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.296729+0000","last_change":"2024-02-15T23:29:39.767710+0000","last_active":"2024-02-15T23:30:58.296729+0000","last_peered":"2024-02-15T23:30:58.296729+0000","last_clean":"2024-02-15T23:30:58.296729+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:30:58.296729+0000","last_undegraded":"2024-02-15T23:30:58.296729+0000","last_fullsized":"2024-02-15T23:30:58.296729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:31:07.642735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.804317+0000","last_change":"2024-02-15T23:30:10.804317+0000","last_active":"2024-02-15T23:30:10.804317+0000","last_peered":"2024-02-15T23:30:10.804317+0000","last_clean":"2024-02-15T23:30:10.804317+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:30:10.804317+0000","last_undegraded":"2024-02-15T23:30:10.804317+0000","last_fullsized":"2024-02-15T23:30:10.804317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:30:30.019018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786948+0000","last_change":"2024-02-15T23:29:29.717068+0000","last_active":"2024-02-15T23:30:10.786948+0000","last_peered":"2024-02-15T23:30:10.786948+0000","last_clean":"2024-02-15T23:30:10.786948+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:30:10.786948+0000","last_undegraded":"2024-02-15T23:30:10.786948+0000","last_fullsized":"2024-02-15T23:30:10.786948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809253+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:30:10.809253+0000","last_peered":"2024-02-15T23:30:10.809253+0000","last_clean":"2024-02-15T23:30:10.809253+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:30:10.809253+0000","last_undegraded":"2024-02-15T23:30:10.809253+0000","last_fullsized":"2024-02-15T23:30:10.809253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:34.783207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798441+0000","last_change":"2024-02-15T23:29:33.715626+0000","last_active":"2024-02-15T23:30:10.798441+0000","last_peered":"2024-02-15T23:30:10.798441+0000","last_clean":"2024-02-15T23:30:10.798441+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:30:10.798441+0000","last_undegraded":"2024-02-15T23:30:10.798441+0000","last_fullsized":"2024-02-15T23:30:10.798441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:20.560304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783406+0000","last_change":"2024-02-15T23:29:35.733356+0000","last_active":"2024-02-15T23:30:10.783406+0000","last_peered":"2024-02-15T23:30:10.783406+0000","last_clean":"2024-02-15T23:30:10.783406+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:30:10.783406+0000","last_undegraded":"2024-02-15T23:30:10.783406+0000","last_fullsized":"2024-02-15T23:30:10.783406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:45:43.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":278,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.145436+0000","last_change":"2024-02-15T23:29:37.736088+0000","last_active":"2024-02-15T23:31:04.145436+0000","last_peered":"2024-02-15T23:31:04.145436+0000","last_clean":"2024-02-15T23:31:04.145436+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:04.145436+0000","last_undegraded":"2024-02-15T23:31:04.145436+0000","last_fullsized":"2024-02-15T23:31:04.145436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:40.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.909796+0000","last_change":"2024-02-15T23:29:39.771638+0000","last_active":"2024-02-15T23:31:03.909796+0000","last_peered":"2024-02-15T23:31:03.909796+0000","last_clean":"2024-02-15T23:31:03.909796+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:31:03.909796+0000","last_undegraded":"2024-02-15T23:31:03.909796+0000","last_fullsized":"2024-02-15T23:31:03.909796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:55.181212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796605+0000","last_change":"2024-02-15T23:29:31.701536+0000","last_active":"2024-02-15T23:30:10.796605+0000","last_peered":"2024-02-15T23:30:10.796605+0000","last_clean":"2024-02-15T23:30:10.796605+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:30:10.796605+0000","last_undegraded":"2024-02-15T23:30:10.796605+0000","last_fullsized":"2024-02-15T23:30:10.796605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:01.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.065461+0000","last_change":"2024-02-15T23:29:29.714312+0000","last_active":"2024-02-15T23:30:15.065461+0000","last_peered":"2024-02-15T23:30:15.065461+0000","last_clean":"2024-02-15T23:30:15.065461+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:30:15.065461+0000","last_undegraded":"2024-02-15T23:30:15.065461+0000","last_fullsized":"2024-02-15T23:30:15.065461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:33.379284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.788477+0000","last_change":"2024-02-15T23:29:21.629944+0000","last_active":"2024-02-15T23:30:10.788477+0000","last_peered":"2024-02-15T23:30:10.788477+0000","last_clean":"2024-02-15T23:30:10.788477+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:30:10.788477+0000","last_undegraded":"2024-02-15T23:30:10.788477+0000","last_fullsized":"2024-02-15T23:30:10.788477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:34:24.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794872+0000","last_change":"2024-02-15T23:29:33.715193+0000","last_active":"2024-02-15T23:30:10.794872+0000","last_peered":"2024-02-15T23:30:10.794872+0000","last_clean":"2024-02-15T23:30:10.794872+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:30:10.794872+0000","last_undegraded":"2024-02-15T23:30:10.794872+0000","last_fullsized":"2024-02-15T23:30:10.794872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:04.389424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806532+0000","last_change":"2024-02-15T23:29:35.749284+0000","last_active":"2024-02-15T23:30:10.806532+0000","last_peered":"2024-02-15T23:30:10.806532+0000","last_clean":"2024-02-15T23:30:10.806532+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:30:10.806532+0000","last_undegraded":"2024-02-15T23:30:10.806532+0000","last_fullsized":"2024-02-15T23:30:10.806532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:56.095538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.151818+0000","last_change":"2024-02-15T23:29:37.752616+0000","last_active":"2024-02-15T23:31:04.151818+0000","last_peered":"2024-02-15T23:31:04.151818+0000","last_clean":"2024-02-15T23:31:04.151818+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:04.151818+0000","last_undegraded":"2024-02-15T23:31:04.151818+0000","last_fullsized":"2024-02-15T23:31:04.151818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:51.505644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.298912+0000","last_change":"2024-02-15T23:29:39.760690+0000","last_active":"2024-02-15T23:30:58.298912+0000","last_peered":"2024-02-15T23:30:58.298912+0000","last_clean":"2024-02-15T23:30:58.298912+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:30:58.298912+0000","last_undegraded":"2024-02-15T23:30:58.298912+0000","last_fullsized":"2024-02-15T23:30:58.298912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:11.751170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924945+0000","last_change":"2024-02-15T23:29:31.709896+0000","last_active":"2024-02-15T23:31:03.924945+0000","last_peered":"2024-02-15T23:31:03.924945+0000","last_clean":"2024-02-15T23:31:03.924945+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:03.924945+0000","last_undegraded":"2024-02-15T23:31:03.924945+0000","last_fullsized":"2024-02-15T23:31:03.924945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:18.497832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786236+0000","last_change":"2024-02-15T23:29:29.720515+0000","last_active":"2024-02-15T23:30:10.786236+0000","last_peered":"2024-02-15T23:30:10.786236+0000","last_clean":"2024-02-15T23:30:10.786236+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:30:10.786236+0000","last_undegraded":"2024-02-15T23:30:10.786236+0000","last_fullsized":"2024-02-15T23:30:10.786236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813277+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:30:10.813277+0000","last_peered":"2024-02-15T23:30:10.813277+0000","last_clean":"2024-02-15T23:30:10.813277+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:30:10.813277+0000","last_undegraded":"2024-02-15T23:30:10.813277+0000","last_fullsized":"2024-02-15T23:30:10.813277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:17.587564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795011+0000","last_change":"2024-02-15T23:29:33.710000+0000","last_active":"2024-02-15T23:30:10.795011+0000","last_peered":"2024-02-15T23:30:10.795011+0000","last_clean":"2024-02-15T23:30:10.795011+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:30:10.795011+0000","last_undegraded":"2024-02-15T23:30:10.795011+0000","last_fullsized":"2024-02-15T23:30:10.795011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:36.677573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.875945+0000","last_change":"2024-02-15T23:29:35.717933+0000","last_active":"2024-02-15T23:31:03.875945+0000","last_peered":"2024-02-15T23:31:03.875945+0000","last_clean":"2024-02-15T23:31:03.875945+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:03.875945+0000","last_undegraded":"2024-02-15T23:31:03.875945+0000","last_fullsized":"2024-02-15T23:31:03.875945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:00.658332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784071+0000","last_change":"2024-02-15T23:29:37.739850+0000","last_active":"2024-02-15T23:30:10.784071+0000","last_peered":"2024-02-15T23:30:10.784071+0000","last_clean":"2024-02-15T23:30:10.784071+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:30:10.784071+0000","last_undegraded":"2024-02-15T23:30:10.784071+0000","last_fullsized":"2024-02-15T23:30:10.784071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:09:51.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780548+0000","last_change":"2024-02-15T23:29:39.781085+0000","last_active":"2024-02-15T23:30:10.780548+0000","last_peered":"2024-02-15T23:30:10.780548+0000","last_clean":"2024-02-15T23:30:10.780548+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:30:10.780548+0000","last_undegraded":"2024-02-15T23:30:10.780548+0000","last_fullsized":"2024-02-15T23:30:10.780548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:01.196312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779929+0000","last_change":"2024-02-15T23:29:39.777993+0000","last_active":"2024-02-15T23:30:10.779929+0000","last_peered":"2024-02-15T23:30:10.779929+0000","last_clean":"2024-02-15T23:30:10.779929+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:30:10.779929+0000","last_undegraded":"2024-02-15T23:30:10.779929+0000","last_fullsized":"2024-02-15T23:30:10.779929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:53.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784494+0000","last_change":"2024-02-15T23:29:31.704768+0000","last_active":"2024-02-15T23:30:10.784494+0000","last_peered":"2024-02-15T23:30:10.784494+0000","last_clean":"2024-02-15T23:30:10.784494+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:30:10.784494+0000","last_undegraded":"2024-02-15T23:30:10.784494+0000","last_fullsized":"2024-02-15T23:30:10.784494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:16.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807765+0000","last_change":"2024-02-15T23:29:29.728542+0000","last_active":"2024-02-15T23:30:10.807765+0000","last_peered":"2024-02-15T23:30:10.807765+0000","last_clean":"2024-02-15T23:30:10.807765+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:30:10.807765+0000","last_undegraded":"2024-02-15T23:30:10.807765+0000","last_fullsized":"2024-02-15T23:30:10.807765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:05.901551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.884926+0000","last_change":"2024-02-15T23:29:33.711524+0000","last_active":"2024-02-15T23:31:04.884926+0000","last_peered":"2024-02-15T23:31:04.884926+0000","last_clean":"2024-02-15T23:31:04.884926+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:04.884926+0000","last_undegraded":"2024-02-15T23:31:04.884926+0000","last_fullsized":"2024-02-15T23:31:04.884926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:03.277817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.281776+0000","last_change":"2024-02-15T23:29:35.746240+0000","last_active":"2024-02-15T23:30:58.281776+0000","last_peered":"2024-02-15T23:30:58.281776+0000","last_clean":"2024-02-15T23:30:58.281776+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:30:58.281776+0000","last_undegraded":"2024-02-15T23:30:58.281776+0000","last_fullsized":"2024-02-15T23:30:58.281776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:31:03.614237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797557+0000","last_change":"2024-02-15T23:29:37.765986+0000","last_active":"2024-02-15T23:30:10.797557+0000","last_peered":"2024-02-15T23:30:10.797557+0000","last_clean":"2024-02-15T23:30:10.797557+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:30:10.797557+0000","last_undegraded":"2024-02-15T23:30:10.797557+0000","last_fullsized":"2024-02-15T23:30:10.797557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:38.382170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786394+0000","last_change":"2024-02-15T23:29:39.766083+0000","last_active":"2024-02-15T23:30:10.786394+0000","last_peered":"2024-02-15T23:30:10.786394+0000","last_clean":"2024-02-15T23:30:10.786394+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:30:10.786394+0000","last_undegraded":"2024-02-15T23:30:10.786394+0000","last_fullsized":"2024-02-15T23:30:10.786394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:11.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091281+0000","last_change":"2024-02-15T23:29:31.711705+0000","last_active":"2024-02-15T23:30:15.091281+0000","last_peered":"2024-02-15T23:30:15.091281+0000","last_clean":"2024-02-15T23:30:15.091281+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:30:15.091281+0000","last_undegraded":"2024-02-15T23:30:15.091281+0000","last_fullsized":"2024-02-15T23:30:15.091281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:49.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777397+0000","last_change":"2024-02-15T23:29:29.723948+0000","last_active":"2024-02-15T23:30:10.777397+0000","last_peered":"2024-02-15T23:30:10.777397+0000","last_clean":"2024-02-15T23:30:10.777397+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:30:10.777397+0000","last_undegraded":"2024-02-15T23:30:10.777397+0000","last_fullsized":"2024-02-15T23:30:10.777397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.803790+0000","last_change":"2024-02-15T23:29:33.710951+0000","last_active":"2024-02-15T23:30:10.803790+0000","last_peered":"2024-02-15T23:30:10.803790+0000","last_clean":"2024-02-15T23:30:10.803790+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:30:10.803790+0000","last_undegraded":"2024-02-15T23:30:10.803790+0000","last_fullsized":"2024-02-15T23:30:10.803790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:33.779707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:50.920531+0000","last_change":"2024-02-15T23:29:35.722170+0000","last_active":"2024-02-15T23:30:50.920531+0000","last_peered":"2024-02-15T23:30:50.920531+0000","last_clean":"2024-02-15T23:30:50.920531+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:30:50.920531+0000","last_undegraded":"2024-02-15T23:30:50.920531+0000","last_fullsized":"2024-02-15T23:30:50.920531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:26.740928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776127+0000","last_change":"2024-02-15T23:29:37.766413+0000","last_active":"2024-02-15T23:30:10.776127+0000","last_peered":"2024-02-15T23:30:10.776127+0000","last_clean":"2024-02-15T23:30:10.776127+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:30:10.776127+0000","last_undegraded":"2024-02-15T23:30:10.776127+0000","last_fullsized":"2024-02-15T23:30:10.776127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:58.577241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786018+0000","last_change":"2024-02-15T23:29:39.783805+0000","last_active":"2024-02-15T23:30:10.786018+0000","last_peered":"2024-02-15T23:30:10.786018+0000","last_clean":"2024-02-15T23:30:10.786018+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:30:10.786018+0000","last_undegraded":"2024-02-15T23:30:10.786018+0000","last_fullsized":"2024-02-15T23:30:10.786018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:11.751170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'9","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.309917+0000","last_change":"2024-02-15T23:29:31.709732+0000","last_active":"2024-02-15T23:30:58.309917+0000","last_peered":"2024-02-15T23:30:58.309917+0000","last_clean":"2024-02-15T23:30:58.309917+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:30:58.309917+0000","last_undegraded":"2024-02-15T23:30:58.309917+0000","last_fullsized":"2024-02-15T23:30:58.309917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:04.855243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780146+0000","last_change":"2024-02-15T23:29:29.723953+0000","last_active":"2024-02-15T23:30:10.780146+0000","last_peered":"2024-02-15T23:30:10.780146+0000","last_clean":"2024-02-15T23:30:10.780146+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:30:10.780146+0000","last_undegraded":"2024-02-15T23:30:10.780146+0000","last_fullsized":"2024-02-15T23:30:10.780146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776922+0000","last_change":"2024-02-15T23:29:33.712933+0000","last_active":"2024-02-15T23:30:10.776922+0000","last_peered":"2024-02-15T23:30:10.776922+0000","last_clean":"2024-02-15T23:30:10.776922+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:30:10.776922+0000","last_undegraded":"2024-02-15T23:30:10.776922+0000","last_fullsized":"2024-02-15T23:30:10.776922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:54:18.393325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'36","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.676773+0000","last_change":"2024-02-15T23:29:35.726851+0000","last_active":"2024-02-15T23:31:03.676773+0000","last_peered":"2024-02-15T23:31:03.676773+0000","last_clean":"2024-02-15T23:31:03.676773+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:03.676773+0000","last_undegraded":"2024-02-15T23:31:03.676773+0000","last_fullsized":"2024-02-15T23:31:03.676773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:19.645566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782738+0000","last_change":"2024-02-15T23:29:37.733211+0000","last_active":"2024-02-15T23:30:10.782738+0000","last_peered":"2024-02-15T23:30:10.782738+0000","last_clean":"2024-02-15T23:30:10.782738+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:30:10.782738+0000","last_undegraded":"2024-02-15T23:30:10.782738+0000","last_fullsized":"2024-02-15T23:30:10.782738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:58.620898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806839+0000","last_change":"2024-02-15T23:29:39.784430+0000","last_active":"2024-02-15T23:30:10.806839+0000","last_peered":"2024-02-15T23:30:10.806839+0000","last_clean":"2024-02-15T23:30:10.806839+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:30:10.806839+0000","last_undegraded":"2024-02-15T23:30:10.806839+0000","last_fullsized":"2024-02-15T23:30:10.806839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:55:47.209181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310633+0000","last_change":"2024-02-15T23:29:31.701986+0000","last_active":"2024-02-15T23:30:58.310633+0000","last_peered":"2024-02-15T23:30:58.310633+0000","last_clean":"2024-02-15T23:30:58.310633+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:30:58.310633+0000","last_undegraded":"2024-02-15T23:30:58.310633+0000","last_fullsized":"2024-02-15T23:30:58.310633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:11.385662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792688+0000","last_change":"2024-02-15T23:29:29.736668+0000","last_active":"2024-02-15T23:30:10.792688+0000","last_peered":"2024-02-15T23:30:10.792688+0000","last_clean":"2024-02-15T23:30:10.792688+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:30:10.792688+0000","last_undegraded":"2024-02-15T23:30:10.792688+0000","last_fullsized":"2024-02-15T23:30:10.792688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794825+0000","last_change":"2024-02-15T23:29:33.715292+0000","last_active":"2024-02-15T23:30:10.794825+0000","last_peered":"2024-02-15T23:30:10.794825+0000","last_clean":"2024-02-15T23:30:10.794825+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:30:10.794825+0000","last_undegraded":"2024-02-15T23:30:10.794825+0000","last_fullsized":"2024-02-15T23:30:10.794825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:16.607064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.262617+0000","last_change":"2024-02-15T23:29:35.716431+0000","last_active":"2024-02-15T23:30:58.262617+0000","last_peered":"2024-02-15T23:30:58.262617+0000","last_clean":"2024-02-15T23:30:58.262617+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:30:58.262617+0000","last_undegraded":"2024-02-15T23:30:58.262617+0000","last_fullsized":"2024-02-15T23:30:58.262617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:40.269355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779398+0000","last_change":"2024-02-15T23:29:37.763224+0000","last_active":"2024-02-15T23:30:10.779398+0000","last_peered":"2024-02-15T23:30:10.779398+0000","last_clean":"2024-02-15T23:30:10.779398+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:30:10.779398+0000","last_undegraded":"2024-02-15T23:30:10.779398+0000","last_fullsized":"2024-02-15T23:30:10.779398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:05.584865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.814385+0000","last_change":"2024-02-15T23:29:31.705672+0000","last_active":"2024-02-15T23:30:10.814385+0000","last_peered":"2024-02-15T23:30:10.814385+0000","last_clean":"2024-02-15T23:30:10.814385+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:30:10.814385+0000","last_undegraded":"2024-02-15T23:30:10.814385+0000","last_fullsized":"2024-02-15T23:30:10.814385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:22:55.414951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795287+0000","last_change":"2024-02-15T23:29:29.721645+0000","last_active":"2024-02-15T23:30:10.795287+0000","last_peered":"2024-02-15T23:30:10.795287+0000","last_clean":"2024-02-15T23:30:10.795287+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:30:10.795287+0000","last_undegraded":"2024-02-15T23:30:10.795287+0000","last_fullsized":"2024-02-15T23:30:10.795287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:53:31.617349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790215+0000","last_change":"2024-02-15T23:29:33.720987+0000","last_active":"2024-02-15T23:30:10.790215+0000","last_peered":"2024-02-15T23:30:10.790215+0000","last_clean":"2024-02-15T23:30:10.790215+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:30:10.790215+0000","last_undegraded":"2024-02-15T23:30:10.790215+0000","last_fullsized":"2024-02-15T23:30:10.790215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:40.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'51","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.871106+0000","last_change":"2024-02-15T23:29:35.721819+0000","last_active":"2024-02-15T23:31:03.871106+0000","last_peered":"2024-02-15T23:31:03.871106+0000","last_clean":"2024-02-15T23:31:03.871106+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:03.871106+0000","last_undegraded":"2024-02-15T23:31:03.871106+0000","last_fullsized":"2024-02-15T23:31:03.871106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:56.561268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777783+0000","last_change":"2024-02-15T23:29:37.763301+0000","last_active":"2024-02-15T23:30:10.777783+0000","last_peered":"2024-02-15T23:30:10.777783+0000","last_clean":"2024-02-15T23:30:10.777783+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:30:10.777783+0000","last_undegraded":"2024-02-15T23:30:10.777783+0000","last_fullsized":"2024-02-15T23:30:10.777783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:52:07.386784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.643303+0000","last_change":"2024-02-15T23:29:39.778768+0000","last_active":"2024-02-15T23:30:57.643303+0000","last_peered":"2024-02-15T23:30:57.643303+0000","last_clean":"2024-02-15T23:30:57.643303+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:30:57.643303+0000","last_undegraded":"2024-02-15T23:30:57.643303+0000","last_fullsized":"2024-02-15T23:30:57.643303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.769044+0000","last_change":"2024-02-15T23:29:31.695343+0000","last_active":"2024-02-15T23:30:15.769044+0000","last_peered":"2024-02-15T23:30:15.769044+0000","last_clean":"2024-02-15T23:30:15.769044+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:30:15.769044+0000","last_undegraded":"2024-02-15T23:30:15.769044+0000","last_fullsized":"2024-02-15T23:30:15.769044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:35.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782323+0000","last_change":"2024-02-15T23:29:29.737932+0000","last_active":"2024-02-15T23:30:10.782323+0000","last_peered":"2024-02-15T23:30:10.782323+0000","last_clean":"2024-02-15T23:30:10.782323+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:30:10.782323+0000","last_undegraded":"2024-02-15T23:30:10.782323+0000","last_fullsized":"2024-02-15T23:30:10.782323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781017+0000","last_change":"2024-02-15T23:29:33.704716+0000","last_active":"2024-02-15T23:30:10.781017+0000","last_peered":"2024-02-15T23:30:10.781017+0000","last_clean":"2024-02-15T23:30:10.781017+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:30:10.781017+0000","last_undegraded":"2024-02-15T23:30:10.781017+0000","last_fullsized":"2024-02-15T23:30:10.781017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:43:47.043349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.263598+0000","last_change":"2024-02-15T23:29:35.746767+0000","last_active":"2024-02-15T23:30:58.263598+0000","last_peered":"2024-02-15T23:30:58.263598+0000","last_clean":"2024-02-15T23:30:58.263598+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:30:58.263598+0000","last_undegraded":"2024-02-15T23:30:58.263598+0000","last_fullsized":"2024-02-15T23:30:58.263598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:20.637953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787004+0000","last_change":"2024-02-15T23:29:37.760362+0000","last_active":"2024-02-15T23:30:10.787004+0000","last_peered":"2024-02-15T23:30:10.787004+0000","last_clean":"2024-02-15T23:30:10.787004+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:30:10.787004+0000","last_undegraded":"2024-02-15T23:30:10.787004+0000","last_fullsized":"2024-02-15T23:30:10.787004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:26:31.398449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797516+0000","last_change":"2024-02-15T23:29:39.769995+0000","last_active":"2024-02-15T23:30:10.797516+0000","last_peered":"2024-02-15T23:30:10.797516+0000","last_clean":"2024-02-15T23:30:10.797516+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:30:10.797516+0000","last_undegraded":"2024-02-15T23:30:10.797516+0000","last_fullsized":"2024-02-15T23:30:10.797516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:17.415321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924750+0000","last_change":"2024-02-15T23:29:31.709284+0000","last_active":"2024-02-15T23:31:03.924750+0000","last_peered":"2024-02-15T23:31:03.924750+0000","last_clean":"2024-02-15T23:31:03.924750+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:03.924750+0000","last_undegraded":"2024-02-15T23:31:03.924750+0000","last_fullsized":"2024-02-15T23:31:03.924750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:28.678586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.075644+0000","last_change":"2024-02-15T23:29:29.706515+0000","last_active":"2024-02-15T23:30:15.075644+0000","last_peered":"2024-02-15T23:30:15.075644+0000","last_clean":"2024-02-15T23:30:15.075644+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:30:15.075644+0000","last_undegraded":"2024-02-15T23:30:15.075644+0000","last_fullsized":"2024-02-15T23:30:15.075644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779703+0000","last_change":"2024-02-15T23:29:33.707077+0000","last_active":"2024-02-15T23:30:10.779703+0000","last_peered":"2024-02-15T23:30:10.779703+0000","last_clean":"2024-02-15T23:30:10.779703+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:30:10.779703+0000","last_undegraded":"2024-02-15T23:30:10.779703+0000","last_fullsized":"2024-02-15T23:30:10.779703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:52.708213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.286180+0000","last_change":"2024-02-15T23:29:35.740799+0000","last_active":"2024-02-15T23:30:58.286180+0000","last_peered":"2024-02-15T23:30:58.286180+0000","last_clean":"2024-02-15T23:30:58.286180+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:30:58.286180+0000","last_undegraded":"2024-02-15T23:30:58.286180+0000","last_fullsized":"2024-02-15T23:30:58.286180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:03.568892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787613+0000","last_change":"2024-02-15T23:29:37.765611+0000","last_active":"2024-02-15T23:30:10.787613+0000","last_peered":"2024-02-15T23:30:10.787613+0000","last_clean":"2024-02-15T23:30:10.787613+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:30:10.787613+0000","last_undegraded":"2024-02-15T23:30:10.787613+0000","last_fullsized":"2024-02-15T23:30:10.787613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:20.640463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797644+0000","last_change":"2024-02-15T23:29:39.769430+0000","last_active":"2024-02-15T23:30:10.797644+0000","last_peered":"2024-02-15T23:30:10.797644+0000","last_clean":"2024-02-15T23:30:10.797644+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:30:10.797644+0000","last_undegraded":"2024-02-15T23:30:10.797644+0000","last_fullsized":"2024-02-15T23:30:10.797644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:09:59.883710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791011+0000","last_change":"2024-02-15T23:29:31.691631+0000","last_active":"2024-02-15T23:30:10.791011+0000","last_peered":"2024-02-15T23:30:10.791011+0000","last_clean":"2024-02-15T23:30:10.791011+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:30:10.791011+0000","last_undegraded":"2024-02-15T23:30:10.791011+0000","last_fullsized":"2024-02-15T23:30:10.791011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805500+0000","last_change":"2024-02-15T23:29:29.720236+0000","last_active":"2024-02-15T23:30:10.805500+0000","last_peered":"2024-02-15T23:30:10.805500+0000","last_clean":"2024-02-15T23:30:10.805500+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:30:10.805500+0000","last_undegraded":"2024-02-15T23:30:10.805500+0000","last_fullsized":"2024-02-15T23:30:10.805500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:14.660978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787495+0000","last_change":"2024-02-15T23:29:33.711713+0000","last_active":"2024-02-15T23:30:10.787495+0000","last_peered":"2024-02-15T23:30:10.787495+0000","last_clean":"2024-02-15T23:30:10.787495+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:30:10.787495+0000","last_undegraded":"2024-02-15T23:30:10.787495+0000","last_fullsized":"2024-02-15T23:30:10.787495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:22.356586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810657+0000","last_change":"2024-02-15T23:29:35.751777+0000","last_active":"2024-02-15T23:30:10.810657+0000","last_peered":"2024-02-15T23:30:10.810657+0000","last_clean":"2024-02-15T23:30:10.810657+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:30:10.810657+0000","last_undegraded":"2024-02-15T23:30:10.810657+0000","last_fullsized":"2024-02-15T23:30:10.810657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:30:34.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.143444+0000","last_change":"2024-02-15T23:29:37.767386+0000","last_active":"2024-02-15T23:31:04.143444+0000","last_peered":"2024-02-15T23:31:04.143444+0000","last_clean":"2024-02-15T23:31:04.143444+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:04.143444+0000","last_undegraded":"2024-02-15T23:31:04.143444+0000","last_fullsized":"2024-02-15T23:31:04.143444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:38.436613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.793935+0000","last_change":"2024-02-15T23:29:39.775113+0000","last_active":"2024-02-15T23:30:10.793935+0000","last_peered":"2024-02-15T23:30:10.793935+0000","last_clean":"2024-02-15T23:30:10.793935+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:30:10.793935+0000","last_undegraded":"2024-02-15T23:30:10.793935+0000","last_fullsized":"2024-02-15T23:30:10.793935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:40:43.570670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.765400+0000","last_change":"2024-02-15T23:29:31.684239+0000","last_active":"2024-02-15T23:30:15.765400+0000","last_peered":"2024-02-15T23:30:15.765400+0000","last_clean":"2024-02-15T23:30:15.765400+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:30:15.765400+0000","last_undegraded":"2024-02-15T23:30:15.765400+0000","last_fullsized":"2024-02-15T23:30:15.765400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:57.286122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796635+0000","last_change":"2024-02-15T23:29:29.725067+0000","last_active":"2024-02-15T23:30:10.796635+0000","last_peered":"2024-02-15T23:30:10.796635+0000","last_clean":"2024-02-15T23:30:10.796635+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:30:10.796635+0000","last_undegraded":"2024-02-15T23:30:10.796635+0000","last_fullsized":"2024-02-15T23:30:10.796635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783024+0000","last_change":"2024-02-15T23:29:33.718484+0000","last_active":"2024-02-15T23:30:10.783024+0000","last_peered":"2024-02-15T23:30:10.783024+0000","last_clean":"2024-02-15T23:30:10.783024+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:30:10.783024+0000","last_undegraded":"2024-02-15T23:30:10.783024+0000","last_fullsized":"2024-02-15T23:30:10.783024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:12.597571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.250589+0000","last_change":"2024-02-15T23:29:35.728335+0000","last_active":"2024-02-15T23:30:58.250589+0000","last_peered":"2024-02-15T23:30:58.250589+0000","last_clean":"2024-02-15T23:30:58.250589+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:30:58.250589+0000","last_undegraded":"2024-02-15T23:30:58.250589+0000","last_fullsized":"2024-02-15T23:30:58.250589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:19.485322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783428+0000","last_change":"2024-02-15T23:29:37.763470+0000","last_active":"2024-02-15T23:30:10.783428+0000","last_peered":"2024-02-15T23:30:10.783428+0000","last_clean":"2024-02-15T23:30:10.783428+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:30:10.783428+0000","last_undegraded":"2024-02-15T23:30:10.783428+0000","last_fullsized":"2024-02-15T23:30:10.783428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:48.322860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795923+0000","last_change":"2024-02-15T23:29:39.782265+0000","last_active":"2024-02-15T23:30:10.795923+0000","last_peered":"2024-02-15T23:30:10.795923+0000","last_clean":"2024-02-15T23:30:10.795923+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:30:10.795923+0000","last_undegraded":"2024-02-15T23:30:10.795923+0000","last_fullsized":"2024-02-15T23:30:10.795923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:29.582392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.751269+0000","last_change":"2024-02-15T23:29:31.685467+0000","last_active":"2024-02-15T23:30:14.751269+0000","last_peered":"2024-02-15T23:30:14.751269+0000","last_clean":"2024-02-15T23:30:14.751269+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:30:14.751269+0000","last_undegraded":"2024-02-15T23:30:14.751269+0000","last_fullsized":"2024-02-15T23:30:14.751269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:49.264719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809512+0000","last_change":"2024-02-15T23:29:29.728334+0000","last_active":"2024-02-15T23:30:10.809512+0000","last_peered":"2024-02-15T23:30:10.809512+0000","last_clean":"2024-02-15T23:30:10.809512+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:30:10.809512+0000","last_undegraded":"2024-02-15T23:30:10.809512+0000","last_fullsized":"2024-02-15T23:30:10.809512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:02.838388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785093+0000","last_change":"2024-02-15T23:29:33.707600+0000","last_active":"2024-02-15T23:30:10.785093+0000","last_peered":"2024-02-15T23:30:10.785093+0000","last_clean":"2024-02-15T23:30:10.785093+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:30:10.785093+0000","last_undegraded":"2024-02-15T23:30:10.785093+0000","last_fullsized":"2024-02-15T23:30:10.785093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:35.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'31","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.252201+0000","last_change":"2024-02-15T23:29:35.719654+0000","last_active":"2024-02-15T23:30:58.252201+0000","last_peered":"2024-02-15T23:30:58.252201+0000","last_clean":"2024-02-15T23:30:58.252201+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:30:58.252201+0000","last_undegraded":"2024-02-15T23:30:58.252201+0000","last_fullsized":"2024-02-15T23:30:58.252201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:14.904715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794382+0000","last_change":"2024-02-15T23:29:37.765925+0000","last_active":"2024-02-15T23:30:10.794382+0000","last_peered":"2024-02-15T23:30:10.794382+0000","last_clean":"2024-02-15T23:30:10.794382+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:30:10.794382+0000","last_undegraded":"2024-02-15T23:30:10.794382+0000","last_fullsized":"2024-02-15T23:30:10.794382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:47.006455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813342+0000","last_change":"2024-02-15T23:29:39.784125+0000","last_active":"2024-02-15T23:30:10.813342+0000","last_peered":"2024-02-15T23:30:10.813342+0000","last_clean":"2024-02-15T23:30:10.813342+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:30:10.813342+0000","last_undegraded":"2024-02-15T23:30:10.813342+0000","last_fullsized":"2024-02-15T23:30:10.813342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:38.708272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795106+0000","last_change":"2024-02-15T23:29:31.701274+0000","last_active":"2024-02-15T23:30:10.795106+0000","last_peered":"2024-02-15T23:30:10.795106+0000","last_clean":"2024-02-15T23:30:10.795106+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:30:10.795106+0000","last_undegraded":"2024-02-15T23:30:10.795106+0000","last_fullsized":"2024-02-15T23:30:10.795106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:10.874498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790293+0000","last_change":"2024-02-15T23:29:29.717620+0000","last_active":"2024-02-15T23:30:10.790293+0000","last_peered":"2024-02-15T23:30:10.790293+0000","last_clean":"2024-02-15T23:30:10.790293+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:30:10.790293+0000","last_undegraded":"2024-02-15T23:30:10.790293+0000","last_fullsized":"2024-02-15T23:30:10.790293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:13.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:05.011422+0000","last_change":"2024-02-15T23:29:33.718676+0000","last_active":"2024-02-15T23:31:05.011422+0000","last_peered":"2024-02-15T23:31:05.011422+0000","last_clean":"2024-02-15T23:31:05.011422+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:05.011422+0000","last_undegraded":"2024-02-15T23:31:05.011422+0000","last_fullsized":"2024-02-15T23:31:05.011422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:39.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'24","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.283866+0000","last_change":"2024-02-15T23:29:35.752343+0000","last_active":"2024-02-15T23:30:58.283866+0000","last_peered":"2024-02-15T23:30:58.283866+0000","last_clean":"2024-02-15T23:30:58.283866+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:30:58.283866+0000","last_undegraded":"2024-02-15T23:30:58.283866+0000","last_fullsized":"2024-02-15T23:30:58.283866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:33.613231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798971+0000","last_change":"2024-02-15T23:29:37.770670+0000","last_active":"2024-02-15T23:30:10.798971+0000","last_peered":"2024-02-15T23:30:10.798971+0000","last_clean":"2024-02-15T23:30:10.798971+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:30:10.798971+0000","last_undegraded":"2024-02-15T23:30:10.798971+0000","last_fullsized":"2024-02-15T23:30:10.798971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:36.321730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807623+0000","last_change":"2024-02-15T23:29:39.784728+0000","last_active":"2024-02-15T23:30:10.807623+0000","last_peered":"2024-02-15T23:30:10.807623+0000","last_clean":"2024-02-15T23:30:10.807623+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:30:10.807623+0000","last_undegraded":"2024-02-15T23:30:10.807623+0000","last_fullsized":"2024-02-15T23:30:10.807623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:48.823664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.765342+0000","last_change":"2024-02-15T23:29:31.684323+0000","last_active":"2024-02-15T23:30:15.765342+0000","last_peered":"2024-02-15T23:30:15.765342+0000","last_clean":"2024-02-15T23:30:15.765342+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:30:15.765342+0000","last_undegraded":"2024-02-15T23:30:15.765342+0000","last_fullsized":"2024-02-15T23:30:15.765342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:28.332760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792855+0000","last_change":"2024-02-15T23:29:29.719123+0000","last_active":"2024-02-15T23:30:10.792855+0000","last_peered":"2024-02-15T23:30:10.792855+0000","last_clean":"2024-02-15T23:30:10.792855+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:30:10.792855+0000","last_undegraded":"2024-02-15T23:30:10.792855+0000","last_fullsized":"2024-02-15T23:30:10.792855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783243+0000","last_change":"2024-02-15T23:29:33.718106+0000","last_active":"2024-02-15T23:30:10.783243+0000","last_peered":"2024-02-15T23:30:10.783243+0000","last_clean":"2024-02-15T23:30:10.783243+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:30:10.783243+0000","last_undegraded":"2024-02-15T23:30:10.783243+0000","last_fullsized":"2024-02-15T23:30:10.783243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:13.398453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.899549+0000","last_change":"2024-02-15T23:29:35.748095+0000","last_active":"2024-02-15T23:31:03.899549+0000","last_peered":"2024-02-15T23:31:03.899549+0000","last_clean":"2024-02-15T23:31:03.899549+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:03.899549+0000","last_undegraded":"2024-02-15T23:31:03.899549+0000","last_fullsized":"2024-02-15T23:31:03.899549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:34:58.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785313+0000","last_change":"2024-02-15T23:29:37.764100+0000","last_active":"2024-02-15T23:30:10.785313+0000","last_peered":"2024-02-15T23:30:10.785313+0000","last_clean":"2024-02-15T23:30:10.785313+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:30:10.785313+0000","last_undegraded":"2024-02-15T23:30:10.785313+0000","last_fullsized":"2024-02-15T23:30:10.785313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:59.183786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.051571+0000","last_change":"2024-02-15T23:29:39.784447+0000","last_active":"2024-02-15T23:30:15.051571+0000","last_peered":"2024-02-15T23:30:15.051571+0000","last_clean":"2024-02-15T23:30:15.051571+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:30:15.051571+0000","last_undegraded":"2024-02-15T23:30:15.051571+0000","last_fullsized":"2024-02-15T23:30:15.051571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:42.388138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796691+0000","last_change":"2024-02-15T23:29:31.710180+0000","last_active":"2024-02-15T23:30:10.796691+0000","last_peered":"2024-02-15T23:30:10.796691+0000","last_clean":"2024-02-15T23:30:10.796691+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:30:10.796691+0000","last_undegraded":"2024-02-15T23:30:10.796691+0000","last_fullsized":"2024-02-15T23:30:10.796691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:43.016654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.775086+0000","last_change":"2024-02-15T23:29:29.733523+0000","last_active":"2024-02-15T23:30:10.775086+0000","last_peered":"2024-02-15T23:30:10.775086+0000","last_clean":"2024-02-15T23:30:10.775086+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:30:10.775086+0000","last_undegraded":"2024-02-15T23:30:10.775086+0000","last_fullsized":"2024-02-15T23:30:10.775086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:35.831875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.293732+0000","last_change":"2024-02-15T23:29:31.689326+0000","last_active":"2024-02-15T23:30:14.293732+0000","last_peered":"2024-02-15T23:30:14.293732+0000","last_clean":"2024-02-15T23:30:14.293732+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:30:14.293732+0000","last_undegraded":"2024-02-15T23:30:14.293732+0000","last_fullsized":"2024-02-15T23:30:14.293732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:41.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783852+0000","last_change":"2024-02-15T23:29:29.708496+0000","last_active":"2024-02-15T23:30:10.783852+0000","last_peered":"2024-02-15T23:30:10.783852+0000","last_clean":"2024-02-15T23:30:10.783852+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:30:10.783852+0000","last_undegraded":"2024-02-15T23:30:10.783852+0000","last_fullsized":"2024-02-15T23:30:10.783852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924796+0000","last_change":"2024-02-15T23:29:31.705760+0000","last_active":"2024-02-15T23:31:03.924796+0000","last_peered":"2024-02-15T23:31:03.924796+0000","last_clean":"2024-02-15T23:31:03.924796+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:03.924796+0000","last_undegraded":"2024-02-15T23:31:03.924796+0000","last_fullsized":"2024-02-15T23:31:03.924796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:52:01.340593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799615+0000","last_change":"2024-02-15T23:29:29.728191+0000","last_active":"2024-02-15T23:30:10.799615+0000","last_peered":"2024-02-15T23:30:10.799615+0000","last_clean":"2024-02-15T23:30:10.799615+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:30:10.799615+0000","last_undegraded":"2024-02-15T23:30:10.799615+0000","last_fullsized":"2024-02-15T23:30:10.799615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:21.821782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924754+0000","last_change":"2024-02-15T23:29:31.693908+0000","last_active":"2024-02-15T23:31:03.924754+0000","last_peered":"2024-02-15T23:31:03.924754+0000","last_clean":"2024-02-15T23:31:03.924754+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:03.924754+0000","last_undegraded":"2024-02-15T23:31:03.924754+0000","last_fullsized":"2024-02-15T23:31:03.924754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:49.264719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787153+0000","last_change":"2024-02-15T23:29:29.707236+0000","last_active":"2024-02-15T23:30:10.787153+0000","last_peered":"2024-02-15T23:30:10.787153+0000","last_clean":"2024-02-15T23:30:10.787153+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:30:10.787153+0000","last_undegraded":"2024-02-15T23:30:10.787153+0000","last_fullsized":"2024-02-15T23:30:10.787153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924794+0000","last_change":"2024-02-15T23:29:31.709341+0000","last_active":"2024-02-15T23:31:03.924794+0000","last_peered":"2024-02-15T23:31:03.924794+0000","last_clean":"2024-02-15T23:31:03.924794+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:03.924794+0000","last_undegraded":"2024-02-15T23:31:03.924794+0000","last_fullsized":"2024-02-15T23:31:03.924794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:16.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787213+0000","last_change":"2024-02-15T23:29:29.716033+0000","last_active":"2024-02-15T23:30:10.787213+0000","last_peered":"2024-02-15T23:30:10.787213+0000","last_clean":"2024-02-15T23:30:10.787213+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:30:10.787213+0000","last_undegraded":"2024-02-15T23:30:10.787213+0000","last_fullsized":"2024-02-15T23:30:10.787213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310211+0000","last_change":"2024-02-15T23:29:31.704944+0000","last_active":"2024-02-15T23:30:58.310211+0000","last_peered":"2024-02-15T23:30:58.310211+0000","last_clean":"2024-02-15T23:30:58.310211+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:30:58.310211+0000","last_undegraded":"2024-02-15T23:30:58.310211+0000","last_fullsized":"2024-02-15T23:30:58.310211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:21:12.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787672+0000","last_change":"2024-02-15T23:29:29.738175+0000","last_active":"2024-02-15T23:30:10.787672+0000","last_peered":"2024-02-15T23:30:10.787672+0000","last_clean":"2024-02-15T23:30:10.787672+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:30:10.787672+0000","last_undegraded":"2024-02-15T23:30:10.787672+0000","last_fullsized":"2024-02-15T23:30:10.787672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785339+0000","last_change":"2024-02-15T23:29:31.695350+0000","last_active":"2024-02-15T23:30:10.785339+0000","last_peered":"2024-02-15T23:30:10.785339+0000","last_clean":"2024-02-15T23:30:10.785339+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:30:10.785339+0000","last_undegraded":"2024-02-15T23:30:10.785339+0000","last_fullsized":"2024-02-15T23:30:10.785339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:21.379451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780402+0000","last_change":"2024-02-15T23:29:29.731948+0000","last_active":"2024-02-15T23:30:10.780402+0000","last_peered":"2024-02-15T23:30:10.780402+0000","last_clean":"2024-02-15T23:30:10.780402+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:30:10.780402+0000","last_undegraded":"2024-02-15T23:30:10.780402+0000","last_fullsized":"2024-02-15T23:30:10.780402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.925201+0000","last_change":"2024-02-15T23:29:31.693023+0000","last_active":"2024-02-15T23:31:03.925201+0000","last_peered":"2024-02-15T23:31:03.925201+0000","last_clean":"2024-02-15T23:31:03.925201+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:03.925201+0000","last_undegraded":"2024-02-15T23:31:03.925201+0000","last_fullsized":"2024-02-15T23:31:03.925201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790918+0000","last_change":"2024-02-15T23:29:29.710596+0000","last_active":"2024-02-15T23:30:10.790918+0000","last_peered":"2024-02-15T23:30:10.790918+0000","last_clean":"2024-02-15T23:30:10.790918+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:30:10.790918+0000","last_undegraded":"2024-02-15T23:30:10.790918+0000","last_fullsized":"2024-02-15T23:30:10.790918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796948+0000","last_change":"2024-02-15T23:29:31.689541+0000","last_active":"2024-02-15T23:30:10.796948+0000","last_peered":"2024-02-15T23:30:10.796948+0000","last_clean":"2024-02-15T23:30:10.796948+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:30:10.796948+0000","last_undegraded":"2024-02-15T23:30:10.796948+0000","last_fullsized":"2024-02-15T23:30:10.796948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:51.240648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795824+0000","last_change":"2024-02-15T23:29:29.716896+0000","last_active":"2024-02-15T23:30:10.795824+0000","last_peered":"2024-02-15T23:30:10.795824+0000","last_clean":"2024-02-15T23:30:10.795824+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:30:10.795824+0000","last_undegraded":"2024-02-15T23:30:10.795824+0000","last_fullsized":"2024-02-15T23:30:10.795824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:26:58.454845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.779706+0000","last_change":"2024-02-15T23:30:10.793574+0000","last_active":"2024-02-15T23:30:15.779706+0000","last_peered":"2024-02-15T23:30:15.779706+0000","last_clean":"2024-02-15T23:30:15.779706+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:30:15.779706+0000","last_undegraded":"2024-02-15T23:30:15.779706+0000","last_fullsized":"2024-02-15T23:30:15.779706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:47.873898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784302+0000","last_change":"2024-02-15T23:29:29.719351+0000","last_active":"2024-02-15T23:30:10.784302+0000","last_peered":"2024-02-15T23:30:10.784302+0000","last_clean":"2024-02-15T23:30:10.784302+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:30:10.784302+0000","last_undegraded":"2024-02-15T23:30:10.784302+0000","last_fullsized":"2024-02-15T23:30:10.784302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'21","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499219+0000","last_change":"2024-02-15T23:29:31.713582+0000","last_active":"2024-02-15T23:30:57.499219+0000","last_peered":"2024-02-15T23:30:57.499219+0000","last_clean":"2024-02-15T23:30:57.499219+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:30:57.499219+0000","last_undegraded":"2024-02-15T23:30:57.499219+0000","last_fullsized":"2024-02-15T23:30:57.499219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783783+0000","last_change":"2024-02-15T23:29:29.741437+0000","last_active":"2024-02-15T23:30:10.783783+0000","last_peered":"2024-02-15T23:30:10.783783+0000","last_clean":"2024-02-15T23:30:10.783783+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:30:10.783783+0000","last_undegraded":"2024-02-15T23:30:10.783783+0000","last_fullsized":"2024-02-15T23:30:10.783783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786380+0000","last_change":"2024-02-15T23:29:31.694663+0000","last_active":"2024-02-15T23:30:10.786380+0000","last_peered":"2024-02-15T23:30:10.786380+0000","last_clean":"2024-02-15T23:30:10.786380+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:30:10.786380+0000","last_undegraded":"2024-02-15T23:30:10.786380+0000","last_fullsized":"2024-02-15T23:30:10.786380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:01.705137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790614+0000","last_change":"2024-02-15T23:29:29.720975+0000","last_active":"2024-02-15T23:30:10.790614+0000","last_peered":"2024-02-15T23:30:10.790614+0000","last_clean":"2024-02-15T23:30:10.790614+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:30:10.790614+0000","last_undegraded":"2024-02-15T23:30:10.790614+0000","last_fullsized":"2024-02-15T23:30:10.790614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091043+0000","last_change":"2024-02-15T23:29:31.703991+0000","last_active":"2024-02-15T23:30:15.091043+0000","last_peered":"2024-02-15T23:30:15.091043+0000","last_clean":"2024-02-15T23:30:15.091043+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:30:15.091043+0000","last_undegraded":"2024-02-15T23:30:15.091043+0000","last_fullsized":"2024-02-15T23:30:15.091043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.248593+0000","last_change":"2024-02-15T23:29:29.714331+0000","last_active":"2024-02-15T23:30:14.248593+0000","last_peered":"2024-02-15T23:30:14.248593+0000","last_clean":"2024-02-15T23:30:14.248593+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:30:14.248593+0000","last_undegraded":"2024-02-15T23:30:14.248593+0000","last_fullsized":"2024-02-15T23:30:14.248593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:19.362596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499673+0000","last_change":"2024-02-15T23:29:31.689861+0000","last_active":"2024-02-15T23:30:57.499673+0000","last_peered":"2024-02-15T23:30:57.499673+0000","last_clean":"2024-02-15T23:30:57.499673+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:30:57.499673+0000","last_undegraded":"2024-02-15T23:30:57.499673+0000","last_fullsized":"2024-02-15T23:30:57.499673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:43.878770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810021+0000","last_change":"2024-02-15T23:29:29.720292+0000","last_active":"2024-02-15T23:30:10.810021+0000","last_peered":"2024-02-15T23:30:10.810021+0000","last_clean":"2024-02-15T23:30:10.810021+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:30:10.810021+0000","last_undegraded":"2024-02-15T23:30:10.810021+0000","last_fullsized":"2024-02-15T23:30:10.810021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:29.439315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310693+0000","last_change":"2024-02-15T23:29:31.699375+0000","last_active":"2024-02-15T23:30:58.310693+0000","last_peered":"2024-02-15T23:30:58.310693+0000","last_clean":"2024-02-15T23:30:58.310693+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:30:58.310693+0000","last_undegraded":"2024-02-15T23:30:58.310693+0000","last_fullsized":"2024-02-15T23:30:58.310693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:33.891211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780993+0000","last_change":"2024-02-15T23:29:29.730792+0000","last_active":"2024-02-15T23:30:10.780993+0000","last_peered":"2024-02-15T23:30:10.780993+0000","last_clean":"2024-02-15T23:30:10.780993+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:30:10.780993+0000","last_undegraded":"2024-02-15T23:30:10.780993+0000","last_fullsized":"2024-02-15T23:30:10.780993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.854975+0000","last_change":"2024-02-15T23:29:31.694898+0000","last_active":"2024-02-15T23:30:57.854975+0000","last_peered":"2024-02-15T23:30:57.854975+0000","last_clean":"2024-02-15T23:30:57.854975+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:30:57.854975+0000","last_undegraded":"2024-02-15T23:30:57.854975+0000","last_fullsized":"2024-02-15T23:30:57.854975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:33.539189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.081189+0000","last_change":"2024-02-15T23:29:29.714026+0000","last_active":"2024-02-15T23:30:15.081189+0000","last_peered":"2024-02-15T23:30:15.081189+0000","last_clean":"2024-02-15T23:30:15.081189+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:30:15.081189+0000","last_undegraded":"2024-02-15T23:30:15.081189+0000","last_fullsized":"2024-02-15T23:30:15.081189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:39.963502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796908+0000","last_change":"2024-02-15T23:29:29.714394+0000","last_active":"2024-02-15T23:30:10.796908+0000","last_peered":"2024-02-15T23:30:10.796908+0000","last_clean":"2024-02-15T23:30:10.796908+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:30:10.796908+0000","last_undegraded":"2024-02-15T23:30:10.796908+0000","last_fullsized":"2024-02-15T23:30:10.796908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:36.000311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791872+0000","last_change":"2024-02-15T23:29:31.696441+0000","last_active":"2024-02-15T23:30:10.791872+0000","last_peered":"2024-02-15T23:30:10.791872+0000","last_clean":"2024-02-15T23:30:10.791872+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:30:10.791872+0000","last_undegraded":"2024-02-15T23:30:10.791872+0000","last_fullsized":"2024-02-15T23:30:10.791872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:07.483252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784436+0000","last_change":"2024-02-15T23:29:29.716351+0000","last_active":"2024-02-15T23:30:10.784436+0000","last_peered":"2024-02-15T23:30:10.784436+0000","last_clean":"2024-02-15T23:30:10.784436+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:30:10.784436+0000","last_undegraded":"2024-02-15T23:30:10.784436+0000","last_fullsized":"2024-02-15T23:30:10.784436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091055+0000","last_change":"2024-02-15T23:29:31.709385+0000","last_active":"2024-02-15T23:30:15.091055+0000","last_peered":"2024-02-15T23:30:15.091055+0000","last_clean":"2024-02-15T23:30:15.091055+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:30:15.091055+0000","last_undegraded":"2024-02-15T23:30:15.091055+0000","last_fullsized":"2024-02-15T23:30:15.091055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:02.842564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705692,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52700000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705690,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.622}]},{"osd":3,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.503},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":0.67500000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.755},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.64700000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:31:12.764 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-15T23:31:12.764 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:31:12.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.903+0000 7f70cfe7b640 1 Processor -- start 2024-02-15T23:31:12.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.903+0000 7f70cfe7b640 1 -- start start 2024-02-15T23:31:12.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f70c81290f0 0x7f70c812c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c8095ee0 con 0x7f70c8128d10 2024-02-15T23:31:12.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c8096320 con 0x7f70c81290f0 2024-02-15T23:31:12.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cd416640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f70c81290f0 0x7f70c812c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cdc17640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f70c8128d10 0x7f70c812bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36860/0 (socket says 172.21.15.131:36860) 2024-02-15T23:31:12.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cdc17640 1 -- 172.21.15.131:0/1649133066 learned_addr learned my addr 172.21.15.131:0/1649133066 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:12.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cd416640 1 -- 172.21.15.131:0/1649133066 >> v1:172.21.15.131:6789/0 conn(0x7f70c8128d10 legacy=0x7f70c812bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70ccc15640 1 -- 172.21.15.131:0/1649133066 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052948315 0 0) 0x7f70c8095ee0 con 0x7f70c8128d10 2024-02-15T23:31:12.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cd416640 1 -- 172.21.15.131:0/1649133066 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8128620 con 0x7f70c81290f0 2024-02-15T23:31:12.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cd416640 1 --2- 172.21.15.131:0/1649133066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c81290f0 0x7f70c812c230 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009740 tx=0x7f70bc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfcd41faba42f43 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70ccc15640 1 -- 172.21.15.131:0/1649133066 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70bc0ac530 con 0x7f70c81290f0 2024-02-15T23:31:12.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70ccc15640 1 -- 172.21.15.131:0/1649133066 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc0a8050 con 0x7f70c81290f0 2024-02-15T23:31:12.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70ccc15640 1 -- 172.21.15.131:0/1649133066 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70bc0ac7e0 con 0x7f70c81290f0 2024-02-15T23:31:12.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 -- 172.21.15.131:0/1649133066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c81290f0 msgr2=0x7f70c812c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:12.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 --2- 172.21.15.131:0/1649133066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c81290f0 0x7f70c812c230 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009740 tx=0x7f70bc01c490 comp rx=0 tx=0).stop 2024-02-15T23:31:12.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 -- 172.21.15.131:0/1649133066 shutdown_connections 2024-02-15T23:31:12.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 --2- 172.21.15.131:0/1649133066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c81290f0 0x7f70c812c230 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:12.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 -- 172.21.15.131:0/1649133066 >> 172.21.15.131:0/1649133066 conn(0x7f70c809a2f0 msgr2=0x7f70c809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:12.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 -- 172.21.15.131:0/1649133066 shutdown_connections 2024-02-15T23:31:12.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.907+0000 7f70cfe7b640 1 -- 172.21.15.131:0/1649133066 wait complete. 2024-02-15T23:31:12.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cfe7b640 1 Processor -- start 2024-02-15T23:31:12.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cfe7b640 1 -- start start 2024-02-15T23:31:12.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cfe7b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c8128d10 0x7f70c81c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cfe7b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c8131710 con 0x7f70c8128d10 2024-02-15T23:31:12.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cdc17640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c8128d10 0x7f70c81c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cdc17640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c8128d10 0x7f70c81c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51186/0 (socket says 172.21.15.131:51186) 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cdc17640 1 -- 172.21.15.131:0/177166521 learned_addr learned my addr 172.21.15.131:0/177166521 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cdc17640 1 -- 172.21.15.131:0/177166521 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc009420 con 0x7f70c8128d10 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cdc17640 1 --2- 172.21.15.131:0/177166521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c8128d10 0x7f70c81c3010 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c840 tx=0x7f70c000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70c67fc640 1 -- 172.21.15.131:0/177166521 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70c000a660 con 0x7f70c8128d10 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70c67fc640 1 -- 172.21.15.131:0/177166521 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000a7e0 con 0x7f70c8128d10 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c80980b0 con 0x7f70c8128d10 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70c67fc640 1 -- 172.21.15.131:0/177166521 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70c000aac0 con 0x7f70c8128d10 2024-02-15T23:31:12.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c8130450 con 0x7f70c8128d10 2024-02-15T23:31:12.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70c67fc640 1 -- 172.21.15.131:0/177166521 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70c000ac20 con 0x7f70c8128d10 2024-02-15T23:31:12.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c8067e00 con 0x7f70c8128d10 2024-02-15T23:31:12.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70c67fc640 1 --2- 172.21.15.131:0/177166521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70b4035a10 0x7f70b4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:12.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70c67fc640 1 -- 172.21.15.131:0/177166521 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f70c0048130 con 0x7f70c8128d10 2024-02-15T23:31:12.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.911+0000 7f70cd416640 1 --2- 172.21.15.131:0/177166521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70b4035a10 0x7f70b4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:12.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.915+0000 7f70cd416640 1 --2- 172.21.15.131:0/177166521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70b4035a10 0x7f70b4037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0ae000 tx=0x7f70bc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:12.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:12.915+0000 7f70c67fc640 1 -- 172.21.15.131:0/177166521 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f70c001a6b0 con 0x7f70c8128d10 2024-02-15T23:31:13.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.071+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70c809bcd0 con 0x7f70b4035a10 2024-02-15T23:31:13.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.119+0000 7f70c67fc640 1 -- 172.21.15.131:0/177166521 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673439 (secure 0 0 0) 0x7f70c809bcd0 con 0x7f70b4035a10 2024-02-15T23:31:13.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:31:13.139 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:31:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70b4035a10 msgr2=0x7f70b4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 --2- 172.21.15.131:0/177166521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70b4035a10 0x7f70b4037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0ae000 tx=0x7f70bc0a7000 comp rx=0 tx=0).stop 2024-02-15T23:31:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c8128d10 msgr2=0x7f70c81c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 --2- 172.21.15.131:0/177166521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c8128d10 0x7f70c81c3010 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c840 tx=0x7f70c000cd00 comp rx=0 tx=0).stop 2024-02-15T23:31:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 shutdown_connections 2024-02-15T23:31:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 --2- 172.21.15.131:0/177166521 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70b4035a10 0x7f70b4037ed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 --2- 172.21.15.131:0/177166521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70c8128d10 0x7f70c81c3010 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 >> 172.21.15.131:0/177166521 conn(0x7f70c809a2f0 msgr2=0x7f70c8121940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 shutdown_connections 2024-02-15T23:31:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.123+0000 7f70cfe7b640 1 -- 172.21.15.131:0/177166521 wait complete. 2024-02-15T23:31:13.152 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-15T23:31:11.540744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1179,"num_objects":-18,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":381,"num_read_kb":364,"num_write":117,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005607"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780958+0000","last_change":"2024-02-15T23:29:29.730549+0000","last_active":"2024-02-15T23:30:10.780958+0000","last_peered":"2024-02-15T23:30:10.780958+0000","last_clean":"2024-02-15T23:30:10.780958+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:30:10.780958+0000","last_undegraded":"2024-02-15T23:30:10.780958+0000","last_fullsized":"2024-02-15T23:30:10.780958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785328+0000","last_change":"2024-02-15T23:29:31.691386+0000","last_active":"2024-02-15T23:30:10.785328+0000","last_peered":"2024-02-15T23:30:10.785328+0000","last_clean":"2024-02-15T23:30:10.785328+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:30:10.785328+0000","last_undegraded":"2024-02-15T23:30:10.785328+0000","last_fullsized":"2024-02-15T23:30:10.785328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790667+0000","last_change":"2024-02-15T23:29:29.719743+0000","last_active":"2024-02-15T23:30:10.790667+0000","last_peered":"2024-02-15T23:30:10.790667+0000","last_clean":"2024-02-15T23:30:10.790667+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:30:10.790667+0000","last_undegraded":"2024-02-15T23:30:10.790667+0000","last_fullsized":"2024-02-15T23:30:10.790667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:39.453929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798345+0000","last_change":"2024-02-15T23:29:31.701574+0000","last_active":"2024-02-15T23:30:10.798345+0000","last_peered":"2024-02-15T23:30:10.798345+0000","last_clean":"2024-02-15T23:30:10.798345+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:30:10.798345+0000","last_undegraded":"2024-02-15T23:30:10.798345+0000","last_fullsized":"2024-02-15T23:30:10.798345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:10.584779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812824+0000","last_change":"2024-02-15T23:29:29.725919+0000","last_active":"2024-02-15T23:30:10.812824+0000","last_peered":"2024-02-15T23:30:10.812824+0000","last_clean":"2024-02-15T23:30:10.812824+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:30:10.812824+0000","last_undegraded":"2024-02-15T23:30:10.812824+0000","last_fullsized":"2024-02-15T23:30:10.812824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:47.717202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806961+0000","last_change":"2024-02-15T23:29:31.701595+0000","last_active":"2024-02-15T23:30:10.806961+0000","last_peered":"2024-02-15T23:30:10.806961+0000","last_clean":"2024-02-15T23:30:10.806961+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:30:10.806961+0000","last_undegraded":"2024-02-15T23:30:10.806961+0000","last_fullsized":"2024-02-15T23:30:10.806961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:22.710710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778727+0000","last_change":"2024-02-15T23:29:29.725199+0000","last_active":"2024-02-15T23:30:10.778727+0000","last_peered":"2024-02-15T23:30:10.778727+0000","last_clean":"2024-02-15T23:30:10.778727+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:30:10.778727+0000","last_undegraded":"2024-02-15T23:30:10.778727+0000","last_fullsized":"2024-02-15T23:30:10.778727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807450+0000","last_change":"2024-02-15T23:29:31.703063+0000","last_active":"2024-02-15T23:30:10.807450+0000","last_peered":"2024-02-15T23:30:10.807450+0000","last_clean":"2024-02-15T23:30:10.807450+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:30:10.807450+0000","last_undegraded":"2024-02-15T23:30:10.807450+0000","last_fullsized":"2024-02-15T23:30:10.807450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:01.557444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805914+0000","last_change":"2024-02-15T23:29:29.710832+0000","last_active":"2024-02-15T23:30:10.805914+0000","last_peered":"2024-02-15T23:30:10.805914+0000","last_clean":"2024-02-15T23:30:10.805914+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:30:10.805914+0000","last_undegraded":"2024-02-15T23:30:10.805914+0000","last_fullsized":"2024-02-15T23:30:10.805914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:40.054442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924941+0000","last_change":"2024-02-15T23:29:31.689546+0000","last_active":"2024-02-15T23:31:03.924941+0000","last_peered":"2024-02-15T23:31:03.924941+0000","last_clean":"2024-02-15T23:31:03.924941+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:03.924941+0000","last_undegraded":"2024-02-15T23:31:03.924941+0000","last_fullsized":"2024-02-15T23:31:03.924941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:35.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777097+0000","last_change":"2024-02-15T23:29:29.729934+0000","last_active":"2024-02-15T23:30:10.777097+0000","last_peered":"2024-02-15T23:30:10.777097+0000","last_clean":"2024-02-15T23:30:10.777097+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:30:10.777097+0000","last_undegraded":"2024-02-15T23:30:10.777097+0000","last_fullsized":"2024-02-15T23:30:10.777097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:51:36.207574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808769+0000","last_change":"2024-02-15T23:29:31.705431+0000","last_active":"2024-02-15T23:30:10.808769+0000","last_peered":"2024-02-15T23:30:10.808769+0000","last_clean":"2024-02-15T23:30:10.808769+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:30:10.808769+0000","last_undegraded":"2024-02-15T23:30:10.808769+0000","last_fullsized":"2024-02-15T23:30:10.808769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:20.343794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795719+0000","last_change":"2024-02-15T23:29:29.707555+0000","last_active":"2024-02-15T23:30:10.795719+0000","last_peered":"2024-02-15T23:30:10.795719+0000","last_clean":"2024-02-15T23:30:10.795719+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:30:10.795719+0000","last_undegraded":"2024-02-15T23:30:10.795719+0000","last_fullsized":"2024-02-15T23:30:10.795719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:50:04.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091130+0000","last_change":"2024-02-15T23:29:31.689285+0000","last_active":"2024-02-15T23:30:15.091130+0000","last_peered":"2024-02-15T23:30:15.091130+0000","last_clean":"2024-02-15T23:30:15.091130+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:30:15.091130+0000","last_undegraded":"2024-02-15T23:30:15.091130+0000","last_fullsized":"2024-02-15T23:30:15.091130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784401+0000","last_change":"2024-02-15T23:29:29.720155+0000","last_active":"2024-02-15T23:30:10.784401+0000","last_peered":"2024-02-15T23:30:10.784401+0000","last_clean":"2024-02-15T23:30:10.784401+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:30:10.784401+0000","last_undegraded":"2024-02-15T23:30:10.784401+0000","last_fullsized":"2024-02-15T23:30:10.784401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784463+0000","last_change":"2024-02-15T23:29:31.711090+0000","last_active":"2024-02-15T23:30:10.784463+0000","last_peered":"2024-02-15T23:30:10.784463+0000","last_clean":"2024-02-15T23:30:10.784463+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:30:10.784463+0000","last_undegraded":"2024-02-15T23:30:10.784463+0000","last_fullsized":"2024-02-15T23:30:10.784463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797604+0000","last_change":"2024-02-15T23:29:31.699913+0000","last_active":"2024-02-15T23:30:10.797604+0000","last_peered":"2024-02-15T23:30:10.797604+0000","last_clean":"2024-02-15T23:30:10.797604+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:30:10.797604+0000","last_undegraded":"2024-02-15T23:30:10.797604+0000","last_fullsized":"2024-02-15T23:30:10.797604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:37.069926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.304267+0000","last_change":"2024-02-15T23:29:29.720102+0000","last_active":"2024-02-15T23:30:58.304267+0000","last_peered":"2024-02-15T23:30:58.304267+0000","last_clean":"2024-02-15T23:30:58.304267+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:30:58.304267+0000","last_undegraded":"2024-02-15T23:30:58.304267+0000","last_fullsized":"2024-02-15T23:30:58.304267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.750065+0000","last_change":"2024-02-15T23:29:31.691136+0000","last_active":"2024-02-15T23:30:14.750065+0000","last_peered":"2024-02-15T23:30:14.750065+0000","last_clean":"2024-02-15T23:30:14.750065+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:30:14.750065+0000","last_undegraded":"2024-02-15T23:30:14.750065+0000","last_fullsized":"2024-02-15T23:30:14.750065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:07.483252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781312+0000","last_change":"2024-02-15T23:29:29.734663+0000","last_active":"2024-02-15T23:30:10.781312+0000","last_peered":"2024-02-15T23:30:10.781312+0000","last_clean":"2024-02-15T23:30:10.781312+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:30:10.781312+0000","last_undegraded":"2024-02-15T23:30:10.781312+0000","last_fullsized":"2024-02-15T23:30:10.781312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924741+0000","last_change":"2024-02-15T23:29:31.689924+0000","last_active":"2024-02-15T23:31:03.924741+0000","last_peered":"2024-02-15T23:31:03.924741+0000","last_clean":"2024-02-15T23:31:03.924741+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:03.924741+0000","last_undegraded":"2024-02-15T23:31:03.924741+0000","last_fullsized":"2024-02-15T23:31:03.924741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:43:45.030558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791227+0000","last_change":"2024-02-15T23:29:29.739167+0000","last_active":"2024-02-15T23:30:10.791227+0000","last_peered":"2024-02-15T23:30:10.791227+0000","last_clean":"2024-02-15T23:30:10.791227+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:30:10.791227+0000","last_undegraded":"2024-02-15T23:30:10.791227+0000","last_fullsized":"2024-02-15T23:30:10.791227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.764985+0000","last_change":"2024-02-15T23:29:31.708859+0000","last_active":"2024-02-15T23:30:14.764985+0000","last_peered":"2024-02-15T23:30:14.764985+0000","last_clean":"2024-02-15T23:30:14.764985+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:30:14.764985+0000","last_undegraded":"2024-02-15T23:30:14.764985+0000","last_fullsized":"2024-02-15T23:30:14.764985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:07.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785957+0000","last_change":"2024-02-15T23:29:29.720464+0000","last_active":"2024-02-15T23:30:10.785957+0000","last_peered":"2024-02-15T23:30:10.785957+0000","last_clean":"2024-02-15T23:30:10.785957+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:30:10.785957+0000","last_undegraded":"2024-02-15T23:30:10.785957+0000","last_fullsized":"2024-02-15T23:30:10.785957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784167+0000","last_change":"2024-02-15T23:29:31.703343+0000","last_active":"2024-02-15T23:30:10.784167+0000","last_peered":"2024-02-15T23:30:10.784167+0000","last_clean":"2024-02-15T23:30:10.784167+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:30:10.784167+0000","last_undegraded":"2024-02-15T23:30:10.784167+0000","last_fullsized":"2024-02-15T23:30:10.784167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:21.379451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787886+0000","last_change":"2024-02-15T23:29:29.719436+0000","last_active":"2024-02-15T23:30:10.787886+0000","last_peered":"2024-02-15T23:30:10.787886+0000","last_clean":"2024-02-15T23:30:10.787886+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:30:10.787886+0000","last_undegraded":"2024-02-15T23:30:10.787886+0000","last_fullsized":"2024-02-15T23:30:10.787886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792681+0000","last_change":"2024-02-15T23:29:31.689367+0000","last_active":"2024-02-15T23:30:10.792681+0000","last_peered":"2024-02-15T23:30:10.792681+0000","last_clean":"2024-02-15T23:30:10.792681+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:30:10.792681+0000","last_undegraded":"2024-02-15T23:30:10.792681+0000","last_fullsized":"2024-02-15T23:30:10.792681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:54:16.380534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.800109+0000","last_change":"2024-02-15T23:29:29.717627+0000","last_active":"2024-02-15T23:30:10.800109+0000","last_peered":"2024-02-15T23:30:10.800109+0000","last_clean":"2024-02-15T23:30:10.800109+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:30:10.800109+0000","last_undegraded":"2024-02-15T23:30:10.800109+0000","last_fullsized":"2024-02-15T23:30:10.800109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:39.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'17","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.908865+0000","last_change":"2024-02-15T23:29:39.766173+0000","last_active":"2024-02-15T23:31:03.908865+0000","last_peered":"2024-02-15T23:31:03.908865+0000","last_clean":"2024-02-15T23:31:03.908865+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:03.908865+0000","last_undegraded":"2024-02-15T23:31:03.908865+0000","last_fullsized":"2024-02-15T23:31:03.908865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809014+0000","last_change":"2024-02-15T23:29:31.703049+0000","last_active":"2024-02-15T23:30:10.809014+0000","last_peered":"2024-02-15T23:30:10.809014+0000","last_clean":"2024-02-15T23:30:10.809014+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:30:10.809014+0000","last_undegraded":"2024-02-15T23:30:10.809014+0000","last_fullsized":"2024-02-15T23:30:10.809014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:58:59.538674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.804971+0000","last_change":"2024-02-15T23:29:29.711609+0000","last_active":"2024-02-15T23:30:10.804971+0000","last_peered":"2024-02-15T23:30:10.804971+0000","last_clean":"2024-02-15T23:30:10.804971+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:30:10.804971+0000","last_undegraded":"2024-02-15T23:30:10.804971+0000","last_fullsized":"2024-02-15T23:30:10.804971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:47.247864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808354+0000","last_change":"2024-02-15T23:29:33.713197+0000","last_active":"2024-02-15T23:30:10.808354+0000","last_peered":"2024-02-15T23:30:10.808354+0000","last_clean":"2024-02-15T23:30:10.808354+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:30:10.808354+0000","last_undegraded":"2024-02-15T23:30:10.808354+0000","last_fullsized":"2024-02-15T23:30:10.808354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:59:23.796227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.274861+0000","last_change":"2024-02-15T23:29:35.748567+0000","last_active":"2024-02-15T23:30:58.274861+0000","last_peered":"2024-02-15T23:30:58.274861+0000","last_clean":"2024-02-15T23:30:58.274861+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:30:58.274861+0000","last_undegraded":"2024-02-15T23:30:58.274861+0000","last_fullsized":"2024-02-15T23:30:58.274861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:00:08.530157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792782+0000","last_change":"2024-02-15T23:29:37.761765+0000","last_active":"2024-02-15T23:30:10.792782+0000","last_peered":"2024-02-15T23:30:10.792782+0000","last_clean":"2024-02-15T23:30:10.792782+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:30:10.792782+0000","last_undegraded":"2024-02-15T23:30:10.792782+0000","last_fullsized":"2024-02-15T23:30:10.792782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:20.640463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.446576+0000","last_change":"2024-02-15T23:29:39.772828+0000","last_active":"2024-02-15T23:30:52.446576+0000","last_peered":"2024-02-15T23:30:52.446576+0000","last_clean":"2024-02-15T23:30:52.446576+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:30:52.446576+0000","last_undegraded":"2024-02-15T23:30:52.446576+0000","last_fullsized":"2024-02-15T23:30:52.446576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:46:46.759299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499588+0000","last_change":"2024-02-15T23:29:31.707498+0000","last_active":"2024-02-15T23:30:57.499588+0000","last_peered":"2024-02-15T23:30:57.499588+0000","last_clean":"2024-02-15T23:30:57.499588+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:30:57.499588+0000","last_undegraded":"2024-02-15T23:30:57.499588+0000","last_fullsized":"2024-02-15T23:30:57.499588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:47.182154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776324+0000","last_change":"2024-02-15T23:29:29.722314+0000","last_active":"2024-02-15T23:30:10.776324+0000","last_peered":"2024-02-15T23:30:10.776324+0000","last_clean":"2024-02-15T23:30:10.776324+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:30:10.776324+0000","last_undegraded":"2024-02-15T23:30:10.776324+0000","last_fullsized":"2024-02-15T23:30:10.776324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785649+0000","last_change":"2024-02-15T23:29:33.707309+0000","last_active":"2024-02-15T23:30:10.785649+0000","last_peered":"2024-02-15T23:30:10.785649+0000","last_clean":"2024-02-15T23:30:10.785649+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:30:10.785649+0000","last_undegraded":"2024-02-15T23:30:10.785649+0000","last_fullsized":"2024-02-15T23:30:10.785649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:38:28.615466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791778+0000","last_change":"2024-02-15T23:29:35.731494+0000","last_active":"2024-02-15T23:30:10.791778+0000","last_peered":"2024-02-15T23:30:10.791778+0000","last_clean":"2024-02-15T23:30:10.791778+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:30:10.791778+0000","last_undegraded":"2024-02-15T23:30:10.791778+0000","last_fullsized":"2024-02-15T23:30:10.791778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:29:30.966627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786144+0000","last_change":"2024-02-15T23:29:37.752102+0000","last_active":"2024-02-15T23:30:10.786144+0000","last_peered":"2024-02-15T23:30:10.786144+0000","last_clean":"2024-02-15T23:30:10.786144+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:30:10.786144+0000","last_undegraded":"2024-02-15T23:30:10.786144+0000","last_fullsized":"2024-02-15T23:30:10.786144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:37.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783801+0000","last_change":"2024-02-15T23:29:39.757721+0000","last_active":"2024-02-15T23:30:10.783801+0000","last_peered":"2024-02-15T23:30:10.783801+0000","last_clean":"2024-02-15T23:30:10.783801+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:30:10.783801+0000","last_undegraded":"2024-02-15T23:30:10.783801+0000","last_fullsized":"2024-02-15T23:30:10.783801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:27.441839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310678+0000","last_change":"2024-02-15T23:29:31.705324+0000","last_active":"2024-02-15T23:30:58.310678+0000","last_peered":"2024-02-15T23:30:58.310678+0000","last_clean":"2024-02-15T23:30:58.310678+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:30:58.310678+0000","last_undegraded":"2024-02-15T23:30:58.310678+0000","last_fullsized":"2024-02-15T23:30:58.310678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:52.531050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795098+0000","last_change":"2024-02-15T23:29:29.728584+0000","last_active":"2024-02-15T23:30:10.795098+0000","last_peered":"2024-02-15T23:30:10.795098+0000","last_clean":"2024-02-15T23:30:10.795098+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:30:10.795098+0000","last_undegraded":"2024-02-15T23:30:10.795098+0000","last_fullsized":"2024-02-15T23:30:10.795098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:16.480977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791658+0000","last_change":"2024-02-15T23:29:33.723876+0000","last_active":"2024-02-15T23:30:10.791658+0000","last_peered":"2024-02-15T23:30:10.791658+0000","last_clean":"2024-02-15T23:30:10.791658+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:30:10.791658+0000","last_undegraded":"2024-02-15T23:30:10.791658+0000","last_fullsized":"2024-02-15T23:30:10.791658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:04.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778396+0000","last_change":"2024-02-15T23:29:35.725059+0000","last_active":"2024-02-15T23:30:10.778396+0000","last_peered":"2024-02-15T23:30:10.778396+0000","last_clean":"2024-02-15T23:30:10.778396+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:30:10.778396+0000","last_undegraded":"2024-02-15T23:30:10.778396+0000","last_fullsized":"2024-02-15T23:30:10.778396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:42.048881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.147419+0000","last_change":"2024-02-15T23:29:37.774111+0000","last_active":"2024-02-15T23:31:04.147419+0000","last_peered":"2024-02-15T23:31:04.147419+0000","last_clean":"2024-02-15T23:31:04.147419+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:04.147419+0000","last_undegraded":"2024-02-15T23:31:04.147419+0000","last_fullsized":"2024-02-15T23:31:04.147419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:25.049564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777264+0000","last_change":"2024-02-15T23:29:39.776305+0000","last_active":"2024-02-15T23:30:10.777264+0000","last_peered":"2024-02-15T23:30:10.777264+0000","last_clean":"2024-02-15T23:30:10.777264+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:30:10.777264+0000","last_undegraded":"2024-02-15T23:30:10.777264+0000","last_fullsized":"2024-02-15T23:30:10.777264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:57.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791795+0000","last_change":"2024-02-15T23:29:31.696768+0000","last_active":"2024-02-15T23:30:10.791795+0000","last_peered":"2024-02-15T23:30:10.791795+0000","last_clean":"2024-02-15T23:30:10.791795+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:30:10.791795+0000","last_undegraded":"2024-02-15T23:30:10.791795+0000","last_fullsized":"2024-02-15T23:30:10.791795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:02.842564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783249+0000","last_change":"2024-02-15T23:29:29.737866+0000","last_active":"2024-02-15T23:30:10.783249+0000","last_peered":"2024-02-15T23:30:10.783249+0000","last_clean":"2024-02-15T23:30:10.783249+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:30:10.783249+0000","last_undegraded":"2024-02-15T23:30:10.783249+0000","last_fullsized":"2024-02-15T23:30:10.783249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:51:36.207574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809941+0000","last_change":"2024-02-15T23:29:33.715302+0000","last_active":"2024-02-15T23:30:10.809941+0000","last_peered":"2024-02-15T23:30:10.809941+0000","last_clean":"2024-02-15T23:30:10.809941+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:30:10.809941+0000","last_undegraded":"2024-02-15T23:30:10.809941+0000","last_fullsized":"2024-02-15T23:30:10.809941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:57.337417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.267498+0000","last_change":"2024-02-15T23:29:35.718792+0000","last_active":"2024-02-15T23:30:58.267498+0000","last_peered":"2024-02-15T23:30:58.267498+0000","last_clean":"2024-02-15T23:30:58.267498+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:30:58.267498+0000","last_undegraded":"2024-02-15T23:30:58.267498+0000","last_fullsized":"2024-02-15T23:30:58.267498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:06.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":330,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.153670+0000","last_change":"2024-02-15T23:29:37.752749+0000","last_active":"2024-02-15T23:31:04.153670+0000","last_peered":"2024-02-15T23:31:04.153670+0000","last_clean":"2024-02-15T23:31:04.153670+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:04.153670+0000","last_undegraded":"2024-02-15T23:31:04.153670+0000","last_fullsized":"2024-02-15T23:31:04.153670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:58.620898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797372+0000","last_change":"2024-02-15T23:29:31.702049+0000","last_active":"2024-02-15T23:30:10.797372+0000","last_peered":"2024-02-15T23:30:10.797372+0000","last_clean":"2024-02-15T23:30:10.797372+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:30:10.797372+0000","last_undegraded":"2024-02-15T23:30:10.797372+0000","last_fullsized":"2024-02-15T23:30:10.797372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:56.628114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780198+0000","last_change":"2024-02-15T23:29:29.731688+0000","last_active":"2024-02-15T23:30:10.780198+0000","last_peered":"2024-02-15T23:30:10.780198+0000","last_clean":"2024-02-15T23:30:10.780198+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:30:10.780198+0000","last_undegraded":"2024-02-15T23:30:10.780198+0000","last_fullsized":"2024-02-15T23:30:10.780198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783045+0000","last_change":"2024-02-15T23:29:33.721207+0000","last_active":"2024-02-15T23:30:10.783045+0000","last_peered":"2024-02-15T23:30:10.783045+0000","last_clean":"2024-02-15T23:30:10.783045+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:30:10.783045+0000","last_undegraded":"2024-02-15T23:30:10.783045+0000","last_fullsized":"2024-02-15T23:30:10.783045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:35.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.280812+0000","last_change":"2024-02-15T23:29:35.722074+0000","last_active":"2024-02-15T23:30:58.280812+0000","last_peered":"2024-02-15T23:30:58.280812+0000","last_clean":"2024-02-15T23:30:58.280812+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:30:58.280812+0000","last_undegraded":"2024-02-15T23:30:58.280812+0000","last_fullsized":"2024-02-15T23:30:58.280812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:37.868310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787088+0000","last_change":"2024-02-15T23:29:37.752862+0000","last_active":"2024-02-15T23:30:10.787088+0000","last_peered":"2024-02-15T23:30:10.787088+0000","last_clean":"2024-02-15T23:30:10.787088+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:30:10.787088+0000","last_undegraded":"2024-02-15T23:30:10.787088+0000","last_fullsized":"2024-02-15T23:30:10.787088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:24.593703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.061346+0000","last_change":"2024-02-15T23:29:39.779875+0000","last_active":"2024-02-15T23:30:58.061346+0000","last_peered":"2024-02-15T23:30:58.061346+0000","last_clean":"2024-02-15T23:30:58.061346+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:30:58.061346+0000","last_undegraded":"2024-02-15T23:30:58.061346+0000","last_fullsized":"2024-02-15T23:30:58.061346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:55.612483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.925206+0000","last_change":"2024-02-15T23:29:31.694940+0000","last_active":"2024-02-15T23:31:03.925206+0000","last_peered":"2024-02-15T23:31:03.925206+0000","last_clean":"2024-02-15T23:31:03.925206+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:31:03.925206+0000","last_undegraded":"2024-02-15T23:31:03.925206+0000","last_fullsized":"2024-02-15T23:31:03.925206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:07.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779830+0000","last_change":"2024-02-15T23:29:29.723619+0000","last_active":"2024-02-15T23:30:10.779830+0000","last_peered":"2024-02-15T23:30:10.779830+0000","last_clean":"2024-02-15T23:30:10.779830+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:30:10.779830+0000","last_undegraded":"2024-02-15T23:30:10.779830+0000","last_fullsized":"2024-02-15T23:30:10.779830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790262+0000","last_change":"2024-02-15T23:30:10.788609+0000","last_active":"2024-02-15T23:30:10.790262+0000","last_peered":"2024-02-15T23:30:10.790262+0000","last_clean":"2024-02-15T23:30:10.790262+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:30:10.790262+0000","last_undegraded":"2024-02-15T23:30:10.790262+0000","last_fullsized":"2024-02-15T23:30:10.790262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:57.337417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.254023+0000","last_change":"2024-02-15T23:29:35.747759+0000","last_active":"2024-02-15T23:30:58.254023+0000","last_peered":"2024-02-15T23:30:58.254023+0000","last_clean":"2024-02-15T23:30:58.254023+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:30:58.254023+0000","last_undegraded":"2024-02-15T23:30:58.254023+0000","last_fullsized":"2024-02-15T23:30:58.254023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:50:15.235598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785044+0000","last_change":"2024-02-15T23:29:37.763519+0000","last_active":"2024-02-15T23:30:10.785044+0000","last_peered":"2024-02-15T23:30:10.785044+0000","last_clean":"2024-02-15T23:30:10.785044+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:30:10.785044+0000","last_undegraded":"2024-02-15T23:30:10.785044+0000","last_fullsized":"2024-02-15T23:30:10.785044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:40.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.305871+0000","last_change":"2024-02-15T23:29:39.781125+0000","last_active":"2024-02-15T23:30:52.305871+0000","last_peered":"2024-02-15T23:30:52.305871+0000","last_clean":"2024-02-15T23:30:52.305871+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:30:52.305871+0000","last_undegraded":"2024-02-15T23:30:52.305871+0000","last_fullsized":"2024-02-15T23:30:52.305871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:11.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.752655+0000","last_change":"2024-02-15T23:29:31.710943+0000","last_active":"2024-02-15T23:30:14.752655+0000","last_peered":"2024-02-15T23:30:14.752655+0000","last_clean":"2024-02-15T23:30:14.752655+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:30:14.752655+0000","last_undegraded":"2024-02-15T23:30:14.752655+0000","last_fullsized":"2024-02-15T23:30:14.752655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:42.071297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810297+0000","last_change":"2024-02-15T23:29:29.725600+0000","last_active":"2024-02-15T23:30:10.810297+0000","last_peered":"2024-02-15T23:30:10.810297+0000","last_clean":"2024-02-15T23:30:10.810297+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:30:10.810297+0000","last_undegraded":"2024-02-15T23:30:10.810297+0000","last_fullsized":"2024-02-15T23:30:10.810297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:05.621720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786043+0000","last_change":"2024-02-15T23:29:33.719603+0000","last_active":"2024-02-15T23:30:10.786043+0000","last_peered":"2024-02-15T23:30:10.786043+0000","last_clean":"2024-02-15T23:30:10.786043+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:30:10.786043+0000","last_undegraded":"2024-02-15T23:30:10.786043+0000","last_fullsized":"2024-02-15T23:30:10.786043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:30:40.574457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'35","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.282736+0000","last_change":"2024-02-15T23:29:35.747042+0000","last_active":"2024-02-15T23:30:58.282736+0000","last_peered":"2024-02-15T23:30:58.282736+0000","last_clean":"2024-02-15T23:30:58.282736+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:30:58.282736+0000","last_undegraded":"2024-02-15T23:30:58.282736+0000","last_fullsized":"2024-02-15T23:30:58.282736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:30.039763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.155605+0000","last_change":"2024-02-15T23:29:37.763712+0000","last_active":"2024-02-15T23:31:04.155605+0000","last_peered":"2024-02-15T23:31:04.155605+0000","last_clean":"2024-02-15T23:31:04.155605+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:04.155605+0000","last_undegraded":"2024-02-15T23:31:04.155605+0000","last_fullsized":"2024-02-15T23:31:04.155605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:37.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.440803+0000","last_change":"2024-02-15T23:29:39.784076+0000","last_active":"2024-02-15T23:30:52.440803+0000","last_peered":"2024-02-15T23:30:52.440803+0000","last_clean":"2024-02-15T23:30:52.440803+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:30:52.440803+0000","last_undegraded":"2024-02-15T23:30:52.440803+0000","last_fullsized":"2024-02-15T23:30:52.440803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:20.743271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780987+0000","last_change":"2024-02-15T23:29:31.682141+0000","last_active":"2024-02-15T23:30:10.780987+0000","last_peered":"2024-02-15T23:30:10.780987+0000","last_clean":"2024-02-15T23:30:10.780987+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:30:10.780987+0000","last_undegraded":"2024-02-15T23:30:10.780987+0000","last_fullsized":"2024-02-15T23:30:10.780987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:04.855243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807634+0000","last_change":"2024-02-15T23:29:29.717855+0000","last_active":"2024-02-15T23:30:10.807634+0000","last_peered":"2024-02-15T23:30:10.807634+0000","last_clean":"2024-02-15T23:30:10.807634+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:30:10.807634+0000","last_undegraded":"2024-02-15T23:30:10.807634+0000","last_fullsized":"2024-02-15T23:30:10.807634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:52.833533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786259+0000","last_change":"2024-02-15T23:29:33.726139+0000","last_active":"2024-02-15T23:30:10.786259+0000","last_peered":"2024-02-15T23:30:10.786259+0000","last_clean":"2024-02-15T23:30:10.786259+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:30:10.786259+0000","last_undegraded":"2024-02-15T23:30:10.786259+0000","last_fullsized":"2024-02-15T23:30:10.786259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:53.253439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.867714+0000","last_change":"2024-02-15T23:29:35.749140+0000","last_active":"2024-02-15T23:31:03.867714+0000","last_peered":"2024-02-15T23:31:03.867714+0000","last_clean":"2024-02-15T23:31:03.867714+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:03.867714+0000","last_undegraded":"2024-02-15T23:31:03.867714+0000","last_fullsized":"2024-02-15T23:31:03.867714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:54:44.162530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784051+0000","last_change":"2024-02-15T23:29:37.740778+0000","last_active":"2024-02-15T23:30:10.784051+0000","last_peered":"2024-02-15T23:30:10.784051+0000","last_clean":"2024-02-15T23:30:10.784051+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:30:10.784051+0000","last_undegraded":"2024-02-15T23:30:10.784051+0000","last_fullsized":"2024-02-15T23:30:10.784051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:26:31.398449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.788113+0000","last_change":"2024-02-15T23:29:39.766366+0000","last_active":"2024-02-15T23:30:10.788113+0000","last_peered":"2024-02-15T23:30:10.788113+0000","last_clean":"2024-02-15T23:30:10.788113+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:30:10.788113+0000","last_undegraded":"2024-02-15T23:30:10.788113+0000","last_fullsized":"2024-02-15T23:30:10.788113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:29.582392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.763860+0000","last_change":"2024-02-15T23:30:10.801846+0000","last_active":"2024-02-15T23:30:15.763860+0000","last_peered":"2024-02-15T23:30:15.763860+0000","last_clean":"2024-02-15T23:30:15.763860+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:30:15.763860+0000","last_undegraded":"2024-02-15T23:30:15.763860+0000","last_fullsized":"2024-02-15T23:30:15.763860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:53:52.065139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.506655+0000","last_change":"2024-02-15T23:29:29.716793+0000","last_active":"2024-02-15T23:30:57.506655+0000","last_peered":"2024-02-15T23:30:57.506655+0000","last_clean":"2024-02-15T23:30:57.506655+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:30:57.506655+0000","last_undegraded":"2024-02-15T23:30:57.506655+0000","last_fullsized":"2024-02-15T23:30:57.506655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780151+0000","last_change":"2024-02-15T23:29:33.705063+0000","last_active":"2024-02-15T23:30:10.780151+0000","last_peered":"2024-02-15T23:30:10.780151+0000","last_clean":"2024-02-15T23:30:10.780151+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:30:10.780151+0000","last_undegraded":"2024-02-15T23:30:10.780151+0000","last_fullsized":"2024-02-15T23:30:10.780151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:20.311560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'32","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.870129+0000","last_change":"2024-02-15T23:29:35.728175+0000","last_active":"2024-02-15T23:31:03.870129+0000","last_peered":"2024-02-15T23:31:03.870129+0000","last_clean":"2024-02-15T23:31:03.870129+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:03.870129+0000","last_undegraded":"2024-02-15T23:31:03.870129+0000","last_fullsized":"2024-02-15T23:31:03.870129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:32.708804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812233+0000","last_change":"2024-02-15T23:29:37.772409+0000","last_active":"2024-02-15T23:30:10.812233+0000","last_peered":"2024-02-15T23:30:10.812233+0000","last_clean":"2024-02-15T23:30:10.812233+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:30:10.812233+0000","last_undegraded":"2024-02-15T23:30:10.812233+0000","last_fullsized":"2024-02-15T23:30:10.812233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:31.227259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794250+0000","last_change":"2024-02-15T23:29:39.775394+0000","last_active":"2024-02-15T23:30:10.794250+0000","last_peered":"2024-02-15T23:30:10.794250+0000","last_clean":"2024-02-15T23:30:10.794250+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:30:10.794250+0000","last_undegraded":"2024-02-15T23:30:10.794250+0000","last_fullsized":"2024-02-15T23:30:10.794250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:42.665101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310584+0000","last_change":"2024-02-15T23:29:31.709643+0000","last_active":"2024-02-15T23:30:58.310584+0000","last_peered":"2024-02-15T23:30:58.310584+0000","last_clean":"2024-02-15T23:30:58.310584+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:30:58.310584+0000","last_undegraded":"2024-02-15T23:30:58.310584+0000","last_fullsized":"2024-02-15T23:30:58.310584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:34:14.575064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807250+0000","last_change":"2024-02-15T23:29:29.725808+0000","last_active":"2024-02-15T23:30:10.807250+0000","last_peered":"2024-02-15T23:30:10.807250+0000","last_clean":"2024-02-15T23:30:10.807250+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:30:10.807250+0000","last_undegraded":"2024-02-15T23:30:10.807250+0000","last_fullsized":"2024-02-15T23:30:10.807250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:52.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785684+0000","last_change":"2024-02-15T23:29:33.719257+0000","last_active":"2024-02-15T23:30:10.785684+0000","last_peered":"2024-02-15T23:30:10.785684+0000","last_clean":"2024-02-15T23:30:10.785684+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:30:10.785684+0000","last_undegraded":"2024-02-15T23:30:10.785684+0000","last_fullsized":"2024-02-15T23:30:10.785684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:38.251929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.295841+0000","last_change":"2024-02-15T23:29:35.714372+0000","last_active":"2024-02-15T23:30:58.295841+0000","last_peered":"2024-02-15T23:30:58.295841+0000","last_clean":"2024-02-15T23:30:58.295841+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:30:58.295841+0000","last_undegraded":"2024-02-15T23:30:58.295841+0000","last_fullsized":"2024-02-15T23:30:58.295841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:41.100143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":332,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.148483+0000","last_change":"2024-02-15T23:29:37.751264+0000","last_active":"2024-02-15T23:31:04.148483+0000","last_peered":"2024-02-15T23:31:04.148483+0000","last_clean":"2024-02-15T23:31:04.148483+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:04.148483+0000","last_undegraded":"2024-02-15T23:31:04.148483+0000","last_fullsized":"2024-02-15T23:31:04.148483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:53.228345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.326564+0000","last_change":"2024-02-15T23:29:39.757713+0000","last_active":"2024-02-15T23:30:58.326564+0000","last_peered":"2024-02-15T23:30:58.326564+0000","last_clean":"2024-02-15T23:30:58.326564+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:30:58.326564+0000","last_undegraded":"2024-02-15T23:30:58.326564+0000","last_fullsized":"2024-02-15T23:30:58.326564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:40.849035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780839+0000","last_change":"2024-02-15T23:29:31.706992+0000","last_active":"2024-02-15T23:30:10.780839+0000","last_peered":"2024-02-15T23:30:10.780839+0000","last_clean":"2024-02-15T23:30:10.780839+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:30:10.780839+0000","last_undegraded":"2024-02-15T23:30:10.780839+0000","last_fullsized":"2024-02-15T23:30:10.780839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798403+0000","last_change":"2024-02-15T23:29:29.720429+0000","last_active":"2024-02-15T23:30:10.798403+0000","last_peered":"2024-02-15T23:30:10.798403+0000","last_clean":"2024-02-15T23:30:10.798403+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:30:10.798403+0000","last_undegraded":"2024-02-15T23:30:10.798403+0000","last_fullsized":"2024-02-15T23:30:10.798403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:55.269267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:05.011086+0000","last_change":"2024-02-15T23:29:33.721567+0000","last_active":"2024-02-15T23:31:05.011086+0000","last_peered":"2024-02-15T23:31:05.011086+0000","last_clean":"2024-02-15T23:31:05.011086+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:05.011086+0000","last_undegraded":"2024-02-15T23:31:05.011086+0000","last_fullsized":"2024-02-15T23:31:05.011086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:24.723502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809385+0000","last_change":"2024-02-15T23:29:35.750907+0000","last_active":"2024-02-15T23:30:10.809385+0000","last_peered":"2024-02-15T23:30:10.809385+0000","last_clean":"2024-02-15T23:30:10.809385+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:30:10.809385+0000","last_undegraded":"2024-02-15T23:30:10.809385+0000","last_fullsized":"2024-02-15T23:30:10.809385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:51.904115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":375,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.150823+0000","last_change":"2024-02-15T23:29:37.734243+0000","last_active":"2024-02-15T23:31:04.150823+0000","last_peered":"2024-02-15T23:31:04.150823+0000","last_clean":"2024-02-15T23:31:04.150823+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:04.150823+0000","last_undegraded":"2024-02-15T23:31:04.150823+0000","last_fullsized":"2024-02-15T23:31:04.150823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:24.593703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780732+0000","last_change":"2024-02-15T23:29:39.767850+0000","last_active":"2024-02-15T23:30:10.780732+0000","last_peered":"2024-02-15T23:30:10.780732+0000","last_clean":"2024-02-15T23:30:10.780732+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:30:10.780732+0000","last_undegraded":"2024-02-15T23:30:10.780732+0000","last_fullsized":"2024-02-15T23:30:10.780732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:09:53.270028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310285+0000","last_change":"2024-02-15T23:29:31.710143+0000","last_active":"2024-02-15T23:30:58.310285+0000","last_peered":"2024-02-15T23:30:58.310285+0000","last_clean":"2024-02-15T23:30:58.310285+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:30:58.310285+0000","last_undegraded":"2024-02-15T23:30:58.310285+0000","last_fullsized":"2024-02-15T23:30:58.310285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:33:08.745254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796597+0000","last_change":"2024-02-15T23:29:29.724689+0000","last_active":"2024-02-15T23:30:10.796597+0000","last_peered":"2024-02-15T23:30:10.796597+0000","last_clean":"2024-02-15T23:30:10.796597+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:30:10.796597+0000","last_undegraded":"2024-02-15T23:30:10.796597+0000","last_fullsized":"2024-02-15T23:30:10.796597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:26.315905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810239+0000","last_change":"2024-02-15T23:29:33.716469+0000","last_active":"2024-02-15T23:30:10.810239+0000","last_peered":"2024-02-15T23:30:10.810239+0000","last_clean":"2024-02-15T23:30:10.810239+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:30:10.810239+0000","last_undegraded":"2024-02-15T23:30:10.810239+0000","last_fullsized":"2024-02-15T23:30:10.810239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:04.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.276589+0000","last_change":"2024-02-15T23:29:35.730918+0000","last_active":"2024-02-15T23:30:58.276589+0000","last_peered":"2024-02-15T23:30:58.276589+0000","last_clean":"2024-02-15T23:30:58.276589+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:30:58.276589+0000","last_undegraded":"2024-02-15T23:30:58.276589+0000","last_fullsized":"2024-02-15T23:30:58.276589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:34:18.605282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778025+0000","last_change":"2024-02-15T23:29:37.767166+0000","last_active":"2024-02-15T23:30:10.778025+0000","last_peered":"2024-02-15T23:30:10.778025+0000","last_clean":"2024-02-15T23:30:10.778025+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:30:10.778025+0000","last_undegraded":"2024-02-15T23:30:10.778025+0000","last_fullsized":"2024-02-15T23:30:10.778025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:01.461141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783831+0000","last_change":"2024-02-15T23:29:39.756802+0000","last_active":"2024-02-15T23:30:10.783831+0000","last_peered":"2024-02-15T23:30:10.783831+0000","last_clean":"2024-02-15T23:30:10.783831+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:30:10.783831+0000","last_undegraded":"2024-02-15T23:30:10.783831+0000","last_fullsized":"2024-02-15T23:30:10.783831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:27.441839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310387+0000","last_change":"2024-02-15T23:29:31.709063+0000","last_active":"2024-02-15T23:30:58.310387+0000","last_peered":"2024-02-15T23:30:58.310387+0000","last_clean":"2024-02-15T23:30:58.310387+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:30:58.310387+0000","last_undegraded":"2024-02-15T23:30:58.310387+0000","last_fullsized":"2024-02-15T23:30:58.310387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:15.455104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782126+0000","last_change":"2024-02-15T23:29:17.391071+0000","last_active":"2024-02-15T23:30:10.782126+0000","last_peered":"2024-02-15T23:30:10.782126+0000","last_clean":"2024-02-15T23:30:10.782126+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:30:10.782126+0000","last_undegraded":"2024-02-15T23:30:10.782126+0000","last_fullsized":"2024-02-15T23:30:10.782126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_clean_scrub_stamp":"2024-02-15T23:29:15.580621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:00.893203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806662+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:30:10.806662+0000","last_peered":"2024-02-15T23:30:10.806662+0000","last_clean":"2024-02-15T23:30:10.806662+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:30:10.806662+0000","last_undegraded":"2024-02-15T23:30:10.806662+0000","last_fullsized":"2024-02-15T23:30:10.806662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:31:39.646588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.916327+0000","last_change":"2024-02-15T23:29:29.725524+0000","last_active":"2024-02-15T23:31:03.916327+0000","last_peered":"2024-02-15T23:31:03.916327+0000","last_clean":"2024-02-15T23:31:03.916327+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:31:03.916327+0000","last_undegraded":"2024-02-15T23:31:03.916327+0000","last_fullsized":"2024-02-15T23:31:03.916327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:58.815157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.801490+0000","last_change":"2024-02-15T23:30:10.801490+0000","last_active":"2024-02-15T23:30:10.801490+0000","last_peered":"2024-02-15T23:30:10.801490+0000","last_clean":"2024-02-15T23:30:10.801490+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:30:10.801490+0000","last_undegraded":"2024-02-15T23:30:10.801490+0000","last_fullsized":"2024-02-15T23:30:10.801490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:55:48.775082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.890716+0000","last_change":"2024-02-15T23:29:35.746233+0000","last_active":"2024-02-15T23:31:03.890716+0000","last_peered":"2024-02-15T23:31:03.890716+0000","last_clean":"2024-02-15T23:31:03.890716+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:03.890716+0000","last_undegraded":"2024-02-15T23:31:03.890716+0000","last_fullsized":"2024-02-15T23:31:03.890716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:56:17.988220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787880+0000","last_change":"2024-02-15T23:29:37.764075+0000","last_active":"2024-02-15T23:30:10.787880+0000","last_peered":"2024-02-15T23:30:10.787880+0000","last_clean":"2024-02-15T23:30:10.787880+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:30:10.787880+0000","last_undegraded":"2024-02-15T23:30:10.787880+0000","last_fullsized":"2024-02-15T23:30:10.787880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:59:27.829626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.943862+0000","last_change":"2024-02-15T23:29:39.777587+0000","last_active":"2024-02-15T23:31:03.943862+0000","last_peered":"2024-02-15T23:31:03.943862+0000","last_clean":"2024-02-15T23:31:03.943862+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:31:03.943862+0000","last_undegraded":"2024-02-15T23:31:03.943862+0000","last_fullsized":"2024-02-15T23:31:03.943862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:50.335386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'13","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499841+0000","last_change":"2024-02-15T23:29:31.705098+0000","last_active":"2024-02-15T23:30:57.499841+0000","last_peered":"2024-02-15T23:30:57.499841+0000","last_clean":"2024-02-15T23:30:57.499841+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:30:57.499841+0000","last_undegraded":"2024-02-15T23:30:57.499841+0000","last_fullsized":"2024-02-15T23:30:57.499841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:15.615348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795289+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:30:10.795289+0000","last_peered":"2024-02-15T23:30:10.795289+0000","last_clean":"2024-02-15T23:30:10.795289+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:30:10.795289+0000","last_undegraded":"2024-02-15T23:30:10.795289+0000","last_fullsized":"2024-02-15T23:30:10.795289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:26.706393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.062516+0000","last_change":"2024-02-15T23:29:29.708594+0000","last_active":"2024-02-15T23:30:15.062516+0000","last_peered":"2024-02-15T23:30:15.062516+0000","last_clean":"2024-02-15T23:30:15.062516+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:30:15.062516+0000","last_undegraded":"2024-02-15T23:30:15.062516+0000","last_fullsized":"2024-02-15T23:30:15.062516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812552+0000","last_change":"2024-02-15T23:29:33.716868+0000","last_active":"2024-02-15T23:30:10.812552+0000","last_peered":"2024-02-15T23:30:10.812552+0000","last_clean":"2024-02-15T23:30:10.812552+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:30:10.812552+0000","last_undegraded":"2024-02-15T23:30:10.812552+0000","last_fullsized":"2024-02-15T23:30:10.812552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:53:54.077930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.142415+0000","last_change":"2024-02-15T23:29:35.724256+0000","last_active":"2024-02-15T23:31:04.142415+0000","last_peered":"2024-02-15T23:31:04.142415+0000","last_clean":"2024-02-15T23:31:04.142415+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:04.142415+0000","last_undegraded":"2024-02-15T23:31:04.142415+0000","last_fullsized":"2024-02-15T23:31:04.142415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:05.587661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807241+0000","last_change":"2024-02-15T23:29:37.769851+0000","last_active":"2024-02-15T23:30:10.807241+0000","last_peered":"2024-02-15T23:30:10.807241+0000","last_clean":"2024-02-15T23:30:10.807241+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:30:10.807241+0000","last_undegraded":"2024-02-15T23:30:10.807241+0000","last_fullsized":"2024-02-15T23:30:10.807241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:49.141465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.462247+0000","last_change":"2024-02-15T23:29:39.779672+0000","last_active":"2024-02-15T23:30:52.462247+0000","last_peered":"2024-02-15T23:30:52.462247+0000","last_clean":"2024-02-15T23:30:52.462247+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:30:52.462247+0000","last_undegraded":"2024-02-15T23:30:52.462247+0000","last_fullsized":"2024-02-15T23:30:52.462247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:40.849035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924349+0000","last_change":"2024-02-15T23:29:31.694236+0000","last_active":"2024-02-15T23:31:03.924349+0000","last_peered":"2024-02-15T23:31:03.924349+0000","last_clean":"2024-02-15T23:31:03.924349+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:03.924349+0000","last_undegraded":"2024-02-15T23:31:03.924349+0000","last_fullsized":"2024-02-15T23:31:03.924349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:49.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777472+0000","last_change":"2024-02-15T23:29:21.622454+0000","last_active":"2024-02-15T23:30:10.777472+0000","last_peered":"2024-02-15T23:30:10.777472+0000","last_clean":"2024-02-15T23:30:10.777472+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:30:10.777472+0000","last_undegraded":"2024-02-15T23:30:10.777472+0000","last_fullsized":"2024-02-15T23:30:10.777472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:05.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783297+0000","last_change":"2024-02-15T23:29:29.718869+0000","last_active":"2024-02-15T23:30:10.783297+0000","last_peered":"2024-02-15T23:30:10.783297+0000","last_clean":"2024-02-15T23:30:10.783297+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:30:10.783297+0000","last_undegraded":"2024-02-15T23:30:10.783297+0000","last_fullsized":"2024-02-15T23:30:10.783297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778385+0000","last_change":"2024-02-15T23:29:33.703250+0000","last_active":"2024-02-15T23:30:10.778385+0000","last_peered":"2024-02-15T23:30:10.778385+0000","last_clean":"2024-02-15T23:30:10.778385+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:30:10.778385+0000","last_undegraded":"2024-02-15T23:30:10.778385+0000","last_fullsized":"2024-02-15T23:30:10.778385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:03.717928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.825449+0000","last_change":"2024-02-15T23:29:35.732833+0000","last_active":"2024-02-15T23:31:03.825449+0000","last_peered":"2024-02-15T23:31:03.825449+0000","last_clean":"2024-02-15T23:31:03.825449+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:03.825449+0000","last_undegraded":"2024-02-15T23:31:03.825449+0000","last_fullsized":"2024-02-15T23:31:03.825449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:23.890835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786334+0000","last_change":"2024-02-15T23:29:37.764209+0000","last_active":"2024-02-15T23:30:10.786334+0000","last_peered":"2024-02-15T23:30:10.786334+0000","last_clean":"2024-02-15T23:30:10.786334+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:30:10.786334+0000","last_undegraded":"2024-02-15T23:30:10.786334+0000","last_fullsized":"2024-02-15T23:30:10.786334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:08.422824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798630+0000","last_change":"2024-02-15T23:29:39.769538+0000","last_active":"2024-02-15T23:30:10.798630+0000","last_peered":"2024-02-15T23:30:10.798630+0000","last_clean":"2024-02-15T23:30:10.798630+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:30:10.798630+0000","last_undegraded":"2024-02-15T23:30:10.798630+0000","last_fullsized":"2024-02-15T23:30:10.798630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:03.906467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924601+0000","last_change":"2024-02-15T23:29:31.691195+0000","last_active":"2024-02-15T23:31:03.924601+0000","last_peered":"2024-02-15T23:31:03.924601+0000","last_clean":"2024-02-15T23:31:03.924601+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:03.924601+0000","last_undegraded":"2024-02-15T23:31:03.924601+0000","last_fullsized":"2024-02-15T23:31:03.924601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799199+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:30:10.799199+0000","last_peered":"2024-02-15T23:30:10.799199+0000","last_clean":"2024-02-15T23:30:10.799199+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:30:10.799199+0000","last_undegraded":"2024-02-15T23:30:10.799199+0000","last_fullsized":"2024-02-15T23:30:10.799199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:56.631774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780471+0000","last_change":"2024-02-15T23:29:29.721410+0000","last_active":"2024-02-15T23:30:10.780471+0000","last_peered":"2024-02-15T23:30:10.780471+0000","last_clean":"2024-02-15T23:30:10.780471+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:30:10.780471+0000","last_undegraded":"2024-02-15T23:30:10.780471+0000","last_fullsized":"2024-02-15T23:30:10.780471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787055+0000","last_change":"2024-02-15T23:29:33.720740+0000","last_active":"2024-02-15T23:30:10.787055+0000","last_peered":"2024-02-15T23:30:10.787055+0000","last_clean":"2024-02-15T23:30:10.787055+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:30:10.787055+0000","last_undegraded":"2024-02-15T23:30:10.787055+0000","last_fullsized":"2024-02-15T23:30:10.787055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:35.850884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809861+0000","last_change":"2024-02-15T23:29:35.749663+0000","last_active":"2024-02-15T23:30:10.809861+0000","last_peered":"2024-02-15T23:30:10.809861+0000","last_clean":"2024-02-15T23:30:10.809861+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:30:10.809861+0000","last_undegraded":"2024-02-15T23:30:10.809861+0000","last_fullsized":"2024-02-15T23:30:10.809861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:55:50.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813015+0000","last_change":"2024-02-15T23:29:37.774191+0000","last_active":"2024-02-15T23:30:10.813015+0000","last_peered":"2024-02-15T23:30:10.813015+0000","last_clean":"2024-02-15T23:30:10.813015+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:30:10.813015+0000","last_undegraded":"2024-02-15T23:30:10.813015+0000","last_fullsized":"2024-02-15T23:30:10.813015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:22.178611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781801+0000","last_change":"2024-02-15T23:29:39.768032+0000","last_active":"2024-02-15T23:30:10.781801+0000","last_peered":"2024-02-15T23:30:10.781801+0000","last_clean":"2024-02-15T23:30:10.781801+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:30:10.781801+0000","last_undegraded":"2024-02-15T23:30:10.781801+0000","last_fullsized":"2024-02-15T23:30:10.781801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:25.706705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'11","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310331+0000","last_change":"2024-02-15T23:30:10.810101+0000","last_active":"2024-02-15T23:30:58.310331+0000","last_peered":"2024-02-15T23:30:58.310331+0000","last_clean":"2024-02-15T23:30:58.310331+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:30:58.310331+0000","last_undegraded":"2024-02-15T23:30:58.310331+0000","last_fullsized":"2024-02-15T23:30:58.310331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:00:04.499939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.071222+0000","last_change":"2024-02-15T23:29:29.733697+0000","last_active":"2024-02-15T23:30:15.071222+0000","last_peered":"2024-02-15T23:30:15.071222+0000","last_clean":"2024-02-15T23:30:15.071222+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:30:15.071222+0000","last_undegraded":"2024-02-15T23:30:15.071222+0000","last_fullsized":"2024-02-15T23:30:15.071222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786022+0000","last_change":"2024-02-15T23:29:21.627861+0000","last_active":"2024-02-15T23:30:10.786022+0000","last_peered":"2024-02-15T23:30:10.786022+0000","last_clean":"2024-02-15T23:30:10.786022+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:30:10.786022+0000","last_undegraded":"2024-02-15T23:30:10.786022+0000","last_fullsized":"2024-02-15T23:30:10.786022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:25:07.064306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.803638+0000","last_change":"2024-02-15T23:30:10.801694+0000","last_active":"2024-02-15T23:30:10.803638+0000","last_peered":"2024-02-15T23:30:10.803638+0000","last_clean":"2024-02-15T23:30:10.803638+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:30:10.803638+0000","last_undegraded":"2024-02-15T23:30:10.803638+0000","last_fullsized":"2024-02-15T23:30:10.803638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:04.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'56","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.879873+0000","last_change":"2024-02-15T23:29:35.740917+0000","last_active":"2024-02-15T23:31:03.879873+0000","last_peered":"2024-02-15T23:31:03.879873+0000","last_clean":"2024-02-15T23:31:03.879873+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:03.879873+0000","last_undegraded":"2024-02-15T23:31:03.879873+0000","last_fullsized":"2024-02-15T23:31:03.879873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:24.374012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.775299+0000","last_change":"2024-02-15T23:29:37.751356+0000","last_active":"2024-02-15T23:30:10.775299+0000","last_peered":"2024-02-15T23:30:10.775299+0000","last_clean":"2024-02-15T23:30:10.775299+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:30:10.775299+0000","last_undegraded":"2024-02-15T23:30:10.775299+0000","last_fullsized":"2024-02-15T23:30:10.775299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:21.661539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.296729+0000","last_change":"2024-02-15T23:29:39.767710+0000","last_active":"2024-02-15T23:30:58.296729+0000","last_peered":"2024-02-15T23:30:58.296729+0000","last_clean":"2024-02-15T23:30:58.296729+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:30:58.296729+0000","last_undegraded":"2024-02-15T23:30:58.296729+0000","last_fullsized":"2024-02-15T23:30:58.296729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:31:07.642735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.804317+0000","last_change":"2024-02-15T23:30:10.804317+0000","last_active":"2024-02-15T23:30:10.804317+0000","last_peered":"2024-02-15T23:30:10.804317+0000","last_clean":"2024-02-15T23:30:10.804317+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:30:10.804317+0000","last_undegraded":"2024-02-15T23:30:10.804317+0000","last_fullsized":"2024-02-15T23:30:10.804317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:30:30.019018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786948+0000","last_change":"2024-02-15T23:29:29.717068+0000","last_active":"2024-02-15T23:30:10.786948+0000","last_peered":"2024-02-15T23:30:10.786948+0000","last_clean":"2024-02-15T23:30:10.786948+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:30:10.786948+0000","last_undegraded":"2024-02-15T23:30:10.786948+0000","last_fullsized":"2024-02-15T23:30:10.786948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809253+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:30:10.809253+0000","last_peered":"2024-02-15T23:30:10.809253+0000","last_clean":"2024-02-15T23:30:10.809253+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:30:10.809253+0000","last_undegraded":"2024-02-15T23:30:10.809253+0000","last_fullsized":"2024-02-15T23:30:10.809253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:34.783207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798441+0000","last_change":"2024-02-15T23:29:33.715626+0000","last_active":"2024-02-15T23:30:10.798441+0000","last_peered":"2024-02-15T23:30:10.798441+0000","last_clean":"2024-02-15T23:30:10.798441+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:30:10.798441+0000","last_undegraded":"2024-02-15T23:30:10.798441+0000","last_fullsized":"2024-02-15T23:30:10.798441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:20.560304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783406+0000","last_change":"2024-02-15T23:29:35.733356+0000","last_active":"2024-02-15T23:30:10.783406+0000","last_peered":"2024-02-15T23:30:10.783406+0000","last_clean":"2024-02-15T23:30:10.783406+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:30:10.783406+0000","last_undegraded":"2024-02-15T23:30:10.783406+0000","last_fullsized":"2024-02-15T23:30:10.783406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:45:43.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":278,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.145436+0000","last_change":"2024-02-15T23:29:37.736088+0000","last_active":"2024-02-15T23:31:04.145436+0000","last_peered":"2024-02-15T23:31:04.145436+0000","last_clean":"2024-02-15T23:31:04.145436+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:04.145436+0000","last_undegraded":"2024-02-15T23:31:04.145436+0000","last_fullsized":"2024-02-15T23:31:04.145436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:40.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.909796+0000","last_change":"2024-02-15T23:29:39.771638+0000","last_active":"2024-02-15T23:31:03.909796+0000","last_peered":"2024-02-15T23:31:03.909796+0000","last_clean":"2024-02-15T23:31:03.909796+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:31:03.909796+0000","last_undegraded":"2024-02-15T23:31:03.909796+0000","last_fullsized":"2024-02-15T23:31:03.909796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:55.181212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796605+0000","last_change":"2024-02-15T23:29:31.701536+0000","last_active":"2024-02-15T23:30:10.796605+0000","last_peered":"2024-02-15T23:30:10.796605+0000","last_clean":"2024-02-15T23:30:10.796605+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:30:10.796605+0000","last_undegraded":"2024-02-15T23:30:10.796605+0000","last_fullsized":"2024-02-15T23:30:10.796605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:01.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.065461+0000","last_change":"2024-02-15T23:29:29.714312+0000","last_active":"2024-02-15T23:30:15.065461+0000","last_peered":"2024-02-15T23:30:15.065461+0000","last_clean":"2024-02-15T23:30:15.065461+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:30:15.065461+0000","last_undegraded":"2024-02-15T23:30:15.065461+0000","last_fullsized":"2024-02-15T23:30:15.065461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:33.379284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.788477+0000","last_change":"2024-02-15T23:29:21.629944+0000","last_active":"2024-02-15T23:30:10.788477+0000","last_peered":"2024-02-15T23:30:10.788477+0000","last_clean":"2024-02-15T23:30:10.788477+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:30:10.788477+0000","last_undegraded":"2024-02-15T23:30:10.788477+0000","last_fullsized":"2024-02-15T23:30:10.788477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:34:24.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794872+0000","last_change":"2024-02-15T23:29:33.715193+0000","last_active":"2024-02-15T23:30:10.794872+0000","last_peered":"2024-02-15T23:30:10.794872+0000","last_clean":"2024-02-15T23:30:10.794872+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:30:10.794872+0000","last_undegraded":"2024-02-15T23:30:10.794872+0000","last_fullsized":"2024-02-15T23:30:10.794872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:04.389424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806532+0000","last_change":"2024-02-15T23:29:35.749284+0000","last_active":"2024-02-15T23:30:10.806532+0000","last_peered":"2024-02-15T23:30:10.806532+0000","last_clean":"2024-02-15T23:30:10.806532+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:30:10.806532+0000","last_undegraded":"2024-02-15T23:30:10.806532+0000","last_fullsized":"2024-02-15T23:30:10.806532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:56.095538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.151818+0000","last_change":"2024-02-15T23:29:37.752616+0000","last_active":"2024-02-15T23:31:04.151818+0000","last_peered":"2024-02-15T23:31:04.151818+0000","last_clean":"2024-02-15T23:31:04.151818+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:04.151818+0000","last_undegraded":"2024-02-15T23:31:04.151818+0000","last_fullsized":"2024-02-15T23:31:04.151818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:51.505644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.298912+0000","last_change":"2024-02-15T23:29:39.760690+0000","last_active":"2024-02-15T23:30:58.298912+0000","last_peered":"2024-02-15T23:30:58.298912+0000","last_clean":"2024-02-15T23:30:58.298912+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:30:58.298912+0000","last_undegraded":"2024-02-15T23:30:58.298912+0000","last_fullsized":"2024-02-15T23:30:58.298912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:11.751170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924945+0000","last_change":"2024-02-15T23:29:31.709896+0000","last_active":"2024-02-15T23:31:03.924945+0000","last_peered":"2024-02-15T23:31:03.924945+0000","last_clean":"2024-02-15T23:31:03.924945+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:03.924945+0000","last_undegraded":"2024-02-15T23:31:03.924945+0000","last_fullsized":"2024-02-15T23:31:03.924945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:18.497832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786236+0000","last_change":"2024-02-15T23:29:29.720515+0000","last_active":"2024-02-15T23:30:10.786236+0000","last_peered":"2024-02-15T23:30:10.786236+0000","last_clean":"2024-02-15T23:30:10.786236+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:30:10.786236+0000","last_undegraded":"2024-02-15T23:30:10.786236+0000","last_fullsized":"2024-02-15T23:30:10.786236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813277+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:30:10.813277+0000","last_peered":"2024-02-15T23:30:10.813277+0000","last_clean":"2024-02-15T23:30:10.813277+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:30:10.813277+0000","last_undegraded":"2024-02-15T23:30:10.813277+0000","last_fullsized":"2024-02-15T23:30:10.813277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:17.587564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795011+0000","last_change":"2024-02-15T23:29:33.710000+0000","last_active":"2024-02-15T23:30:10.795011+0000","last_peered":"2024-02-15T23:30:10.795011+0000","last_clean":"2024-02-15T23:30:10.795011+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:30:10.795011+0000","last_undegraded":"2024-02-15T23:30:10.795011+0000","last_fullsized":"2024-02-15T23:30:10.795011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:36.677573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.875945+0000","last_change":"2024-02-15T23:29:35.717933+0000","last_active":"2024-02-15T23:31:03.875945+0000","last_peered":"2024-02-15T23:31:03.875945+0000","last_clean":"2024-02-15T23:31:03.875945+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:03.875945+0000","last_undegraded":"2024-02-15T23:31:03.875945+0000","last_fullsized":"2024-02-15T23:31:03.875945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:00.658332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784071+0000","last_change":"2024-02-15T23:29:37.739850+0000","last_active":"2024-02-15T23:30:10.784071+0000","last_peered":"2024-02-15T23:30:10.784071+0000","last_clean":"2024-02-15T23:30:10.784071+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:30:10.784071+0000","last_undegraded":"2024-02-15T23:30:10.784071+0000","last_fullsized":"2024-02-15T23:30:10.784071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:09:51.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780548+0000","last_change":"2024-02-15T23:29:39.781085+0000","last_active":"2024-02-15T23:30:10.780548+0000","last_peered":"2024-02-15T23:30:10.780548+0000","last_clean":"2024-02-15T23:30:10.780548+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:30:10.780548+0000","last_undegraded":"2024-02-15T23:30:10.780548+0000","last_fullsized":"2024-02-15T23:30:10.780548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:01.196312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779929+0000","last_change":"2024-02-15T23:29:39.777993+0000","last_active":"2024-02-15T23:30:10.779929+0000","last_peered":"2024-02-15T23:30:10.779929+0000","last_clean":"2024-02-15T23:30:10.779929+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:30:10.779929+0000","last_undegraded":"2024-02-15T23:30:10.779929+0000","last_fullsized":"2024-02-15T23:30:10.779929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:53.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784494+0000","last_change":"2024-02-15T23:29:31.704768+0000","last_active":"2024-02-15T23:30:10.784494+0000","last_peered":"2024-02-15T23:30:10.784494+0000","last_clean":"2024-02-15T23:30:10.784494+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:30:10.784494+0000","last_undegraded":"2024-02-15T23:30:10.784494+0000","last_fullsized":"2024-02-15T23:30:10.784494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:16.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807765+0000","last_change":"2024-02-15T23:29:29.728542+0000","last_active":"2024-02-15T23:30:10.807765+0000","last_peered":"2024-02-15T23:30:10.807765+0000","last_clean":"2024-02-15T23:30:10.807765+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:30:10.807765+0000","last_undegraded":"2024-02-15T23:30:10.807765+0000","last_fullsized":"2024-02-15T23:30:10.807765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:05.901551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.884926+0000","last_change":"2024-02-15T23:29:33.711524+0000","last_active":"2024-02-15T23:31:04.884926+0000","last_peered":"2024-02-15T23:31:04.884926+0000","last_clean":"2024-02-15T23:31:04.884926+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:04.884926+0000","last_undegraded":"2024-02-15T23:31:04.884926+0000","last_fullsized":"2024-02-15T23:31:04.884926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:03.277817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.281776+0000","last_change":"2024-02-15T23:29:35.746240+0000","last_active":"2024-02-15T23:30:58.281776+0000","last_peered":"2024-02-15T23:30:58.281776+0000","last_clean":"2024-02-15T23:30:58.281776+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:30:58.281776+0000","last_undegraded":"2024-02-15T23:30:58.281776+0000","last_fullsized":"2024-02-15T23:30:58.281776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:31:03.614237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797557+0000","last_change":"2024-02-15T23:29:37.765986+0000","last_active":"2024-02-15T23:30:10.797557+0000","last_peered":"2024-02-15T23:30:10.797557+0000","last_clean":"2024-02-15T23:30:10.797557+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:30:10.797557+0000","last_undegraded":"2024-02-15T23:30:10.797557+0000","last_fullsized":"2024-02-15T23:30:10.797557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:38.382170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786394+0000","last_change":"2024-02-15T23:29:39.766083+0000","last_active":"2024-02-15T23:30:10.786394+0000","last_peered":"2024-02-15T23:30:10.786394+0000","last_clean":"2024-02-15T23:30:10.786394+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:30:10.786394+0000","last_undegraded":"2024-02-15T23:30:10.786394+0000","last_fullsized":"2024-02-15T23:30:10.786394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:11.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091281+0000","last_change":"2024-02-15T23:29:31.711705+0000","last_active":"2024-02-15T23:30:15.091281+0000","last_peered":"2024-02-15T23:30:15.091281+0000","last_clean":"2024-02-15T23:30:15.091281+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:30:15.091281+0000","last_undegraded":"2024-02-15T23:30:15.091281+0000","last_fullsized":"2024-02-15T23:30:15.091281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:49.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777397+0000","last_change":"2024-02-15T23:29:29.723948+0000","last_active":"2024-02-15T23:30:10.777397+0000","last_peered":"2024-02-15T23:30:10.777397+0000","last_clean":"2024-02-15T23:30:10.777397+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:30:10.777397+0000","last_undegraded":"2024-02-15T23:30:10.777397+0000","last_fullsized":"2024-02-15T23:30:10.777397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.803790+0000","last_change":"2024-02-15T23:29:33.710951+0000","last_active":"2024-02-15T23:30:10.803790+0000","last_peered":"2024-02-15T23:30:10.803790+0000","last_clean":"2024-02-15T23:30:10.803790+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:30:10.803790+0000","last_undegraded":"2024-02-15T23:30:10.803790+0000","last_fullsized":"2024-02-15T23:30:10.803790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:33.779707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:50.920531+0000","last_change":"2024-02-15T23:29:35.722170+0000","last_active":"2024-02-15T23:30:50.920531+0000","last_peered":"2024-02-15T23:30:50.920531+0000","last_clean":"2024-02-15T23:30:50.920531+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:30:50.920531+0000","last_undegraded":"2024-02-15T23:30:50.920531+0000","last_fullsized":"2024-02-15T23:30:50.920531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:26.740928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776127+0000","last_change":"2024-02-15T23:29:37.766413+0000","last_active":"2024-02-15T23:30:10.776127+0000","last_peered":"2024-02-15T23:30:10.776127+0000","last_clean":"2024-02-15T23:30:10.776127+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:30:10.776127+0000","last_undegraded":"2024-02-15T23:30:10.776127+0000","last_fullsized":"2024-02-15T23:30:10.776127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:58.577241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786018+0000","last_change":"2024-02-15T23:29:39.783805+0000","last_active":"2024-02-15T23:30:10.786018+0000","last_peered":"2024-02-15T23:30:10.786018+0000","last_clean":"2024-02-15T23:30:10.786018+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:30:10.786018+0000","last_undegraded":"2024-02-15T23:30:10.786018+0000","last_fullsized":"2024-02-15T23:30:10.786018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:11.751170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'9","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.309917+0000","last_change":"2024-02-15T23:29:31.709732+0000","last_active":"2024-02-15T23:30:58.309917+0000","last_peered":"2024-02-15T23:30:58.309917+0000","last_clean":"2024-02-15T23:30:58.309917+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:30:58.309917+0000","last_undegraded":"2024-02-15T23:30:58.309917+0000","last_fullsized":"2024-02-15T23:30:58.309917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:04.855243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780146+0000","last_change":"2024-02-15T23:29:29.723953+0000","last_active":"2024-02-15T23:30:10.780146+0000","last_peered":"2024-02-15T23:30:10.780146+0000","last_clean":"2024-02-15T23:30:10.780146+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:30:10.780146+0000","last_undegraded":"2024-02-15T23:30:10.780146+0000","last_fullsized":"2024-02-15T23:30:10.780146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776922+0000","last_change":"2024-02-15T23:29:33.712933+0000","last_active":"2024-02-15T23:30:10.776922+0000","last_peered":"2024-02-15T23:30:10.776922+0000","last_clean":"2024-02-15T23:30:10.776922+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:30:10.776922+0000","last_undegraded":"2024-02-15T23:30:10.776922+0000","last_fullsized":"2024-02-15T23:30:10.776922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:54:18.393325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'36","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.676773+0000","last_change":"2024-02-15T23:29:35.726851+0000","last_active":"2024-02-15T23:31:03.676773+0000","last_peered":"2024-02-15T23:31:03.676773+0000","last_clean":"2024-02-15T23:31:03.676773+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:03.676773+0000","last_undegraded":"2024-02-15T23:31:03.676773+0000","last_fullsized":"2024-02-15T23:31:03.676773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:19.645566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782738+0000","last_change":"2024-02-15T23:29:37.733211+0000","last_active":"2024-02-15T23:30:10.782738+0000","last_peered":"2024-02-15T23:30:10.782738+0000","last_clean":"2024-02-15T23:30:10.782738+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:30:10.782738+0000","last_undegraded":"2024-02-15T23:30:10.782738+0000","last_fullsized":"2024-02-15T23:30:10.782738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:58.620898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806839+0000","last_change":"2024-02-15T23:29:39.784430+0000","last_active":"2024-02-15T23:30:10.806839+0000","last_peered":"2024-02-15T23:30:10.806839+0000","last_clean":"2024-02-15T23:30:10.806839+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:30:10.806839+0000","last_undegraded":"2024-02-15T23:30:10.806839+0000","last_fullsized":"2024-02-15T23:30:10.806839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:55:47.209181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310633+0000","last_change":"2024-02-15T23:29:31.701986+0000","last_active":"2024-02-15T23:30:58.310633+0000","last_peered":"2024-02-15T23:30:58.310633+0000","last_clean":"2024-02-15T23:30:58.310633+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:30:58.310633+0000","last_undegraded":"2024-02-15T23:30:58.310633+0000","last_fullsized":"2024-02-15T23:30:58.310633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:11.385662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792688+0000","last_change":"2024-02-15T23:29:29.736668+0000","last_active":"2024-02-15T23:30:10.792688+0000","last_peered":"2024-02-15T23:30:10.792688+0000","last_clean":"2024-02-15T23:30:10.792688+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:30:10.792688+0000","last_undegraded":"2024-02-15T23:30:10.792688+0000","last_fullsized":"2024-02-15T23:30:10.792688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794825+0000","last_change":"2024-02-15T23:29:33.715292+0000","last_active":"2024-02-15T23:30:10.794825+0000","last_peered":"2024-02-15T23:30:10.794825+0000","last_clean":"2024-02-15T23:30:10.794825+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:30:10.794825+0000","last_undegraded":"2024-02-15T23:30:10.794825+0000","last_fullsized":"2024-02-15T23:30:10.794825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:16.607064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.262617+0000","last_change":"2024-02-15T23:29:35.716431+0000","last_active":"2024-02-15T23:30:58.262617+0000","last_peered":"2024-02-15T23:30:58.262617+0000","last_clean":"2024-02-15T23:30:58.262617+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:30:58.262617+0000","last_undegraded":"2024-02-15T23:30:58.262617+0000","last_fullsized":"2024-02-15T23:30:58.262617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:40.269355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779398+0000","last_change":"2024-02-15T23:29:37.763224+0000","last_active":"2024-02-15T23:30:10.779398+0000","last_peered":"2024-02-15T23:30:10.779398+0000","last_clean":"2024-02-15T23:30:10.779398+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:30:10.779398+0000","last_undegraded":"2024-02-15T23:30:10.779398+0000","last_fullsized":"2024-02-15T23:30:10.779398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:05.584865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.814385+0000","last_change":"2024-02-15T23:29:31.705672+0000","last_active":"2024-02-15T23:30:10.814385+0000","last_peered":"2024-02-15T23:30:10.814385+0000","last_clean":"2024-02-15T23:30:10.814385+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:30:10.814385+0000","last_undegraded":"2024-02-15T23:30:10.814385+0000","last_fullsized":"2024-02-15T23:30:10.814385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:22:55.414951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795287+0000","last_change":"2024-02-15T23:29:29.721645+0000","last_active":"2024-02-15T23:30:10.795287+0000","last_peered":"2024-02-15T23:30:10.795287+0000","last_clean":"2024-02-15T23:30:10.795287+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:30:10.795287+0000","last_undegraded":"2024-02-15T23:30:10.795287+0000","last_fullsized":"2024-02-15T23:30:10.795287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:53:31.617349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790215+0000","last_change":"2024-02-15T23:29:33.720987+0000","last_active":"2024-02-15T23:30:10.790215+0000","last_peered":"2024-02-15T23:30:10.790215+0000","last_clean":"2024-02-15T23:30:10.790215+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:30:10.790215+0000","last_undegraded":"2024-02-15T23:30:10.790215+0000","last_fullsized":"2024-02-15T23:30:10.790215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:40.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'51","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.871106+0000","last_change":"2024-02-15T23:29:35.721819+0000","last_active":"2024-02-15T23:31:03.871106+0000","last_peered":"2024-02-15T23:31:03.871106+0000","last_clean":"2024-02-15T23:31:03.871106+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:03.871106+0000","last_undegraded":"2024-02-15T23:31:03.871106+0000","last_fullsized":"2024-02-15T23:31:03.871106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:56.561268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777783+0000","last_change":"2024-02-15T23:29:37.763301+0000","last_active":"2024-02-15T23:30:10.777783+0000","last_peered":"2024-02-15T23:30:10.777783+0000","last_clean":"2024-02-15T23:30:10.777783+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:30:10.777783+0000","last_undegraded":"2024-02-15T23:30:10.777783+0000","last_fullsized":"2024-02-15T23:30:10.777783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:52:07.386784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.643303+0000","last_change":"2024-02-15T23:29:39.778768+0000","last_active":"2024-02-15T23:30:57.643303+0000","last_peered":"2024-02-15T23:30:57.643303+0000","last_clean":"2024-02-15T23:30:57.643303+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:30:57.643303+0000","last_undegraded":"2024-02-15T23:30:57.643303+0000","last_fullsized":"2024-02-15T23:30:57.643303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.769044+0000","last_change":"2024-02-15T23:29:31.695343+0000","last_active":"2024-02-15T23:30:15.769044+0000","last_peered":"2024-02-15T23:30:15.769044+0000","last_clean":"2024-02-15T23:30:15.769044+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:30:15.769044+0000","last_undegraded":"2024-02-15T23:30:15.769044+0000","last_fullsized":"2024-02-15T23:30:15.769044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:35.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782323+0000","last_change":"2024-02-15T23:29:29.737932+0000","last_active":"2024-02-15T23:30:10.782323+0000","last_peered":"2024-02-15T23:30:10.782323+0000","last_clean":"2024-02-15T23:30:10.782323+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:30:10.782323+0000","last_undegraded":"2024-02-15T23:30:10.782323+0000","last_fullsized":"2024-02-15T23:30:10.782323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781017+0000","last_change":"2024-02-15T23:29:33.704716+0000","last_active":"2024-02-15T23:30:10.781017+0000","last_peered":"2024-02-15T23:30:10.781017+0000","last_clean":"2024-02-15T23:30:10.781017+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:30:10.781017+0000","last_undegraded":"2024-02-15T23:30:10.781017+0000","last_fullsized":"2024-02-15T23:30:10.781017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:43:47.043349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.263598+0000","last_change":"2024-02-15T23:29:35.746767+0000","last_active":"2024-02-15T23:30:58.263598+0000","last_peered":"2024-02-15T23:30:58.263598+0000","last_clean":"2024-02-15T23:30:58.263598+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:30:58.263598+0000","last_undegraded":"2024-02-15T23:30:58.263598+0000","last_fullsized":"2024-02-15T23:30:58.263598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:20.637953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787004+0000","last_change":"2024-02-15T23:29:37.760362+0000","last_active":"2024-02-15T23:30:10.787004+0000","last_peered":"2024-02-15T23:30:10.787004+0000","last_clean":"2024-02-15T23:30:10.787004+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:30:10.787004+0000","last_undegraded":"2024-02-15T23:30:10.787004+0000","last_fullsized":"2024-02-15T23:30:10.787004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:26:31.398449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797516+0000","last_change":"2024-02-15T23:29:39.769995+0000","last_active":"2024-02-15T23:30:10.797516+0000","last_peered":"2024-02-15T23:30:10.797516+0000","last_clean":"2024-02-15T23:30:10.797516+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:30:10.797516+0000","last_undegraded":"2024-02-15T23:30:10.797516+0000","last_fullsized":"2024-02-15T23:30:10.797516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:17.415321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924750+0000","last_change":"2024-02-15T23:29:31.709284+0000","last_active":"2024-02-15T23:31:03.924750+0000","last_peered":"2024-02-15T23:31:03.924750+0000","last_clean":"2024-02-15T23:31:03.924750+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:03.924750+0000","last_undegraded":"2024-02-15T23:31:03.924750+0000","last_fullsized":"2024-02-15T23:31:03.924750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:28.678586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.075644+0000","last_change":"2024-02-15T23:29:29.706515+0000","last_active":"2024-02-15T23:30:15.075644+0000","last_peered":"2024-02-15T23:30:15.075644+0000","last_clean":"2024-02-15T23:30:15.075644+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:30:15.075644+0000","last_undegraded":"2024-02-15T23:30:15.075644+0000","last_fullsized":"2024-02-15T23:30:15.075644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779703+0000","last_change":"2024-02-15T23:29:33.707077+0000","last_active":"2024-02-15T23:30:10.779703+0000","last_peered":"2024-02-15T23:30:10.779703+0000","last_clean":"2024-02-15T23:30:10.779703+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:30:10.779703+0000","last_undegraded":"2024-02-15T23:30:10.779703+0000","last_fullsized":"2024-02-15T23:30:10.779703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:52.708213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.286180+0000","last_change":"2024-02-15T23:29:35.740799+0000","last_active":"2024-02-15T23:30:58.286180+0000","last_peered":"2024-02-15T23:30:58.286180+0000","last_clean":"2024-02-15T23:30:58.286180+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:30:58.286180+0000","last_undegraded":"2024-02-15T23:30:58.286180+0000","last_fullsized":"2024-02-15T23:30:58.286180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:03.568892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787613+0000","last_change":"2024-02-15T23:29:37.765611+0000","last_active":"2024-02-15T23:30:10.787613+0000","last_peered":"2024-02-15T23:30:10.787613+0000","last_clean":"2024-02-15T23:30:10.787613+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:30:10.787613+0000","last_undegraded":"2024-02-15T23:30:10.787613+0000","last_fullsized":"2024-02-15T23:30:10.787613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:20.640463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797644+0000","last_change":"2024-02-15T23:29:39.769430+0000","last_active":"2024-02-15T23:30:10.797644+0000","last_peered":"2024-02-15T23:30:10.797644+0000","last_clean":"2024-02-15T23:30:10.797644+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:30:10.797644+0000","last_undegraded":"2024-02-15T23:30:10.797644+0000","last_fullsized":"2024-02-15T23:30:10.797644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:09:59.883710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791011+0000","last_change":"2024-02-15T23:29:31.691631+0000","last_active":"2024-02-15T23:30:10.791011+0000","last_peered":"2024-02-15T23:30:10.791011+0000","last_clean":"2024-02-15T23:30:10.791011+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:30:10.791011+0000","last_undegraded":"2024-02-15T23:30:10.791011+0000","last_fullsized":"2024-02-15T23:30:10.791011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805500+0000","last_change":"2024-02-15T23:29:29.720236+0000","last_active":"2024-02-15T23:30:10.805500+0000","last_peered":"2024-02-15T23:30:10.805500+0000","last_clean":"2024-02-15T23:30:10.805500+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:30:10.805500+0000","last_undegraded":"2024-02-15T23:30:10.805500+0000","last_fullsized":"2024-02-15T23:30:10.805500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:14.660978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787495+0000","last_change":"2024-02-15T23:29:33.711713+0000","last_active":"2024-02-15T23:30:10.787495+0000","last_peered":"2024-02-15T23:30:10.787495+0000","last_clean":"2024-02-15T23:30:10.787495+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:30:10.787495+0000","last_undegraded":"2024-02-15T23:30:10.787495+0000","last_fullsized":"2024-02-15T23:30:10.787495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:22.356586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810657+0000","last_change":"2024-02-15T23:29:35.751777+0000","last_active":"2024-02-15T23:30:10.810657+0000","last_peered":"2024-02-15T23:30:10.810657+0000","last_clean":"2024-02-15T23:30:10.810657+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:30:10.810657+0000","last_undegraded":"2024-02-15T23:30:10.810657+0000","last_fullsized":"2024-02-15T23:30:10.810657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:30:34.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:04.143444+0000","last_change":"2024-02-15T23:29:37.767386+0000","last_active":"2024-02-15T23:31:04.143444+0000","last_peered":"2024-02-15T23:31:04.143444+0000","last_clean":"2024-02-15T23:31:04.143444+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:04.143444+0000","last_undegraded":"2024-02-15T23:31:04.143444+0000","last_fullsized":"2024-02-15T23:31:04.143444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:38.436613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.793935+0000","last_change":"2024-02-15T23:29:39.775113+0000","last_active":"2024-02-15T23:30:10.793935+0000","last_peered":"2024-02-15T23:30:10.793935+0000","last_clean":"2024-02-15T23:30:10.793935+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:30:10.793935+0000","last_undegraded":"2024-02-15T23:30:10.793935+0000","last_fullsized":"2024-02-15T23:30:10.793935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:40:43.570670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.765400+0000","last_change":"2024-02-15T23:29:31.684239+0000","last_active":"2024-02-15T23:30:15.765400+0000","last_peered":"2024-02-15T23:30:15.765400+0000","last_clean":"2024-02-15T23:30:15.765400+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:30:15.765400+0000","last_undegraded":"2024-02-15T23:30:15.765400+0000","last_fullsized":"2024-02-15T23:30:15.765400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:57.286122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796635+0000","last_change":"2024-02-15T23:29:29.725067+0000","last_active":"2024-02-15T23:30:10.796635+0000","last_peered":"2024-02-15T23:30:10.796635+0000","last_clean":"2024-02-15T23:30:10.796635+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:30:10.796635+0000","last_undegraded":"2024-02-15T23:30:10.796635+0000","last_fullsized":"2024-02-15T23:30:10.796635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783024+0000","last_change":"2024-02-15T23:29:33.718484+0000","last_active":"2024-02-15T23:30:10.783024+0000","last_peered":"2024-02-15T23:30:10.783024+0000","last_clean":"2024-02-15T23:30:10.783024+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:30:10.783024+0000","last_undegraded":"2024-02-15T23:30:10.783024+0000","last_fullsized":"2024-02-15T23:30:10.783024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:12.597571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.250589+0000","last_change":"2024-02-15T23:29:35.728335+0000","last_active":"2024-02-15T23:30:58.250589+0000","last_peered":"2024-02-15T23:30:58.250589+0000","last_clean":"2024-02-15T23:30:58.250589+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:30:58.250589+0000","last_undegraded":"2024-02-15T23:30:58.250589+0000","last_fullsized":"2024-02-15T23:30:58.250589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:19.485322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783428+0000","last_change":"2024-02-15T23:29:37.763470+0000","last_active":"2024-02-15T23:30:10.783428+0000","last_peered":"2024-02-15T23:30:10.783428+0000","last_clean":"2024-02-15T23:30:10.783428+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:30:10.783428+0000","last_undegraded":"2024-02-15T23:30:10.783428+0000","last_fullsized":"2024-02-15T23:30:10.783428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:48.322860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795923+0000","last_change":"2024-02-15T23:29:39.782265+0000","last_active":"2024-02-15T23:30:10.795923+0000","last_peered":"2024-02-15T23:30:10.795923+0000","last_clean":"2024-02-15T23:30:10.795923+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:30:10.795923+0000","last_undegraded":"2024-02-15T23:30:10.795923+0000","last_fullsized":"2024-02-15T23:30:10.795923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:29.582392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.751269+0000","last_change":"2024-02-15T23:29:31.685467+0000","last_active":"2024-02-15T23:30:14.751269+0000","last_peered":"2024-02-15T23:30:14.751269+0000","last_clean":"2024-02-15T23:30:14.751269+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:30:14.751269+0000","last_undegraded":"2024-02-15T23:30:14.751269+0000","last_fullsized":"2024-02-15T23:30:14.751269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:49.264719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809512+0000","last_change":"2024-02-15T23:29:29.728334+0000","last_active":"2024-02-15T23:30:10.809512+0000","last_peered":"2024-02-15T23:30:10.809512+0000","last_clean":"2024-02-15T23:30:10.809512+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:30:10.809512+0000","last_undegraded":"2024-02-15T23:30:10.809512+0000","last_fullsized":"2024-02-15T23:30:10.809512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:02.838388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785093+0000","last_change":"2024-02-15T23:29:33.707600+0000","last_active":"2024-02-15T23:30:10.785093+0000","last_peered":"2024-02-15T23:30:10.785093+0000","last_clean":"2024-02-15T23:30:10.785093+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:30:10.785093+0000","last_undegraded":"2024-02-15T23:30:10.785093+0000","last_fullsized":"2024-02-15T23:30:10.785093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:35.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'31","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.252201+0000","last_change":"2024-02-15T23:29:35.719654+0000","last_active":"2024-02-15T23:30:58.252201+0000","last_peered":"2024-02-15T23:30:58.252201+0000","last_clean":"2024-02-15T23:30:58.252201+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:30:58.252201+0000","last_undegraded":"2024-02-15T23:30:58.252201+0000","last_fullsized":"2024-02-15T23:30:58.252201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:14.904715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794382+0000","last_change":"2024-02-15T23:29:37.765925+0000","last_active":"2024-02-15T23:30:10.794382+0000","last_peered":"2024-02-15T23:30:10.794382+0000","last_clean":"2024-02-15T23:30:10.794382+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:30:10.794382+0000","last_undegraded":"2024-02-15T23:30:10.794382+0000","last_fullsized":"2024-02-15T23:30:10.794382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:47.006455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813342+0000","last_change":"2024-02-15T23:29:39.784125+0000","last_active":"2024-02-15T23:30:10.813342+0000","last_peered":"2024-02-15T23:30:10.813342+0000","last_clean":"2024-02-15T23:30:10.813342+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:30:10.813342+0000","last_undegraded":"2024-02-15T23:30:10.813342+0000","last_fullsized":"2024-02-15T23:30:10.813342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:38.708272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795106+0000","last_change":"2024-02-15T23:29:31.701274+0000","last_active":"2024-02-15T23:30:10.795106+0000","last_peered":"2024-02-15T23:30:10.795106+0000","last_clean":"2024-02-15T23:30:10.795106+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:30:10.795106+0000","last_undegraded":"2024-02-15T23:30:10.795106+0000","last_fullsized":"2024-02-15T23:30:10.795106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:10.874498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790293+0000","last_change":"2024-02-15T23:29:29.717620+0000","last_active":"2024-02-15T23:30:10.790293+0000","last_peered":"2024-02-15T23:30:10.790293+0000","last_clean":"2024-02-15T23:30:10.790293+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:30:10.790293+0000","last_undegraded":"2024-02-15T23:30:10.790293+0000","last_fullsized":"2024-02-15T23:30:10.790293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:13.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:05.011422+0000","last_change":"2024-02-15T23:29:33.718676+0000","last_active":"2024-02-15T23:31:05.011422+0000","last_peered":"2024-02-15T23:31:05.011422+0000","last_clean":"2024-02-15T23:31:05.011422+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:05.011422+0000","last_undegraded":"2024-02-15T23:31:05.011422+0000","last_fullsized":"2024-02-15T23:31:05.011422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:39.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'24","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.283866+0000","last_change":"2024-02-15T23:29:35.752343+0000","last_active":"2024-02-15T23:30:58.283866+0000","last_peered":"2024-02-15T23:30:58.283866+0000","last_clean":"2024-02-15T23:30:58.283866+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:30:58.283866+0000","last_undegraded":"2024-02-15T23:30:58.283866+0000","last_fullsized":"2024-02-15T23:30:58.283866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:33.613231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798971+0000","last_change":"2024-02-15T23:29:37.770670+0000","last_active":"2024-02-15T23:30:10.798971+0000","last_peered":"2024-02-15T23:30:10.798971+0000","last_clean":"2024-02-15T23:30:10.798971+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:30:10.798971+0000","last_undegraded":"2024-02-15T23:30:10.798971+0000","last_fullsized":"2024-02-15T23:30:10.798971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:36.321730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807623+0000","last_change":"2024-02-15T23:29:39.784728+0000","last_active":"2024-02-15T23:30:10.807623+0000","last_peered":"2024-02-15T23:30:10.807623+0000","last_clean":"2024-02-15T23:30:10.807623+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:30:10.807623+0000","last_undegraded":"2024-02-15T23:30:10.807623+0000","last_fullsized":"2024-02-15T23:30:10.807623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:48.823664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.765342+0000","last_change":"2024-02-15T23:29:31.684323+0000","last_active":"2024-02-15T23:30:15.765342+0000","last_peered":"2024-02-15T23:30:15.765342+0000","last_clean":"2024-02-15T23:30:15.765342+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:30:15.765342+0000","last_undegraded":"2024-02-15T23:30:15.765342+0000","last_fullsized":"2024-02-15T23:30:15.765342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:28.332760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792855+0000","last_change":"2024-02-15T23:29:29.719123+0000","last_active":"2024-02-15T23:30:10.792855+0000","last_peered":"2024-02-15T23:30:10.792855+0000","last_clean":"2024-02-15T23:30:10.792855+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:30:10.792855+0000","last_undegraded":"2024-02-15T23:30:10.792855+0000","last_fullsized":"2024-02-15T23:30:10.792855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783243+0000","last_change":"2024-02-15T23:29:33.718106+0000","last_active":"2024-02-15T23:30:10.783243+0000","last_peered":"2024-02-15T23:30:10.783243+0000","last_clean":"2024-02-15T23:30:10.783243+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:30:10.783243+0000","last_undegraded":"2024-02-15T23:30:10.783243+0000","last_fullsized":"2024-02-15T23:30:10.783243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:13.398453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.899549+0000","last_change":"2024-02-15T23:29:35.748095+0000","last_active":"2024-02-15T23:31:03.899549+0000","last_peered":"2024-02-15T23:31:03.899549+0000","last_clean":"2024-02-15T23:31:03.899549+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:03.899549+0000","last_undegraded":"2024-02-15T23:31:03.899549+0000","last_fullsized":"2024-02-15T23:31:03.899549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:34:58.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785313+0000","last_change":"2024-02-15T23:29:37.764100+0000","last_active":"2024-02-15T23:30:10.785313+0000","last_peered":"2024-02-15T23:30:10.785313+0000","last_clean":"2024-02-15T23:30:10.785313+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:30:10.785313+0000","last_undegraded":"2024-02-15T23:30:10.785313+0000","last_fullsized":"2024-02-15T23:30:10.785313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:59.183786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.051571+0000","last_change":"2024-02-15T23:29:39.784447+0000","last_active":"2024-02-15T23:30:15.051571+0000","last_peered":"2024-02-15T23:30:15.051571+0000","last_clean":"2024-02-15T23:30:15.051571+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:30:15.051571+0000","last_undegraded":"2024-02-15T23:30:15.051571+0000","last_fullsized":"2024-02-15T23:30:15.051571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:42.388138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796691+0000","last_change":"2024-02-15T23:29:31.710180+0000","last_active":"2024-02-15T23:30:10.796691+0000","last_peered":"2024-02-15T23:30:10.796691+0000","last_clean":"2024-02-15T23:30:10.796691+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:30:10.796691+0000","last_undegraded":"2024-02-15T23:30:10.796691+0000","last_fullsized":"2024-02-15T23:30:10.796691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:43.016654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.775086+0000","last_change":"2024-02-15T23:29:29.733523+0000","last_active":"2024-02-15T23:30:10.775086+0000","last_peered":"2024-02-15T23:30:10.775086+0000","last_clean":"2024-02-15T23:30:10.775086+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:30:10.775086+0000","last_undegraded":"2024-02-15T23:30:10.775086+0000","last_fullsized":"2024-02-15T23:30:10.775086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:35.831875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.293732+0000","last_change":"2024-02-15T23:29:31.689326+0000","last_active":"2024-02-15T23:30:14.293732+0000","last_peered":"2024-02-15T23:30:14.293732+0000","last_clean":"2024-02-15T23:30:14.293732+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:30:14.293732+0000","last_undegraded":"2024-02-15T23:30:14.293732+0000","last_fullsized":"2024-02-15T23:30:14.293732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:41.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783852+0000","last_change":"2024-02-15T23:29:29.708496+0000","last_active":"2024-02-15T23:30:10.783852+0000","last_peered":"2024-02-15T23:30:10.783852+0000","last_clean":"2024-02-15T23:30:10.783852+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:30:10.783852+0000","last_undegraded":"2024-02-15T23:30:10.783852+0000","last_fullsized":"2024-02-15T23:30:10.783852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924796+0000","last_change":"2024-02-15T23:29:31.705760+0000","last_active":"2024-02-15T23:31:03.924796+0000","last_peered":"2024-02-15T23:31:03.924796+0000","last_clean":"2024-02-15T23:31:03.924796+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:03.924796+0000","last_undegraded":"2024-02-15T23:31:03.924796+0000","last_fullsized":"2024-02-15T23:31:03.924796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:52:01.340593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799615+0000","last_change":"2024-02-15T23:29:29.728191+0000","last_active":"2024-02-15T23:30:10.799615+0000","last_peered":"2024-02-15T23:30:10.799615+0000","last_clean":"2024-02-15T23:30:10.799615+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:30:10.799615+0000","last_undegraded":"2024-02-15T23:30:10.799615+0000","last_fullsized":"2024-02-15T23:30:10.799615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:21.821782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924754+0000","last_change":"2024-02-15T23:29:31.693908+0000","last_active":"2024-02-15T23:31:03.924754+0000","last_peered":"2024-02-15T23:31:03.924754+0000","last_clean":"2024-02-15T23:31:03.924754+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:03.924754+0000","last_undegraded":"2024-02-15T23:31:03.924754+0000","last_fullsized":"2024-02-15T23:31:03.924754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:49.264719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787153+0000","last_change":"2024-02-15T23:29:29.707236+0000","last_active":"2024-02-15T23:30:10.787153+0000","last_peered":"2024-02-15T23:30:10.787153+0000","last_clean":"2024-02-15T23:30:10.787153+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:30:10.787153+0000","last_undegraded":"2024-02-15T23:30:10.787153+0000","last_fullsized":"2024-02-15T23:30:10.787153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924794+0000","last_change":"2024-02-15T23:29:31.709341+0000","last_active":"2024-02-15T23:31:03.924794+0000","last_peered":"2024-02-15T23:31:03.924794+0000","last_clean":"2024-02-15T23:31:03.924794+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:03.924794+0000","last_undegraded":"2024-02-15T23:31:03.924794+0000","last_fullsized":"2024-02-15T23:31:03.924794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:16.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787213+0000","last_change":"2024-02-15T23:29:29.716033+0000","last_active":"2024-02-15T23:30:10.787213+0000","last_peered":"2024-02-15T23:30:10.787213+0000","last_clean":"2024-02-15T23:30:10.787213+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:30:10.787213+0000","last_undegraded":"2024-02-15T23:30:10.787213+0000","last_fullsized":"2024-02-15T23:30:10.787213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310211+0000","last_change":"2024-02-15T23:29:31.704944+0000","last_active":"2024-02-15T23:30:58.310211+0000","last_peered":"2024-02-15T23:30:58.310211+0000","last_clean":"2024-02-15T23:30:58.310211+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:30:58.310211+0000","last_undegraded":"2024-02-15T23:30:58.310211+0000","last_fullsized":"2024-02-15T23:30:58.310211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:21:12.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787672+0000","last_change":"2024-02-15T23:29:29.738175+0000","last_active":"2024-02-15T23:30:10.787672+0000","last_peered":"2024-02-15T23:30:10.787672+0000","last_clean":"2024-02-15T23:30:10.787672+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:30:10.787672+0000","last_undegraded":"2024-02-15T23:30:10.787672+0000","last_fullsized":"2024-02-15T23:30:10.787672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785339+0000","last_change":"2024-02-15T23:29:31.695350+0000","last_active":"2024-02-15T23:30:10.785339+0000","last_peered":"2024-02-15T23:30:10.785339+0000","last_clean":"2024-02-15T23:30:10.785339+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:30:10.785339+0000","last_undegraded":"2024-02-15T23:30:10.785339+0000","last_fullsized":"2024-02-15T23:30:10.785339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:21.379451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780402+0000","last_change":"2024-02-15T23:29:29.731948+0000","last_active":"2024-02-15T23:30:10.780402+0000","last_peered":"2024-02-15T23:30:10.780402+0000","last_clean":"2024-02-15T23:30:10.780402+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:30:10.780402+0000","last_undegraded":"2024-02-15T23:30:10.780402+0000","last_fullsized":"2024-02-15T23:30:10.780402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.925201+0000","last_change":"2024-02-15T23:29:31.693023+0000","last_active":"2024-02-15T23:31:03.925201+0000","last_peered":"2024-02-15T23:31:03.925201+0000","last_clean":"2024-02-15T23:31:03.925201+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:03.925201+0000","last_undegraded":"2024-02-15T23:31:03.925201+0000","last_fullsized":"2024-02-15T23:31:03.925201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790918+0000","last_change":"2024-02-15T23:29:29.710596+0000","last_active":"2024-02-15T23:30:10.790918+0000","last_peered":"2024-02-15T23:30:10.790918+0000","last_clean":"2024-02-15T23:30:10.790918+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:30:10.790918+0000","last_undegraded":"2024-02-15T23:30:10.790918+0000","last_fullsized":"2024-02-15T23:30:10.790918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796948+0000","last_change":"2024-02-15T23:29:31.689541+0000","last_active":"2024-02-15T23:30:10.796948+0000","last_peered":"2024-02-15T23:30:10.796948+0000","last_clean":"2024-02-15T23:30:10.796948+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:30:10.796948+0000","last_undegraded":"2024-02-15T23:30:10.796948+0000","last_fullsized":"2024-02-15T23:30:10.796948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:51.240648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795824+0000","last_change":"2024-02-15T23:29:29.716896+0000","last_active":"2024-02-15T23:30:10.795824+0000","last_peered":"2024-02-15T23:30:10.795824+0000","last_clean":"2024-02-15T23:30:10.795824+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:30:10.795824+0000","last_undegraded":"2024-02-15T23:30:10.795824+0000","last_fullsized":"2024-02-15T23:30:10.795824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:26:58.454845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.779706+0000","last_change":"2024-02-15T23:30:10.793574+0000","last_active":"2024-02-15T23:30:15.779706+0000","last_peered":"2024-02-15T23:30:15.779706+0000","last_clean":"2024-02-15T23:30:15.779706+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:30:15.779706+0000","last_undegraded":"2024-02-15T23:30:15.779706+0000","last_fullsized":"2024-02-15T23:30:15.779706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:47.873898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784302+0000","last_change":"2024-02-15T23:29:29.719351+0000","last_active":"2024-02-15T23:30:10.784302+0000","last_peered":"2024-02-15T23:30:10.784302+0000","last_clean":"2024-02-15T23:30:10.784302+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:30:10.784302+0000","last_undegraded":"2024-02-15T23:30:10.784302+0000","last_fullsized":"2024-02-15T23:30:10.784302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'21","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499219+0000","last_change":"2024-02-15T23:29:31.713582+0000","last_active":"2024-02-15T23:30:57.499219+0000","last_peered":"2024-02-15T23:30:57.499219+0000","last_clean":"2024-02-15T23:30:57.499219+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:30:57.499219+0000","last_undegraded":"2024-02-15T23:30:57.499219+0000","last_fullsized":"2024-02-15T23:30:57.499219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783783+0000","last_change":"2024-02-15T23:29:29.741437+0000","last_active":"2024-02-15T23:30:10.783783+0000","last_peered":"2024-02-15T23:30:10.783783+0000","last_clean":"2024-02-15T23:30:10.783783+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:30:10.783783+0000","last_undegraded":"2024-02-15T23:30:10.783783+0000","last_fullsized":"2024-02-15T23:30:10.783783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786380+0000","last_change":"2024-02-15T23:29:31.694663+0000","last_active":"2024-02-15T23:30:10.786380+0000","last_peered":"2024-02-15T23:30:10.786380+0000","last_clean":"2024-02-15T23:30:10.786380+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:30:10.786380+0000","last_undegraded":"2024-02-15T23:30:10.786380+0000","last_fullsized":"2024-02-15T23:30:10.786380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:01.705137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790614+0000","last_change":"2024-02-15T23:29:29.720975+0000","last_active":"2024-02-15T23:30:10.790614+0000","last_peered":"2024-02-15T23:30:10.790614+0000","last_clean":"2024-02-15T23:30:10.790614+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:30:10.790614+0000","last_undegraded":"2024-02-15T23:30:10.790614+0000","last_fullsized":"2024-02-15T23:30:10.790614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091043+0000","last_change":"2024-02-15T23:29:31.703991+0000","last_active":"2024-02-15T23:30:15.091043+0000","last_peered":"2024-02-15T23:30:15.091043+0000","last_clean":"2024-02-15T23:30:15.091043+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:30:15.091043+0000","last_undegraded":"2024-02-15T23:30:15.091043+0000","last_fullsized":"2024-02-15T23:30:15.091043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.248593+0000","last_change":"2024-02-15T23:29:29.714331+0000","last_active":"2024-02-15T23:30:14.248593+0000","last_peered":"2024-02-15T23:30:14.248593+0000","last_clean":"2024-02-15T23:30:14.248593+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:30:14.248593+0000","last_undegraded":"2024-02-15T23:30:14.248593+0000","last_fullsized":"2024-02-15T23:30:14.248593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:19.362596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499673+0000","last_change":"2024-02-15T23:29:31.689861+0000","last_active":"2024-02-15T23:30:57.499673+0000","last_peered":"2024-02-15T23:30:57.499673+0000","last_clean":"2024-02-15T23:30:57.499673+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:30:57.499673+0000","last_undegraded":"2024-02-15T23:30:57.499673+0000","last_fullsized":"2024-02-15T23:30:57.499673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:43.878770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810021+0000","last_change":"2024-02-15T23:29:29.720292+0000","last_active":"2024-02-15T23:30:10.810021+0000","last_peered":"2024-02-15T23:30:10.810021+0000","last_clean":"2024-02-15T23:30:10.810021+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:30:10.810021+0000","last_undegraded":"2024-02-15T23:30:10.810021+0000","last_fullsized":"2024-02-15T23:30:10.810021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:29.439315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310693+0000","last_change":"2024-02-15T23:29:31.699375+0000","last_active":"2024-02-15T23:30:58.310693+0000","last_peered":"2024-02-15T23:30:58.310693+0000","last_clean":"2024-02-15T23:30:58.310693+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:30:58.310693+0000","last_undegraded":"2024-02-15T23:30:58.310693+0000","last_fullsized":"2024-02-15T23:30:58.310693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:33.891211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780993+0000","last_change":"2024-02-15T23:29:29.730792+0000","last_active":"2024-02-15T23:30:10.780993+0000","last_peered":"2024-02-15T23:30:10.780993+0000","last_clean":"2024-02-15T23:30:10.780993+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:30:10.780993+0000","last_undegraded":"2024-02-15T23:30:10.780993+0000","last_fullsized":"2024-02-15T23:30:10.780993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.854975+0000","last_change":"2024-02-15T23:29:31.694898+0000","last_active":"2024-02-15T23:30:57.854975+0000","last_peered":"2024-02-15T23:30:57.854975+0000","last_clean":"2024-02-15T23:30:57.854975+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:30:57.854975+0000","last_undegraded":"2024-02-15T23:30:57.854975+0000","last_fullsized":"2024-02-15T23:30:57.854975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:33.539189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.081189+0000","last_change":"2024-02-15T23:29:29.714026+0000","last_active":"2024-02-15T23:30:15.081189+0000","last_peered":"2024-02-15T23:30:15.081189+0000","last_clean":"2024-02-15T23:30:15.081189+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:30:15.081189+0000","last_undegraded":"2024-02-15T23:30:15.081189+0000","last_fullsized":"2024-02-15T23:30:15.081189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:39.963502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796908+0000","last_change":"2024-02-15T23:29:29.714394+0000","last_active":"2024-02-15T23:30:10.796908+0000","last_peered":"2024-02-15T23:30:10.796908+0000","last_clean":"2024-02-15T23:30:10.796908+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:30:10.796908+0000","last_undegraded":"2024-02-15T23:30:10.796908+0000","last_fullsized":"2024-02-15T23:30:10.796908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:36.000311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791872+0000","last_change":"2024-02-15T23:29:31.696441+0000","last_active":"2024-02-15T23:30:10.791872+0000","last_peered":"2024-02-15T23:30:10.791872+0000","last_clean":"2024-02-15T23:30:10.791872+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:30:10.791872+0000","last_undegraded":"2024-02-15T23:30:10.791872+0000","last_fullsized":"2024-02-15T23:30:10.791872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:07.483252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784436+0000","last_change":"2024-02-15T23:29:29.716351+0000","last_active":"2024-02-15T23:30:10.784436+0000","last_peered":"2024-02-15T23:30:10.784436+0000","last_clean":"2024-02-15T23:30:10.784436+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:30:10.784436+0000","last_undegraded":"2024-02-15T23:30:10.784436+0000","last_fullsized":"2024-02-15T23:30:10.784436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091055+0000","last_change":"2024-02-15T23:29:31.709385+0000","last_active":"2024-02-15T23:30:15.091055+0000","last_peered":"2024-02-15T23:30:15.091055+0000","last_clean":"2024-02-15T23:30:15.091055+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:30:15.091055+0000","last_undegraded":"2024-02-15T23:30:15.091055+0000","last_fullsized":"2024-02-15T23:30:15.091055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:02.842564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705692,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52700000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705690,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.622}]},{"osd":3,"last update":"Thu Feb 15 23:30:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.503},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":0.67500000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.755},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.64700000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:31:13.162 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T23:31:13.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.303+0000 7fd3f1eeb640 1 Processor -- start 2024-02-15T23:31:13.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.303+0000 7fd3f1eeb640 1 -- start start 2024-02-15T23:31:13.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.303+0000 7fd3f1eeb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3ec12d530 0x7fd3ec12f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:13.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.303+0000 7fd3f1eeb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec094180 con 0x7fd3ec092560 2024-02-15T23:31:13.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.303+0000 7fd3f1eeb640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec093050 con 0x7fd3ec12d530 2024-02-15T23:31:13.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3eaffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3ec12d530 0x7fd3ec12f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:13.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3eb7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd3ec092560 0x7fd3ec092940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36862/0 (socket says 172.21.15.131:36862) 2024-02-15T23:31:13.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3eb7fe640 1 -- 172.21.15.131:0/2517547288 learned_addr learned my addr 172.21.15.131:0/2517547288 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:13.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3eaffd640 1 -- 172.21.15.131:0/2517547288 >> v1:172.21.15.131:6789/0 conn(0x7fd3ec092560 legacy=0x7fd3ec092940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:13.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3eaffd640 1 -- 172.21.15.131:0/2517547288 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec0958f0 con 0x7fd3ec12d530 2024-02-15T23:31:13.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3eaffd640 1 --2- 172.21.15.131:0/2517547288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec12d530 0x7fd3ec12f920 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400a8e0 tx=0x7fd3d401d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89fc1b9be534a66 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:13.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3ea7fc640 1 -- 172.21.15.131:0/2517547288 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3d40a66e0 con 0x7fd3ec12d530 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3ea7fc640 1 -- 172.21.15.131:0/2517547288 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d40a6840 con 0x7fd3ec12d530 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3ea7fc640 1 -- 172.21.15.131:0/2517547288 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3d40a6b00 con 0x7fd3ec12d530 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2517547288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec12d530 msgr2=0x7fd3ec12f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3f1eeb640 1 --2- 172.21.15.131:0/2517547288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec12d530 0x7fd3ec12f920 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400a8e0 tx=0x7fd3d401d740 comp rx=0 tx=0).stop 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2517547288 shutdown_connections 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3f1eeb640 1 --2- 172.21.15.131:0/2517547288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec12d530 0x7fd3ec12f920 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2517547288 >> 172.21.15.131:0/2517547288 conn(0x7fd3ec09a2f0 msgr2=0x7fd3ec09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2517547288 shutdown_connections 2024-02-15T23:31:13.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.307+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2517547288 wait complete. 2024-02-15T23:31:13.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3f1eeb640 1 Processor -- start 2024-02-15T23:31:13.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3f1eeb640 1 -- start start 2024-02-15T23:31:13.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3f1eeb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec092560 0x7fd3ec1c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:13.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3f1eeb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0982e0 con 0x7fd3ec092560 2024-02-15T23:31:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3eb7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec092560 0x7fd3ec1c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3eb7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec092560 0x7fd3ec1c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51208/0 (socket says 172.21.15.131:51208) 2024-02-15T23:31:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3eb7fe640 1 -- 172.21.15.131:0/2436146022 learned_addr learned my addr 172.21.15.131:0/2436146022 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3eb7fe640 1 -- 172.21.15.131:0/2436146022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d400a5c0 con 0x7fd3ec092560 2024-02-15T23:31:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3eb7fe640 1 --2- 172.21.15.131:0/2436146022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec092560 0x7fd3ec1c54f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00ca90 tx=0x7fd3dc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3e3fff640 1 -- 172.21.15.131:0/2436146022 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3dc004ca0 con 0x7fd3ec092560 2024-02-15T23:31:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3e3fff640 1 -- 172.21.15.131:0/2436146022 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc004e00 con 0x7fd3ec092560 2024-02-15T23:31:13.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3e3fff640 1 -- 172.21.15.131:0/2436146022 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3dc00aba0 con 0x7fd3ec092560 2024-02-15T23:31:13.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec071e40 con 0x7fd3ec092560 2024-02-15T23:31:13.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec08f7b0 con 0x7fd3ec092560 2024-02-15T23:31:13.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3e3fff640 1 -- 172.21.15.131:0/2436146022 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3dc00ad00 con 0x7fd3ec092560 2024-02-15T23:31:13.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec067e00 con 0x7fd3ec092560 2024-02-15T23:31:13.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3e3fff640 1 --2- 172.21.15.131:0/2436146022 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd3cc035a10 0x7fd3cc037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:13.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3e3fff640 1 -- 172.21.15.131:0/2436146022 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd3dc048790 con 0x7fd3ec092560 2024-02-15T23:31:13.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.311+0000 7fd3eaffd640 1 --2- 172.21.15.131:0/2436146022 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd3cc035a10 0x7fd3cc037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:13.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.315+0000 7fd3eaffd640 1 --2- 172.21.15.131:0/2436146022 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd3cc035a10 0x7fd3cc037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40b0000 tx=0x7fd3d40a8070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:13.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.315+0000 7fd3e3fff640 1 -- 172.21.15.131:0/2436146022 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd3dc010300 con 0x7fd3ec092560 2024-02-15T23:31:13.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.475+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3ec122b10 con 0x7fd3ec092560 2024-02-15T23:31:13.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.475+0000 7fd3e3fff640 1 -- 172.21.15.131:0/2436146022 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+21030 (secure 0 0 0) 0x7fd3dc018020 con 0x7fd3ec092560 2024-02-15T23:31:13.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:31:13.487 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":33,"fsid":"633d2778-ce48-4cf9-a862-869ac6a165af","created":"2024-02-15T23:29:04.739458+0000","modified":"2024-02-15T23:30:10.773312+0000","last_up_change":"2024-02-15T23:29:13.557417+0000","last_in_change":"2024-02-15T23:29:05.873641+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T23:29:15.569040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-15T23:29:20.515339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-02-15T23:29:27.681446+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-02-15T23:29:30.047837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-02-15T23:29:31.954105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-02-15T23:29:33.860711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-02-15T23:29:35.794715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-02-15T23:29:37.945462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a808640e-6008-4ec4-b6e0-4ae1c480ac33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6801","nonce":31994139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6803","nonce":31994139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6807","nonce":31994139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":31994139},{"type":"v1","addr":"172.21.15.131:6805","nonce":31994139}]},"public_addr":"172.21.15.131:6801/31994139","cluster_addr":"172.21.15.131:6803/31994139","heartbeat_back_addr":"172.21.15.131:6807/31994139","heartbeat_front_addr":"172.21.15.131:6805/31994139","state":["exists","up"]},{"osd":1,"uuid":"1965c486-d2df-4b7e-bca1-3827989223e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6801","nonce":2918336019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6803","nonce":2918336019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6807","nonce":2918336019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2918336019},{"type":"v1","addr":"172.21.15.133:6805","nonce":2918336019}]},"public_addr":"172.21.15.133:6801/2918336019","cluster_addr":"172.21.15.133:6803/2918336019","heartbeat_back_addr":"172.21.15.133:6807/2918336019","heartbeat_front_addr":"172.21.15.133:6805/2918336019","state":["exists","up"]},{"osd":2,"uuid":"bd677a5e-b48a-43c0-9fe4-701bb31f3331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6809","nonce":3615800201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6811","nonce":3615800201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6815","nonce":3615800201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3615800201},{"type":"v1","addr":"172.21.15.133:6813","nonce":3615800201}]},"public_addr":"172.21.15.133:6809/3615800201","cluster_addr":"172.21.15.133:6811/3615800201","heartbeat_back_addr":"172.21.15.133:6815/3615800201","heartbeat_front_addr":"172.21.15.133:6813/3615800201","state":["exists","up"]},{"osd":3,"uuid":"e3b81b09-0178-420a-8d91-228e6ebabed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6817","nonce":1056376173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6819","nonce":1056376173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6823","nonce":1056376173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1056376173},{"type":"v1","addr":"172.21.15.133:6821","nonce":1056376173}]},"public_addr":"172.21.15.133:6817/1056376173","cluster_addr":"172.21.15.133:6819/1056376173","heartbeat_back_addr":"172.21.15.133:6823/1056376173","heartbeat_front_addr":"172.21.15.133:6821/1056376173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.171302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.401420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:11.392376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T23:29:10.859549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.3","mappings":[{"from":3,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.2e","mappings":[{"from":3,"to":0}]},{"pgid":"5.3","mappings":[{"from":0,"to":2}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.8","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:31:13.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd3cc035a10 msgr2=0x7fd3cc037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:13.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 --2- 172.21.15.131:0/2436146022 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd3cc035a10 0x7fd3cc037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40b0000 tx=0x7fd3d40a8070 comp rx=0 tx=0).stop 2024-02-15T23:31:13.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec092560 msgr2=0x7fd3ec1c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:13.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 --2- 172.21.15.131:0/2436146022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec092560 0x7fd3ec1c54f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00ca90 tx=0x7fd3dc00cf50 comp rx=0 tx=0).stop 2024-02-15T23:31:13.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 shutdown_connections 2024-02-15T23:31:13.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 --2- 172.21.15.131:0/2436146022 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd3cc035a10 0x7fd3cc037ed0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:13.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 --2- 172.21.15.131:0/2436146022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3ec092560 0x7fd3ec1c54f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:13.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 >> 172.21.15.131:0/2436146022 conn(0x7fd3ec09a2f0 msgr2=0x7fd3ec090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:13.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 shutdown_connections 2024-02-15T23:31:13.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:13.479+0000 7fd3f1eeb640 1 -- 172.21.15.131:0/2436146022 wait complete. 2024-02-15T23:31:14.506 INFO:tasks.ceph:Scrubbing osd.0 2024-02-15T23:31:14.507 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-15T23:31:14.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.631+0000 7f735ee81640 1 Processor -- start 2024-02-15T23:31:14.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.631+0000 7f735ee81640 1 -- start start 2024-02-15T23:31:14.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f735ee81640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7358128560 0x7f7358128af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:14.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f735ee81640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73580964c0 con 0x7f7358129030 2024-02-15T23:31:14.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f735ee81640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7358129490 con 0x7f7358128560 2024-02-15T23:31:14.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f734ffff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7358129030 0x7f735812baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36872/0 (socket says 172.21.15.131:36872) 2024-02-15T23:31:14.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f734ffff640 1 -- 172.21.15.131:0/1691994987 learned_addr learned my addr 172.21.15.131:0/1691994987 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:14.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f735cc1d640 1 --2- 172.21.15.131:0/1691994987 >> v2:172.21.15.131:3300/0 conn(0x7f7358128560 0x7f7358128af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:14.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f734f7fe640 1 -- 172.21.15.131:0/1691994987 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162692412 0 0) 0x7f73580964c0 con 0x7f7358129030 2024-02-15T23:31:14.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f734f7fe640 1 -- 172.21.15.131:0/1691994987 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7340003530 con 0x7f7358129030 2024-02-15T23:31:14.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f735cc1d640 1 -- 172.21.15.131:0/1691994987 >> v1:172.21.15.131:6789/0 conn(0x7f7358129030 legacy=0x7f735812baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f734f7fe640 1 -- 172.21.15.131:0/1691994987 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3502493941 0 0) 0x7f7340003530 con 0x7f7358129030 2024-02-15T23:31:14.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f735cc1d640 1 -- 172.21.15.131:0/1691994987 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7358095740 con 0x7f7358128560 2024-02-15T23:31:14.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f735cc1d640 1 --2- 172.21.15.131:0/1691994987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f7358128af0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7354009740 tx=0x7f735401c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2a13cd2a4c53ef server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:14.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f734f7fe640 1 -- 172.21.15.131:0/1691994987 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73480015b0 con 0x7f7358128560 2024-02-15T23:31:14.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f734f7fe640 1 -- 172.21.15.131:0/1691994987 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73540a4ce0 con 0x7f7358128560 2024-02-15T23:31:14.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.635+0000 7f734f7fe640 1 -- 172.21.15.131:0/1691994987 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73540ac440 con 0x7f7358128560 2024-02-15T23:31:14.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- 172.21.15.131:0/1691994987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 msgr2=0x7f7358128af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 --2- 172.21.15.131:0/1691994987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f7358128af0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7354009740 tx=0x7f735401c290 comp rx=0 tx=0).stop 2024-02-15T23:31:14.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- 172.21.15.131:0/1691994987 shutdown_connections 2024-02-15T23:31:14.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 --2- 172.21.15.131:0/1691994987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f7358128af0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- 172.21.15.131:0/1691994987 >> 172.21.15.131:0/1691994987 conn(0x7f735809a050 msgr2=0x7f735809a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:14.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- 172.21.15.131:0/1691994987 shutdown_connections 2024-02-15T23:31:14.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- 172.21.15.131:0/1691994987 wait complete. 2024-02-15T23:31:14.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 Processor -- start 2024-02-15T23:31:14.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- start start 2024-02-15T23:31:14.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f73581c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:14.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735812b950 con 0x7f7358128560 2024-02-15T23:31:14.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735cc1d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f73581c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:14.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735cc1d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f73581c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51238/0 (socket says 172.21.15.131:51238) 2024-02-15T23:31:14.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735cc1d640 1 -- 172.21.15.131:0/3278111125 learned_addr learned my addr 172.21.15.131:0/3278111125 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:14.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735cc1d640 1 -- 172.21.15.131:0/3278111125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354009420 con 0x7f7358128560 2024-02-15T23:31:14.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735cc1d640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f73581c3cf0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f73540af040 tx=0x7f7354019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:14.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73540b5540 con 0x7f7358128560 2024-02-15T23:31:14.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73540b56c0 con 0x7f7358128560 2024-02-15T23:31:14.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7358130370 con 0x7f7358128560 2024-02-15T23:31:14.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73540b59a0 con 0x7f7358128560 2024-02-15T23:31:14.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7358131010 con 0x7f7358128560 2024-02-15T23:31:14.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f735812bef0 con 0x7f7358128560 2024-02-15T23:31:14.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f73540b3040 con 0x7f7358128560 2024-02-15T23:31:14.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7344035a10 0x7f7344037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:14.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f73540e29f0 con 0x7f7358128560 2024-02-15T23:31:14.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7344041e80 0x7f7344044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:14.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73440449f0 con 0x7f7344041e80 2024-02-15T23:31:14.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73540e72a0 con 0x7f7358128560 2024-02-15T23:31:14.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f735d41e640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7344041e80 0x7f7344044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:14.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.639+0000 7f734ffff640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7344035a10 0x7f7344037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:14.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.643+0000 7f735d41e640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7344041e80 0x7f7344044320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:14.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.643+0000 7f734ffff640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7344035a10 0x7f7344037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7348005890 tx=0x7f7348001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:14.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.643+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 <== osd.0 v2:172.21.15.131:6800/31994139 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f73440449f0 con 0x7f7344041e80 2024-02-15T23:31:14.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 --> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7358062860 con 0x7f7344041e80 2024-02-15T23:31:14.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f734d7fa640 1 -- 172.21.15.131:0/3278111125 <== osd.0 v2:172.21.15.131:6800/31994139 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7358062860 con 0x7f7344041e80 2024-02-15T23:31:14.665 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-02-15T23:31:14.665 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-15T23:31:14.666 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7344041e80 msgr2=0x7f7344044320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7344041e80 0x7f7344044320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7344035a10 msgr2=0x7f7344037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7344035a10 0x7f7344037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7348005890 tx=0x7f7348001240 comp rx=0 tx=0).stop 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 msgr2=0x7f73581c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f73581c3cf0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f73540af040 tx=0x7f7354019030 comp rx=0 tx=0).stop 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 shutdown_connections 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:6800/31994139,v1:172.21.15.131:6801/31994139] conn(0x7f7344041e80 0x7f7344044320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f7344035a10 0x7f7344037ed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 --2- 172.21.15.131:0/3278111125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7358128560 0x7f73581c3cf0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 >> 172.21.15.131:0/3278111125 conn(0x7f735809a050 msgr2=0x7f7358097680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:14.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 shutdown_connections 2024-02-15T23:31:14.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.655+0000 7f735ee81640 1 -- 172.21.15.131:0/3278111125 wait complete. 2024-02-15T23:31:14.681 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-15T23:31:14.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6f1263640 1 Processor -- start 2024-02-15T23:31:14.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6f1263640 1 -- start start 2024-02-15T23:31:14.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6f1263640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6ec06ea60 0x7fb6ec1330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:14.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6f1263640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec06e1f0 con 0x7fb6ec12e240 2024-02-15T23:31:14.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6f1263640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec12ed30 con 0x7fb6ec06ea60 2024-02-15T23:31:14.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6eaffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb6ec12e240 0x7fb6ec12e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36874/0 (socket says 172.21.15.131:36874) 2024-02-15T23:31:14.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6eaffd640 1 -- 172.21.15.131:0/1543661779 learned_addr learned my addr 172.21.15.131:0/1543661779 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:14.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6ea7fc640 1 --2- 172.21.15.131:0/1543661779 >> v2:172.21.15.131:3300/0 conn(0x7fb6ec06ea60 0x7fb6ec1330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:14.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6e9ffb640 1 -- 172.21.15.131:0/1543661779 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305419473 0 0) 0x7fb6ec06e1f0 con 0x7fb6ec12e240 2024-02-15T23:31:14.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6e9ffb640 1 -- 172.21.15.131:0/1543661779 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6d4003530 con 0x7fb6ec12e240 2024-02-15T23:31:14.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6ea7fc640 1 -- 172.21.15.131:0/1543661779 >> v1:172.21.15.131:6789/0 conn(0x7fb6ec12e240 legacy=0x7fb6ec12e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.787+0000 7fb6ea7fc640 1 -- 172.21.15.131:0/1543661779 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec09b610 con 0x7fb6ec06ea60 2024-02-15T23:31:14.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6ea7fc640 1 --2- 172.21.15.131:0/1543661779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1330a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009740 tx=0x7fb6e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f26933e1e9b8ed server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:14.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6e9ffb640 1 -- 172.21.15.131:0/1543661779 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e00ab530 con 0x7fb6ec06ea60 2024-02-15T23:31:14.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6e9ffb640 1 -- 172.21.15.131:0/1543661779 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e00a7050 con 0x7fb6ec06ea60 2024-02-15T23:31:14.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6e9ffb640 1 -- 172.21.15.131:0/1543661779 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e00ab7c0 con 0x7fb6ec06ea60 2024-02-15T23:31:14.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- 172.21.15.131:0/1543661779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 msgr2=0x7fb6ec1330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 --2- 172.21.15.131:0/1543661779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1330a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009740 tx=0x7fb6e001c370 comp rx=0 tx=0).stop 2024-02-15T23:31:14.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- 172.21.15.131:0/1543661779 shutdown_connections 2024-02-15T23:31:14.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 --2- 172.21.15.131:0/1543661779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1330a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- 172.21.15.131:0/1543661779 >> 172.21.15.131:0/1543661779 conn(0x7fb6ec09c220 msgr2=0x7fb6ec071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:14.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- 172.21.15.131:0/1543661779 shutdown_connections 2024-02-15T23:31:14.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- 172.21.15.131:0/1543661779 wait complete. 2024-02-15T23:31:14.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 Processor -- start 2024-02-15T23:31:14.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- start start 2024-02-15T23:31:14.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:14.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec11e0f0 con 0x7fb6ec06ea60 2024-02-15T23:31:14.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6eaffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:14.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6eaffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51248/0 (socket says 172.21.15.131:51248) 2024-02-15T23:31:14.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6eaffd640 1 -- 172.21.15.131:0/1225376537 learned_addr learned my addr 172.21.15.131:0/1225376537 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:14.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6eaffd640 1 -- 172.21.15.131:0/1225376537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e0009420 con 0x7fb6ec06ea60 2024-02-15T23:31:14.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6eaffd640 1 --2- 172.21.15.131:0/1225376537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1c55c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00cb40 tx=0x7fb6dc0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:14.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6d37fe640 1 -- 172.21.15.131:0/1225376537 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6dc00ab80 con 0x7fb6ec06ea60 2024-02-15T23:31:14.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6d37fe640 1 -- 172.21.15.131:0/1225376537 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc00ace0 con 0x7fb6ec06ea60 2024-02-15T23:31:14.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec11fd40 con 0x7fb6ec06ea60 2024-02-15T23:31:14.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6d37fe640 1 -- 172.21.15.131:0/1225376537 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6dc012400 con 0x7fb6ec06ea60 2024-02-15T23:31:14.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.791+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec11e740 con 0x7fb6ec06ea60 2024-02-15T23:31:14.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.795+0000 7fb6d37fe640 1 -- 172.21.15.131:0/1225376537 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb6dc007070 con 0x7fb6ec06ea60 2024-02-15T23:31:14.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.795+0000 7fb6d37fe640 1 --2- 172.21.15.131:0/1225376537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb6d8035a10 0x7fb6d8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:14.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.795+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec11ed40 con 0x7fb6ec06ea60 2024-02-15T23:31:14.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.795+0000 7fb6d37fe640 1 -- 172.21.15.131:0/1225376537 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb6dc0487b0 con 0x7fb6ec06ea60 2024-02-15T23:31:14.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.795+0000 7fb6ea7fc640 1 --2- 172.21.15.131:0/1225376537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb6d8035a10 0x7fb6d8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:14.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.795+0000 7fb6ea7fc640 1 --2- 172.21.15.131:0/1225376537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb6d8035a10 0x7fb6d8037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00ad000 tx=0x7fb6e00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:14.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.799+0000 7fb6d37fe640 1 -- 172.21.15.131:0/1225376537 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb6dc019680 con 0x7fb6ec06ea60 2024-02-15T23:31:14.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.947+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6ec062860 con 0x7fb6d8035a10 2024-02-15T23:31:14.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.947+0000 7fb6d37fe640 1 -- 172.21.15.131:0/1225376537 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb6ec062860 con 0x7fb6d8035a10 2024-02-15T23:31:14.959 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 0 to deep-scrub 2024-02-15T23:31:14.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb6d8035a10 msgr2=0x7fb6d8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 --2- 172.21.15.131:0/1225376537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb6d8035a10 0x7fb6d8037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00ad000 tx=0x7fb6e00a6000 comp rx=0 tx=0).stop 2024-02-15T23:31:14.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 msgr2=0x7fb6ec1c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:14.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 --2- 172.21.15.131:0/1225376537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1c55c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00cb40 tx=0x7fb6dc0021f0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 shutdown_connections 2024-02-15T23:31:14.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 --2- 172.21.15.131:0/1225376537 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fb6d8035a10 0x7fb6d8037ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 --2- 172.21.15.131:0/1225376537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ec06ea60 0x7fb6ec1c55c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:14.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 >> 172.21.15.131:0/1225376537 conn(0x7fb6ec09c220 msgr2=0x7fb6ec070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:14.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 shutdown_connections 2024-02-15T23:31:14.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:14.951+0000 7fb6f1263640 1 -- 172.21.15.131:0/1225376537 wait complete. 2024-02-15T23:31:14.976 INFO:tasks.ceph:Scrubbing osd.1 2024-02-15T23:31:14.976 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-15T23:31:15.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0f8e5640 1 Processor -- start 2024-02-15T23:31:15.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0f8e5640 1 -- start start 2024-02-15T23:31:15.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0f8e5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4f08128560 0x7f4f08128af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0f8e5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f080964c0 con 0x7f4f08129030 2024-02-15T23:31:15.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0f8e5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f08129490 con 0x7f4f08128560 2024-02-15T23:31:15.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0d681640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4f08128560 0x7f4f08128af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0ce80640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4f08129030 0x7f4f0812baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36876/0 (socket says 172.21.15.131:36876) 2024-02-15T23:31:15.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0ce80640 1 -- 172.21.15.131:0/2992348045 learned_addr learned my addr 172.21.15.131:0/2992348045 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:15.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0d681640 1 -- 172.21.15.131:0/2992348045 >> v1:172.21.15.131:6789/0 conn(0x7f4f08129030 legacy=0x7f4f0812baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.079+0000 7f4f0d681640 1 -- 172.21.15.131:0/2992348045 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08095740 con 0x7f4f08128560 2024-02-15T23:31:15.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0d681640 1 --2- 172.21.15.131:0/2992348045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08128560 0x7f4f08128af0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009740 tx=0x7f4f0401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903764a788872e64 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4efffff640 1 -- 172.21.15.131:0/2992348045 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f040ab530 con 0x7f4f08128560 2024-02-15T23:31:15.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4efffff640 1 -- 172.21.15.131:0/2992348045 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f040a7050 con 0x7f4f08128560 2024-02-15T23:31:15.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4efffff640 1 -- 172.21.15.131:0/2992348045 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f040ab7e0 con 0x7f4f08128560 2024-02-15T23:31:15.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2992348045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08128560 msgr2=0x7f4f08128af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 --2- 172.21.15.131:0/2992348045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08128560 0x7f4f08128af0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009740 tx=0x7f4f0401c370 comp rx=0 tx=0).stop 2024-02-15T23:31:15.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2992348045 shutdown_connections 2024-02-15T23:31:15.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 --2- 172.21.15.131:0/2992348045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08128560 0x7f4f08128af0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2992348045 >> 172.21.15.131:0/2992348045 conn(0x7f4f0809a050 msgr2=0x7f4f0809a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:15.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2992348045 shutdown_connections 2024-02-15T23:31:15.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2992348045 wait complete. 2024-02-15T23:31:15.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 Processor -- start 2024-02-15T23:31:15.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- start start 2024-02-15T23:31:15.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08129030 0x7f4f081c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0806e2c0 con 0x7f4f08129030 2024-02-15T23:31:15.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0d681640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08129030 0x7f4f081c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0d681640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08129030 0x7f4f081c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51278/0 (socket says 172.21.15.131:51278) 2024-02-15T23:31:15.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0d681640 1 -- 172.21.15.131:0/2471092559 learned_addr learned my addr 172.21.15.131:0/2471092559 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:15.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0d681640 1 -- 172.21.15.131:0/2471092559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04009420 con 0x7f4f08129030 2024-02-15T23:31:15.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0d681640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08129030 0x7f4f081c2a80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4f04019fa0 tx=0x7f4f04019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f040b4540 con 0x7f4f08129030 2024-02-15T23:31:15.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f040b46a0 con 0x7f4f08129030 2024-02-15T23:31:15.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0806d890 con 0x7f4f08129030 2024-02-15T23:31:15.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f040b4980 con 0x7f4f08129030 2024-02-15T23:31:15.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f08131290 con 0x7f4f08129030 2024-02-15T23:31:15.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f081233a0 con 0x7f4f08129030 2024-02-15T23:31:15.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.083+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4f040b2040 con 0x7f4f08129030 2024-02-15T23:31:15.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4efdffb640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4eec035a10 0x7f4eec037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4f040e2b60 con 0x7f4f08129030 2024-02-15T23:31:15.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4efdffb640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7f4eec041ee0 0x7f4eec044380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4eec044a50 con 0x7f4eec041ee0 2024-02-15T23:31:15.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f040e72a0 con 0x7f4f08129030 2024-02-15T23:31:15.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4f0ce80640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4eec035a10 0x7f4eec037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4f0de82640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7f4eec041ee0 0x7f4eec044380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4f0ce80640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4eec035a10 0x7f4eec037ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8001610 tx=0x7f4ef8007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4f0de82640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7f4eec041ee0 0x7f4eec044380 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.087+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 <== osd.1 v2:172.21.15.133:6800/2918336019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4eec044a50 con 0x7f4eec041ee0 2024-02-15T23:31:15.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.099+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 --> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4f08062860 con 0x7f4eec041ee0 2024-02-15T23:31:15.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.099+0000 7f4efdffb640 1 -- 172.21.15.131:0/2471092559 <== osd.1 v2:172.21.15.133:6800/2918336019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4f08062860 con 0x7f4eec041ee0 2024-02-15T23:31:15.111 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-02-15T23:31:15.111 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-15T23:31:15.111 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-02-15T23:31:15.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7f4eec041ee0 msgr2=0x7f4eec044380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7f4eec041ee0 0x7f4eec044380 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4eec035a10 msgr2=0x7f4eec037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4eec035a10 0x7f4eec037ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8001610 tx=0x7f4ef8007ad0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08129030 msgr2=0x7f4f081c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08129030 0x7f4f081c2a80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4f04019fa0 tx=0x7f4f04019110 comp rx=0 tx=0).stop 2024-02-15T23:31:15.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 shutdown_connections 2024-02-15T23:31:15.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6800/2918336019,v1:172.21.15.133:6801/2918336019] conn(0x7f4eec041ee0 0x7f4eec044380 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f4eec035a10 0x7f4eec037ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 --2- 172.21.15.131:0/2471092559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f08129030 0x7f4f081c2a80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 >> 172.21.15.131:0/2471092559 conn(0x7f4f0809a050 msgr2=0x7f4f08096980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:15.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 shutdown_connections 2024-02-15T23:31:15.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.103+0000 7f4f0f8e5640 1 -- 172.21.15.131:0/2471092559 wait complete. 2024-02-15T23:31:15.125 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-15T23:31:15.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f2376b73640 1 Processor -- start 2024-02-15T23:31:15.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f2376b73640 1 -- start start 2024-02-15T23:31:15.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f2376b73640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2370099560 0x7f2370130e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f2376b73640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2370099c10 con 0x7f2370098a70 2024-02-15T23:31:15.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f2376b73640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237009de50 con 0x7f2370099560 2024-02-15T23:31:15.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f236ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2370099560 0x7f2370130e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f237490f640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2370098a70 0x7f2370098e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36890/0 (socket says 172.21.15.131:36890) 2024-02-15T23:31:15.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f237490f640 1 -- 172.21.15.131:0/1420170712 learned_addr learned my addr 172.21.15.131:0/1420170712 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:15.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f236ffff640 1 -- 172.21.15.131:0/1420170712 >> v1:172.21.15.131:6789/0 conn(0x7f2370098a70 legacy=0x7f2370098e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f236ffff640 1 -- 172.21.15.131:0/1420170712 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700722c0 con 0x7f2370099560 2024-02-15T23:31:15.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.227+0000 7f236ffff640 1 --2- 172.21.15.131:0/1420170712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370099560 0x7f2370130e30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2358009740 tx=0x7f235801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938566f7e8455d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236f7fe640 1 -- 172.21.15.131:0/1420170712 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23580ab530 con 0x7f2370099560 2024-02-15T23:31:15.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236f7fe640 1 -- 172.21.15.131:0/1420170712 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23580a7050 con 0x7f2370099560 2024-02-15T23:31:15.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236f7fe640 1 -- 172.21.15.131:0/1420170712 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23580ab7e0 con 0x7f2370099560 2024-02-15T23:31:15.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- 172.21.15.131:0/1420170712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370099560 msgr2=0x7f2370130e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 --2- 172.21.15.131:0/1420170712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370099560 0x7f2370130e30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2358009740 tx=0x7f235801c370 comp rx=0 tx=0).stop 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- 172.21.15.131:0/1420170712 shutdown_connections 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 --2- 172.21.15.131:0/1420170712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370099560 0x7f2370130e30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- 172.21.15.131:0/1420170712 >> 172.21.15.131:0/1420170712 conn(0x7f237009c330 msgr2=0x7f2370071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- 172.21.15.131:0/1420170712 shutdown_connections 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- 172.21.15.131:0/1420170712 wait complete. 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 Processor -- start 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- start start 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370098a70 0x7f237006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237006ee20 con 0x7f2370098a70 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f237490f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370098a70 0x7f237006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f237490f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370098a70 0x7f237006d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51304/0 (socket says 172.21.15.131:51304) 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f237490f640 1 -- 172.21.15.131:0/1935954571 learned_addr learned my addr 172.21.15.131:0/1935954571 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f237490f640 1 -- 172.21.15.131:0/1935954571 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358009420 con 0x7f2370098a70 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f237490f640 1 --2- 172.21.15.131:0/1935954571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370098a70 0x7f237006d430 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f236800cb20 tx=0x7f236800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236d7fa640 1 -- 172.21.15.131:0/1935954571 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f236800abf0 con 0x7f2370098a70 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236d7fa640 1 -- 172.21.15.131:0/1935954571 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236800ad50 con 0x7f2370098a70 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237011fb80 con 0x7f2370098a70 2024-02-15T23:31:15.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236d7fa640 1 -- 172.21.15.131:0/1935954571 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2368012400 con 0x7f2370098a70 2024-02-15T23:31:15.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237011feb0 con 0x7f2370098a70 2024-02-15T23:31:15.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370062860 con 0x7f2370098a70 2024-02-15T23:31:15.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236d7fa640 1 -- 172.21.15.131:0/1935954571 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2368012560 con 0x7f2370098a70 2024-02-15T23:31:15.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236d7fa640 1 --2- 172.21.15.131:0/1935954571 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2354035a10 0x7f2354037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.231+0000 7f236d7fa640 1 -- 172.21.15.131:0/1935954571 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2368048710 con 0x7f2370098a70 2024-02-15T23:31:15.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.235+0000 7f236ffff640 1 --2- 172.21.15.131:0/1935954571 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2354035a10 0x7f2354037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.235+0000 7f236ffff640 1 --2- 172.21.15.131:0/1935954571 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2354035a10 0x7f2354037ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23580ad000 tx=0x7f23580a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.239+0000 7f236d7fa640 1 -- 172.21.15.131:0/1935954571 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2368007070 con 0x7f2370098a70 2024-02-15T23:31:15.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.387+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f237006e630 con 0x7f2354035a10 2024-02-15T23:31:15.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f236d7fa640 1 -- 172.21.15.131:0/1935954571 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f237006e630 con 0x7f2354035a10 2024-02-15T23:31:15.400 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 1 to deep-scrub 2024-02-15T23:31:15.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2354035a10 msgr2=0x7f2354037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 --2- 172.21.15.131:0/1935954571 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2354035a10 0x7f2354037ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23580ad000 tx=0x7f23580a6000 comp rx=0 tx=0).stop 2024-02-15T23:31:15.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370098a70 msgr2=0x7f237006d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 --2- 172.21.15.131:0/1935954571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370098a70 0x7f237006d430 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f236800cb20 tx=0x7f236800a060 comp rx=0 tx=0).stop 2024-02-15T23:31:15.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 shutdown_connections 2024-02-15T23:31:15.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 --2- 172.21.15.131:0/1935954571 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f2354035a10 0x7f2354037ed0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 --2- 172.21.15.131:0/1935954571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2370098a70 0x7f237006d430 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 >> 172.21.15.131:0/1935954571 conn(0x7f237009c330 msgr2=0x7f237012b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:15.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 shutdown_connections 2024-02-15T23:31:15.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.391+0000 7f2376b73640 1 -- 172.21.15.131:0/1935954571 wait complete. 2024-02-15T23:31:15.417 INFO:tasks.ceph:Scrubbing osd.2 2024-02-15T23:31:15.417 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-15T23:31:15.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe22dae3640 1 Processor -- start 2024-02-15T23:31:15.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe22dae3640 1 -- start start 2024-02-15T23:31:15.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe22dae3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe22812e4c0 0x7fe22812e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe22dae3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2280963c0 con 0x7fe22812ede0 2024-02-15T23:31:15.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe22dae3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe228095500 con 0x7fe22812e4c0 2024-02-15T23:31:15.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe2277fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe22812e4c0 0x7fe22812e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe226ffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe22812ede0 0x7fe2280936b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36892/0 (socket says 172.21.15.131:36892) 2024-02-15T23:31:15.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe226ffd640 1 -- 172.21.15.131:0/1104203577 learned_addr learned my addr 172.21.15.131:0/1104203577 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:15.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe2267fc640 1 -- 172.21.15.131:0/1104203577 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065063385 0 0) 0x7fe2280963c0 con 0x7fe22812ede0 2024-02-15T23:31:15.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe2267fc640 1 -- 172.21.15.131:0/1104203577 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe214003530 con 0x7fe22812ede0 2024-02-15T23:31:15.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe2277fe640 1 -- 172.21.15.131:0/1104203577 >> v1:172.21.15.131:6789/0 conn(0x7fe22812ede0 legacy=0x7fe2280936b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.531+0000 7fe2277fe640 1 -- 172.21.15.131:0/1104203577 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22809c030 con 0x7fe22812e4c0 2024-02-15T23:31:15.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe2277fe640 1 --2- 172.21.15.131:0/1104203577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22812e8a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe210009740 tx=0x7fe21001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13efa189e2eea5fe server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe2267fc640 1 -- 172.21.15.131:0/1104203577 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2100ab530 con 0x7fe22812e4c0 2024-02-15T23:31:15.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe2267fc640 1 -- 172.21.15.131:0/1104203577 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2100a7050 con 0x7fe22812e4c0 2024-02-15T23:31:15.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe2267fc640 1 -- 172.21.15.131:0/1104203577 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2100ab7c0 con 0x7fe22812e4c0 2024-02-15T23:31:15.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 -- 172.21.15.131:0/1104203577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 msgr2=0x7fe22812e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 --2- 172.21.15.131:0/1104203577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22812e8a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe210009740 tx=0x7fe21001c310 comp rx=0 tx=0).stop 2024-02-15T23:31:15.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 -- 172.21.15.131:0/1104203577 shutdown_connections 2024-02-15T23:31:15.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 --2- 172.21.15.131:0/1104203577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22812e8a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 -- 172.21.15.131:0/1104203577 >> 172.21.15.131:0/1104203577 conn(0x7fe22809a050 msgr2=0x7fe22809a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:15.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 -- 172.21.15.131:0/1104203577 shutdown_connections 2024-02-15T23:31:15.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 -- 172.21.15.131:0/1104203577 wait complete. 2024-02-15T23:31:15.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 Processor -- start 2024-02-15T23:31:15.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 -- start start 2024-02-15T23:31:15.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.535+0000 7fe22dae3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22806ff10 con 0x7fe22812e4c0 2024-02-15T23:31:15.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe2277fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe2277fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22806dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51326/0 (socket says 172.21.15.131:51326) 2024-02-15T23:31:15.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe2277fe640 1 -- 172.21.15.131:0/2697958099 learned_addr learned my addr 172.21.15.131:0/2697958099 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:15.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe2277fe640 1 -- 172.21.15.131:0/2697958099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210009420 con 0x7fe22812e4c0 2024-02-15T23:31:15.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe2277fe640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22806dd50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe210018f80 tx=0x7fe210019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe210003960 con 0x7fe22812e4c0 2024-02-15T23:31:15.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe210003ac0 con 0x7fe22812e4c0 2024-02-15T23:31:15.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe210003d60 con 0x7fe22812e4c0 2024-02-15T23:31:15.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2280919f0 con 0x7fe22812e4c0 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe228071620 con 0x7fe22812e4c0 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe228136530 con 0x7fe22812e4c0 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe2100b2040 con 0x7fe22812e4c0 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe208035a10 0x7fe208037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fe2100e2860 con 0x7fe22812e4c0 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe208041ee0 0x7fe208044380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe208044a50 con 0x7fe208041ee0 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2100e72a0 con 0x7fe22812e4c0 2024-02-15T23:31:15.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe226ffd640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe208035a10 0x7fe208037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe227fff640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe208041ee0 0x7fe208044380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe226ffd640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe208035a10 0x7fe208037ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe218007fd0 tx=0x7fe218007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.539+0000 7fe227fff640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe208041ee0 0x7fe208044380 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.543+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 <== osd.2 v2:172.21.15.133:6808/3615800201 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe208044a50 con 0x7fe208041ee0 2024-02-15T23:31:15.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 --> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe22806f630 con 0x7fe208041ee0 2024-02-15T23:31:15.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe21ffff640 1 -- 172.21.15.131:0/2697958099 <== osd.2 v2:172.21.15.133:6808/3615800201 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe22806f630 con 0x7fe208041ee0 2024-02-15T23:31:15.565 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-02-15T23:31:15.566 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-15T23:31:15.566 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-02-15T23:31:15.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe208041ee0 msgr2=0x7fe208044380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe208041ee0 0x7fe208044380 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe208035a10 msgr2=0x7fe208037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe208035a10 0x7fe208037ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe218007fd0 tx=0x7fe218007980 comp rx=0 tx=0).stop 2024-02-15T23:31:15.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 msgr2=0x7fe22806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22806dd50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe210018f80 tx=0x7fe210019110 comp rx=0 tx=0).stop 2024-02-15T23:31:15.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 shutdown_connections 2024-02-15T23:31:15.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6808/3615800201,v1:172.21.15.133:6809/3615800201] conn(0x7fe208041ee0 0x7fe208044380 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe208035a10 0x7fe208037ed0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 --2- 172.21.15.131:0/2697958099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22812e4c0 0x7fe22806dd50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 >> 172.21.15.131:0/2697958099 conn(0x7fe22809a050 msgr2=0x7fe2280975d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:15.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 shutdown_connections 2024-02-15T23:31:15.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.555+0000 7fe22dae3640 1 -- 172.21.15.131:0/2697958099 wait complete. 2024-02-15T23:31:15.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-15T23:31:15.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f708d0f0640 1 Processor -- start 2024-02-15T23:31:15.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f708d0f0640 1 -- start start 2024-02-15T23:31:15.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f708d0f0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7088095520 0x7f7088095900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f708d0f0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7088072570 con 0x7f708806c310 2024-02-15T23:31:15.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f708d0f0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7088095060 con 0x7f7088095520 2024-02-15T23:31:15.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f7086d9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7088095520 0x7f7088095900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f708659c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f708806c310 0x7f7088127470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36904/0 (socket says 172.21.15.131:36904) 2024-02-15T23:31:15.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f7086d9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7088095520 0x7f7088095900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51336/0 (socket says 172.21.15.131:51336) 2024-02-15T23:31:15.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f708659c640 1 -- 172.21.15.131:0/370423797 learned_addr learned my addr 172.21.15.131:0/370423797 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:15.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f7086d9d640 1 -- 172.21.15.131:0/370423797 >> v1:172.21.15.131:6789/0 conn(0x7f708806c310 legacy=0x7f7088127470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f7086d9d640 1 -- 172.21.15.131:0/370423797 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088095300 con 0x7f7088095520 2024-02-15T23:31:15.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.683+0000 7f7085d9b640 1 -- 172.21.15.131:0/370423797 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456711069 0 0) 0x7f7088072570 con 0x7f708806c310 2024-02-15T23:31:15.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f7086d9d640 1 --2- 172.21.15.131:0/370423797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7088095520 0x7f7088095900 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7078009d90 tx=0x7f707801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7535ae02599154b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f7085d9b640 1 -- 172.21.15.131:0/370423797 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f708806cc20 con 0x7f7088095520 2024-02-15T23:31:15.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f7085d9b640 1 -- 172.21.15.131:0/370423797 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70780a5770 con 0x7f7088095520 2024-02-15T23:31:15.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f7085d9b640 1 -- 172.21.15.131:0/370423797 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70780a5a30 con 0x7f7088095520 2024-02-15T23:31:15.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 -- 172.21.15.131:0/370423797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7088095520 msgr2=0x7f7088095900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 --2- 172.21.15.131:0/370423797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7088095520 0x7f7088095900 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7078009d90 tx=0x7f707801c8c0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 -- 172.21.15.131:0/370423797 shutdown_connections 2024-02-15T23:31:15.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 --2- 172.21.15.131:0/370423797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7088095520 0x7f7088095900 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 -- 172.21.15.131:0/370423797 >> 172.21.15.131:0/370423797 conn(0x7f708809a0c0 msgr2=0x7f708809a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:15.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 -- 172.21.15.131:0/370423797 shutdown_connections 2024-02-15T23:31:15.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 -- 172.21.15.131:0/370423797 wait complete. 2024-02-15T23:31:15.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 Processor -- start 2024-02-15T23:31:15.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 -- start start 2024-02-15T23:31:15.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f708806c310 0x7f70881c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f708d0f0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708812bc50 con 0x7f708806c310 2024-02-15T23:31:15.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f7086d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f708806c310 0x7f70881c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f7086d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f708806c310 0x7f70881c32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51344/0 (socket says 172.21.15.131:51344) 2024-02-15T23:31:15.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f7086d9d640 1 -- 172.21.15.131:0/439184128 learned_addr learned my addr 172.21.15.131:0/439184128 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:15.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.687+0000 7f7086d9d640 1 -- 172.21.15.131:0/439184128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009a70 con 0x7f708806c310 2024-02-15T23:31:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f7086d9d640 1 --2- 172.21.15.131:0/439184128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f708806c310 0x7f70881c32d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f70780a5740 tx=0x7f7078019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f706f7fe640 1 -- 172.21.15.131:0/439184128 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70780ad780 con 0x7f708806c310 2024-02-15T23:31:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f706f7fe640 1 -- 172.21.15.131:0/439184128 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70780ad8e0 con 0x7f708806c310 2024-02-15T23:31:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7088071af0 con 0x7f708806c310 2024-02-15T23:31:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f706f7fe640 1 -- 172.21.15.131:0/439184128 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70780adbc0 con 0x7f708806c310 2024-02-15T23:31:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7088071820 con 0x7f708806c310 2024-02-15T23:31:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f706f7fe640 1 -- 172.21.15.131:0/439184128 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70780b4050 con 0x7f708806c310 2024-02-15T23:31:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708812cbf0 con 0x7f708806c310 2024-02-15T23:31:15.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f706f7fe640 1 --2- 172.21.15.131:0/439184128 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70740359c0 0x7f7074037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f706f7fe640 1 -- 172.21.15.131:0/439184128 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f70780e36d0 con 0x7f708806c310 2024-02-15T23:31:15.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f708659c640 1 --2- 172.21.15.131:0/439184128 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70740359c0 0x7f7074037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.691+0000 7f708659c640 1 --2- 172.21.15.131:0/439184128 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70740359c0 0x7f7074037e80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f707c007fd0 tx=0x7f707c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:15.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.695+0000 7f706f7fe640 1 -- 172.21.15.131:0/439184128 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f70780b5de0 con 0x7f708806c310 2024-02-15T23:31:15.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.843+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7088073100 con 0x7f70740359c0 2024-02-15T23:31:15.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f706f7fe640 1 -- 172.21.15.131:0/439184128 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7088073100 con 0x7f70740359c0 2024-02-15T23:31:15.856 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 2 to deep-scrub 2024-02-15T23:31:15.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70740359c0 msgr2=0x7f7074037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 --2- 172.21.15.131:0/439184128 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70740359c0 0x7f7074037e80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f707c007fd0 tx=0x7f707c007920 comp rx=0 tx=0).stop 2024-02-15T23:31:15.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f708806c310 msgr2=0x7f70881c32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 --2- 172.21.15.131:0/439184128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f708806c310 0x7f70881c32d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f70780a5740 tx=0x7f7078019660 comp rx=0 tx=0).stop 2024-02-15T23:31:15.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 shutdown_connections 2024-02-15T23:31:15.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 --2- 172.21.15.131:0/439184128 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f70740359c0 0x7f7074037e80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 --2- 172.21.15.131:0/439184128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f708806c310 0x7f70881c32d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:15.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 >> 172.21.15.131:0/439184128 conn(0x7f708809a0c0 msgr2=0x7f7088093e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:15.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 shutdown_connections 2024-02-15T23:31:15.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.847+0000 7f708d0f0640 1 -- 172.21.15.131:0/439184128 wait complete. 2024-02-15T23:31:15.872 INFO:tasks.ceph:Scrubbing osd.3 2024-02-15T23:31:15.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-15T23:31:15.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa462177640 1 Processor -- start 2024-02-15T23:31:15.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa462177640 1 -- start start 2024-02-15T23:31:15.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa462177640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa45c128560 0x7fa45c128af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:15.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa462177640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c0964c0 con 0x7fa45c129030 2024-02-15T23:31:15.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa462177640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45c129490 con 0x7fa45c128560 2024-02-15T23:31:15.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45b7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa45c128560 0x7fa45c128af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:15.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45affd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa45c129030 0x7fa45c12baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36910/0 (socket says 172.21.15.131:36910) 2024-02-15T23:31:15.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45affd640 1 -- 172.21.15.131:0/1776715389 learned_addr learned my addr 172.21.15.131:0/1776715389 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:15.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45a7fc640 1 -- 172.21.15.131:0/1776715389 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643826923 0 0) 0x7fa45c0964c0 con 0x7fa45c129030 2024-02-15T23:31:15.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45a7fc640 1 -- 172.21.15.131:0/1776715389 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa444003530 con 0x7fa45c129030 2024-02-15T23:31:15.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45b7fe640 1 -- 172.21.15.131:0/1776715389 >> v1:172.21.15.131:6789/0 conn(0x7fa45c129030 legacy=0x7fa45c12baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:15.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45b7fe640 1 -- 172.21.15.131:0/1776715389 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c095740 con 0x7fa45c128560 2024-02-15T23:31:16.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45b7fe640 1 --2- 172.21.15.131:0/1776715389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c128af0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009740 tx=0x7fa44c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccba01f45d03d0c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45a7fc640 1 -- 172.21.15.131:0/1776715389 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa44c0ab530 con 0x7fa45c128560 2024-02-15T23:31:16.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45a7fc640 1 -- 172.21.15.131:0/1776715389 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c0a7050 con 0x7fa45c128560 2024-02-15T23:31:16.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.987+0000 7fa45a7fc640 1 -- 172.21.15.131:0/1776715389 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa44c0ab7c0 con 0x7fa45c128560 2024-02-15T23:31:16.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- 172.21.15.131:0/1776715389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 msgr2=0x7fa45c128af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 --2- 172.21.15.131:0/1776715389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c128af0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009740 tx=0x7fa44c01c370 comp rx=0 tx=0).stop 2024-02-15T23:31:16.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- 172.21.15.131:0/1776715389 shutdown_connections 2024-02-15T23:31:16.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 --2- 172.21.15.131:0/1776715389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c128af0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- 172.21.15.131:0/1776715389 >> 172.21.15.131:0/1776715389 conn(0x7fa45c09a050 msgr2=0x7fa45c09a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:16.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- 172.21.15.131:0/1776715389 shutdown_connections 2024-02-15T23:31:16.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- 172.21.15.131:0/1776715389 wait complete. 2024-02-15T23:31:16.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 Processor -- start 2024-02-15T23:31:16.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- start start 2024-02-15T23:31:16.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c1c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c08bf80 con 0x7fa45c128560 2024-02-15T23:31:16.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa45b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c1c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa45b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c1c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51364/0 (socket says 172.21.15.131:51364) 2024-02-15T23:31:16.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa45b7fe640 1 -- 172.21.15.131:0/3005796605 learned_addr learned my addr 172.21.15.131:0/3005796605 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:16.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa45b7fe640 1 -- 172.21.15.131:0/3005796605 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c009420 con 0x7fa45c128560 2024-02-15T23:31:16.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa45b7fe640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c1c3cf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0ae040 tx=0x7fa44c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa44c0b4410 con 0x7fa45c128560 2024-02-15T23:31:16.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c0b4570 con 0x7fa45c128560 2024-02-15T23:31:16.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c12b8c0 con 0x7fa45c128560 2024-02-15T23:31:16.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa44c0b4810 con 0x7fa45c128560 2024-02-15T23:31:16.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c08b580 con 0x7fa45c128560 2024-02-15T23:31:16.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa44c0b2040 con 0x7fa45c128560 2024-02-15T23:31:16.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa45c062860 con 0x7fa45c128560 2024-02-15T23:31:16.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa443fff640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa448035a10 0x7fa448037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa44c0e2b30 con 0x7fa45c128560 2024-02-15T23:31:16.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa443fff640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7fa448041e80 0x7fa448044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.991+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4480449f0 con 0x7fa448041e80 2024-02-15T23:31:16.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.995+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa44c0e72a0 con 0x7fa45c128560 2024-02-15T23:31:16.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.995+0000 7fa45affd640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa448035a10 0x7fa448037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.995+0000 7fa45bfff640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7fa448041e80 0x7fa448044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.995+0000 7fa45affd640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa448035a10 0x7fa448037ed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa450007fd0 tx=0x7fa450007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.995+0000 7fa45bfff640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7fa448041e80 0x7fa448044320 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:15.995+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 <== osd.3 v2:172.21.15.133:6816/1056376173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa4480449f0 con 0x7fa448041e80 2024-02-15T23:31:16.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.007+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 --> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa45c129030 con 0x7fa448041e80 2024-02-15T23:31:16.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa443fff640 1 -- 172.21.15.131:0/3005796605 <== osd.3 v2:172.21.15.133:6816/1056376173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa45c129030 con 0x7fa448041e80 2024-02-15T23:31:16.020 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-02-15T23:31:16.020 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-15T23:31:16.020 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-02-15T23:31:16.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7fa448041e80 msgr2=0x7fa448044320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7fa448041e80 0x7fa448044320 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa448035a10 msgr2=0x7fa448037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa448035a10 0x7fa448037ed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa450007fd0 tx=0x7fa450007980 comp rx=0 tx=0).stop 2024-02-15T23:31:16.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 msgr2=0x7fa45c1c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c1c3cf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0ae040 tx=0x7fa44c019110 comp rx=0 tx=0).stop 2024-02-15T23:31:16.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 shutdown_connections 2024-02-15T23:31:16.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6816/1056376173,v1:172.21.15.133:6817/1056376173] conn(0x7fa448041e80 0x7fa448044320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fa448035a10 0x7fa448037ed0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 --2- 172.21.15.131:0/3005796605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c128560 0x7fa45c1c3cf0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 >> 172.21.15.131:0/3005796605 conn(0x7fa45c09a050 msgr2=0x7fa45c1270a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:16.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 shutdown_connections 2024-02-15T23:31:16.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.011+0000 7fa462177640 1 -- 172.21.15.131:0/3005796605 wait complete. 2024-02-15T23:31:16.035 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-15T23:31:16.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-02-15T23:31:16.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f4319c6f640 1 Processor -- start 2024-02-15T23:31:16.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f4319c6f640 1 -- start start 2024-02-15T23:31:16.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f4319c6f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4314098a70 0x7f4314098e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f4319c6f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4314072150 con 0x7f4314099390 2024-02-15T23:31:16.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f4319c6f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f431409b060 con 0x7f4314098a70 2024-02-15T23:31:16.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f43137fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4314098a70 0x7f4314098e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f430bfff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4314099390 0x7f431412bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36924/0 (socket says 172.21.15.131:36924) 2024-02-15T23:31:16.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f430bfff640 1 -- 172.21.15.131:0/2117767394 learned_addr learned my addr 172.21.15.131:0/2117767394 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:16.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f43137fe640 1 -- 172.21.15.131:0/2117767394 >> v1:172.21.15.131:6789/0 conn(0x7f4314099390 legacy=0x7f431412bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f43137fe640 1 -- 172.21.15.131:0/2117767394 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431409a910 con 0x7f4314098a70 2024-02-15T23:31:16.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f43137fe640 1 --2- 172.21.15.131:0/2117767394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f4314098e50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4304009740 tx=0x7f430401c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e6702418023e33 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f4312ffd640 1 -- 172.21.15.131:0/2117767394 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43040ab530 con 0x7f4314098a70 2024-02-15T23:31:16.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f4312ffd640 1 -- 172.21.15.131:0/2117767394 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43040a7050 con 0x7f4314098a70 2024-02-15T23:31:16.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.143+0000 7f4312ffd640 1 -- 172.21.15.131:0/2117767394 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43040ab7e0 con 0x7f4314098a70 2024-02-15T23:31:16.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- 172.21.15.131:0/2117767394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 msgr2=0x7f4314098e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 --2- 172.21.15.131:0/2117767394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f4314098e50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4304009740 tx=0x7f430401c200 comp rx=0 tx=0).stop 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- 172.21.15.131:0/2117767394 shutdown_connections 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 --2- 172.21.15.131:0/2117767394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f4314098e50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- 172.21.15.131:0/2117767394 >> 172.21.15.131:0/2117767394 conn(0x7f431409c330 msgr2=0x7f4314071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- 172.21.15.131:0/2117767394 shutdown_connections 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- 172.21.15.131:0/2117767394 wait complete. 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 Processor -- start 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- start start 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f43141282d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4314129bd0 con 0x7f4314098a70 2024-02-15T23:31:16.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f43137fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f43141282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f43137fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f43141282d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51378/0 (socket says 172.21.15.131:51378) 2024-02-15T23:31:16.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f43137fe640 1 -- 172.21.15.131:0/1119811060 learned_addr learned my addr 172.21.15.131:0/1119811060 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:16.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f43137fe640 1 -- 172.21.15.131:0/1119811060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4304009420 con 0x7f4314098a70 2024-02-15T23:31:16.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f43137fe640 1 --2- 172.21.15.131:0/1119811060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f43141282d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4304018e10 tx=0x7f430401aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4310ff9640 1 -- 172.21.15.131:0/1119811060 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43040b7660 con 0x7f4314098a70 2024-02-15T23:31:16.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4310ff9640 1 -- 172.21.15.131:0/1119811060 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43040b77c0 con 0x7f4314098a70 2024-02-15T23:31:16.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431411bca0 con 0x7f4314098a70 2024-02-15T23:31:16.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4310ff9640 1 -- 172.21.15.131:0/1119811060 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43040b7aa0 con 0x7f4314098a70 2024-02-15T23:31:16.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431411a4c0 con 0x7f4314098a70 2024-02-15T23:31:16.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4314062860 con 0x7f4314098a70 2024-02-15T23:31:16.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4310ff9640 1 -- 172.21.15.131:0/1119811060 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f43040b7c00 con 0x7f4314098a70 2024-02-15T23:31:16.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4310ff9640 1 --2- 172.21.15.131:0/1119811060 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f42f4035a10 0x7f42f4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f4310ff9640 1 -- 172.21.15.131:0/1119811060 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f43040e3130 con 0x7f4314098a70 2024-02-15T23:31:16.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.147+0000 7f430bfff640 1 --2- 172.21.15.131:0/1119811060 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f42f4035a10 0x7f42f4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.151+0000 7f430bfff640 1 --2- 172.21.15.131:0/1119811060 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f42f4035a10 0x7f42f4037ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f42fc001800 tx=0x7f42fc007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.151+0000 7f4310ff9640 1 -- 172.21.15.131:0/1119811060 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43040c79f0 con 0x7f4314098a70 2024-02-15T23:31:16.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f431411a4c0 con 0x7f42f4035a10 2024-02-15T23:31:16.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4310ff9640 1 -- 172.21.15.131:0/1119811060 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f431411a4c0 con 0x7f42f4035a10 2024-02-15T23:31:16.317 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 3 to deep-scrub 2024-02-15T23:31:16.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f42f4035a10 msgr2=0x7f42f4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 --2- 172.21.15.131:0/1119811060 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f42f4035a10 0x7f42f4037ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f42fc001800 tx=0x7f42fc007a10 comp rx=0 tx=0).stop 2024-02-15T23:31:16.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 msgr2=0x7f43141282d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 --2- 172.21.15.131:0/1119811060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f43141282d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4304018e10 tx=0x7f430401aa40 comp rx=0 tx=0).stop 2024-02-15T23:31:16.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 shutdown_connections 2024-02-15T23:31:16.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 --2- 172.21.15.131:0/1119811060 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f42f4035a10 0x7f42f4037ed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 --2- 172.21.15.131:0/1119811060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4314098a70 0x7f43141282d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.307+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 >> 172.21.15.131:0/1119811060 conn(0x7f431409c330 msgr2=0x7f431412e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:16.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.311+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 shutdown_connections 2024-02-15T23:31:16.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.311+0000 7f4319c6f640 1 -- 172.21.15.131:0/1119811060 wait complete. 2024-02-15T23:31:16.334 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:31:16.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.435+0000 7f1d7bed3640 1 Processor -- start 2024-02-15T23:31:16.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.435+0000 7f1d7bed3640 1 -- start start 2024-02-15T23:31:16.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1d7406c3f0 0x7f1d7412fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d74072390 con 0x7f1d7412b000 2024-02-15T23:31:16.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7409c1e0 con 0x7f1d7406c3f0 2024-02-15T23:31:16.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d79c6f640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1d7412b000 0x7f1d7412b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:36940/0 (socket says 172.21.15.131:36940) 2024-02-15T23:31:16.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d79c6f640 1 -- 172.21.15.131:0/3041037612 learned_addr learned my addr 172.21.15.131:0/3041037612 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:16.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7946e640 1 --2- 172.21.15.131:0/3041037612 >> v2:172.21.15.131:3300/0 conn(0x7f1d7406c3f0 0x7f1d7412fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d78c6d640 1 -- 172.21.15.131:0/3041037612 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529127756 0 0) 0x7f1d74072390 con 0x7f1d7412b000 2024-02-15T23:31:16.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d78c6d640 1 -- 172.21.15.131:0/3041037612 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d60003530 con 0x7f1d7412b000 2024-02-15T23:31:16.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7946e640 1 -- 172.21.15.131:0/3041037612 >> v1:172.21.15.131:6789/0 conn(0x7f1d7412b000 legacy=0x7f1d7412b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7946e640 1 -- 172.21.15.131:0/3041037612 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7406d030 con 0x7f1d7406c3f0 2024-02-15T23:31:16.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7946e640 1 --2- 172.21.15.131:0/3041037612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d7412fe30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009740 tx=0x7f1d6401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85660d54c8546c4d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d78c6d640 1 -- 172.21.15.131:0/3041037612 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d640ab530 con 0x7f1d7406c3f0 2024-02-15T23:31:16.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d78c6d640 1 -- 172.21.15.131:0/3041037612 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d640a7050 con 0x7f1d7406c3f0 2024-02-15T23:31:16.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d78c6d640 1 -- 172.21.15.131:0/3041037612 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d640ab7e0 con 0x7f1d7406c3f0 2024-02-15T23:31:16.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3041037612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 msgr2=0x7f1d7412fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 --2- 172.21.15.131:0/3041037612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d7412fe30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009740 tx=0x7f1d6401c370 comp rx=0 tx=0).stop 2024-02-15T23:31:16.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3041037612 shutdown_connections 2024-02-15T23:31:16.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 --2- 172.21.15.131:0/3041037612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d7412fe30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3041037612 >> 172.21.15.131:0/3041037612 conn(0x7f1d7409a2f0 msgr2=0x7f1d7409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:16.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3041037612 shutdown_connections 2024-02-15T23:31:16.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.439+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3041037612 wait complete. 2024-02-15T23:31:16.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d7bed3640 1 Processor -- start 2024-02-15T23:31:16.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d7bed3640 1 -- start start 2024-02-15T23:31:16.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d7bed3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d741234e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d7bed3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74125930 con 0x7f1d7406c3f0 2024-02-15T23:31:16.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d79c6f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d741234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d79c6f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d741234e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51396/0 (socket says 172.21.15.131:51396) 2024-02-15T23:31:16.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d79c6f640 1 -- 172.21.15.131:0/3387938644 learned_addr learned my addr 172.21.15.131:0/3387938644 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:16.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d79c6f640 1 -- 172.21.15.131:0/3387938644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d64009420 con 0x7f1d7406c3f0 2024-02-15T23:31:16.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d79c6f640 1 --2- 172.21.15.131:0/3387938644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d741234e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00cb40 tx=0x7f1d6c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d6a7fc640 1 -- 172.21.15.131:0/3387938644 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c00abf0 con 0x7f1d7406c3f0 2024-02-15T23:31:16.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d6a7fc640 1 -- 172.21.15.131:0/3387938644 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00ad50 con 0x7f1d7406c3f0 2024-02-15T23:31:16.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d6a7fc640 1 -- 172.21.15.131:0/3387938644 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c012400 con 0x7f1d7406c3f0 2024-02-15T23:31:16.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d74124d30 con 0x7f1d7406c3f0 2024-02-15T23:31:16.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d74125610 con 0x7f1d7406c3f0 2024-02-15T23:31:16.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d6a7fc640 1 -- 172.21.15.131:0/3387938644 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1d6c007070 con 0x7f1d7406c3f0 2024-02-15T23:31:16.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d74067e00 con 0x7f1d7406c3f0 2024-02-15T23:31:16.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d6a7fc640 1 --2- 172.21.15.131:0/3387938644 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d58035a10 0x7f1d58037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:16.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d6a7fc640 1 -- 172.21.15.131:0/3387938644 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1d6c048790 con 0x7f1d7406c3f0 2024-02-15T23:31:16.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.443+0000 7f1d7946e640 1 --2- 172.21.15.131:0/3387938644 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d58035a10 0x7f1d58037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:16.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.447+0000 7f1d7946e640 1 --2- 172.21.15.131:0/3387938644 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d58035a10 0x7f1d58037ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1d640ad000 tx=0x7f1d640a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:16.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.447+0000 7f1d6a7fc640 1 -- 172.21.15.131:0/3387938644 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1d6c007930 con 0x7f1d7406c3f0 2024-02-15T23:31:16.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.595+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d74062860 con 0x7f1d58035a10 2024-02-15T23:31:16.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.639+0000 7f1d6a7fc640 1 -- 172.21.15.131:0/3387938644 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673569 (secure 0 0 0) 0x7f1d74062860 con 0x7f1d58035a10 2024-02-15T23:31:16.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:31:16.663 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:31:16.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d58035a10 msgr2=0x7f1d58037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 --2- 172.21.15.131:0/3387938644 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d58035a10 0x7f1d58037ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1d640ad000 tx=0x7f1d640a6000 comp rx=0 tx=0).stop 2024-02-15T23:31:16.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 msgr2=0x7f1d741234e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:16.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 --2- 172.21.15.131:0/3387938644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d741234e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00cb40 tx=0x7f1d6c00a060 comp rx=0 tx=0).stop 2024-02-15T23:31:16.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 shutdown_connections 2024-02-15T23:31:16.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 --2- 172.21.15.131:0/3387938644 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f1d58035a10 0x7f1d58037ed0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 --2- 172.21.15.131:0/3387938644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7406c3f0 0x7f1d741234e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:16.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 >> 172.21.15.131:0/3387938644 conn(0x7f1d7409a2f0 msgr2=0x7f1d7409a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:16.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 shutdown_connections 2024-02-15T23:31:16.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:16.647+0000 7f1d7bed3640 1 -- 172.21.15.131:0/3387938644 wait complete. 2024-02-15T23:31:16.675 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-02-15T23:31:15.542989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3797,"ondisk_log_size":3797,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-825,"num_objects":-16,"num_object_clones":0,"num_object_copies":-34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":388,"num_read_kb":386,"num_write":118,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005617"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780958+0000","last_change":"2024-02-15T23:29:29.730549+0000","last_active":"2024-02-15T23:30:10.780958+0000","last_peered":"2024-02-15T23:30:10.780958+0000","last_clean":"2024-02-15T23:30:10.780958+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:30:10.780958+0000","last_undegraded":"2024-02-15T23:30:10.780958+0000","last_fullsized":"2024-02-15T23:30:10.780958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785328+0000","last_change":"2024-02-15T23:29:31.691386+0000","last_active":"2024-02-15T23:30:10.785328+0000","last_peered":"2024-02-15T23:30:10.785328+0000","last_clean":"2024-02-15T23:30:10.785328+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:30:10.785328+0000","last_undegraded":"2024-02-15T23:30:10.785328+0000","last_fullsized":"2024-02-15T23:30:10.785328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790667+0000","last_change":"2024-02-15T23:29:29.719743+0000","last_active":"2024-02-15T23:30:10.790667+0000","last_peered":"2024-02-15T23:30:10.790667+0000","last_clean":"2024-02-15T23:30:10.790667+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:30:10.790667+0000","last_undegraded":"2024-02-15T23:30:10.790667+0000","last_fullsized":"2024-02-15T23:30:10.790667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:39.453929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798345+0000","last_change":"2024-02-15T23:29:31.701574+0000","last_active":"2024-02-15T23:30:10.798345+0000","last_peered":"2024-02-15T23:30:10.798345+0000","last_clean":"2024-02-15T23:30:10.798345+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:30:10.798345+0000","last_undegraded":"2024-02-15T23:30:10.798345+0000","last_fullsized":"2024-02-15T23:30:10.798345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:10.584779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812824+0000","last_change":"2024-02-15T23:29:29.725919+0000","last_active":"2024-02-15T23:30:10.812824+0000","last_peered":"2024-02-15T23:30:10.812824+0000","last_clean":"2024-02-15T23:30:10.812824+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:30:10.812824+0000","last_undegraded":"2024-02-15T23:30:10.812824+0000","last_fullsized":"2024-02-15T23:30:10.812824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:47.717202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806961+0000","last_change":"2024-02-15T23:29:31.701595+0000","last_active":"2024-02-15T23:30:10.806961+0000","last_peered":"2024-02-15T23:30:10.806961+0000","last_clean":"2024-02-15T23:30:10.806961+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:30:10.806961+0000","last_undegraded":"2024-02-15T23:30:10.806961+0000","last_fullsized":"2024-02-15T23:30:10.806961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:22.710710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778727+0000","last_change":"2024-02-15T23:29:29.725199+0000","last_active":"2024-02-15T23:30:10.778727+0000","last_peered":"2024-02-15T23:30:10.778727+0000","last_clean":"2024-02-15T23:30:10.778727+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:30:10.778727+0000","last_undegraded":"2024-02-15T23:30:10.778727+0000","last_fullsized":"2024-02-15T23:30:10.778727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807450+0000","last_change":"2024-02-15T23:29:31.703063+0000","last_active":"2024-02-15T23:30:10.807450+0000","last_peered":"2024-02-15T23:30:10.807450+0000","last_clean":"2024-02-15T23:30:10.807450+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:30:10.807450+0000","last_undegraded":"2024-02-15T23:30:10.807450+0000","last_fullsized":"2024-02-15T23:30:10.807450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:01.557444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805914+0000","last_change":"2024-02-15T23:29:29.710832+0000","last_active":"2024-02-15T23:30:10.805914+0000","last_peered":"2024-02-15T23:30:10.805914+0000","last_clean":"2024-02-15T23:30:10.805914+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:30:10.805914+0000","last_undegraded":"2024-02-15T23:30:10.805914+0000","last_fullsized":"2024-02-15T23:30:10.805914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:40.054442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924941+0000","last_change":"2024-02-15T23:29:31.689546+0000","last_active":"2024-02-15T23:31:03.924941+0000","last_peered":"2024-02-15T23:31:03.924941+0000","last_clean":"2024-02-15T23:31:03.924941+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:03.924941+0000","last_undegraded":"2024-02-15T23:31:03.924941+0000","last_fullsized":"2024-02-15T23:31:03.924941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:35.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777097+0000","last_change":"2024-02-15T23:29:29.729934+0000","last_active":"2024-02-15T23:30:10.777097+0000","last_peered":"2024-02-15T23:30:10.777097+0000","last_clean":"2024-02-15T23:30:10.777097+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:30:10.777097+0000","last_undegraded":"2024-02-15T23:30:10.777097+0000","last_fullsized":"2024-02-15T23:30:10.777097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:51:36.207574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808769+0000","last_change":"2024-02-15T23:29:31.705431+0000","last_active":"2024-02-15T23:30:10.808769+0000","last_peered":"2024-02-15T23:30:10.808769+0000","last_clean":"2024-02-15T23:30:10.808769+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:30:10.808769+0000","last_undegraded":"2024-02-15T23:30:10.808769+0000","last_fullsized":"2024-02-15T23:30:10.808769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:20.343794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795719+0000","last_change":"2024-02-15T23:29:29.707555+0000","last_active":"2024-02-15T23:30:10.795719+0000","last_peered":"2024-02-15T23:30:10.795719+0000","last_clean":"2024-02-15T23:30:10.795719+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:30:10.795719+0000","last_undegraded":"2024-02-15T23:30:10.795719+0000","last_fullsized":"2024-02-15T23:30:10.795719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:50:04.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091130+0000","last_change":"2024-02-15T23:29:31.689285+0000","last_active":"2024-02-15T23:30:15.091130+0000","last_peered":"2024-02-15T23:30:15.091130+0000","last_clean":"2024-02-15T23:30:15.091130+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:30:15.091130+0000","last_undegraded":"2024-02-15T23:30:15.091130+0000","last_fullsized":"2024-02-15T23:30:15.091130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784401+0000","last_change":"2024-02-15T23:29:29.720155+0000","last_active":"2024-02-15T23:30:10.784401+0000","last_peered":"2024-02-15T23:30:10.784401+0000","last_clean":"2024-02-15T23:30:10.784401+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:30:10.784401+0000","last_undegraded":"2024-02-15T23:30:10.784401+0000","last_fullsized":"2024-02-15T23:30:10.784401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784463+0000","last_change":"2024-02-15T23:29:31.711090+0000","last_active":"2024-02-15T23:30:10.784463+0000","last_peered":"2024-02-15T23:30:10.784463+0000","last_clean":"2024-02-15T23:30:10.784463+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:30:10.784463+0000","last_undegraded":"2024-02-15T23:30:10.784463+0000","last_fullsized":"2024-02-15T23:30:10.784463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797604+0000","last_change":"2024-02-15T23:29:31.699913+0000","last_active":"2024-02-15T23:30:10.797604+0000","last_peered":"2024-02-15T23:30:10.797604+0000","last_clean":"2024-02-15T23:30:10.797604+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:30:10.797604+0000","last_undegraded":"2024-02-15T23:30:10.797604+0000","last_fullsized":"2024-02-15T23:30:10.797604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:37.069926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.304267+0000","last_change":"2024-02-15T23:29:29.720102+0000","last_active":"2024-02-15T23:30:58.304267+0000","last_peered":"2024-02-15T23:30:58.304267+0000","last_clean":"2024-02-15T23:30:58.304267+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:30:58.304267+0000","last_undegraded":"2024-02-15T23:30:58.304267+0000","last_fullsized":"2024-02-15T23:30:58.304267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.750065+0000","last_change":"2024-02-15T23:29:31.691136+0000","last_active":"2024-02-15T23:30:14.750065+0000","last_peered":"2024-02-15T23:30:14.750065+0000","last_clean":"2024-02-15T23:30:14.750065+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:30:14.750065+0000","last_undegraded":"2024-02-15T23:30:14.750065+0000","last_fullsized":"2024-02-15T23:30:14.750065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:07.483252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781312+0000","last_change":"2024-02-15T23:29:29.734663+0000","last_active":"2024-02-15T23:30:10.781312+0000","last_peered":"2024-02-15T23:30:10.781312+0000","last_clean":"2024-02-15T23:30:10.781312+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:30:10.781312+0000","last_undegraded":"2024-02-15T23:30:10.781312+0000","last_fullsized":"2024-02-15T23:30:10.781312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924741+0000","last_change":"2024-02-15T23:29:31.689924+0000","last_active":"2024-02-15T23:31:03.924741+0000","last_peered":"2024-02-15T23:31:03.924741+0000","last_clean":"2024-02-15T23:31:03.924741+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:03.924741+0000","last_undegraded":"2024-02-15T23:31:03.924741+0000","last_fullsized":"2024-02-15T23:31:03.924741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:43:45.030558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791227+0000","last_change":"2024-02-15T23:29:29.739167+0000","last_active":"2024-02-15T23:30:10.791227+0000","last_peered":"2024-02-15T23:30:10.791227+0000","last_clean":"2024-02-15T23:30:10.791227+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:30:10.791227+0000","last_undegraded":"2024-02-15T23:30:10.791227+0000","last_fullsized":"2024-02-15T23:30:10.791227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.764985+0000","last_change":"2024-02-15T23:29:31.708859+0000","last_active":"2024-02-15T23:30:14.764985+0000","last_peered":"2024-02-15T23:30:14.764985+0000","last_clean":"2024-02-15T23:30:14.764985+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:30:14.764985+0000","last_undegraded":"2024-02-15T23:30:14.764985+0000","last_fullsized":"2024-02-15T23:30:14.764985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:07.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785957+0000","last_change":"2024-02-15T23:29:29.720464+0000","last_active":"2024-02-15T23:30:10.785957+0000","last_peered":"2024-02-15T23:30:10.785957+0000","last_clean":"2024-02-15T23:30:10.785957+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:30:10.785957+0000","last_undegraded":"2024-02-15T23:30:10.785957+0000","last_fullsized":"2024-02-15T23:30:10.785957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784167+0000","last_change":"2024-02-15T23:29:31.703343+0000","last_active":"2024-02-15T23:30:10.784167+0000","last_peered":"2024-02-15T23:30:10.784167+0000","last_clean":"2024-02-15T23:30:10.784167+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:30:10.784167+0000","last_undegraded":"2024-02-15T23:30:10.784167+0000","last_fullsized":"2024-02-15T23:30:10.784167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:21.379451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787886+0000","last_change":"2024-02-15T23:29:29.719436+0000","last_active":"2024-02-15T23:30:10.787886+0000","last_peered":"2024-02-15T23:30:10.787886+0000","last_clean":"2024-02-15T23:30:10.787886+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:30:10.787886+0000","last_undegraded":"2024-02-15T23:30:10.787886+0000","last_fullsized":"2024-02-15T23:30:10.787886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792681+0000","last_change":"2024-02-15T23:29:31.689367+0000","last_active":"2024-02-15T23:30:10.792681+0000","last_peered":"2024-02-15T23:30:10.792681+0000","last_clean":"2024-02-15T23:30:10.792681+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:30:10.792681+0000","last_undegraded":"2024-02-15T23:30:10.792681+0000","last_fullsized":"2024-02-15T23:30:10.792681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:54:16.380534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.800109+0000","last_change":"2024-02-15T23:29:29.717627+0000","last_active":"2024-02-15T23:30:10.800109+0000","last_peered":"2024-02-15T23:30:10.800109+0000","last_clean":"2024-02-15T23:30:10.800109+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:30:10.800109+0000","last_undegraded":"2024-02-15T23:30:10.800109+0000","last_fullsized":"2024-02-15T23:30:10.800109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:39.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'17","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.908865+0000","last_change":"2024-02-15T23:29:39.766173+0000","last_active":"2024-02-15T23:31:03.908865+0000","last_peered":"2024-02-15T23:31:03.908865+0000","last_clean":"2024-02-15T23:31:03.908865+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:03.908865+0000","last_undegraded":"2024-02-15T23:31:03.908865+0000","last_fullsized":"2024-02-15T23:31:03.908865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809014+0000","last_change":"2024-02-15T23:29:31.703049+0000","last_active":"2024-02-15T23:30:10.809014+0000","last_peered":"2024-02-15T23:30:10.809014+0000","last_clean":"2024-02-15T23:30:10.809014+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:30:10.809014+0000","last_undegraded":"2024-02-15T23:30:10.809014+0000","last_fullsized":"2024-02-15T23:30:10.809014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:58:59.538674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.804971+0000","last_change":"2024-02-15T23:29:29.711609+0000","last_active":"2024-02-15T23:30:10.804971+0000","last_peered":"2024-02-15T23:30:10.804971+0000","last_clean":"2024-02-15T23:30:10.804971+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:30:10.804971+0000","last_undegraded":"2024-02-15T23:30:10.804971+0000","last_fullsized":"2024-02-15T23:30:10.804971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:47.247864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808354+0000","last_change":"2024-02-15T23:29:33.713197+0000","last_active":"2024-02-15T23:30:10.808354+0000","last_peered":"2024-02-15T23:30:10.808354+0000","last_clean":"2024-02-15T23:30:10.808354+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:30:10.808354+0000","last_undegraded":"2024-02-15T23:30:10.808354+0000","last_fullsized":"2024-02-15T23:30:10.808354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:59:23.796227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.721968+0000","last_change":"2024-02-15T23:29:35.748567+0000","last_active":"2024-02-15T23:31:11.721968+0000","last_peered":"2024-02-15T23:31:11.721968+0000","last_clean":"2024-02-15T23:31:11.721968+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:31:11.721968+0000","last_undegraded":"2024-02-15T23:31:11.721968+0000","last_fullsized":"2024-02-15T23:31:11.721968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:00:08.530157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792782+0000","last_change":"2024-02-15T23:29:37.761765+0000","last_active":"2024-02-15T23:30:10.792782+0000","last_peered":"2024-02-15T23:30:10.792782+0000","last_clean":"2024-02-15T23:30:10.792782+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:30:10.792782+0000","last_undegraded":"2024-02-15T23:30:10.792782+0000","last_fullsized":"2024-02-15T23:30:10.792782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:20.640463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.446576+0000","last_change":"2024-02-15T23:29:39.772828+0000","last_active":"2024-02-15T23:30:52.446576+0000","last_peered":"2024-02-15T23:30:52.446576+0000","last_clean":"2024-02-15T23:30:52.446576+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:30:52.446576+0000","last_undegraded":"2024-02-15T23:30:52.446576+0000","last_fullsized":"2024-02-15T23:30:52.446576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:46:46.759299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499588+0000","last_change":"2024-02-15T23:29:31.707498+0000","last_active":"2024-02-15T23:30:57.499588+0000","last_peered":"2024-02-15T23:30:57.499588+0000","last_clean":"2024-02-15T23:30:57.499588+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:30:57.499588+0000","last_undegraded":"2024-02-15T23:30:57.499588+0000","last_fullsized":"2024-02-15T23:30:57.499588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:47.182154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776324+0000","last_change":"2024-02-15T23:29:29.722314+0000","last_active":"2024-02-15T23:30:10.776324+0000","last_peered":"2024-02-15T23:30:10.776324+0000","last_clean":"2024-02-15T23:30:10.776324+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:30:10.776324+0000","last_undegraded":"2024-02-15T23:30:10.776324+0000","last_fullsized":"2024-02-15T23:30:10.776324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785649+0000","last_change":"2024-02-15T23:29:33.707309+0000","last_active":"2024-02-15T23:30:10.785649+0000","last_peered":"2024-02-15T23:30:10.785649+0000","last_clean":"2024-02-15T23:30:10.785649+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:30:10.785649+0000","last_undegraded":"2024-02-15T23:30:10.785649+0000","last_fullsized":"2024-02-15T23:30:10.785649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:38:28.615466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791778+0000","last_change":"2024-02-15T23:29:35.731494+0000","last_active":"2024-02-15T23:30:10.791778+0000","last_peered":"2024-02-15T23:30:10.791778+0000","last_clean":"2024-02-15T23:30:10.791778+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:30:10.791778+0000","last_undegraded":"2024-02-15T23:30:10.791778+0000","last_fullsized":"2024-02-15T23:30:10.791778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:29:30.966627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786144+0000","last_change":"2024-02-15T23:29:37.752102+0000","last_active":"2024-02-15T23:30:10.786144+0000","last_peered":"2024-02-15T23:30:10.786144+0000","last_clean":"2024-02-15T23:30:10.786144+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:30:10.786144+0000","last_undegraded":"2024-02-15T23:30:10.786144+0000","last_fullsized":"2024-02-15T23:30:10.786144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:37.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783801+0000","last_change":"2024-02-15T23:29:39.757721+0000","last_active":"2024-02-15T23:30:10.783801+0000","last_peered":"2024-02-15T23:30:10.783801+0000","last_clean":"2024-02-15T23:30:10.783801+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:30:10.783801+0000","last_undegraded":"2024-02-15T23:30:10.783801+0000","last_fullsized":"2024-02-15T23:30:10.783801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:27.441839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310678+0000","last_change":"2024-02-15T23:29:31.705324+0000","last_active":"2024-02-15T23:30:58.310678+0000","last_peered":"2024-02-15T23:30:58.310678+0000","last_clean":"2024-02-15T23:30:58.310678+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:30:58.310678+0000","last_undegraded":"2024-02-15T23:30:58.310678+0000","last_fullsized":"2024-02-15T23:30:58.310678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:52.531050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795098+0000","last_change":"2024-02-15T23:29:29.728584+0000","last_active":"2024-02-15T23:30:10.795098+0000","last_peered":"2024-02-15T23:30:10.795098+0000","last_clean":"2024-02-15T23:30:10.795098+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:30:10.795098+0000","last_undegraded":"2024-02-15T23:30:10.795098+0000","last_fullsized":"2024-02-15T23:30:10.795098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:16.480977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791658+0000","last_change":"2024-02-15T23:29:33.723876+0000","last_active":"2024-02-15T23:30:10.791658+0000","last_peered":"2024-02-15T23:30:10.791658+0000","last_clean":"2024-02-15T23:30:10.791658+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:30:10.791658+0000","last_undegraded":"2024-02-15T23:30:10.791658+0000","last_fullsized":"2024-02-15T23:30:10.791658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:04.882762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778396+0000","last_change":"2024-02-15T23:29:35.725059+0000","last_active":"2024-02-15T23:30:10.778396+0000","last_peered":"2024-02-15T23:30:10.778396+0000","last_clean":"2024-02-15T23:30:10.778396+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:30:10.778396+0000","last_undegraded":"2024-02-15T23:30:10.778396+0000","last_fullsized":"2024-02-15T23:30:10.778396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:42.048881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":305,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.637176+0000","last_change":"2024-02-15T23:29:37.774111+0000","last_active":"2024-02-15T23:31:11.637176+0000","last_peered":"2024-02-15T23:31:11.637176+0000","last_clean":"2024-02-15T23:31:11.637176+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:11.637176+0000","last_undegraded":"2024-02-15T23:31:11.637176+0000","last_fullsized":"2024-02-15T23:31:11.637176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:25.049564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777264+0000","last_change":"2024-02-15T23:29:39.776305+0000","last_active":"2024-02-15T23:30:10.777264+0000","last_peered":"2024-02-15T23:30:10.777264+0000","last_clean":"2024-02-15T23:30:10.777264+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:30:10.777264+0000","last_undegraded":"2024-02-15T23:30:10.777264+0000","last_fullsized":"2024-02-15T23:30:10.777264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:57.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791795+0000","last_change":"2024-02-15T23:29:31.696768+0000","last_active":"2024-02-15T23:30:10.791795+0000","last_peered":"2024-02-15T23:30:10.791795+0000","last_clean":"2024-02-15T23:30:10.791795+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:30:10.791795+0000","last_undegraded":"2024-02-15T23:30:10.791795+0000","last_fullsized":"2024-02-15T23:30:10.791795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:02.842564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783249+0000","last_change":"2024-02-15T23:29:29.737866+0000","last_active":"2024-02-15T23:30:10.783249+0000","last_peered":"2024-02-15T23:30:10.783249+0000","last_clean":"2024-02-15T23:30:10.783249+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:30:10.783249+0000","last_undegraded":"2024-02-15T23:30:10.783249+0000","last_fullsized":"2024-02-15T23:30:10.783249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:51:36.207574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809941+0000","last_change":"2024-02-15T23:29:33.715302+0000","last_active":"2024-02-15T23:30:10.809941+0000","last_peered":"2024-02-15T23:30:10.809941+0000","last_clean":"2024-02-15T23:30:10.809941+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:30:10.809941+0000","last_undegraded":"2024-02-15T23:30:10.809941+0000","last_fullsized":"2024-02-15T23:30:10.809941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:57.337417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.901317+0000","last_change":"2024-02-15T23:29:35.718792+0000","last_active":"2024-02-15T23:31:11.901317+0000","last_peered":"2024-02-15T23:31:11.901317+0000","last_clean":"2024-02-15T23:31:11.901317+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:31:11.901317+0000","last_undegraded":"2024-02-15T23:31:11.901317+0000","last_fullsized":"2024-02-15T23:31:11.901317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:06.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":333,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.644106+0000","last_change":"2024-02-15T23:29:37.752749+0000","last_active":"2024-02-15T23:31:11.644106+0000","last_peered":"2024-02-15T23:31:11.644106+0000","last_clean":"2024-02-15T23:31:11.644106+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:11.644106+0000","last_undegraded":"2024-02-15T23:31:11.644106+0000","last_fullsized":"2024-02-15T23:31:11.644106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:58.620898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797372+0000","last_change":"2024-02-15T23:29:31.702049+0000","last_active":"2024-02-15T23:30:10.797372+0000","last_peered":"2024-02-15T23:30:10.797372+0000","last_clean":"2024-02-15T23:30:10.797372+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:30:10.797372+0000","last_undegraded":"2024-02-15T23:30:10.797372+0000","last_fullsized":"2024-02-15T23:30:10.797372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:56.628114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780198+0000","last_change":"2024-02-15T23:29:29.731688+0000","last_active":"2024-02-15T23:30:10.780198+0000","last_peered":"2024-02-15T23:30:10.780198+0000","last_clean":"2024-02-15T23:30:10.780198+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:30:10.780198+0000","last_undegraded":"2024-02-15T23:30:10.780198+0000","last_fullsized":"2024-02-15T23:30:10.780198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783045+0000","last_change":"2024-02-15T23:29:33.721207+0000","last_active":"2024-02-15T23:30:10.783045+0000","last_peered":"2024-02-15T23:30:10.783045+0000","last_clean":"2024-02-15T23:30:10.783045+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:30:10.783045+0000","last_undegraded":"2024-02-15T23:30:10.783045+0000","last_fullsized":"2024-02-15T23:30:10.783045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:35.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'41","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.741311+0000","last_change":"2024-02-15T23:29:35.722074+0000","last_active":"2024-02-15T23:31:11.741311+0000","last_peered":"2024-02-15T23:31:11.741311+0000","last_clean":"2024-02-15T23:31:11.741311+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:31:11.741311+0000","last_undegraded":"2024-02-15T23:31:11.741311+0000","last_fullsized":"2024-02-15T23:31:11.741311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:37.868310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787088+0000","last_change":"2024-02-15T23:29:37.752862+0000","last_active":"2024-02-15T23:30:10.787088+0000","last_peered":"2024-02-15T23:30:10.787088+0000","last_clean":"2024-02-15T23:30:10.787088+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:30:10.787088+0000","last_undegraded":"2024-02-15T23:30:10.787088+0000","last_fullsized":"2024-02-15T23:30:10.787088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:24.593703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.061346+0000","last_change":"2024-02-15T23:29:39.779875+0000","last_active":"2024-02-15T23:30:58.061346+0000","last_peered":"2024-02-15T23:30:58.061346+0000","last_clean":"2024-02-15T23:30:58.061346+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:30:58.061346+0000","last_undegraded":"2024-02-15T23:30:58.061346+0000","last_fullsized":"2024-02-15T23:30:58.061346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:55.612483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.925206+0000","last_change":"2024-02-15T23:29:31.694940+0000","last_active":"2024-02-15T23:31:03.925206+0000","last_peered":"2024-02-15T23:31:03.925206+0000","last_clean":"2024-02-15T23:31:03.925206+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:31:03.925206+0000","last_undegraded":"2024-02-15T23:31:03.925206+0000","last_fullsized":"2024-02-15T23:31:03.925206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:07.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779830+0000","last_change":"2024-02-15T23:29:29.723619+0000","last_active":"2024-02-15T23:30:10.779830+0000","last_peered":"2024-02-15T23:30:10.779830+0000","last_clean":"2024-02-15T23:30:10.779830+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:30:10.779830+0000","last_undegraded":"2024-02-15T23:30:10.779830+0000","last_fullsized":"2024-02-15T23:30:10.779830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790262+0000","last_change":"2024-02-15T23:30:10.788609+0000","last_active":"2024-02-15T23:30:10.790262+0000","last_peered":"2024-02-15T23:30:10.790262+0000","last_clean":"2024-02-15T23:30:10.790262+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:30:10.790262+0000","last_undegraded":"2024-02-15T23:30:10.790262+0000","last_fullsized":"2024-02-15T23:30:10.790262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:57.337417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.824110+0000","last_change":"2024-02-15T23:29:35.747759+0000","last_active":"2024-02-15T23:31:11.824110+0000","last_peered":"2024-02-15T23:31:11.824110+0000","last_clean":"2024-02-15T23:31:11.824110+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:31:11.824110+0000","last_undegraded":"2024-02-15T23:31:11.824110+0000","last_fullsized":"2024-02-15T23:31:11.824110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:50:15.235598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785044+0000","last_change":"2024-02-15T23:29:37.763519+0000","last_active":"2024-02-15T23:30:10.785044+0000","last_peered":"2024-02-15T23:30:10.785044+0000","last_clean":"2024-02-15T23:30:10.785044+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:30:10.785044+0000","last_undegraded":"2024-02-15T23:30:10.785044+0000","last_fullsized":"2024-02-15T23:30:10.785044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:40.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.305871+0000","last_change":"2024-02-15T23:29:39.781125+0000","last_active":"2024-02-15T23:30:52.305871+0000","last_peered":"2024-02-15T23:30:52.305871+0000","last_clean":"2024-02-15T23:30:52.305871+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:30:52.305871+0000","last_undegraded":"2024-02-15T23:30:52.305871+0000","last_fullsized":"2024-02-15T23:30:52.305871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:11.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.752655+0000","last_change":"2024-02-15T23:29:31.710943+0000","last_active":"2024-02-15T23:30:14.752655+0000","last_peered":"2024-02-15T23:30:14.752655+0000","last_clean":"2024-02-15T23:30:14.752655+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:30:14.752655+0000","last_undegraded":"2024-02-15T23:30:14.752655+0000","last_fullsized":"2024-02-15T23:30:14.752655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:42.071297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810297+0000","last_change":"2024-02-15T23:29:29.725600+0000","last_active":"2024-02-15T23:30:10.810297+0000","last_peered":"2024-02-15T23:30:10.810297+0000","last_clean":"2024-02-15T23:30:10.810297+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:30:10.810297+0000","last_undegraded":"2024-02-15T23:30:10.810297+0000","last_fullsized":"2024-02-15T23:30:10.810297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:15:05.621720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786043+0000","last_change":"2024-02-15T23:29:33.719603+0000","last_active":"2024-02-15T23:30:10.786043+0000","last_peered":"2024-02-15T23:30:10.786043+0000","last_clean":"2024-02-15T23:30:10.786043+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:30:10.786043+0000","last_undegraded":"2024-02-15T23:30:10.786043+0000","last_fullsized":"2024-02-15T23:30:10.786043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:30:40.574457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'38","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.749744+0000","last_change":"2024-02-15T23:29:35.747042+0000","last_active":"2024-02-15T23:31:11.749744+0000","last_peered":"2024-02-15T23:31:11.749744+0000","last_clean":"2024-02-15T23:31:11.749744+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:31:11.749744+0000","last_undegraded":"2024-02-15T23:31:11.749744+0000","last_fullsized":"2024-02-15T23:31:11.749744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:30.039763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":304,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.646870+0000","last_change":"2024-02-15T23:29:37.763712+0000","last_active":"2024-02-15T23:31:11.646870+0000","last_peered":"2024-02-15T23:31:11.646870+0000","last_clean":"2024-02-15T23:31:11.646870+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:11.646870+0000","last_undegraded":"2024-02-15T23:31:11.646870+0000","last_fullsized":"2024-02-15T23:31:11.646870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:37.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.440803+0000","last_change":"2024-02-15T23:29:39.784076+0000","last_active":"2024-02-15T23:30:52.440803+0000","last_peered":"2024-02-15T23:30:52.440803+0000","last_clean":"2024-02-15T23:30:52.440803+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:30:52.440803+0000","last_undegraded":"2024-02-15T23:30:52.440803+0000","last_fullsized":"2024-02-15T23:30:52.440803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:20.743271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780987+0000","last_change":"2024-02-15T23:29:31.682141+0000","last_active":"2024-02-15T23:30:10.780987+0000","last_peered":"2024-02-15T23:30:10.780987+0000","last_clean":"2024-02-15T23:30:10.780987+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:30:10.780987+0000","last_undegraded":"2024-02-15T23:30:10.780987+0000","last_fullsized":"2024-02-15T23:30:10.780987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:04.855243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807634+0000","last_change":"2024-02-15T23:29:29.717855+0000","last_active":"2024-02-15T23:30:10.807634+0000","last_peered":"2024-02-15T23:30:10.807634+0000","last_clean":"2024-02-15T23:30:10.807634+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:30:10.807634+0000","last_undegraded":"2024-02-15T23:30:10.807634+0000","last_fullsized":"2024-02-15T23:30:10.807634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:52.833533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786259+0000","last_change":"2024-02-15T23:29:33.726139+0000","last_active":"2024-02-15T23:30:10.786259+0000","last_peered":"2024-02-15T23:30:10.786259+0000","last_clean":"2024-02-15T23:30:10.786259+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:30:10.786259+0000","last_undegraded":"2024-02-15T23:30:10.786259+0000","last_fullsized":"2024-02-15T23:30:10.786259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:53.253439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'56","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.842731+0000","last_change":"2024-02-15T23:29:35.749140+0000","last_active":"2024-02-15T23:31:11.842731+0000","last_peered":"2024-02-15T23:31:11.842731+0000","last_clean":"2024-02-15T23:31:11.842731+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:11.842731+0000","last_undegraded":"2024-02-15T23:31:11.842731+0000","last_fullsized":"2024-02-15T23:31:11.842731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:54:44.162530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784051+0000","last_change":"2024-02-15T23:29:37.740778+0000","last_active":"2024-02-15T23:30:10.784051+0000","last_peered":"2024-02-15T23:30:10.784051+0000","last_clean":"2024-02-15T23:30:10.784051+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:30:10.784051+0000","last_undegraded":"2024-02-15T23:30:10.784051+0000","last_fullsized":"2024-02-15T23:30:10.784051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:26:31.398449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.788113+0000","last_change":"2024-02-15T23:29:39.766366+0000","last_active":"2024-02-15T23:30:10.788113+0000","last_peered":"2024-02-15T23:30:10.788113+0000","last_clean":"2024-02-15T23:30:10.788113+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:30:10.788113+0000","last_undegraded":"2024-02-15T23:30:10.788113+0000","last_fullsized":"2024-02-15T23:30:10.788113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:29.582392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.763860+0000","last_change":"2024-02-15T23:30:10.801846+0000","last_active":"2024-02-15T23:30:15.763860+0000","last_peered":"2024-02-15T23:30:15.763860+0000","last_clean":"2024-02-15T23:30:15.763860+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:30:15.763860+0000","last_undegraded":"2024-02-15T23:30:15.763860+0000","last_fullsized":"2024-02-15T23:30:15.763860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:53:52.065139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.506655+0000","last_change":"2024-02-15T23:29:29.716793+0000","last_active":"2024-02-15T23:30:57.506655+0000","last_peered":"2024-02-15T23:30:57.506655+0000","last_clean":"2024-02-15T23:30:57.506655+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:30:57.506655+0000","last_undegraded":"2024-02-15T23:30:57.506655+0000","last_fullsized":"2024-02-15T23:30:57.506655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780151+0000","last_change":"2024-02-15T23:29:33.705063+0000","last_active":"2024-02-15T23:30:10.780151+0000","last_peered":"2024-02-15T23:30:10.780151+0000","last_clean":"2024-02-15T23:30:10.780151+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:30:10.780151+0000","last_undegraded":"2024-02-15T23:30:10.780151+0000","last_fullsized":"2024-02-15T23:30:10.780151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:20.311560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'35","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.848991+0000","last_change":"2024-02-15T23:29:35.728175+0000","last_active":"2024-02-15T23:31:11.848991+0000","last_peered":"2024-02-15T23:31:11.848991+0000","last_clean":"2024-02-15T23:31:11.848991+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:11.848991+0000","last_undegraded":"2024-02-15T23:31:11.848991+0000","last_fullsized":"2024-02-15T23:31:11.848991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:32.708804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812233+0000","last_change":"2024-02-15T23:29:37.772409+0000","last_active":"2024-02-15T23:30:10.812233+0000","last_peered":"2024-02-15T23:30:10.812233+0000","last_clean":"2024-02-15T23:30:10.812233+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:30:10.812233+0000","last_undegraded":"2024-02-15T23:30:10.812233+0000","last_fullsized":"2024-02-15T23:30:10.812233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:31.227259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794250+0000","last_change":"2024-02-15T23:29:39.775394+0000","last_active":"2024-02-15T23:30:10.794250+0000","last_peered":"2024-02-15T23:30:10.794250+0000","last_clean":"2024-02-15T23:30:10.794250+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:30:10.794250+0000","last_undegraded":"2024-02-15T23:30:10.794250+0000","last_fullsized":"2024-02-15T23:30:10.794250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:42.665101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310584+0000","last_change":"2024-02-15T23:29:31.709643+0000","last_active":"2024-02-15T23:30:58.310584+0000","last_peered":"2024-02-15T23:30:58.310584+0000","last_clean":"2024-02-15T23:30:58.310584+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:30:58.310584+0000","last_undegraded":"2024-02-15T23:30:58.310584+0000","last_fullsized":"2024-02-15T23:30:58.310584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:34:14.575064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807250+0000","last_change":"2024-02-15T23:29:29.725808+0000","last_active":"2024-02-15T23:30:10.807250+0000","last_peered":"2024-02-15T23:30:10.807250+0000","last_clean":"2024-02-15T23:30:10.807250+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:30:10.807250+0000","last_undegraded":"2024-02-15T23:30:10.807250+0000","last_fullsized":"2024-02-15T23:30:10.807250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:52.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785684+0000","last_change":"2024-02-15T23:29:33.719257+0000","last_active":"2024-02-15T23:30:10.785684+0000","last_peered":"2024-02-15T23:30:10.785684+0000","last_clean":"2024-02-15T23:30:10.785684+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:30:10.785684+0000","last_undegraded":"2024-02-15T23:30:10.785684+0000","last_fullsized":"2024-02-15T23:30:10.785684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:38.251929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.801300+0000","last_change":"2024-02-15T23:29:35.714372+0000","last_active":"2024-02-15T23:31:11.801300+0000","last_peered":"2024-02-15T23:31:11.801300+0000","last_clean":"2024-02-15T23:31:11.801300+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:31:11.801300+0000","last_undegraded":"2024-02-15T23:31:11.801300+0000","last_fullsized":"2024-02-15T23:31:11.801300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:41.100143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":335,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.638192+0000","last_change":"2024-02-15T23:29:37.751264+0000","last_active":"2024-02-15T23:31:11.638192+0000","last_peered":"2024-02-15T23:31:11.638192+0000","last_clean":"2024-02-15T23:31:11.638192+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:11.638192+0000","last_undegraded":"2024-02-15T23:31:11.638192+0000","last_fullsized":"2024-02-15T23:31:11.638192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:53.228345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.326564+0000","last_change":"2024-02-15T23:29:39.757713+0000","last_active":"2024-02-15T23:30:58.326564+0000","last_peered":"2024-02-15T23:30:58.326564+0000","last_clean":"2024-02-15T23:30:58.326564+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:30:58.326564+0000","last_undegraded":"2024-02-15T23:30:58.326564+0000","last_fullsized":"2024-02-15T23:30:58.326564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:40.849035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780839+0000","last_change":"2024-02-15T23:29:31.706992+0000","last_active":"2024-02-15T23:30:10.780839+0000","last_peered":"2024-02-15T23:30:10.780839+0000","last_clean":"2024-02-15T23:30:10.780839+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:30:10.780839+0000","last_undegraded":"2024-02-15T23:30:10.780839+0000","last_fullsized":"2024-02-15T23:30:10.780839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798403+0000","last_change":"2024-02-15T23:29:29.720429+0000","last_active":"2024-02-15T23:30:10.798403+0000","last_peered":"2024-02-15T23:30:10.798403+0000","last_clean":"2024-02-15T23:30:10.798403+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:30:10.798403+0000","last_undegraded":"2024-02-15T23:30:10.798403+0000","last_fullsized":"2024-02-15T23:30:10.798403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:55.269267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":363,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.611618+0000","last_change":"2024-02-15T23:29:33.721567+0000","last_active":"2024-02-15T23:31:11.611618+0000","last_peered":"2024-02-15T23:31:11.611618+0000","last_clean":"2024-02-15T23:31:11.611618+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:11.611618+0000","last_undegraded":"2024-02-15T23:31:11.611618+0000","last_fullsized":"2024-02-15T23:31:11.611618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:24.723502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809385+0000","last_change":"2024-02-15T23:29:35.750907+0000","last_active":"2024-02-15T23:30:10.809385+0000","last_peered":"2024-02-15T23:30:10.809385+0000","last_clean":"2024-02-15T23:30:10.809385+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:30:10.809385+0000","last_undegraded":"2024-02-15T23:30:10.809385+0000","last_fullsized":"2024-02-15T23:30:10.809385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:51.904115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":378,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.640829+0000","last_change":"2024-02-15T23:29:37.734243+0000","last_active":"2024-02-15T23:31:11.640829+0000","last_peered":"2024-02-15T23:31:11.640829+0000","last_clean":"2024-02-15T23:31:11.640829+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:11.640829+0000","last_undegraded":"2024-02-15T23:31:11.640829+0000","last_fullsized":"2024-02-15T23:31:11.640829+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:24.593703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780732+0000","last_change":"2024-02-15T23:29:39.767850+0000","last_active":"2024-02-15T23:30:10.780732+0000","last_peered":"2024-02-15T23:30:10.780732+0000","last_clean":"2024-02-15T23:30:10.780732+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:30:10.780732+0000","last_undegraded":"2024-02-15T23:30:10.780732+0000","last_fullsized":"2024-02-15T23:30:10.780732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:09:53.270028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310285+0000","last_change":"2024-02-15T23:29:31.710143+0000","last_active":"2024-02-15T23:30:58.310285+0000","last_peered":"2024-02-15T23:30:58.310285+0000","last_clean":"2024-02-15T23:30:58.310285+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:30:58.310285+0000","last_undegraded":"2024-02-15T23:30:58.310285+0000","last_fullsized":"2024-02-15T23:30:58.310285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:33:08.745254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796597+0000","last_change":"2024-02-15T23:29:29.724689+0000","last_active":"2024-02-15T23:30:10.796597+0000","last_peered":"2024-02-15T23:30:10.796597+0000","last_clean":"2024-02-15T23:30:10.796597+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:30:10.796597+0000","last_undegraded":"2024-02-15T23:30:10.796597+0000","last_fullsized":"2024-02-15T23:30:10.796597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:26.315905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810239+0000","last_change":"2024-02-15T23:29:33.716469+0000","last_active":"2024-02-15T23:30:10.810239+0000","last_peered":"2024-02-15T23:30:10.810239+0000","last_clean":"2024-02-15T23:30:10.810239+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:30:10.810239+0000","last_undegraded":"2024-02-15T23:30:10.810239+0000","last_fullsized":"2024-02-15T23:30:10.810239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:04.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.727044+0000","last_change":"2024-02-15T23:29:35.730918+0000","last_active":"2024-02-15T23:31:11.727044+0000","last_peered":"2024-02-15T23:31:11.727044+0000","last_clean":"2024-02-15T23:31:11.727044+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:31:11.727044+0000","last_undegraded":"2024-02-15T23:31:11.727044+0000","last_fullsized":"2024-02-15T23:31:11.727044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:34:18.605282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778025+0000","last_change":"2024-02-15T23:29:37.767166+0000","last_active":"2024-02-15T23:30:10.778025+0000","last_peered":"2024-02-15T23:30:10.778025+0000","last_clean":"2024-02-15T23:30:10.778025+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:30:10.778025+0000","last_undegraded":"2024-02-15T23:30:10.778025+0000","last_fullsized":"2024-02-15T23:30:10.778025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:01.461141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783831+0000","last_change":"2024-02-15T23:29:39.756802+0000","last_active":"2024-02-15T23:30:10.783831+0000","last_peered":"2024-02-15T23:30:10.783831+0000","last_clean":"2024-02-15T23:30:10.783831+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:30:10.783831+0000","last_undegraded":"2024-02-15T23:30:10.783831+0000","last_fullsized":"2024-02-15T23:30:10.783831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:27.441839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310387+0000","last_change":"2024-02-15T23:29:31.709063+0000","last_active":"2024-02-15T23:30:58.310387+0000","last_peered":"2024-02-15T23:30:58.310387+0000","last_clean":"2024-02-15T23:30:58.310387+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:30:58.310387+0000","last_undegraded":"2024-02-15T23:30:58.310387+0000","last_fullsized":"2024-02-15T23:30:58.310387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:15.455104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782126+0000","last_change":"2024-02-15T23:29:17.391071+0000","last_active":"2024-02-15T23:30:10.782126+0000","last_peered":"2024-02-15T23:30:10.782126+0000","last_clean":"2024-02-15T23:30:10.782126+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:30:10.782126+0000","last_undegraded":"2024-02-15T23:30:10.782126+0000","last_fullsized":"2024-02-15T23:30:10.782126+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_clean_scrub_stamp":"2024-02-15T23:29:15.580621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:00.893203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806662+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:30:10.806662+0000","last_peered":"2024-02-15T23:30:10.806662+0000","last_clean":"2024-02-15T23:30:10.806662+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:30:10.806662+0000","last_undegraded":"2024-02-15T23:30:10.806662+0000","last_fullsized":"2024-02-15T23:30:10.806662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:31:39.646588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.916327+0000","last_change":"2024-02-15T23:29:29.725524+0000","last_active":"2024-02-15T23:31:03.916327+0000","last_peered":"2024-02-15T23:31:03.916327+0000","last_clean":"2024-02-15T23:31:03.916327+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:31:03.916327+0000","last_undegraded":"2024-02-15T23:31:03.916327+0000","last_fullsized":"2024-02-15T23:31:03.916327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:58.815157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.801490+0000","last_change":"2024-02-15T23:30:10.801490+0000","last_active":"2024-02-15T23:30:10.801490+0000","last_peered":"2024-02-15T23:30:10.801490+0000","last_clean":"2024-02-15T23:30:10.801490+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:30:10.801490+0000","last_undegraded":"2024-02-15T23:30:10.801490+0000","last_fullsized":"2024-02-15T23:30:10.801490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:55:48.775082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'79","reported_seq":159,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.785850+0000","last_change":"2024-02-15T23:29:35.746233+0000","last_active":"2024-02-15T23:31:11.785850+0000","last_peered":"2024-02-15T23:31:11.785850+0000","last_clean":"2024-02-15T23:31:11.785850+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:11.785850+0000","last_undegraded":"2024-02-15T23:31:11.785850+0000","last_fullsized":"2024-02-15T23:31:11.785850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:56:17.988220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787880+0000","last_change":"2024-02-15T23:29:37.764075+0000","last_active":"2024-02-15T23:30:10.787880+0000","last_peered":"2024-02-15T23:30:10.787880+0000","last_clean":"2024-02-15T23:30:10.787880+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:30:10.787880+0000","last_undegraded":"2024-02-15T23:30:10.787880+0000","last_fullsized":"2024-02-15T23:30:10.787880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:59:27.829626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.943862+0000","last_change":"2024-02-15T23:29:39.777587+0000","last_active":"2024-02-15T23:31:03.943862+0000","last_peered":"2024-02-15T23:31:03.943862+0000","last_clean":"2024-02-15T23:31:03.943862+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:31:03.943862+0000","last_undegraded":"2024-02-15T23:31:03.943862+0000","last_fullsized":"2024-02-15T23:31:03.943862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:50.335386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'13","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499841+0000","last_change":"2024-02-15T23:29:31.705098+0000","last_active":"2024-02-15T23:30:57.499841+0000","last_peered":"2024-02-15T23:30:57.499841+0000","last_clean":"2024-02-15T23:30:57.499841+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:30:57.499841+0000","last_undegraded":"2024-02-15T23:30:57.499841+0000","last_fullsized":"2024-02-15T23:30:57.499841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:15.615348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795289+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:30:10.795289+0000","last_peered":"2024-02-15T23:30:10.795289+0000","last_clean":"2024-02-15T23:30:10.795289+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:30:10.795289+0000","last_undegraded":"2024-02-15T23:30:10.795289+0000","last_fullsized":"2024-02-15T23:30:10.795289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:26.706393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.062516+0000","last_change":"2024-02-15T23:29:29.708594+0000","last_active":"2024-02-15T23:30:15.062516+0000","last_peered":"2024-02-15T23:30:15.062516+0000","last_clean":"2024-02-15T23:30:15.062516+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:30:15.062516+0000","last_undegraded":"2024-02-15T23:30:15.062516+0000","last_fullsized":"2024-02-15T23:30:15.062516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812552+0000","last_change":"2024-02-15T23:29:33.716868+0000","last_active":"2024-02-15T23:30:10.812552+0000","last_peered":"2024-02-15T23:30:10.812552+0000","last_clean":"2024-02-15T23:30:10.812552+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:30:10.812552+0000","last_undegraded":"2024-02-15T23:30:10.812552+0000","last_fullsized":"2024-02-15T23:30:10.812552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:53:54.077930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'250","reported_seq":432,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.923261+0000","last_change":"2024-02-15T23:29:35.724256+0000","last_active":"2024-02-15T23:31:11.923261+0000","last_peered":"2024-02-15T23:31:11.923261+0000","last_clean":"2024-02-15T23:31:11.923261+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:11.923261+0000","last_undegraded":"2024-02-15T23:31:11.923261+0000","last_fullsized":"2024-02-15T23:31:11.923261+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:05.587661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807241+0000","last_change":"2024-02-15T23:29:37.769851+0000","last_active":"2024-02-15T23:30:10.807241+0000","last_peered":"2024-02-15T23:30:10.807241+0000","last_clean":"2024-02-15T23:30:10.807241+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:30:10.807241+0000","last_undegraded":"2024-02-15T23:30:10.807241+0000","last_fullsized":"2024-02-15T23:30:10.807241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:49.141465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.462247+0000","last_change":"2024-02-15T23:29:39.779672+0000","last_active":"2024-02-15T23:30:52.462247+0000","last_peered":"2024-02-15T23:30:52.462247+0000","last_clean":"2024-02-15T23:30:52.462247+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:30:52.462247+0000","last_undegraded":"2024-02-15T23:30:52.462247+0000","last_fullsized":"2024-02-15T23:30:52.462247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:40.849035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924349+0000","last_change":"2024-02-15T23:29:31.694236+0000","last_active":"2024-02-15T23:31:03.924349+0000","last_peered":"2024-02-15T23:31:03.924349+0000","last_clean":"2024-02-15T23:31:03.924349+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:03.924349+0000","last_undegraded":"2024-02-15T23:31:03.924349+0000","last_fullsized":"2024-02-15T23:31:03.924349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:49.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777472+0000","last_change":"2024-02-15T23:29:21.622454+0000","last_active":"2024-02-15T23:30:10.777472+0000","last_peered":"2024-02-15T23:30:10.777472+0000","last_clean":"2024-02-15T23:30:10.777472+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:30:10.777472+0000","last_undegraded":"2024-02-15T23:30:10.777472+0000","last_fullsized":"2024-02-15T23:30:10.777472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:05.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783297+0000","last_change":"2024-02-15T23:29:29.718869+0000","last_active":"2024-02-15T23:30:10.783297+0000","last_peered":"2024-02-15T23:30:10.783297+0000","last_clean":"2024-02-15T23:30:10.783297+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:30:10.783297+0000","last_undegraded":"2024-02-15T23:30:10.783297+0000","last_fullsized":"2024-02-15T23:30:10.783297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778385+0000","last_change":"2024-02-15T23:29:33.703250+0000","last_active":"2024-02-15T23:30:10.778385+0000","last_peered":"2024-02-15T23:30:10.778385+0000","last_clean":"2024-02-15T23:30:10.778385+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:30:10.778385+0000","last_undegraded":"2024-02-15T23:30:10.778385+0000","last_fullsized":"2024-02-15T23:30:10.778385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:03.717928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.825449+0000","last_change":"2024-02-15T23:29:35.732833+0000","last_active":"2024-02-15T23:31:03.825449+0000","last_peered":"2024-02-15T23:31:03.825449+0000","last_clean":"2024-02-15T23:31:03.825449+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:03.825449+0000","last_undegraded":"2024-02-15T23:31:03.825449+0000","last_fullsized":"2024-02-15T23:31:03.825449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:23.890835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786334+0000","last_change":"2024-02-15T23:29:37.764209+0000","last_active":"2024-02-15T23:30:10.786334+0000","last_peered":"2024-02-15T23:30:10.786334+0000","last_clean":"2024-02-15T23:30:10.786334+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:30:10.786334+0000","last_undegraded":"2024-02-15T23:30:10.786334+0000","last_fullsized":"2024-02-15T23:30:10.786334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:08.422824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798630+0000","last_change":"2024-02-15T23:29:39.769538+0000","last_active":"2024-02-15T23:30:10.798630+0000","last_peered":"2024-02-15T23:30:10.798630+0000","last_clean":"2024-02-15T23:30:10.798630+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:30:10.798630+0000","last_undegraded":"2024-02-15T23:30:10.798630+0000","last_fullsized":"2024-02-15T23:30:10.798630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:03.906467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924601+0000","last_change":"2024-02-15T23:29:31.691195+0000","last_active":"2024-02-15T23:31:03.924601+0000","last_peered":"2024-02-15T23:31:03.924601+0000","last_clean":"2024-02-15T23:31:03.924601+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:03.924601+0000","last_undegraded":"2024-02-15T23:31:03.924601+0000","last_fullsized":"2024-02-15T23:31:03.924601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799199+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:30:10.799199+0000","last_peered":"2024-02-15T23:30:10.799199+0000","last_clean":"2024-02-15T23:30:10.799199+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:30:10.799199+0000","last_undegraded":"2024-02-15T23:30:10.799199+0000","last_fullsized":"2024-02-15T23:30:10.799199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:56.631774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780471+0000","last_change":"2024-02-15T23:29:29.721410+0000","last_active":"2024-02-15T23:30:10.780471+0000","last_peered":"2024-02-15T23:30:10.780471+0000","last_clean":"2024-02-15T23:30:10.780471+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:30:10.780471+0000","last_undegraded":"2024-02-15T23:30:10.780471+0000","last_fullsized":"2024-02-15T23:30:10.780471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787055+0000","last_change":"2024-02-15T23:29:33.720740+0000","last_active":"2024-02-15T23:30:10.787055+0000","last_peered":"2024-02-15T23:30:10.787055+0000","last_clean":"2024-02-15T23:30:10.787055+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:30:10.787055+0000","last_undegraded":"2024-02-15T23:30:10.787055+0000","last_fullsized":"2024-02-15T23:30:10.787055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:35.850884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809861+0000","last_change":"2024-02-15T23:29:35.749663+0000","last_active":"2024-02-15T23:30:10.809861+0000","last_peered":"2024-02-15T23:30:10.809861+0000","last_clean":"2024-02-15T23:30:10.809861+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:30:10.809861+0000","last_undegraded":"2024-02-15T23:30:10.809861+0000","last_fullsized":"2024-02-15T23:30:10.809861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:55:50.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813015+0000","last_change":"2024-02-15T23:29:37.774191+0000","last_active":"2024-02-15T23:30:10.813015+0000","last_peered":"2024-02-15T23:30:10.813015+0000","last_clean":"2024-02-15T23:30:10.813015+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:30:10.813015+0000","last_undegraded":"2024-02-15T23:30:10.813015+0000","last_fullsized":"2024-02-15T23:30:10.813015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:22.178611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781801+0000","last_change":"2024-02-15T23:29:39.768032+0000","last_active":"2024-02-15T23:30:10.781801+0000","last_peered":"2024-02-15T23:30:10.781801+0000","last_clean":"2024-02-15T23:30:10.781801+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:30:10.781801+0000","last_undegraded":"2024-02-15T23:30:10.781801+0000","last_fullsized":"2024-02-15T23:30:10.781801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:25.706705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'11","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310331+0000","last_change":"2024-02-15T23:30:10.810101+0000","last_active":"2024-02-15T23:30:58.310331+0000","last_peered":"2024-02-15T23:30:58.310331+0000","last_clean":"2024-02-15T23:30:58.310331+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:30:58.310331+0000","last_undegraded":"2024-02-15T23:30:58.310331+0000","last_fullsized":"2024-02-15T23:30:58.310331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:00:04.499939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.071222+0000","last_change":"2024-02-15T23:29:29.733697+0000","last_active":"2024-02-15T23:30:15.071222+0000","last_peered":"2024-02-15T23:30:15.071222+0000","last_clean":"2024-02-15T23:30:15.071222+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:30:15.071222+0000","last_undegraded":"2024-02-15T23:30:15.071222+0000","last_fullsized":"2024-02-15T23:30:15.071222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786022+0000","last_change":"2024-02-15T23:29:21.627861+0000","last_active":"2024-02-15T23:30:10.786022+0000","last_peered":"2024-02-15T23:30:10.786022+0000","last_clean":"2024-02-15T23:30:10.786022+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:30:10.786022+0000","last_undegraded":"2024-02-15T23:30:10.786022+0000","last_fullsized":"2024-02-15T23:30:10.786022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:25:07.064306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.803638+0000","last_change":"2024-02-15T23:30:10.801694+0000","last_active":"2024-02-15T23:30:10.803638+0000","last_peered":"2024-02-15T23:30:10.803638+0000","last_clean":"2024-02-15T23:30:10.803638+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:30:10.803638+0000","last_undegraded":"2024-02-15T23:30:10.803638+0000","last_fullsized":"2024-02-15T23:30:10.803638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:04.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'62","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.910137+0000","last_change":"2024-02-15T23:29:35.740917+0000","last_active":"2024-02-15T23:31:11.910137+0000","last_peered":"2024-02-15T23:31:11.910137+0000","last_clean":"2024-02-15T23:31:11.910137+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:11.910137+0000","last_undegraded":"2024-02-15T23:31:11.910137+0000","last_fullsized":"2024-02-15T23:31:11.910137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:24.374012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.775299+0000","last_change":"2024-02-15T23:29:37.751356+0000","last_active":"2024-02-15T23:30:10.775299+0000","last_peered":"2024-02-15T23:30:10.775299+0000","last_clean":"2024-02-15T23:30:10.775299+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:30:10.775299+0000","last_undegraded":"2024-02-15T23:30:10.775299+0000","last_fullsized":"2024-02-15T23:30:10.775299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:21.661539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.296729+0000","last_change":"2024-02-15T23:29:39.767710+0000","last_active":"2024-02-15T23:30:58.296729+0000","last_peered":"2024-02-15T23:30:58.296729+0000","last_clean":"2024-02-15T23:30:58.296729+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:30:58.296729+0000","last_undegraded":"2024-02-15T23:30:58.296729+0000","last_fullsized":"2024-02-15T23:30:58.296729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:31:07.642735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.804317+0000","last_change":"2024-02-15T23:30:10.804317+0000","last_active":"2024-02-15T23:30:10.804317+0000","last_peered":"2024-02-15T23:30:10.804317+0000","last_clean":"2024-02-15T23:30:10.804317+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:30:10.804317+0000","last_undegraded":"2024-02-15T23:30:10.804317+0000","last_fullsized":"2024-02-15T23:30:10.804317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:30:30.019018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786948+0000","last_change":"2024-02-15T23:29:29.717068+0000","last_active":"2024-02-15T23:30:10.786948+0000","last_peered":"2024-02-15T23:30:10.786948+0000","last_clean":"2024-02-15T23:30:10.786948+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:30:10.786948+0000","last_undegraded":"2024-02-15T23:30:10.786948+0000","last_fullsized":"2024-02-15T23:30:10.786948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809253+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:30:10.809253+0000","last_peered":"2024-02-15T23:30:10.809253+0000","last_clean":"2024-02-15T23:30:10.809253+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:30:10.809253+0000","last_undegraded":"2024-02-15T23:30:10.809253+0000","last_fullsized":"2024-02-15T23:30:10.809253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:34.783207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798441+0000","last_change":"2024-02-15T23:29:33.715626+0000","last_active":"2024-02-15T23:30:10.798441+0000","last_peered":"2024-02-15T23:30:10.798441+0000","last_clean":"2024-02-15T23:30:10.798441+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:30:10.798441+0000","last_undegraded":"2024-02-15T23:30:10.798441+0000","last_fullsized":"2024-02-15T23:30:10.798441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:20.560304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783406+0000","last_change":"2024-02-15T23:29:35.733356+0000","last_active":"2024-02-15T23:30:10.783406+0000","last_peered":"2024-02-15T23:30:10.783406+0000","last_clean":"2024-02-15T23:30:10.783406+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:30:10.783406+0000","last_undegraded":"2024-02-15T23:30:10.783406+0000","last_fullsized":"2024-02-15T23:30:10.783406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:45:43.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":281,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.634939+0000","last_change":"2024-02-15T23:29:37.736088+0000","last_active":"2024-02-15T23:31:11.634939+0000","last_peered":"2024-02-15T23:31:11.634939+0000","last_clean":"2024-02-15T23:31:11.634939+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:11.634939+0000","last_undegraded":"2024-02-15T23:31:11.634939+0000","last_fullsized":"2024-02-15T23:31:11.634939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:40.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.909796+0000","last_change":"2024-02-15T23:29:39.771638+0000","last_active":"2024-02-15T23:31:03.909796+0000","last_peered":"2024-02-15T23:31:03.909796+0000","last_clean":"2024-02-15T23:31:03.909796+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:31:03.909796+0000","last_undegraded":"2024-02-15T23:31:03.909796+0000","last_fullsized":"2024-02-15T23:31:03.909796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:55.181212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796605+0000","last_change":"2024-02-15T23:29:31.701536+0000","last_active":"2024-02-15T23:30:10.796605+0000","last_peered":"2024-02-15T23:30:10.796605+0000","last_clean":"2024-02-15T23:30:10.796605+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:30:10.796605+0000","last_undegraded":"2024-02-15T23:30:10.796605+0000","last_fullsized":"2024-02-15T23:30:10.796605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:01.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.065461+0000","last_change":"2024-02-15T23:29:29.714312+0000","last_active":"2024-02-15T23:30:15.065461+0000","last_peered":"2024-02-15T23:30:15.065461+0000","last_clean":"2024-02-15T23:30:15.065461+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:30:15.065461+0000","last_undegraded":"2024-02-15T23:30:15.065461+0000","last_fullsized":"2024-02-15T23:30:15.065461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:33.379284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.788477+0000","last_change":"2024-02-15T23:29:21.629944+0000","last_active":"2024-02-15T23:30:10.788477+0000","last_peered":"2024-02-15T23:30:10.788477+0000","last_clean":"2024-02-15T23:30:10.788477+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:30:10.788477+0000","last_undegraded":"2024-02-15T23:30:10.788477+0000","last_fullsized":"2024-02-15T23:30:10.788477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:34:24.944867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794872+0000","last_change":"2024-02-15T23:29:33.715193+0000","last_active":"2024-02-15T23:30:10.794872+0000","last_peered":"2024-02-15T23:30:10.794872+0000","last_clean":"2024-02-15T23:30:10.794872+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:30:10.794872+0000","last_undegraded":"2024-02-15T23:30:10.794872+0000","last_fullsized":"2024-02-15T23:30:10.794872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:04.389424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806532+0000","last_change":"2024-02-15T23:29:35.749284+0000","last_active":"2024-02-15T23:30:10.806532+0000","last_peered":"2024-02-15T23:30:10.806532+0000","last_clean":"2024-02-15T23:30:10.806532+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:30:10.806532+0000","last_undegraded":"2024-02-15T23:30:10.806532+0000","last_fullsized":"2024-02-15T23:30:10.806532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:56.095538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.642085+0000","last_change":"2024-02-15T23:29:37.752616+0000","last_active":"2024-02-15T23:31:11.642085+0000","last_peered":"2024-02-15T23:31:11.642085+0000","last_clean":"2024-02-15T23:31:11.642085+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:11.642085+0000","last_undegraded":"2024-02-15T23:31:11.642085+0000","last_fullsized":"2024-02-15T23:31:11.642085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:51.505644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.298912+0000","last_change":"2024-02-15T23:29:39.760690+0000","last_active":"2024-02-15T23:30:58.298912+0000","last_peered":"2024-02-15T23:30:58.298912+0000","last_clean":"2024-02-15T23:30:58.298912+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:30:58.298912+0000","last_undegraded":"2024-02-15T23:30:58.298912+0000","last_fullsized":"2024-02-15T23:30:58.298912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:11.751170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924945+0000","last_change":"2024-02-15T23:29:31.709896+0000","last_active":"2024-02-15T23:31:03.924945+0000","last_peered":"2024-02-15T23:31:03.924945+0000","last_clean":"2024-02-15T23:31:03.924945+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:03.924945+0000","last_undegraded":"2024-02-15T23:31:03.924945+0000","last_fullsized":"2024-02-15T23:31:03.924945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:18.497832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786236+0000","last_change":"2024-02-15T23:29:29.720515+0000","last_active":"2024-02-15T23:30:10.786236+0000","last_peered":"2024-02-15T23:30:10.786236+0000","last_clean":"2024-02-15T23:30:10.786236+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:30:10.786236+0000","last_undegraded":"2024-02-15T23:30:10.786236+0000","last_fullsized":"2024-02-15T23:30:10.786236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813277+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:30:10.813277+0000","last_peered":"2024-02-15T23:30:10.813277+0000","last_clean":"2024-02-15T23:30:10.813277+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:30:10.813277+0000","last_undegraded":"2024-02-15T23:30:10.813277+0000","last_fullsized":"2024-02-15T23:30:10.813277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:17.587564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795011+0000","last_change":"2024-02-15T23:29:33.710000+0000","last_active":"2024-02-15T23:30:10.795011+0000","last_peered":"2024-02-15T23:30:10.795011+0000","last_clean":"2024-02-15T23:30:10.795011+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:30:10.795011+0000","last_undegraded":"2024-02-15T23:30:10.795011+0000","last_fullsized":"2024-02-15T23:30:10.795011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:36.677573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'85","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.882507+0000","last_change":"2024-02-15T23:29:35.717933+0000","last_active":"2024-02-15T23:31:11.882507+0000","last_peered":"2024-02-15T23:31:11.882507+0000","last_clean":"2024-02-15T23:31:11.882507+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:11.882507+0000","last_undegraded":"2024-02-15T23:31:11.882507+0000","last_fullsized":"2024-02-15T23:31:11.882507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:00.658332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784071+0000","last_change":"2024-02-15T23:29:37.739850+0000","last_active":"2024-02-15T23:30:10.784071+0000","last_peered":"2024-02-15T23:30:10.784071+0000","last_clean":"2024-02-15T23:30:10.784071+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:30:10.784071+0000","last_undegraded":"2024-02-15T23:30:10.784071+0000","last_fullsized":"2024-02-15T23:30:10.784071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:09:51.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780548+0000","last_change":"2024-02-15T23:29:39.781085+0000","last_active":"2024-02-15T23:30:10.780548+0000","last_peered":"2024-02-15T23:30:10.780548+0000","last_clean":"2024-02-15T23:30:10.780548+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:30:10.780548+0000","last_undegraded":"2024-02-15T23:30:10.780548+0000","last_fullsized":"2024-02-15T23:30:10.780548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:01.196312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779929+0000","last_change":"2024-02-15T23:29:39.777993+0000","last_active":"2024-02-15T23:30:10.779929+0000","last_peered":"2024-02-15T23:30:10.779929+0000","last_clean":"2024-02-15T23:30:10.779929+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:30:10.779929+0000","last_undegraded":"2024-02-15T23:30:10.779929+0000","last_fullsized":"2024-02-15T23:30:10.779929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:53.518170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784494+0000","last_change":"2024-02-15T23:29:31.704768+0000","last_active":"2024-02-15T23:30:10.784494+0000","last_peered":"2024-02-15T23:30:10.784494+0000","last_clean":"2024-02-15T23:30:10.784494+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:30:10.784494+0000","last_undegraded":"2024-02-15T23:30:10.784494+0000","last_fullsized":"2024-02-15T23:30:10.784494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:16.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807765+0000","last_change":"2024-02-15T23:29:29.728542+0000","last_active":"2024-02-15T23:30:10.807765+0000","last_peered":"2024-02-15T23:30:10.807765+0000","last_clean":"2024-02-15T23:30:10.807765+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:30:10.807765+0000","last_undegraded":"2024-02-15T23:30:10.807765+0000","last_fullsized":"2024-02-15T23:30:10.807765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:05.901551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'2","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.599721+0000","last_change":"2024-02-15T23:29:33.711524+0000","last_active":"2024-02-15T23:31:11.599721+0000","last_peered":"2024-02-15T23:31:11.599721+0000","last_clean":"2024-02-15T23:31:11.599721+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:11.599721+0000","last_undegraded":"2024-02-15T23:31:11.599721+0000","last_fullsized":"2024-02-15T23:31:11.599721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:03.277817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.745329+0000","last_change":"2024-02-15T23:29:35.746240+0000","last_active":"2024-02-15T23:31:11.745329+0000","last_peered":"2024-02-15T23:31:11.745329+0000","last_clean":"2024-02-15T23:31:11.745329+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:31:11.745329+0000","last_undegraded":"2024-02-15T23:31:11.745329+0000","last_fullsized":"2024-02-15T23:31:11.745329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:31:03.614237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797557+0000","last_change":"2024-02-15T23:29:37.765986+0000","last_active":"2024-02-15T23:30:10.797557+0000","last_peered":"2024-02-15T23:30:10.797557+0000","last_clean":"2024-02-15T23:30:10.797557+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:30:10.797557+0000","last_undegraded":"2024-02-15T23:30:10.797557+0000","last_fullsized":"2024-02-15T23:30:10.797557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:38.382170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786394+0000","last_change":"2024-02-15T23:29:39.766083+0000","last_active":"2024-02-15T23:30:10.786394+0000","last_peered":"2024-02-15T23:30:10.786394+0000","last_clean":"2024-02-15T23:30:10.786394+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:30:10.786394+0000","last_undegraded":"2024-02-15T23:30:10.786394+0000","last_fullsized":"2024-02-15T23:30:10.786394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:11.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091281+0000","last_change":"2024-02-15T23:29:31.711705+0000","last_active":"2024-02-15T23:30:15.091281+0000","last_peered":"2024-02-15T23:30:15.091281+0000","last_clean":"2024-02-15T23:30:15.091281+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:30:15.091281+0000","last_undegraded":"2024-02-15T23:30:15.091281+0000","last_fullsized":"2024-02-15T23:30:15.091281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:49.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777397+0000","last_change":"2024-02-15T23:29:29.723948+0000","last_active":"2024-02-15T23:30:10.777397+0000","last_peered":"2024-02-15T23:30:10.777397+0000","last_clean":"2024-02-15T23:30:10.777397+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:30:10.777397+0000","last_undegraded":"2024-02-15T23:30:10.777397+0000","last_fullsized":"2024-02-15T23:30:10.777397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.803790+0000","last_change":"2024-02-15T23:29:33.710951+0000","last_active":"2024-02-15T23:30:10.803790+0000","last_peered":"2024-02-15T23:30:10.803790+0000","last_clean":"2024-02-15T23:30:10.803790+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:30:10.803790+0000","last_undegraded":"2024-02-15T23:30:10.803790+0000","last_fullsized":"2024-02-15T23:30:10.803790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:33.779707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:50.920531+0000","last_change":"2024-02-15T23:29:35.722170+0000","last_active":"2024-02-15T23:30:50.920531+0000","last_peered":"2024-02-15T23:30:50.920531+0000","last_clean":"2024-02-15T23:30:50.920531+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:30:50.920531+0000","last_undegraded":"2024-02-15T23:30:50.920531+0000","last_fullsized":"2024-02-15T23:30:50.920531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:26.740928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776127+0000","last_change":"2024-02-15T23:29:37.766413+0000","last_active":"2024-02-15T23:30:10.776127+0000","last_peered":"2024-02-15T23:30:10.776127+0000","last_clean":"2024-02-15T23:30:10.776127+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:30:10.776127+0000","last_undegraded":"2024-02-15T23:30:10.776127+0000","last_fullsized":"2024-02-15T23:30:10.776127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:58.577241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786018+0000","last_change":"2024-02-15T23:29:39.783805+0000","last_active":"2024-02-15T23:30:10.786018+0000","last_peered":"2024-02-15T23:30:10.786018+0000","last_clean":"2024-02-15T23:30:10.786018+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:30:10.786018+0000","last_undegraded":"2024-02-15T23:30:10.786018+0000","last_fullsized":"2024-02-15T23:30:10.786018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:11.751170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'9","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.309917+0000","last_change":"2024-02-15T23:29:31.709732+0000","last_active":"2024-02-15T23:30:58.309917+0000","last_peered":"2024-02-15T23:30:58.309917+0000","last_clean":"2024-02-15T23:30:58.309917+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:30:58.309917+0000","last_undegraded":"2024-02-15T23:30:58.309917+0000","last_fullsized":"2024-02-15T23:30:58.309917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:04.855243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780146+0000","last_change":"2024-02-15T23:29:29.723953+0000","last_active":"2024-02-15T23:30:10.780146+0000","last_peered":"2024-02-15T23:30:10.780146+0000","last_clean":"2024-02-15T23:30:10.780146+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:30:10.780146+0000","last_undegraded":"2024-02-15T23:30:10.780146+0000","last_fullsized":"2024-02-15T23:30:10.780146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:39.162600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776922+0000","last_change":"2024-02-15T23:29:33.712933+0000","last_active":"2024-02-15T23:30:10.776922+0000","last_peered":"2024-02-15T23:30:10.776922+0000","last_clean":"2024-02-15T23:30:10.776922+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:30:10.776922+0000","last_undegraded":"2024-02-15T23:30:10.776922+0000","last_fullsized":"2024-02-15T23:30:10.776922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:54:18.393325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'39","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.891558+0000","last_change":"2024-02-15T23:29:35.726851+0000","last_active":"2024-02-15T23:31:11.891558+0000","last_peered":"2024-02-15T23:31:11.891558+0000","last_clean":"2024-02-15T23:31:11.891558+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:11.891558+0000","last_undegraded":"2024-02-15T23:31:11.891558+0000","last_fullsized":"2024-02-15T23:31:11.891558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:27:19.645566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782738+0000","last_change":"2024-02-15T23:29:37.733211+0000","last_active":"2024-02-15T23:30:10.782738+0000","last_peered":"2024-02-15T23:30:10.782738+0000","last_clean":"2024-02-15T23:30:10.782738+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:30:10.782738+0000","last_undegraded":"2024-02-15T23:30:10.782738+0000","last_fullsized":"2024-02-15T23:30:10.782738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:58.620898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806839+0000","last_change":"2024-02-15T23:29:39.784430+0000","last_active":"2024-02-15T23:30:10.806839+0000","last_peered":"2024-02-15T23:30:10.806839+0000","last_clean":"2024-02-15T23:30:10.806839+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:30:10.806839+0000","last_undegraded":"2024-02-15T23:30:10.806839+0000","last_fullsized":"2024-02-15T23:30:10.806839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:55:47.209181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310633+0000","last_change":"2024-02-15T23:29:31.701986+0000","last_active":"2024-02-15T23:30:58.310633+0000","last_peered":"2024-02-15T23:30:58.310633+0000","last_clean":"2024-02-15T23:30:58.310633+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:30:58.310633+0000","last_undegraded":"2024-02-15T23:30:58.310633+0000","last_fullsized":"2024-02-15T23:30:58.310633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:11.385662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792688+0000","last_change":"2024-02-15T23:29:29.736668+0000","last_active":"2024-02-15T23:30:10.792688+0000","last_peered":"2024-02-15T23:30:10.792688+0000","last_clean":"2024-02-15T23:30:10.792688+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:30:10.792688+0000","last_undegraded":"2024-02-15T23:30:10.792688+0000","last_fullsized":"2024-02-15T23:30:10.792688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:54.141348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794825+0000","last_change":"2024-02-15T23:29:33.715292+0000","last_active":"2024-02-15T23:30:10.794825+0000","last_peered":"2024-02-15T23:30:10.794825+0000","last_clean":"2024-02-15T23:30:10.794825+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:30:10.794825+0000","last_undegraded":"2024-02-15T23:30:10.794825+0000","last_fullsized":"2024-02-15T23:30:10.794825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:16.607064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.865997+0000","last_change":"2024-02-15T23:29:35.716431+0000","last_active":"2024-02-15T23:31:11.865997+0000","last_peered":"2024-02-15T23:31:11.865997+0000","last_clean":"2024-02-15T23:31:11.865997+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:31:11.865997+0000","last_undegraded":"2024-02-15T23:31:11.865997+0000","last_fullsized":"2024-02-15T23:31:11.865997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:40.269355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779398+0000","last_change":"2024-02-15T23:29:37.763224+0000","last_active":"2024-02-15T23:30:10.779398+0000","last_peered":"2024-02-15T23:30:10.779398+0000","last_clean":"2024-02-15T23:30:10.779398+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:30:10.779398+0000","last_undegraded":"2024-02-15T23:30:10.779398+0000","last_fullsized":"2024-02-15T23:30:10.779398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:05.584865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.814385+0000","last_change":"2024-02-15T23:29:31.705672+0000","last_active":"2024-02-15T23:30:10.814385+0000","last_peered":"2024-02-15T23:30:10.814385+0000","last_clean":"2024-02-15T23:30:10.814385+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:30:10.814385+0000","last_undegraded":"2024-02-15T23:30:10.814385+0000","last_fullsized":"2024-02-15T23:30:10.814385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:22:55.414951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795287+0000","last_change":"2024-02-15T23:29:29.721645+0000","last_active":"2024-02-15T23:30:10.795287+0000","last_peered":"2024-02-15T23:30:10.795287+0000","last_clean":"2024-02-15T23:30:10.795287+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:30:10.795287+0000","last_undegraded":"2024-02-15T23:30:10.795287+0000","last_fullsized":"2024-02-15T23:30:10.795287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:53:31.617349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790215+0000","last_change":"2024-02-15T23:29:33.720987+0000","last_active":"2024-02-15T23:30:10.790215+0000","last_peered":"2024-02-15T23:30:10.790215+0000","last_clean":"2024-02-15T23:30:10.790215+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:30:10.790215+0000","last_undegraded":"2024-02-15T23:30:10.790215+0000","last_fullsized":"2024-02-15T23:30:10.790215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:40.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'57","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.856577+0000","last_change":"2024-02-15T23:29:35.721819+0000","last_active":"2024-02-15T23:31:11.856577+0000","last_peered":"2024-02-15T23:31:11.856577+0000","last_clean":"2024-02-15T23:31:11.856577+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:11.856577+0000","last_undegraded":"2024-02-15T23:31:11.856577+0000","last_fullsized":"2024-02-15T23:31:11.856577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:56.561268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777783+0000","last_change":"2024-02-15T23:29:37.763301+0000","last_active":"2024-02-15T23:30:10.777783+0000","last_peered":"2024-02-15T23:30:10.777783+0000","last_clean":"2024-02-15T23:30:10.777783+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:30:10.777783+0000","last_undegraded":"2024-02-15T23:30:10.777783+0000","last_fullsized":"2024-02-15T23:30:10.777783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:52:07.386784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.643303+0000","last_change":"2024-02-15T23:29:39.778768+0000","last_active":"2024-02-15T23:30:57.643303+0000","last_peered":"2024-02-15T23:30:57.643303+0000","last_clean":"2024-02-15T23:30:57.643303+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:30:57.643303+0000","last_undegraded":"2024-02-15T23:30:57.643303+0000","last_fullsized":"2024-02-15T23:30:57.643303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.769044+0000","last_change":"2024-02-15T23:29:31.695343+0000","last_active":"2024-02-15T23:30:15.769044+0000","last_peered":"2024-02-15T23:30:15.769044+0000","last_clean":"2024-02-15T23:30:15.769044+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:30:15.769044+0000","last_undegraded":"2024-02-15T23:30:15.769044+0000","last_fullsized":"2024-02-15T23:30:15.769044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:35.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782323+0000","last_change":"2024-02-15T23:29:29.737932+0000","last_active":"2024-02-15T23:30:10.782323+0000","last_peered":"2024-02-15T23:30:10.782323+0000","last_clean":"2024-02-15T23:30:10.782323+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:30:10.782323+0000","last_undegraded":"2024-02-15T23:30:10.782323+0000","last_fullsized":"2024-02-15T23:30:10.782323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:33.340052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781017+0000","last_change":"2024-02-15T23:29:33.704716+0000","last_active":"2024-02-15T23:30:10.781017+0000","last_peered":"2024-02-15T23:30:10.781017+0000","last_clean":"2024-02-15T23:30:10.781017+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:30:10.781017+0000","last_undegraded":"2024-02-15T23:30:10.781017+0000","last_fullsized":"2024-02-15T23:30:10.781017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:43:47.043349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.874717+0000","last_change":"2024-02-15T23:29:35.746767+0000","last_active":"2024-02-15T23:31:11.874717+0000","last_peered":"2024-02-15T23:31:11.874717+0000","last_clean":"2024-02-15T23:31:11.874717+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:31:11.874717+0000","last_undegraded":"2024-02-15T23:31:11.874717+0000","last_fullsized":"2024-02-15T23:31:11.874717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:20.637953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787004+0000","last_change":"2024-02-15T23:29:37.760362+0000","last_active":"2024-02-15T23:30:10.787004+0000","last_peered":"2024-02-15T23:30:10.787004+0000","last_clean":"2024-02-15T23:30:10.787004+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:30:10.787004+0000","last_undegraded":"2024-02-15T23:30:10.787004+0000","last_fullsized":"2024-02-15T23:30:10.787004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:26:31.398449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797516+0000","last_change":"2024-02-15T23:29:39.769995+0000","last_active":"2024-02-15T23:30:10.797516+0000","last_peered":"2024-02-15T23:30:10.797516+0000","last_clean":"2024-02-15T23:30:10.797516+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:30:10.797516+0000","last_undegraded":"2024-02-15T23:30:10.797516+0000","last_fullsized":"2024-02-15T23:30:10.797516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:17.415321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924750+0000","last_change":"2024-02-15T23:29:31.709284+0000","last_active":"2024-02-15T23:31:03.924750+0000","last_peered":"2024-02-15T23:31:03.924750+0000","last_clean":"2024-02-15T23:31:03.924750+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:03.924750+0000","last_undegraded":"2024-02-15T23:31:03.924750+0000","last_fullsized":"2024-02-15T23:31:03.924750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:28.678586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.075644+0000","last_change":"2024-02-15T23:29:29.706515+0000","last_active":"2024-02-15T23:30:15.075644+0000","last_peered":"2024-02-15T23:30:15.075644+0000","last_clean":"2024-02-15T23:30:15.075644+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:30:15.075644+0000","last_undegraded":"2024-02-15T23:30:15.075644+0000","last_fullsized":"2024-02-15T23:30:15.075644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.779703+0000","last_change":"2024-02-15T23:29:33.707077+0000","last_active":"2024-02-15T23:30:10.779703+0000","last_peered":"2024-02-15T23:30:10.779703+0000","last_clean":"2024-02-15T23:30:10.779703+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:30:10.779703+0000","last_undegraded":"2024-02-15T23:30:10.779703+0000","last_fullsized":"2024-02-15T23:30:10.779703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:52.708213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.765249+0000","last_change":"2024-02-15T23:29:35.740799+0000","last_active":"2024-02-15T23:31:11.765249+0000","last_peered":"2024-02-15T23:31:11.765249+0000","last_clean":"2024-02-15T23:31:11.765249+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:31:11.765249+0000","last_undegraded":"2024-02-15T23:31:11.765249+0000","last_fullsized":"2024-02-15T23:31:11.765249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:03.568892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787613+0000","last_change":"2024-02-15T23:29:37.765611+0000","last_active":"2024-02-15T23:30:10.787613+0000","last_peered":"2024-02-15T23:30:10.787613+0000","last_clean":"2024-02-15T23:30:10.787613+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:30:10.787613+0000","last_undegraded":"2024-02-15T23:30:10.787613+0000","last_fullsized":"2024-02-15T23:30:10.787613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:55:20.640463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797644+0000","last_change":"2024-02-15T23:29:39.769430+0000","last_active":"2024-02-15T23:30:10.797644+0000","last_peered":"2024-02-15T23:30:10.797644+0000","last_clean":"2024-02-15T23:30:10.797644+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:30:10.797644+0000","last_undegraded":"2024-02-15T23:30:10.797644+0000","last_fullsized":"2024-02-15T23:30:10.797644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:09:59.883710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791011+0000","last_change":"2024-02-15T23:29:31.691631+0000","last_active":"2024-02-15T23:30:10.791011+0000","last_peered":"2024-02-15T23:30:10.791011+0000","last_clean":"2024-02-15T23:30:10.791011+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:30:10.791011+0000","last_undegraded":"2024-02-15T23:30:10.791011+0000","last_fullsized":"2024-02-15T23:30:10.791011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805500+0000","last_change":"2024-02-15T23:29:29.720236+0000","last_active":"2024-02-15T23:30:10.805500+0000","last_peered":"2024-02-15T23:30:10.805500+0000","last_clean":"2024-02-15T23:30:10.805500+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:30:10.805500+0000","last_undegraded":"2024-02-15T23:30:10.805500+0000","last_fullsized":"2024-02-15T23:30:10.805500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:14.660978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787495+0000","last_change":"2024-02-15T23:29:33.711713+0000","last_active":"2024-02-15T23:30:10.787495+0000","last_peered":"2024-02-15T23:30:10.787495+0000","last_clean":"2024-02-15T23:30:10.787495+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:30:10.787495+0000","last_undegraded":"2024-02-15T23:30:10.787495+0000","last_fullsized":"2024-02-15T23:30:10.787495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:22.356586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810657+0000","last_change":"2024-02-15T23:29:35.751777+0000","last_active":"2024-02-15T23:30:10.810657+0000","last_peered":"2024-02-15T23:30:10.810657+0000","last_clean":"2024-02-15T23:30:10.810657+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:30:10.810657+0000","last_undegraded":"2024-02-15T23:30:10.810657+0000","last_fullsized":"2024-02-15T23:30:10.810657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:30:34.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":293,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.631415+0000","last_change":"2024-02-15T23:29:37.767386+0000","last_active":"2024-02-15T23:31:11.631415+0000","last_peered":"2024-02-15T23:31:11.631415+0000","last_clean":"2024-02-15T23:31:11.631415+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:11.631415+0000","last_undegraded":"2024-02-15T23:31:11.631415+0000","last_fullsized":"2024-02-15T23:31:11.631415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:38.436613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.793935+0000","last_change":"2024-02-15T23:29:39.775113+0000","last_active":"2024-02-15T23:30:10.793935+0000","last_peered":"2024-02-15T23:30:10.793935+0000","last_clean":"2024-02-15T23:30:10.793935+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:30:10.793935+0000","last_undegraded":"2024-02-15T23:30:10.793935+0000","last_fullsized":"2024-02-15T23:30:10.793935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:40:43.570670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.765400+0000","last_change":"2024-02-15T23:29:31.684239+0000","last_active":"2024-02-15T23:30:15.765400+0000","last_peered":"2024-02-15T23:30:15.765400+0000","last_clean":"2024-02-15T23:30:15.765400+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:30:15.765400+0000","last_undegraded":"2024-02-15T23:30:15.765400+0000","last_fullsized":"2024-02-15T23:30:15.765400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:57.286122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796635+0000","last_change":"2024-02-15T23:29:29.725067+0000","last_active":"2024-02-15T23:30:10.796635+0000","last_peered":"2024-02-15T23:30:10.796635+0000","last_clean":"2024-02-15T23:30:10.796635+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:30:10.796635+0000","last_undegraded":"2024-02-15T23:30:10.796635+0000","last_fullsized":"2024-02-15T23:30:10.796635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783024+0000","last_change":"2024-02-15T23:29:33.718484+0000","last_active":"2024-02-15T23:30:10.783024+0000","last_peered":"2024-02-15T23:30:10.783024+0000","last_clean":"2024-02-15T23:30:10.783024+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:30:10.783024+0000","last_undegraded":"2024-02-15T23:30:10.783024+0000","last_fullsized":"2024-02-15T23:30:10.783024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:12.597571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.808246+0000","last_change":"2024-02-15T23:29:35.728335+0000","last_active":"2024-02-15T23:31:11.808246+0000","last_peered":"2024-02-15T23:31:11.808246+0000","last_clean":"2024-02-15T23:31:11.808246+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:31:11.808246+0000","last_undegraded":"2024-02-15T23:31:11.808246+0000","last_fullsized":"2024-02-15T23:31:11.808246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:23:19.485322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783428+0000","last_change":"2024-02-15T23:29:37.763470+0000","last_active":"2024-02-15T23:30:10.783428+0000","last_peered":"2024-02-15T23:30:10.783428+0000","last_clean":"2024-02-15T23:30:10.783428+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:30:10.783428+0000","last_undegraded":"2024-02-15T23:30:10.783428+0000","last_fullsized":"2024-02-15T23:30:10.783428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:48:48.322860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795923+0000","last_change":"2024-02-15T23:29:39.782265+0000","last_active":"2024-02-15T23:30:10.795923+0000","last_peered":"2024-02-15T23:30:10.795923+0000","last_clean":"2024-02-15T23:30:10.795923+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:30:10.795923+0000","last_undegraded":"2024-02-15T23:30:10.795923+0000","last_fullsized":"2024-02-15T23:30:10.795923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:23:29.582392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.751269+0000","last_change":"2024-02-15T23:29:31.685467+0000","last_active":"2024-02-15T23:30:14.751269+0000","last_peered":"2024-02-15T23:30:14.751269+0000","last_clean":"2024-02-15T23:30:14.751269+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:30:14.751269+0000","last_undegraded":"2024-02-15T23:30:14.751269+0000","last_fullsized":"2024-02-15T23:30:14.751269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:49.264719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809512+0000","last_change":"2024-02-15T23:29:29.728334+0000","last_active":"2024-02-15T23:30:10.809512+0000","last_peered":"2024-02-15T23:30:10.809512+0000","last_clean":"2024-02-15T23:30:10.809512+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:30:10.809512+0000","last_undegraded":"2024-02-15T23:30:10.809512+0000","last_fullsized":"2024-02-15T23:30:10.809512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:02.838388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785093+0000","last_change":"2024-02-15T23:29:33.707600+0000","last_active":"2024-02-15T23:30:10.785093+0000","last_peered":"2024-02-15T23:30:10.785093+0000","last_clean":"2024-02-15T23:30:10.785093+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:30:10.785093+0000","last_undegraded":"2024-02-15T23:30:10.785093+0000","last_fullsized":"2024-02-15T23:30:10.785093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:35.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'34","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.816303+0000","last_change":"2024-02-15T23:29:35.719654+0000","last_active":"2024-02-15T23:31:11.816303+0000","last_peered":"2024-02-15T23:31:11.816303+0000","last_clean":"2024-02-15T23:31:11.816303+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:31:11.816303+0000","last_undegraded":"2024-02-15T23:31:11.816303+0000","last_fullsized":"2024-02-15T23:31:11.816303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:14.904715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794382+0000","last_change":"2024-02-15T23:29:37.765925+0000","last_active":"2024-02-15T23:30:10.794382+0000","last_peered":"2024-02-15T23:30:10.794382+0000","last_clean":"2024-02-15T23:30:10.794382+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:30:10.794382+0000","last_undegraded":"2024-02-15T23:30:10.794382+0000","last_fullsized":"2024-02-15T23:30:10.794382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:47.006455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813342+0000","last_change":"2024-02-15T23:29:39.784125+0000","last_active":"2024-02-15T23:30:10.813342+0000","last_peered":"2024-02-15T23:30:10.813342+0000","last_clean":"2024-02-15T23:30:10.813342+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:30:10.813342+0000","last_undegraded":"2024-02-15T23:30:10.813342+0000","last_fullsized":"2024-02-15T23:30:10.813342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:38.708272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795106+0000","last_change":"2024-02-15T23:29:31.701274+0000","last_active":"2024-02-15T23:30:10.795106+0000","last_peered":"2024-02-15T23:30:10.795106+0000","last_clean":"2024-02-15T23:30:10.795106+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:30:10.795106+0000","last_undegraded":"2024-02-15T23:30:10.795106+0000","last_fullsized":"2024-02-15T23:30:10.795106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:10.874498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790293+0000","last_change":"2024-02-15T23:29:29.717620+0000","last_active":"2024-02-15T23:30:10.790293+0000","last_peered":"2024-02-15T23:30:10.790293+0000","last_clean":"2024-02-15T23:30:10.790293+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:30:10.790293+0000","last_undegraded":"2024-02-15T23:30:10.790293+0000","last_fullsized":"2024-02-15T23:30:10.790293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:13.963017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.598884+0000","last_change":"2024-02-15T23:29:33.718676+0000","last_active":"2024-02-15T23:31:11.598884+0000","last_peered":"2024-02-15T23:31:11.598884+0000","last_clean":"2024-02-15T23:31:11.598884+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:11.598884+0000","last_undegraded":"2024-02-15T23:31:11.598884+0000","last_fullsized":"2024-02-15T23:31:11.598884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:39.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'27","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.754125+0000","last_change":"2024-02-15T23:29:35.752343+0000","last_active":"2024-02-15T23:31:11.754125+0000","last_peered":"2024-02-15T23:31:11.754125+0000","last_clean":"2024-02-15T23:31:11.754125+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:31:11.754125+0000","last_undegraded":"2024-02-15T23:31:11.754125+0000","last_fullsized":"2024-02-15T23:31:11.754125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:33.613231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798971+0000","last_change":"2024-02-15T23:29:37.770670+0000","last_active":"2024-02-15T23:30:10.798971+0000","last_peered":"2024-02-15T23:30:10.798971+0000","last_clean":"2024-02-15T23:30:10.798971+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:30:10.798971+0000","last_undegraded":"2024-02-15T23:30:10.798971+0000","last_fullsized":"2024-02-15T23:30:10.798971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:36.321730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807623+0000","last_change":"2024-02-15T23:29:39.784728+0000","last_active":"2024-02-15T23:30:10.807623+0000","last_peered":"2024-02-15T23:30:10.807623+0000","last_clean":"2024-02-15T23:30:10.807623+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:30:10.807623+0000","last_undegraded":"2024-02-15T23:30:10.807623+0000","last_fullsized":"2024-02-15T23:30:10.807623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:48.823664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.765342+0000","last_change":"2024-02-15T23:29:31.684323+0000","last_active":"2024-02-15T23:30:15.765342+0000","last_peered":"2024-02-15T23:30:15.765342+0000","last_clean":"2024-02-15T23:30:15.765342+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:30:15.765342+0000","last_undegraded":"2024-02-15T23:30:15.765342+0000","last_fullsized":"2024-02-15T23:30:15.765342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:28.332760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792855+0000","last_change":"2024-02-15T23:29:29.719123+0000","last_active":"2024-02-15T23:30:10.792855+0000","last_peered":"2024-02-15T23:30:10.792855+0000","last_clean":"2024-02-15T23:30:10.792855+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:30:10.792855+0000","last_undegraded":"2024-02-15T23:30:10.792855+0000","last_fullsized":"2024-02-15T23:30:10.792855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:09.622828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783243+0000","last_change":"2024-02-15T23:29:33.718106+0000","last_active":"2024-02-15T23:30:10.783243+0000","last_peered":"2024-02-15T23:30:10.783243+0000","last_clean":"2024-02-15T23:30:10.783243+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:30:10.783243+0000","last_undegraded":"2024-02-15T23:30:10.783243+0000","last_fullsized":"2024-02-15T23:30:10.783243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:13.398453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.772613+0000","last_change":"2024-02-15T23:29:35.748095+0000","last_active":"2024-02-15T23:31:11.772613+0000","last_peered":"2024-02-15T23:31:11.772613+0000","last_clean":"2024-02-15T23:31:11.772613+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:11.772613+0000","last_undegraded":"2024-02-15T23:31:11.772613+0000","last_fullsized":"2024-02-15T23:31:11.772613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:34:58.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785313+0000","last_change":"2024-02-15T23:29:37.764100+0000","last_active":"2024-02-15T23:30:10.785313+0000","last_peered":"2024-02-15T23:30:10.785313+0000","last_clean":"2024-02-15T23:30:10.785313+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:30:10.785313+0000","last_undegraded":"2024-02-15T23:30:10.785313+0000","last_fullsized":"2024-02-15T23:30:10.785313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:23:59.183786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.051571+0000","last_change":"2024-02-15T23:29:39.784447+0000","last_active":"2024-02-15T23:30:15.051571+0000","last_peered":"2024-02-15T23:30:15.051571+0000","last_clean":"2024-02-15T23:30:15.051571+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:30:15.051571+0000","last_undegraded":"2024-02-15T23:30:15.051571+0000","last_fullsized":"2024-02-15T23:30:15.051571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:42.388138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796691+0000","last_change":"2024-02-15T23:29:31.710180+0000","last_active":"2024-02-15T23:30:10.796691+0000","last_peered":"2024-02-15T23:30:10.796691+0000","last_clean":"2024-02-15T23:30:10.796691+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:30:10.796691+0000","last_undegraded":"2024-02-15T23:30:10.796691+0000","last_fullsized":"2024-02-15T23:30:10.796691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:43.016654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.775086+0000","last_change":"2024-02-15T23:29:29.733523+0000","last_active":"2024-02-15T23:30:10.775086+0000","last_peered":"2024-02-15T23:30:10.775086+0000","last_clean":"2024-02-15T23:30:10.775086+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:30:10.775086+0000","last_undegraded":"2024-02-15T23:30:10.775086+0000","last_fullsized":"2024-02-15T23:30:10.775086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:35.831875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.293732+0000","last_change":"2024-02-15T23:29:31.689326+0000","last_active":"2024-02-15T23:30:14.293732+0000","last_peered":"2024-02-15T23:30:14.293732+0000","last_clean":"2024-02-15T23:30:14.293732+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:30:14.293732+0000","last_undegraded":"2024-02-15T23:30:14.293732+0000","last_fullsized":"2024-02-15T23:30:14.293732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:41.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783852+0000","last_change":"2024-02-15T23:29:29.708496+0000","last_active":"2024-02-15T23:30:10.783852+0000","last_peered":"2024-02-15T23:30:10.783852+0000","last_clean":"2024-02-15T23:30:10.783852+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:30:10.783852+0000","last_undegraded":"2024-02-15T23:30:10.783852+0000","last_fullsized":"2024-02-15T23:30:10.783852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:28.358603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924796+0000","last_change":"2024-02-15T23:29:31.705760+0000","last_active":"2024-02-15T23:31:03.924796+0000","last_peered":"2024-02-15T23:31:03.924796+0000","last_clean":"2024-02-15T23:31:03.924796+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:03.924796+0000","last_undegraded":"2024-02-15T23:31:03.924796+0000","last_fullsized":"2024-02-15T23:31:03.924796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:52:01.340593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799615+0000","last_change":"2024-02-15T23:29:29.728191+0000","last_active":"2024-02-15T23:30:10.799615+0000","last_peered":"2024-02-15T23:30:10.799615+0000","last_clean":"2024-02-15T23:30:10.799615+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:30:10.799615+0000","last_undegraded":"2024-02-15T23:30:10.799615+0000","last_fullsized":"2024-02-15T23:30:10.799615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:21.821782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924754+0000","last_change":"2024-02-15T23:29:31.693908+0000","last_active":"2024-02-15T23:31:03.924754+0000","last_peered":"2024-02-15T23:31:03.924754+0000","last_clean":"2024-02-15T23:31:03.924754+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:03.924754+0000","last_undegraded":"2024-02-15T23:31:03.924754+0000","last_fullsized":"2024-02-15T23:31:03.924754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:49.264719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787153+0000","last_change":"2024-02-15T23:29:29.707236+0000","last_active":"2024-02-15T23:30:10.787153+0000","last_peered":"2024-02-15T23:30:10.787153+0000","last_clean":"2024-02-15T23:30:10.787153+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:30:10.787153+0000","last_undegraded":"2024-02-15T23:30:10.787153+0000","last_fullsized":"2024-02-15T23:30:10.787153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:41.746941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.924794+0000","last_change":"2024-02-15T23:29:31.709341+0000","last_active":"2024-02-15T23:31:03.924794+0000","last_peered":"2024-02-15T23:31:03.924794+0000","last_clean":"2024-02-15T23:31:03.924794+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:03.924794+0000","last_undegraded":"2024-02-15T23:31:03.924794+0000","last_fullsized":"2024-02-15T23:31:03.924794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:04:16.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787213+0000","last_change":"2024-02-15T23:29:29.716033+0000","last_active":"2024-02-15T23:30:10.787213+0000","last_peered":"2024-02-15T23:30:10.787213+0000","last_clean":"2024-02-15T23:30:10.787213+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:30:10.787213+0000","last_undegraded":"2024-02-15T23:30:10.787213+0000","last_fullsized":"2024-02-15T23:30:10.787213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310211+0000","last_change":"2024-02-15T23:29:31.704944+0000","last_active":"2024-02-15T23:30:58.310211+0000","last_peered":"2024-02-15T23:30:58.310211+0000","last_clean":"2024-02-15T23:30:58.310211+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:30:58.310211+0000","last_undegraded":"2024-02-15T23:30:58.310211+0000","last_fullsized":"2024-02-15T23:30:58.310211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:21:12.839930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787672+0000","last_change":"2024-02-15T23:29:29.738175+0000","last_active":"2024-02-15T23:30:10.787672+0000","last_peered":"2024-02-15T23:30:10.787672+0000","last_clean":"2024-02-15T23:30:10.787672+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:30:10.787672+0000","last_undegraded":"2024-02-15T23:30:10.787672+0000","last_fullsized":"2024-02-15T23:30:10.787672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785339+0000","last_change":"2024-02-15T23:29:31.695350+0000","last_active":"2024-02-15T23:30:10.785339+0000","last_peered":"2024-02-15T23:30:10.785339+0000","last_clean":"2024-02-15T23:30:10.785339+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:30:10.785339+0000","last_undegraded":"2024-02-15T23:30:10.785339+0000","last_fullsized":"2024-02-15T23:30:10.785339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:21.379451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780402+0000","last_change":"2024-02-15T23:29:29.731948+0000","last_active":"2024-02-15T23:30:10.780402+0000","last_peered":"2024-02-15T23:30:10.780402+0000","last_clean":"2024-02-15T23:30:10.780402+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:30:10.780402+0000","last_undegraded":"2024-02-15T23:30:10.780402+0000","last_fullsized":"2024-02-15T23:30:10.780402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:52:23.522082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.925201+0000","last_change":"2024-02-15T23:29:31.693023+0000","last_active":"2024-02-15T23:31:03.925201+0000","last_peered":"2024-02-15T23:31:03.925201+0000","last_clean":"2024-02-15T23:31:03.925201+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:03.925201+0000","last_undegraded":"2024-02-15T23:31:03.925201+0000","last_fullsized":"2024-02-15T23:31:03.925201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:31.456171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790918+0000","last_change":"2024-02-15T23:29:29.710596+0000","last_active":"2024-02-15T23:30:10.790918+0000","last_peered":"2024-02-15T23:30:10.790918+0000","last_clean":"2024-02-15T23:30:10.790918+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:30:10.790918+0000","last_undegraded":"2024-02-15T23:30:10.790918+0000","last_fullsized":"2024-02-15T23:30:10.790918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:59.335058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796948+0000","last_change":"2024-02-15T23:29:31.689541+0000","last_active":"2024-02-15T23:30:10.796948+0000","last_peered":"2024-02-15T23:30:10.796948+0000","last_clean":"2024-02-15T23:30:10.796948+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:30:10.796948+0000","last_undegraded":"2024-02-15T23:30:10.796948+0000","last_fullsized":"2024-02-15T23:30:10.796948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:17:51.240648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795824+0000","last_change":"2024-02-15T23:29:29.716896+0000","last_active":"2024-02-15T23:30:10.795824+0000","last_peered":"2024-02-15T23:30:10.795824+0000","last_clean":"2024-02-15T23:30:10.795824+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:30:10.795824+0000","last_undegraded":"2024-02-15T23:30:10.795824+0000","last_fullsized":"2024-02-15T23:30:10.795824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:26:58.454845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.779706+0000","last_change":"2024-02-15T23:30:10.793574+0000","last_active":"2024-02-15T23:30:15.779706+0000","last_peered":"2024-02-15T23:30:15.779706+0000","last_clean":"2024-02-15T23:30:15.779706+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:30:15.779706+0000","last_undegraded":"2024-02-15T23:30:15.779706+0000","last_fullsized":"2024-02-15T23:30:15.779706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:47.873898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784302+0000","last_change":"2024-02-15T23:29:29.719351+0000","last_active":"2024-02-15T23:30:10.784302+0000","last_peered":"2024-02-15T23:30:10.784302+0000","last_clean":"2024-02-15T23:30:10.784302+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:30:10.784302+0000","last_undegraded":"2024-02-15T23:30:10.784302+0000","last_fullsized":"2024-02-15T23:30:10.784302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:18.633599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'21","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499219+0000","last_change":"2024-02-15T23:29:31.713582+0000","last_active":"2024-02-15T23:30:57.499219+0000","last_peered":"2024-02-15T23:30:57.499219+0000","last_clean":"2024-02-15T23:30:57.499219+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:30:57.499219+0000","last_undegraded":"2024-02-15T23:30:57.499219+0000","last_fullsized":"2024-02-15T23:30:57.499219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:00:54.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783783+0000","last_change":"2024-02-15T23:29:29.741437+0000","last_active":"2024-02-15T23:30:10.783783+0000","last_peered":"2024-02-15T23:30:10.783783+0000","last_clean":"2024-02-15T23:30:10.783783+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:30:10.783783+0000","last_undegraded":"2024-02-15T23:30:10.783783+0000","last_fullsized":"2024-02-15T23:30:10.783783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786380+0000","last_change":"2024-02-15T23:29:31.694663+0000","last_active":"2024-02-15T23:30:10.786380+0000","last_peered":"2024-02-15T23:30:10.786380+0000","last_clean":"2024-02-15T23:30:10.786380+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:30:10.786380+0000","last_undegraded":"2024-02-15T23:30:10.786380+0000","last_fullsized":"2024-02-15T23:30:10.786380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:01.705137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790614+0000","last_change":"2024-02-15T23:29:29.720975+0000","last_active":"2024-02-15T23:30:10.790614+0000","last_peered":"2024-02-15T23:30:10.790614+0000","last_clean":"2024-02-15T23:30:10.790614+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:30:10.790614+0000","last_undegraded":"2024-02-15T23:30:10.790614+0000","last_fullsized":"2024-02-15T23:30:10.790614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:38.715173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091043+0000","last_change":"2024-02-15T23:29:31.703991+0000","last_active":"2024-02-15T23:30:15.091043+0000","last_peered":"2024-02-15T23:30:15.091043+0000","last_clean":"2024-02-15T23:30:15.091043+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:30:15.091043+0000","last_undegraded":"2024-02-15T23:30:15.091043+0000","last_fullsized":"2024-02-15T23:30:15.091043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:19:07.918406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.248593+0000","last_change":"2024-02-15T23:29:29.714331+0000","last_active":"2024-02-15T23:30:14.248593+0000","last_peered":"2024-02-15T23:30:14.248593+0000","last_clean":"2024-02-15T23:30:14.248593+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:30:14.248593+0000","last_undegraded":"2024-02-15T23:30:14.248593+0000","last_fullsized":"2024-02-15T23:30:14.248593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:59:19.362596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.499673+0000","last_change":"2024-02-15T23:29:31.689861+0000","last_active":"2024-02-15T23:30:57.499673+0000","last_peered":"2024-02-15T23:30:57.499673+0000","last_clean":"2024-02-15T23:30:57.499673+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:30:57.499673+0000","last_undegraded":"2024-02-15T23:30:57.499673+0000","last_fullsized":"2024-02-15T23:30:57.499673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:43.878770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810021+0000","last_change":"2024-02-15T23:29:29.720292+0000","last_active":"2024-02-15T23:30:10.810021+0000","last_peered":"2024-02-15T23:30:10.810021+0000","last_clean":"2024-02-15T23:30:10.810021+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:30:10.810021+0000","last_undegraded":"2024-02-15T23:30:10.810021+0000","last_fullsized":"2024-02-15T23:30:10.810021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:29.439315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.310693+0000","last_change":"2024-02-15T23:29:31.699375+0000","last_active":"2024-02-15T23:30:58.310693+0000","last_peered":"2024-02-15T23:30:58.310693+0000","last_clean":"2024-02-15T23:30:58.310693+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:30:58.310693+0000","last_undegraded":"2024-02-15T23:30:58.310693+0000","last_fullsized":"2024-02-15T23:30:58.310693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:33.891211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780993+0000","last_change":"2024-02-15T23:29:29.730792+0000","last_active":"2024-02-15T23:30:10.780993+0000","last_peered":"2024-02-15T23:30:10.780993+0000","last_clean":"2024-02-15T23:30:10.780993+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:30:10.780993+0000","last_undegraded":"2024-02-15T23:30:10.780993+0000","last_fullsized":"2024-02-15T23:30:10.780993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:47:56.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.854975+0000","last_change":"2024-02-15T23:29:31.694898+0000","last_active":"2024-02-15T23:30:57.854975+0000","last_peered":"2024-02-15T23:30:57.854975+0000","last_clean":"2024-02-15T23:30:57.854975+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:30:57.854975+0000","last_undegraded":"2024-02-15T23:30:57.854975+0000","last_fullsized":"2024-02-15T23:30:57.854975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:33.539189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.081189+0000","last_change":"2024-02-15T23:29:29.714026+0000","last_active":"2024-02-15T23:30:15.081189+0000","last_peered":"2024-02-15T23:30:15.081189+0000","last_clean":"2024-02-15T23:30:15.081189+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:30:15.081189+0000","last_undegraded":"2024-02-15T23:30:15.081189+0000","last_fullsized":"2024-02-15T23:30:15.081189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:39.963502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796908+0000","last_change":"2024-02-15T23:29:29.714394+0000","last_active":"2024-02-15T23:30:10.796908+0000","last_peered":"2024-02-15T23:30:10.796908+0000","last_clean":"2024-02-15T23:30:10.796908+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:30:10.796908+0000","last_undegraded":"2024-02-15T23:30:10.796908+0000","last_fullsized":"2024-02-15T23:30:10.796908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:36.000311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791872+0000","last_change":"2024-02-15T23:29:31.696441+0000","last_active":"2024-02-15T23:30:10.791872+0000","last_peered":"2024-02-15T23:30:10.791872+0000","last_clean":"2024-02-15T23:30:10.791872+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:30:10.791872+0000","last_undegraded":"2024-02-15T23:30:10.791872+0000","last_fullsized":"2024-02-15T23:30:10.791872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:07.483252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784436+0000","last_change":"2024-02-15T23:29:29.716351+0000","last_active":"2024-02-15T23:30:10.784436+0000","last_peered":"2024-02-15T23:30:10.784436+0000","last_clean":"2024-02-15T23:30:10.784436+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:30:10.784436+0000","last_undegraded":"2024-02-15T23:30:10.784436+0000","last_fullsized":"2024-02-15T23:30:10.784436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:23:47.292120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.091055+0000","last_change":"2024-02-15T23:29:31.709385+0000","last_active":"2024-02-15T23:30:15.091055+0000","last_peered":"2024-02-15T23:30:15.091055+0000","last_clean":"2024-02-15T23:30:15.091055+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:30:15.091055+0000","last_undegraded":"2024-02-15T23:30:15.091055+0000","last_fullsized":"2024-02-15T23:30:15.091055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:02.842564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1269,"ondisk_log_size":1269,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705693,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.76300000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.629}]},{"osd":1,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.751,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.23100000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.78600000000000003,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.26300000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.78600000000000003,"5min":1.103,"15min":1.103},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72899999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51300000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75600000000000001,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.55600000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80700000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.43099999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.75900000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.77200000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.79800000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.38200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76800000000000002,"5min":2.452,"15min":2.452},"last":0.67400000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Feb 15 23:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.628},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.748}]},{"osd":3,"last update":"Thu Feb 15 23:30:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:31:16.688 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.688 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.688 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.689 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.689 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.689 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.689 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.689 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.689 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.690 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.690 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.690 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.690 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.690 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.690 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.691 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.691 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.691 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.691 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.691 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.691 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.691 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.692 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.692 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.692 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.692 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.692 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.692 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.693 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.693 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.693 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.693 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.693 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.693 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.693 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.694 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.694 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.694 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.694 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.694 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.694 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.694 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.695 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.695 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.695 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.695 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.695 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.695 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.695 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.696 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.696 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.696 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.696 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.696 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.696 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.697 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.697 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.697 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.697 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.697 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.697 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.697 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.698 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.698 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.698 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.698 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.698 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.698 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.699 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.699 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.699 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.699 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.699 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.699 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.700 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.700 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.700 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.700 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.700 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.700 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.701 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.701 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.701 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.701 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.701 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.702 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.702 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.702 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.702 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.702 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.702 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.703 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.703 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.703 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.703 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.703 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.703 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.704 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.704 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.704 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.704 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.704 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-15T23:29:15.580621+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=15, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.704 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.705 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.705 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.705 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.705 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.705 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.705 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.705 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.706 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.706 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.706 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.706 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.706 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.706 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.706 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.707 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.707 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.707 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.707 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.707 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.707 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.707 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.708 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.708 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.708 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.708 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.708 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.708 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.709 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.709 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.709 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.709 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.709 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.709 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.709 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.710 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.710 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.710 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.710 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.710 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.710 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.710 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.711 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.711 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.711 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.711 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.711 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.711 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.711 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.712 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.712 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.712 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.712 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.712 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.712 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.712 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.713 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.713 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.713 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.713 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.713 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.713 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.713 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.714 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.714 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.714 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.714 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.714 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.714 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.715 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.715 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.715 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.715 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.715 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.715 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.716 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.716 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.716 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.716 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.716 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.716 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.717 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.717 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.717 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.717 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.717 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.717 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.717 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.718 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.718 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.718 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.718 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.718 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.718 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.718 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.719 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.719 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.719 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.719 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.719 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.719 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.720 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.720 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.720 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.720 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.720 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.720 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.721 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.721 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.721 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.721 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.721 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.721 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.722 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.722 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.722 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.722 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.722 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.722 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.722 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.723 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.723 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.723 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.723 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.723 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.723 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.723 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.724 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.724 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.724 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.724 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.724 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.724 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.725 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.725 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.725 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.725 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.725 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.725 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.725 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.726 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.726 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.726 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.726 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.726 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.726 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.727 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.727 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.727 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.727 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.727 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.727 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.727 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.727 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.728 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.728 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.728 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.728 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.728 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.728 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.729 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.729 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.729 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:16.729 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T23:31:36.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:31:36.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.851+0000 7f636ca9d640 1 Processor -- start 2024-02-15T23:31:36.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.851+0000 7f636ca9d640 1 -- start start 2024-02-15T23:31:36.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f636ca9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6368092560 0x7f6368092940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:36.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f636ca9d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6368094180 con 0x7f636812a220 2024-02-15T23:31:36.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f636ca9d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63680958f0 con 0x7f6368092560 2024-02-15T23:31:36.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f635dd9b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f636812a220 0x7f636812a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34038/0 (socket says 172.21.15.131:34038) 2024-02-15T23:31:36.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f635dd9b640 1 -- 172.21.15.131:0/3340458115 learned_addr learned my addr 172.21.15.131:0/3340458115 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:36.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f636659c640 1 --2- 172.21.15.131:0/3340458115 >> v2:172.21.15.131:3300/0 conn(0x7f6368092560 0x7f6368092940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:36.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f6365d9b640 1 -- 172.21.15.131:0/3340458115 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739051492 0 0) 0x7f6368094180 con 0x7f636812a220 2024-02-15T23:31:36.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f6365d9b640 1 -- 172.21.15.131:0/3340458115 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6354003530 con 0x7f636812a220 2024-02-15T23:31:36.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f636659c640 1 -- 172.21.15.131:0/3340458115 >> v1:172.21.15.131:6789/0 conn(0x7f636812a220 legacy=0x7f636812a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:36.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f636659c640 1 -- 172.21.15.131:0/3340458115 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636809c160 con 0x7f6368092560 2024-02-15T23:31:36.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f636659c640 1 --2- 172.21.15.131:0/3340458115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f6368092940 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6358009740 tx=0x7f635801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98597b9dd44c4d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:36.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f6365d9b640 1 -- 172.21.15.131:0/3340458115 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63580a8050 con 0x7f6368092560 2024-02-15T23:31:36.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f6365d9b640 1 -- 172.21.15.131:0/3340458115 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63580ac520 con 0x7f6368092560 2024-02-15T23:31:36.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.855+0000 7f6365d9b640 1 -- 172.21.15.131:0/3340458115 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63580ac7c0 con 0x7f6368092560 2024-02-15T23:31:36.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- 172.21.15.131:0/3340458115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 msgr2=0x7f6368092940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:36.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 --2- 172.21.15.131:0/3340458115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f6368092940 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6358009740 tx=0x7f635801c370 comp rx=0 tx=0).stop 2024-02-15T23:31:36.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- 172.21.15.131:0/3340458115 shutdown_connections 2024-02-15T23:31:36.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 --2- 172.21.15.131:0/3340458115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f6368092940 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:36.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- 172.21.15.131:0/3340458115 >> 172.21.15.131:0/3340458115 conn(0x7f636809a2f0 msgr2=0x7f636809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:36.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- 172.21.15.131:0/3340458115 shutdown_connections 2024-02-15T23:31:36.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- 172.21.15.131:0/3340458115 wait complete. 2024-02-15T23:31:36.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 Processor -- start 2024-02-15T23:31:36.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- start start 2024-02-15T23:31:36.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f636808e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:36.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636806db90 con 0x7f6368092560 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f636808e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f636808e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55890/0 (socket says 172.21.15.131:55890) 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636659c640 1 -- 172.21.15.131:0/1996104360 learned_addr learned my addr 172.21.15.131:0/1996104360 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636659c640 1 -- 172.21.15.131:0/1996104360 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6358009420 con 0x7f6368092560 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636659c640 1 --2- 172.21.15.131:0/1996104360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f636808e6a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f635801aa20 tx=0x7f635801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f635f7fe640 1 -- 172.21.15.131:0/1996104360 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63580ace50 con 0x7f6368092560 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f635f7fe640 1 -- 172.21.15.131:0/1996104360 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63580ab8d0 con 0x7f6368092560 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6368093000 con 0x7f6368092560 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f635f7fe640 1 -- 172.21.15.131:0/1996104360 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63580abb90 con 0x7f6368092560 2024-02-15T23:31:36.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636806cd70 con 0x7f6368092560 2024-02-15T23:31:36.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f635f7fe640 1 -- 172.21.15.131:0/1996104360 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f63580abcf0 con 0x7f6368092560 2024-02-15T23:31:36.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6368067e00 con 0x7f6368092560 2024-02-15T23:31:36.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f635f7fe640 1 --2- 172.21.15.131:0/1996104360 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6348035a10 0x7f6348037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:36.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.859+0000 7f635f7fe640 1 -- 172.21.15.131:0/1996104360 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f63580e3350 con 0x7f6368092560 2024-02-15T23:31:36.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.863+0000 7f635dd9b640 1 --2- 172.21.15.131:0/1996104360 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6348035a10 0x7f6348037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:36.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.863+0000 7f635dd9b640 1 --2- 172.21.15.131:0/1996104360 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6348035a10 0x7f6348037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6350007fd0 tx=0x7f6350007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:36.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:36.867+0000 7f635f7fe640 1 -- 172.21.15.131:0/1996104360 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f63580b4300 con 0x7f6368092560 2024-02-15T23:31:37.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.015+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6368092e80 con 0x7f6348035a10 2024-02-15T23:31:37.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.063+0000 7f635f7fe640 1 -- 172.21.15.131:0/1996104360 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+666925 (secure 0 0 0) 0x7f63500058c0 con 0x7f6348035a10 2024-02-15T23:31:37.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:31:37.082 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:31:37.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6348035a10 msgr2=0x7f6348037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:37.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 --2- 172.21.15.131:0/1996104360 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6348035a10 0x7f6348037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6350007fd0 tx=0x7f6350007980 comp rx=0 tx=0).stop 2024-02-15T23:31:37.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 msgr2=0x7f636808e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:37.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 --2- 172.21.15.131:0/1996104360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f636808e6a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f635801aa20 tx=0x7f635801abb0 comp rx=0 tx=0).stop 2024-02-15T23:31:37.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 shutdown_connections 2024-02-15T23:31:37.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 --2- 172.21.15.131:0/1996104360 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f6348035a10 0x7f6348037ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:37.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 --2- 172.21.15.131:0/1996104360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6368092560 0x7f636808e6a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:37.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 >> 172.21.15.131:0/1996104360 conn(0x7f636809a2f0 msgr2=0x7f63681295d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:37.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 shutdown_connections 2024-02-15T23:31:37.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:37.067+0000 7f636ca9d640 1 -- 172.21.15.131:0/1996104360 wait complete. 2024-02-15T23:31:37.094 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-02-15T23:31:35.553341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3914,"ondisk_log_size":3914,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005764"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.853437+0000","last_change":"2024-02-15T23:29:29.730549+0000","last_active":"2024-02-15T23:31:15.853437+0000","last_peered":"2024-02-15T23:31:15.853437+0000","last_clean":"2024-02-15T23:31:15.853437+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:31:15.853437+0000","last_undegraded":"2024-02-15T23:31:15.853437+0000","last_fullsized":"2024-02-15T23:31:15.853437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785452+0000","last_change":"2024-02-15T23:29:31.691386+0000","last_active":"2024-02-15T23:30:10.785452+0000","last_peered":"2024-02-15T23:30:10.785452+0000","last_clean":"2024-02-15T23:30:10.785452+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:30:10.785452+0000","last_undegraded":"2024-02-15T23:30:10.785452+0000","last_fullsized":"2024-02-15T23:30:10.785452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955420+0000","last_change":"2024-02-15T23:29:29.719743+0000","last_active":"2024-02-15T23:31:14.955420+0000","last_peered":"2024-02-15T23:31:14.955420+0000","last_clean":"2024-02-15T23:31:14.955420+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:31:14.955420+0000","last_undegraded":"2024-02-15T23:31:14.955420+0000","last_fullsized":"2024-02-15T23:31:14.955420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798466+0000","last_change":"2024-02-15T23:29:31.701574+0000","last_active":"2024-02-15T23:30:10.798466+0000","last_peered":"2024-02-15T23:30:10.798466+0000","last_clean":"2024-02-15T23:30:10.798466+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:30:10.798466+0000","last_undegraded":"2024-02-15T23:30:10.798466+0000","last_fullsized":"2024-02-15T23:30:10.798466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315010+0000","last_change":"2024-02-15T23:29:29.725919+0000","last_active":"2024-02-15T23:31:16.315010+0000","last_peered":"2024-02-15T23:31:16.315010+0000","last_clean":"2024-02-15T23:31:16.315010+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:31:16.315010+0000","last_undegraded":"2024-02-15T23:31:16.315010+0000","last_fullsized":"2024-02-15T23:31:16.315010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807067+0000","last_change":"2024-02-15T23:29:31.701595+0000","last_active":"2024-02-15T23:30:10.807067+0000","last_peered":"2024-02-15T23:30:10.807067+0000","last_clean":"2024-02-15T23:30:10.807067+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:30:10.807067+0000","last_undegraded":"2024-02-15T23:30:10.807067+0000","last_fullsized":"2024-02-15T23:30:10.807067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.853116+0000","last_change":"2024-02-15T23:29:29.725199+0000","last_active":"2024-02-15T23:31:15.853116+0000","last_peered":"2024-02-15T23:31:15.853116+0000","last_clean":"2024-02-15T23:31:15.853116+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:31:15.853116+0000","last_undegraded":"2024-02-15T23:31:15.853116+0000","last_fullsized":"2024-02-15T23:31:15.853116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807564+0000","last_change":"2024-02-15T23:29:31.703063+0000","last_active":"2024-02-15T23:30:10.807564+0000","last_peered":"2024-02-15T23:30:10.807564+0000","last_clean":"2024-02-15T23:30:10.807564+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:30:10.807564+0000","last_undegraded":"2024-02-15T23:30:10.807564+0000","last_fullsized":"2024-02-15T23:30:10.807564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806022+0000","last_change":"2024-02-15T23:29:29.710832+0000","last_active":"2024-02-15T23:30:10.806022+0000","last_peered":"2024-02-15T23:30:10.806022+0000","last_clean":"2024-02-15T23:30:10.806022+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:30:10.806022+0000","last_undegraded":"2024-02-15T23:30:10.806022+0000","last_fullsized":"2024-02-15T23:30:10.806022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398792+0000","last_change":"2024-02-15T23:29:31.689546+0000","last_active":"2024-02-15T23:31:15.398792+0000","last_peered":"2024-02-15T23:31:15.398792+0000","last_clean":"2024-02-15T23:31:15.398792+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:15.398792+0000","last_undegraded":"2024-02-15T23:31:15.398792+0000","last_fullsized":"2024-02-15T23:31:15.398792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777225+0000","last_change":"2024-02-15T23:29:29.729934+0000","last_active":"2024-02-15T23:30:10.777225+0000","last_peered":"2024-02-15T23:30:10.777225+0000","last_clean":"2024-02-15T23:30:10.777225+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:30:10.777225+0000","last_undegraded":"2024-02-15T23:30:10.777225+0000","last_fullsized":"2024-02-15T23:30:10.777225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808871+0000","last_change":"2024-02-15T23:29:31.705431+0000","last_active":"2024-02-15T23:30:10.808871+0000","last_peered":"2024-02-15T23:30:10.808871+0000","last_clean":"2024-02-15T23:30:10.808871+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:30:10.808871+0000","last_undegraded":"2024-02-15T23:30:10.808871+0000","last_fullsized":"2024-02-15T23:30:10.808871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:13.509809+0000","last_change":"2024-02-15T23:29:29.707555+0000","last_active":"2024-02-15T23:30:13.509809+0000","last_peered":"2024-02-15T23:30:13.509809+0000","last_clean":"2024-02-15T23:30:13.509809+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:30:13.509809+0000","last_undegraded":"2024-02-15T23:30:13.509809+0000","last_fullsized":"2024-02-15T23:30:13.509809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.103951+0000","last_change":"2024-02-15T23:29:31.689285+0000","last_active":"2024-02-15T23:30:15.103951+0000","last_peered":"2024-02-15T23:30:15.103951+0000","last_clean":"2024-02-15T23:30:15.103951+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:30:15.103951+0000","last_undegraded":"2024-02-15T23:30:15.103951+0000","last_fullsized":"2024-02-15T23:30:15.103951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784530+0000","last_change":"2024-02-15T23:29:29.720155+0000","last_active":"2024-02-15T23:30:10.784530+0000","last_peered":"2024-02-15T23:30:10.784530+0000","last_clean":"2024-02-15T23:30:10.784530+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:30:10.784530+0000","last_undegraded":"2024-02-15T23:30:10.784530+0000","last_fullsized":"2024-02-15T23:30:10.784530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784598+0000","last_change":"2024-02-15T23:29:31.711090+0000","last_active":"2024-02-15T23:30:10.784598+0000","last_peered":"2024-02-15T23:30:10.784598+0000","last_clean":"2024-02-15T23:30:10.784598+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:30:10.784598+0000","last_undegraded":"2024-02-15T23:30:10.784598+0000","last_fullsized":"2024-02-15T23:30:10.784598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797712+0000","last_change":"2024-02-15T23:29:31.699913+0000","last_active":"2024-02-15T23:30:10.797712+0000","last_peered":"2024-02-15T23:30:10.797712+0000","last_clean":"2024-02-15T23:30:10.797712+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:30:10.797712+0000","last_undegraded":"2024-02-15T23:30:10.797712+0000","last_fullsized":"2024-02-15T23:30:10.797712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.307798+0000","last_change":"2024-02-15T23:29:29.720102+0000","last_active":"2024-02-15T23:30:58.307798+0000","last_peered":"2024-02-15T23:30:58.307798+0000","last_clean":"2024-02-15T23:30:58.307798+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:30:58.307798+0000","last_undegraded":"2024-02-15T23:30:58.307798+0000","last_fullsized":"2024-02-15T23:30:58.307798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.760758+0000","last_change":"2024-02-15T23:29:31.691136+0000","last_active":"2024-02-15T23:30:14.760758+0000","last_peered":"2024-02-15T23:30:14.760758+0000","last_clean":"2024-02-15T23:30:14.760758+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:30:14.760758+0000","last_undegraded":"2024-02-15T23:30:14.760758+0000","last_fullsized":"2024-02-15T23:30:14.760758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781426+0000","last_change":"2024-02-15T23:29:29.734663+0000","last_active":"2024-02-15T23:30:10.781426+0000","last_peered":"2024-02-15T23:30:10.781426+0000","last_clean":"2024-02-15T23:30:10.781426+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:30:10.781426+0000","last_undegraded":"2024-02-15T23:30:10.781426+0000","last_fullsized":"2024-02-15T23:30:10.781426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.937026+0000","last_change":"2024-02-15T23:29:31.689924+0000","last_active":"2024-02-15T23:31:03.937026+0000","last_peered":"2024-02-15T23:31:03.937026+0000","last_clean":"2024-02-15T23:31:03.937026+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:03.937026+0000","last_undegraded":"2024-02-15T23:31:03.937026+0000","last_fullsized":"2024-02-15T23:31:03.937026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791343+0000","last_change":"2024-02-15T23:29:29.739167+0000","last_active":"2024-02-15T23:30:10.791343+0000","last_peered":"2024-02-15T23:30:10.791343+0000","last_clean":"2024-02-15T23:30:10.791343+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:30:10.791343+0000","last_undegraded":"2024-02-15T23:30:10.791343+0000","last_fullsized":"2024-02-15T23:30:10.791343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.767703+0000","last_change":"2024-02-15T23:29:31.708859+0000","last_active":"2024-02-15T23:30:14.767703+0000","last_peered":"2024-02-15T23:30:14.767703+0000","last_clean":"2024-02-15T23:30:14.767703+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:30:14.767703+0000","last_undegraded":"2024-02-15T23:30:14.767703+0000","last_fullsized":"2024-02-15T23:30:14.767703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786087+0000","last_change":"2024-02-15T23:29:29.720464+0000","last_active":"2024-02-15T23:30:10.786087+0000","last_peered":"2024-02-15T23:30:10.786087+0000","last_clean":"2024-02-15T23:30:10.786087+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:30:10.786087+0000","last_undegraded":"2024-02-15T23:30:10.786087+0000","last_fullsized":"2024-02-15T23:30:10.786087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784399+0000","last_change":"2024-02-15T23:29:31.703343+0000","last_active":"2024-02-15T23:30:10.784399+0000","last_peered":"2024-02-15T23:30:10.784399+0000","last_clean":"2024-02-15T23:30:10.784399+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:30:10.784399+0000","last_undegraded":"2024-02-15T23:30:10.784399+0000","last_fullsized":"2024-02-15T23:30:10.784399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:13.513036+0000","last_change":"2024-02-15T23:29:29.719436+0000","last_active":"2024-02-15T23:30:13.513036+0000","last_peered":"2024-02-15T23:30:13.513036+0000","last_clean":"2024-02-15T23:30:13.513036+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:30:13.513036+0000","last_undegraded":"2024-02-15T23:30:13.513036+0000","last_fullsized":"2024-02-15T23:30:13.513036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.792815+0000","last_change":"2024-02-15T23:29:31.689367+0000","last_active":"2024-02-15T23:30:10.792815+0000","last_peered":"2024-02-15T23:30:10.792815+0000","last_clean":"2024-02-15T23:30:10.792815+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:30:10.792815+0000","last_undegraded":"2024-02-15T23:30:10.792815+0000","last_fullsized":"2024-02-15T23:30:10.792815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.800215+0000","last_change":"2024-02-15T23:29:29.717627+0000","last_active":"2024-02-15T23:30:10.800215+0000","last_peered":"2024-02-15T23:30:10.800215+0000","last_clean":"2024-02-15T23:30:10.800215+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:30:10.800215+0000","last_undegraded":"2024-02-15T23:30:10.800215+0000","last_fullsized":"2024-02-15T23:30:10.800215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'17","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.954894+0000","last_change":"2024-02-15T23:29:39.766173+0000","last_active":"2024-02-15T23:31:03.954894+0000","last_peered":"2024-02-15T23:31:03.954894+0000","last_clean":"2024-02-15T23:31:03.954894+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:03.954894+0000","last_undegraded":"2024-02-15T23:31:03.954894+0000","last_fullsized":"2024-02-15T23:31:03.954894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809140+0000","last_change":"2024-02-15T23:29:31.703049+0000","last_active":"2024-02-15T23:30:10.809140+0000","last_peered":"2024-02-15T23:30:10.809140+0000","last_clean":"2024-02-15T23:30:10.809140+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:30:10.809140+0000","last_undegraded":"2024-02-15T23:30:10.809140+0000","last_fullsized":"2024-02-15T23:30:10.809140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805085+0000","last_change":"2024-02-15T23:29:29.711609+0000","last_active":"2024-02-15T23:30:10.805085+0000","last_peered":"2024-02-15T23:30:10.805085+0000","last_clean":"2024-02-15T23:30:10.805085+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:30:10.805085+0000","last_undegraded":"2024-02-15T23:30:10.805085+0000","last_fullsized":"2024-02-15T23:30:10.805085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.381596+0000","last_change":"2024-02-15T23:31:23.381651+0000","last_active":"2024-02-15T23:31:23.381596+0000","last_peered":"2024-02-15T23:31:23.381596+0000","last_clean":"2024-02-15T23:31:23.381596+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:31:23.381596+0000","last_undegraded":"2024-02-15T23:31:23.381596+0000","last_fullsized":"2024-02-15T23:31:23.381596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.381406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:53.788740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.723202+0000","last_change":"2024-02-15T23:29:35.748567+0000","last_active":"2024-02-15T23:31:11.723202+0000","last_peered":"2024-02-15T23:31:11.723202+0000","last_clean":"2024-02-15T23:31:11.723202+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:31:11.723202+0000","last_undegraded":"2024-02-15T23:31:11.723202+0000","last_fullsized":"2024-02-15T23:31:11.723202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.464854+0000","last_change":"2024-02-15T23:31:26.464923+0000","last_active":"2024-02-15T23:31:26.464854+0000","last_peered":"2024-02-15T23:31:26.464854+0000","last_clean":"2024-02-15T23:31:26.464854+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:31:26.464854+0000","last_undegraded":"2024-02-15T23:31:26.464854+0000","last_fullsized":"2024-02-15T23:31:26.464854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.464676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:15.850726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.067453+0000","last_change":"2024-02-15T23:29:39.772828+0000","last_active":"2024-02-15T23:30:58.067453+0000","last_peered":"2024-02-15T23:30:58.067453+0000","last_clean":"2024-02-15T23:30:58.067453+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:30:58.067453+0000","last_undegraded":"2024-02-15T23:30:58.067453+0000","last_fullsized":"2024-02-15T23:30:58.067453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.462915+0000","last_change":"2024-02-15T23:31:33.462983+0000","last_active":"2024-02-15T23:31:33.462915+0000","last_peered":"2024-02-15T23:31:33.462915+0000","last_clean":"2024-02-15T23:31:33.462915+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:31:33.462915+0000","last_undegraded":"2024-02-15T23:31:33.462915+0000","last_fullsized":"2024-02-15T23:31:33.462915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.462731+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:08.999822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.776449+0000","last_change":"2024-02-15T23:29:29.722314+0000","last_active":"2024-02-15T23:30:10.776449+0000","last_peered":"2024-02-15T23:30:10.776449+0000","last_clean":"2024-02-15T23:30:10.776449+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:30:10.776449+0000","last_undegraded":"2024-02-15T23:30:10.776449+0000","last_fullsized":"2024-02-15T23:30:10.776449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785709+0000","last_change":"2024-02-15T23:29:33.707309+0000","last_active":"2024-02-15T23:30:10.785709+0000","last_peered":"2024-02-15T23:30:10.785709+0000","last_clean":"2024-02-15T23:30:10.785709+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:30:10.785709+0000","last_undegraded":"2024-02-15T23:30:10.785709+0000","last_fullsized":"2024-02-15T23:30:10.785709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.354123+0000","last_change":"2024-02-15T23:31:20.354191+0000","last_active":"2024-02-15T23:31:20.354123+0000","last_peered":"2024-02-15T23:31:20.354123+0000","last_clean":"2024-02-15T23:31:20.354123+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:31:20.354123+0000","last_undegraded":"2024-02-15T23:31:20.354123+0000","last_fullsized":"2024-02-15T23:31:20.354123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.353944+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:24.028078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.362264+0000","last_change":"2024-02-15T23:31:18.362319+0000","last_active":"2024-02-15T23:31:18.362264+0000","last_peered":"2024-02-15T23:31:18.362264+0000","last_clean":"2024-02-15T23:31:18.362264+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:31:18.362264+0000","last_undegraded":"2024-02-15T23:31:18.362264+0000","last_fullsized":"2024-02-15T23:31:18.362264+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.362075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.313172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783933+0000","last_change":"2024-02-15T23:29:39.757721+0000","last_active":"2024-02-15T23:30:10.783933+0000","last_peered":"2024-02-15T23:30:10.783933+0000","last_clean":"2024-02-15T23:30:10.783933+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:30:10.783933+0000","last_undegraded":"2024-02-15T23:30:10.783933+0000","last_fullsized":"2024-02-15T23:30:10.783933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.322286+0000","last_change":"2024-02-15T23:29:31.705324+0000","last_active":"2024-02-15T23:30:58.322286+0000","last_peered":"2024-02-15T23:30:58.322286+0000","last_clean":"2024-02-15T23:30:58.322286+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:30:58.322286+0000","last_undegraded":"2024-02-15T23:30:58.322286+0000","last_fullsized":"2024-02-15T23:30:58.322286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795237+0000","last_change":"2024-02-15T23:29:29.728584+0000","last_active":"2024-02-15T23:30:10.795237+0000","last_peered":"2024-02-15T23:30:10.795237+0000","last_clean":"2024-02-15T23:30:10.795237+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:30:10.795237+0000","last_undegraded":"2024-02-15T23:30:10.795237+0000","last_fullsized":"2024-02-15T23:30:10.795237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.525956+0000","last_change":"2024-02-15T23:31:33.526018+0000","last_active":"2024-02-15T23:31:33.525956+0000","last_peered":"2024-02-15T23:31:33.525956+0000","last_clean":"2024-02-15T23:31:33.525956+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:31:33.525956+0000","last_undegraded":"2024-02-15T23:31:33.525956+0000","last_fullsized":"2024-02-15T23:31:33.525956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.525754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.228715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.758809+0000","last_change":"2024-02-15T23:31:21.758890+0000","last_active":"2024-02-15T23:31:21.758809+0000","last_peered":"2024-02-15T23:31:21.758809+0000","last_clean":"2024-02-15T23:31:21.758809+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:31:21.758809+0000","last_undegraded":"2024-02-15T23:31:21.758809+0000","last_fullsized":"2024-02-15T23:31:21.758809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.758604+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:00:21.378855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":306,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.935240+0000","last_change":"2024-02-15T23:29:37.774111+0000","last_active":"2024-02-15T23:31:11.935240+0000","last_peered":"2024-02-15T23:31:11.935240+0000","last_clean":"2024-02-15T23:31:11.935240+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:11.935240+0000","last_undegraded":"2024-02-15T23:31:11.935240+0000","last_fullsized":"2024-02-15T23:31:11.935240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777385+0000","last_change":"2024-02-15T23:29:39.776305+0000","last_active":"2024-02-15T23:30:10.777385+0000","last_peered":"2024-02-15T23:30:10.777385+0000","last_clean":"2024-02-15T23:30:10.777385+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:30:10.777385+0000","last_undegraded":"2024-02-15T23:30:10.777385+0000","last_fullsized":"2024-02-15T23:30:10.777385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791871+0000","last_change":"2024-02-15T23:29:31.696768+0000","last_active":"2024-02-15T23:30:10.791871+0000","last_peered":"2024-02-15T23:30:10.791871+0000","last_clean":"2024-02-15T23:30:10.791871+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:30:10.791871+0000","last_undegraded":"2024-02-15T23:30:10.791871+0000","last_fullsized":"2024-02-15T23:30:10.791871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:13.509704+0000","last_change":"2024-02-15T23:29:29.737866+0000","last_active":"2024-02-15T23:30:13.509704+0000","last_peered":"2024-02-15T23:30:13.509704+0000","last_clean":"2024-02-15T23:30:13.509704+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:30:13.509704+0000","last_undegraded":"2024-02-15T23:30:13.509704+0000","last_fullsized":"2024-02-15T23:30:13.509704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.380144+0000","last_change":"2024-02-15T23:31:19.380202+0000","last_active":"2024-02-15T23:31:19.380144+0000","last_peered":"2024-02-15T23:31:19.380144+0000","last_clean":"2024-02-15T23:31:19.380144+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:31:19.380144+0000","last_undegraded":"2024-02-15T23:31:19.380144+0000","last_fullsized":"2024-02-15T23:31:19.380144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.379961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:22.107728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.801386+0000","last_change":"2024-02-15T23:31:23.801467+0000","last_active":"2024-02-15T23:31:23.801386+0000","last_peered":"2024-02-15T23:31:23.801386+0000","last_clean":"2024-02-15T23:31:23.801386+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:31:23.801386+0000","last_undegraded":"2024-02-15T23:31:23.801386+0000","last_fullsized":"2024-02-15T23:31:23.801386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.801176+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:09.278307+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":342,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.592027+0000","last_change":"2024-02-15T23:31:18.592156+0000","last_active":"2024-02-15T23:31:18.592027+0000","last_peered":"2024-02-15T23:31:18.592027+0000","last_clean":"2024-02-15T23:31:18.592027+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:18.592027+0000","last_undegraded":"2024-02-15T23:31:18.592027+0000","last_fullsized":"2024-02-15T23:31:18.592027+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.591821+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.542917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797475+0000","last_change":"2024-02-15T23:29:31.702049+0000","last_active":"2024-02-15T23:30:10.797475+0000","last_peered":"2024-02-15T23:30:10.797475+0000","last_clean":"2024-02-15T23:30:10.797475+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:30:10.797475+0000","last_undegraded":"2024-02-15T23:30:10.797475+0000","last_fullsized":"2024-02-15T23:30:10.797475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780323+0000","last_change":"2024-02-15T23:29:29.731688+0000","last_active":"2024-02-15T23:30:10.780323+0000","last_peered":"2024-02-15T23:30:10.780323+0000","last_clean":"2024-02-15T23:30:10.780323+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:30:10.780323+0000","last_undegraded":"2024-02-15T23:30:10.780323+0000","last_fullsized":"2024-02-15T23:30:10.780323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.477229+0000","last_change":"2024-02-15T23:31:29.477281+0000","last_active":"2024-02-15T23:31:29.477229+0000","last_peered":"2024-02-15T23:31:29.477229+0000","last_clean":"2024-02-15T23:31:29.477229+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:31:29.477229+0000","last_undegraded":"2024-02-15T23:31:29.477229+0000","last_fullsized":"2024-02-15T23:31:29.477229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.477038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.461667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.798432+0000","last_change":"2024-02-15T23:31:22.798531+0000","last_active":"2024-02-15T23:31:22.798432+0000","last_peered":"2024-02-15T23:31:22.798432+0000","last_clean":"2024-02-15T23:31:22.798432+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:31:22.798432+0000","last_undegraded":"2024-02-15T23:31:22.798432+0000","last_fullsized":"2024-02-15T23:31:22.798432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.798209+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:35.238195+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.541436+0000","last_change":"2024-02-15T23:31:17.541487+0000","last_active":"2024-02-15T23:31:17.541436+0000","last_peered":"2024-02-15T23:31:17.541436+0000","last_clean":"2024-02-15T23:31:17.541436+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:31:17.541436+0000","last_undegraded":"2024-02-15T23:31:17.541436+0000","last_fullsized":"2024-02-15T23:31:17.541436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.541232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.369965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.070232+0000","last_change":"2024-02-15T23:29:39.779875+0000","last_active":"2024-02-15T23:30:58.070232+0000","last_peered":"2024-02-15T23:30:58.070232+0000","last_clean":"2024-02-15T23:30:58.070232+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:30:58.070232+0000","last_undegraded":"2024-02-15T23:30:58.070232+0000","last_fullsized":"2024-02-15T23:30:58.070232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.938290+0000","last_change":"2024-02-15T23:29:31.694940+0000","last_active":"2024-02-15T23:31:03.938290+0000","last_peered":"2024-02-15T23:31:03.938290+0000","last_clean":"2024-02-15T23:31:03.938290+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:31:03.938290+0000","last_undegraded":"2024-02-15T23:31:03.938290+0000","last_fullsized":"2024-02-15T23:31:03.938290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:13.510165+0000","last_change":"2024-02-15T23:29:29.723619+0000","last_active":"2024-02-15T23:30:13.510165+0000","last_peered":"2024-02-15T23:30:13.510165+0000","last_clean":"2024-02-15T23:30:13.510165+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:30:13.510165+0000","last_undegraded":"2024-02-15T23:30:13.510165+0000","last_fullsized":"2024-02-15T23:30:13.510165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.579242+0000","last_change":"2024-02-15T23:30:10.788609+0000","last_active":"2024-02-15T23:30:14.579242+0000","last_peered":"2024-02-15T23:30:14.579242+0000","last_clean":"2024-02-15T23:30:14.579242+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:30:14.579242+0000","last_undegraded":"2024-02-15T23:30:14.579242+0000","last_fullsized":"2024-02-15T23:30:14.579242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.459551+0000","last_change":"2024-02-15T23:31:32.459639+0000","last_active":"2024-02-15T23:31:32.459551+0000","last_peered":"2024-02-15T23:31:32.459551+0000","last_clean":"2024-02-15T23:31:32.459551+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:31:32.459551+0000","last_undegraded":"2024-02-15T23:31:32.459551+0000","last_fullsized":"2024-02-15T23:31:32.459551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.459345+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:19.866069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.576952+0000","last_change":"2024-02-15T23:31:16.577110+0000","last_active":"2024-02-15T23:31:16.576952+0000","last_peered":"2024-02-15T23:31:16.576952+0000","last_clean":"2024-02-15T23:31:16.576952+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:31:16.576952+0000","last_undegraded":"2024-02-15T23:31:16.576952+0000","last_fullsized":"2024-02-15T23:31:16.576952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.576722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:35.480941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'7","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.437487+0000","last_change":"2024-02-15T23:29:39.781125+0000","last_active":"2024-02-15T23:30:52.437487+0000","last_peered":"2024-02-15T23:30:52.437487+0000","last_clean":"2024-02-15T23:30:52.437487+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:30:52.437487+0000","last_undegraded":"2024-02-15T23:30:52.437487+0000","last_fullsized":"2024-02-15T23:30:52.437487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.759673+0000","last_change":"2024-02-15T23:29:31.710943+0000","last_active":"2024-02-15T23:30:14.759673+0000","last_peered":"2024-02-15T23:30:14.759673+0000","last_clean":"2024-02-15T23:30:14.759673+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:30:14.759673+0000","last_undegraded":"2024-02-15T23:30:14.759673+0000","last_fullsized":"2024-02-15T23:30:14.759673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810418+0000","last_change":"2024-02-15T23:29:29.725600+0000","last_active":"2024-02-15T23:30:10.810418+0000","last_peered":"2024-02-15T23:30:10.810418+0000","last_clean":"2024-02-15T23:30:10.810418+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:30:10.810418+0000","last_undegraded":"2024-02-15T23:30:10.810418+0000","last_fullsized":"2024-02-15T23:30:10.810418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786153+0000","last_change":"2024-02-15T23:29:33.719603+0000","last_active":"2024-02-15T23:30:10.786153+0000","last_peered":"2024-02-15T23:30:10.786153+0000","last_clean":"2024-02-15T23:30:10.786153+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:30:10.786153+0000","last_undegraded":"2024-02-15T23:30:10.786153+0000","last_fullsized":"2024-02-15T23:30:10.786153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.513914+0000","last_change":"2024-02-15T23:31:30.514009+0000","last_active":"2024-02-15T23:31:30.513914+0000","last_peered":"2024-02-15T23:31:30.513914+0000","last_clean":"2024-02-15T23:31:30.513914+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:31:30.513914+0000","last_undegraded":"2024-02-15T23:31:30.513914+0000","last_fullsized":"2024-02-15T23:31:30.513914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.513714+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:12.277197+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":313,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.644513+0000","last_change":"2024-02-15T23:31:20.644582+0000","last_active":"2024-02-15T23:31:20.644513+0000","last_peered":"2024-02-15T23:31:20.644513+0000","last_clean":"2024-02-15T23:31:20.644513+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:20.644513+0000","last_undegraded":"2024-02-15T23:31:20.644513+0000","last_fullsized":"2024-02-15T23:31:20.644513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.644319+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:29.139495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:52.443622+0000","last_change":"2024-02-15T23:29:39.784076+0000","last_active":"2024-02-15T23:30:52.443622+0000","last_peered":"2024-02-15T23:30:52.443622+0000","last_clean":"2024-02-15T23:30:52.443622+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:30:52.443622+0000","last_undegraded":"2024-02-15T23:30:52.443622+0000","last_fullsized":"2024-02-15T23:30:52.443622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781122+0000","last_change":"2024-02-15T23:29:31.682141+0000","last_active":"2024-02-15T23:30:10.781122+0000","last_peered":"2024-02-15T23:30:10.781122+0000","last_clean":"2024-02-15T23:30:10.781122+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:30:10.781122+0000","last_undegraded":"2024-02-15T23:30:10.781122+0000","last_fullsized":"2024-02-15T23:30:10.781122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807754+0000","last_change":"2024-02-15T23:29:29.717855+0000","last_active":"2024-02-15T23:30:10.807754+0000","last_peered":"2024-02-15T23:30:10.807754+0000","last_clean":"2024-02-15T23:30:10.807754+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:30:10.807754+0000","last_undegraded":"2024-02-15T23:30:10.807754+0000","last_fullsized":"2024-02-15T23:30:10.807754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.499767+0000","last_change":"2024-02-15T23:31:31.499881+0000","last_active":"2024-02-15T23:31:31.499767+0000","last_peered":"2024-02-15T23:31:31.499767+0000","last_clean":"2024-02-15T23:31:31.499767+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:31:31.499767+0000","last_undegraded":"2024-02-15T23:31:31.499767+0000","last_fullsized":"2024-02-15T23:31:31.499767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.499481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.621183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'56","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.844305+0000","last_change":"2024-02-15T23:29:35.749140+0000","last_active":"2024-02-15T23:31:11.844305+0000","last_peered":"2024-02-15T23:31:11.844305+0000","last_clean":"2024-02-15T23:31:11.844305+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:11.844305+0000","last_undegraded":"2024-02-15T23:31:11.844305+0000","last_fullsized":"2024-02-15T23:31:11.844305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.656984+0000","last_change":"2024-02-15T23:31:21.657045+0000","last_active":"2024-02-15T23:31:21.656984+0000","last_peered":"2024-02-15T23:31:21.656984+0000","last_clean":"2024-02-15T23:31:21.656984+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:31:21.656984+0000","last_undegraded":"2024-02-15T23:31:21.656984+0000","last_fullsized":"2024-02-15T23:31:21.656984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.656809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:38.124016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.945792+0000","last_change":"2024-02-15T23:29:39.766366+0000","last_active":"2024-02-15T23:31:03.945792+0000","last_peered":"2024-02-15T23:31:03.945792+0000","last_clean":"2024-02-15T23:31:03.945792+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:31:03.945792+0000","last_undegraded":"2024-02-15T23:31:03.945792+0000","last_fullsized":"2024-02-15T23:31:03.945792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.773260+0000","last_change":"2024-02-15T23:30:10.801846+0000","last_active":"2024-02-15T23:30:15.773260+0000","last_peered":"2024-02-15T23:30:15.773260+0000","last_clean":"2024-02-15T23:30:15.773260+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:30:15.773260+0000","last_undegraded":"2024-02-15T23:30:15.773260+0000","last_fullsized":"2024-02-15T23:30:15.773260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.858070+0000","last_change":"2024-02-15T23:29:29.716793+0000","last_active":"2024-02-15T23:30:57.858070+0000","last_peered":"2024-02-15T23:30:57.858070+0000","last_clean":"2024-02-15T23:30:57.858070+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:30:57.858070+0000","last_undegraded":"2024-02-15T23:30:57.858070+0000","last_fullsized":"2024-02-15T23:30:57.858070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.636096+0000","last_change":"2024-02-15T23:31:33.636155+0000","last_active":"2024-02-15T23:31:33.636096+0000","last_peered":"2024-02-15T23:31:33.636096+0000","last_clean":"2024-02-15T23:31:33.636096+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:31:33.636096+0000","last_undegraded":"2024-02-15T23:31:33.636096+0000","last_fullsized":"2024-02-15T23:31:33.636096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.635864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:47.730744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.407893+0000","last_change":"2024-02-15T23:31:24.407975+0000","last_active":"2024-02-15T23:31:24.407893+0000","last_peered":"2024-02-15T23:31:24.407893+0000","last_clean":"2024-02-15T23:31:24.407893+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:24.407893+0000","last_undegraded":"2024-02-15T23:31:24.407893+0000","last_fullsized":"2024-02-15T23:31:24.407893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.407715+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:36.649762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.812342+0000","last_change":"2024-02-15T23:29:37.772409+0000","last_active":"2024-02-15T23:30:10.812342+0000","last_peered":"2024-02-15T23:30:10.812342+0000","last_clean":"2024-02-15T23:30:10.812342+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:30:10.812342+0000","last_undegraded":"2024-02-15T23:30:10.812342+0000","last_fullsized":"2024-02-15T23:30:10.812342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794453+0000","last_change":"2024-02-15T23:29:39.775394+0000","last_active":"2024-02-15T23:30:10.794453+0000","last_peered":"2024-02-15T23:30:10.794453+0000","last_clean":"2024-02-15T23:30:10.794453+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:30:10.794453+0000","last_undegraded":"2024-02-15T23:30:10.794453+0000","last_fullsized":"2024-02-15T23:30:10.794453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.404285+0000","last_change":"2024-02-15T23:31:27.404343+0000","last_active":"2024-02-15T23:31:27.404285+0000","last_peered":"2024-02-15T23:31:27.404285+0000","last_clean":"2024-02-15T23:31:27.404285+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:31:27.404285+0000","last_undegraded":"2024-02-15T23:31:27.404285+0000","last_fullsized":"2024-02-15T23:31:27.404285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.404065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:04.056272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807367+0000","last_change":"2024-02-15T23:29:29.725808+0000","last_active":"2024-02-15T23:30:10.807367+0000","last_peered":"2024-02-15T23:30:10.807367+0000","last_clean":"2024-02-15T23:30:10.807367+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:30:10.807367+0000","last_undegraded":"2024-02-15T23:30:10.807367+0000","last_fullsized":"2024-02-15T23:30:10.807367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785798+0000","last_change":"2024-02-15T23:29:33.719257+0000","last_active":"2024-02-15T23:30:10.785798+0000","last_peered":"2024-02-15T23:30:10.785798+0000","last_clean":"2024-02-15T23:30:10.785798+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:30:10.785798+0000","last_undegraded":"2024-02-15T23:30:10.785798+0000","last_fullsized":"2024-02-15T23:30:10.785798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.812134+0000","last_change":"2024-02-15T23:31:27.812184+0000","last_active":"2024-02-15T23:31:27.812134+0000","last_peered":"2024-02-15T23:31:27.812134+0000","last_clean":"2024-02-15T23:31:27.812134+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:31:27.812134+0000","last_undegraded":"2024-02-15T23:31:27.812134+0000","last_fullsized":"2024-02-15T23:31:27.812134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.812031+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:53.640763+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":344,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.837204+0000","last_change":"2024-02-15T23:31:18.837313+0000","last_active":"2024-02-15T23:31:18.837204+0000","last_peered":"2024-02-15T23:31:18.837204+0000","last_clean":"2024-02-15T23:31:18.837204+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:18.837204+0000","last_undegraded":"2024-02-15T23:31:18.837204+0000","last_fullsized":"2024-02-15T23:31:18.837204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.836996+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:26.809047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.333321+0000","last_change":"2024-02-15T23:29:39.757713+0000","last_active":"2024-02-15T23:30:58.333321+0000","last_peered":"2024-02-15T23:30:58.333321+0000","last_clean":"2024-02-15T23:30:58.333321+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:30:58.333321+0000","last_undegraded":"2024-02-15T23:30:58.333321+0000","last_fullsized":"2024-02-15T23:30:58.333321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780988+0000","last_change":"2024-02-15T23:29:31.706992+0000","last_active":"2024-02-15T23:30:10.780988+0000","last_peered":"2024-02-15T23:30:10.780988+0000","last_clean":"2024-02-15T23:30:10.780988+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:30:10.780988+0000","last_undegraded":"2024-02-15T23:30:10.780988+0000","last_fullsized":"2024-02-15T23:30:10.780988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798518+0000","last_change":"2024-02-15T23:29:29.720429+0000","last_active":"2024-02-15T23:30:10.798518+0000","last_peered":"2024-02-15T23:30:10.798518+0000","last_clean":"2024-02-15T23:30:10.798518+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:30:10.798518+0000","last_undegraded":"2024-02-15T23:30:10.798518+0000","last_fullsized":"2024-02-15T23:30:10.798518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.474619+0000","last_change":"2024-02-15T23:31:27.474688+0000","last_active":"2024-02-15T23:31:27.474619+0000","last_peered":"2024-02-15T23:31:27.474619+0000","last_clean":"2024-02-15T23:31:27.474619+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:27.474619+0000","last_undegraded":"2024-02-15T23:31:27.474619+0000","last_fullsized":"2024-02-15T23:31:27.474619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.474436+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.169933+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809508+0000","last_change":"2024-02-15T23:29:35.750907+0000","last_active":"2024-02-15T23:30:10.809508+0000","last_peered":"2024-02-15T23:30:10.809508+0000","last_clean":"2024-02-15T23:30:10.809508+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:30:10.809508+0000","last_undegraded":"2024-02-15T23:30:10.809508+0000","last_fullsized":"2024-02-15T23:30:10.809508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":387,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.408122+0000","last_change":"2024-02-15T23:31:16.408189+0000","last_active":"2024-02-15T23:31:16.408122+0000","last_peered":"2024-02-15T23:31:16.408122+0000","last_clean":"2024-02-15T23:31:16.408122+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:16.408122+0000","last_undegraded":"2024-02-15T23:31:16.408122+0000","last_fullsized":"2024-02-15T23:31:16.408122+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.407927+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:42.842010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.684496+0000","last_change":"2024-02-15T23:31:32.684561+0000","last_active":"2024-02-15T23:31:32.684496+0000","last_peered":"2024-02-15T23:31:32.684496+0000","last_clean":"2024-02-15T23:31:32.684496+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:31:32.684496+0000","last_undegraded":"2024-02-15T23:31:32.684496+0000","last_fullsized":"2024-02-15T23:31:32.684496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.684302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:13.848320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.322022+0000","last_change":"2024-02-15T23:29:31.710143+0000","last_active":"2024-02-15T23:30:58.322022+0000","last_peered":"2024-02-15T23:30:58.322022+0000","last_clean":"2024-02-15T23:30:58.322022+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:30:58.322022+0000","last_undegraded":"2024-02-15T23:30:58.322022+0000","last_fullsized":"2024-02-15T23:30:58.322022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796744+0000","last_change":"2024-02-15T23:29:29.724689+0000","last_active":"2024-02-15T23:30:10.796744+0000","last_peered":"2024-02-15T23:30:10.796744+0000","last_clean":"2024-02-15T23:30:10.796744+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:30:10.796744+0000","last_undegraded":"2024-02-15T23:30:10.796744+0000","last_fullsized":"2024-02-15T23:30:10.796744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.443924+0000","last_change":"2024-02-15T23:31:16.443979+0000","last_active":"2024-02-15T23:31:16.443924+0000","last_peered":"2024-02-15T23:31:16.443924+0000","last_clean":"2024-02-15T23:31:16.443924+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:31:16.443924+0000","last_undegraded":"2024-02-15T23:31:16.443924+0000","last_fullsized":"2024-02-15T23:31:16.443924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.443730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:16:47.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.362305+0000","last_change":"2024-02-15T23:31:21.362479+0000","last_active":"2024-02-15T23:31:21.362305+0000","last_peered":"2024-02-15T23:31:21.362305+0000","last_clean":"2024-02-15T23:31:21.362305+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:31:21.362305+0000","last_undegraded":"2024-02-15T23:31:21.362305+0000","last_fullsized":"2024-02-15T23:31:21.362305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.362097+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:21.356365+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.792932+0000","last_change":"2024-02-15T23:31:24.792994+0000","last_active":"2024-02-15T23:31:24.792932+0000","last_peered":"2024-02-15T23:31:24.792932+0000","last_clean":"2024-02-15T23:31:24.792932+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:31:24.792932+0000","last_undegraded":"2024-02-15T23:31:24.792932+0000","last_fullsized":"2024-02-15T23:31:24.792932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.792712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:03:10.186879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.472847+0000","last_change":"2024-02-15T23:31:30.472926+0000","last_active":"2024-02-15T23:31:30.472847+0000","last_peered":"2024-02-15T23:31:30.472847+0000","last_clean":"2024-02-15T23:31:30.472847+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:31:30.472847+0000","last_undegraded":"2024-02-15T23:31:30.472847+0000","last_fullsized":"2024-02-15T23:31:30.472847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.472637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.285998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.502657+0000","last_change":"2024-02-15T23:31:31.502716+0000","last_active":"2024-02-15T23:31:31.502657+0000","last_peered":"2024-02-15T23:31:31.502657+0000","last_clean":"2024-02-15T23:31:31.502657+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:31:31.502657+0000","last_undegraded":"2024-02-15T23:31:31.502657+0000","last_fullsized":"2024-02-15T23:31:31.502657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.502461+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:37.162072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397571+0000","last_change":"2024-02-15T23:29:17.391071+0000","last_active":"2024-02-15T23:31:15.397571+0000","last_peered":"2024-02-15T23:31:15.397571+0000","last_clean":"2024-02-15T23:31:15.397571+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:31:15.397571+0000","last_undegraded":"2024-02-15T23:31:15.397571+0000","last_fullsized":"2024-02-15T23:31:15.397571+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_clean_scrub_stamp":"2024-02-15T23:29:15.580621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314216+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:31:16.314216+0000","last_peered":"2024-02-15T23:31:16.314216+0000","last_clean":"2024-02-15T23:31:16.314216+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:31:16.314216+0000","last_undegraded":"2024-02-15T23:31:16.314216+0000","last_fullsized":"2024-02-15T23:31:16.314216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314269+0000","last_change":"2024-02-15T23:29:29.725524+0000","last_active":"2024-02-15T23:31:16.314269+0000","last_peered":"2024-02-15T23:31:16.314269+0000","last_clean":"2024-02-15T23:31:16.314269+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:31:16.314269+0000","last_undegraded":"2024-02-15T23:31:16.314269+0000","last_fullsized":"2024-02-15T23:31:16.314269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.802713+0000","last_change":"2024-02-15T23:30:10.801490+0000","last_active":"2024-02-15T23:30:10.802713+0000","last_peered":"2024-02-15T23:30:10.802713+0000","last_clean":"2024-02-15T23:30:10.802713+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:30:10.802713+0000","last_undegraded":"2024-02-15T23:30:10.802713+0000","last_fullsized":"2024-02-15T23:30:10.802713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.412591+0000","last_change":"2024-02-15T23:31:24.412677+0000","last_active":"2024-02-15T23:31:24.412591+0000","last_peered":"2024-02-15T23:31:24.412591+0000","last_clean":"2024-02-15T23:31:24.412591+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:24.412591+0000","last_undegraded":"2024-02-15T23:31:24.412591+0000","last_fullsized":"2024-02-15T23:31:24.412591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.412389+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:34.534030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.511578+0000","last_change":"2024-02-15T23:31:28.511629+0000","last_active":"2024-02-15T23:31:28.511578+0000","last_peered":"2024-02-15T23:31:28.511578+0000","last_clean":"2024-02-15T23:31:28.511578+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:31:28.511578+0000","last_undegraded":"2024-02-15T23:31:28.511578+0000","last_fullsized":"2024-02-15T23:31:28.511578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.511388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:40.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.953052+0000","last_change":"2024-02-15T23:29:39.777587+0000","last_active":"2024-02-15T23:31:03.953052+0000","last_peered":"2024-02-15T23:31:03.953052+0000","last_clean":"2024-02-15T23:31:03.953052+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:31:03.953052+0000","last_undegraded":"2024-02-15T23:31:03.953052+0000","last_fullsized":"2024-02-15T23:31:03.953052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'13","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.855043+0000","last_change":"2024-02-15T23:29:31.705098+0000","last_active":"2024-02-15T23:30:57.855043+0000","last_peered":"2024-02-15T23:30:57.855043+0000","last_clean":"2024-02-15T23:30:57.855043+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:30:57.855043+0000","last_undegraded":"2024-02-15T23:30:57.855043+0000","last_fullsized":"2024-02-15T23:30:57.855043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314236+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:31:16.314236+0000","last_peered":"2024-02-15T23:31:16.314236+0000","last_clean":"2024-02-15T23:31:16.314236+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:31:16.314236+0000","last_undegraded":"2024-02-15T23:31:16.314236+0000","last_fullsized":"2024-02-15T23:31:16.314236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955118+0000","last_change":"2024-02-15T23:29:29.708594+0000","last_active":"2024-02-15T23:31:14.955118+0000","last_peered":"2024-02-15T23:31:14.955118+0000","last_clean":"2024-02-15T23:31:14.955118+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:31:14.955118+0000","last_undegraded":"2024-02-15T23:31:14.955118+0000","last_fullsized":"2024-02-15T23:31:14.955118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.399113+0000","last_change":"2024-02-15T23:31:20.399165+0000","last_active":"2024-02-15T23:31:20.399113+0000","last_peered":"2024-02-15T23:31:20.399113+0000","last_clean":"2024-02-15T23:31:20.399113+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:31:20.399113+0000","last_undegraded":"2024-02-15T23:31:20.399113+0000","last_fullsized":"2024-02-15T23:31:20.399113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.398920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:13.693335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":447,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.428193+0000","last_change":"2024-02-15T23:31:25.428280+0000","last_active":"2024-02-15T23:31:25.428193+0000","last_peered":"2024-02-15T23:31:25.428193+0000","last_clean":"2024-02-15T23:31:25.428193+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:25.428193+0000","last_undegraded":"2024-02-15T23:31:25.428193+0000","last_fullsized":"2024-02-15T23:31:25.428193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.427985+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:29.336924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807342+0000","last_change":"2024-02-15T23:29:37.769851+0000","last_active":"2024-02-15T23:30:10.807342+0000","last_peered":"2024-02-15T23:30:10.807342+0000","last_clean":"2024-02-15T23:30:10.807342+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:30:10.807342+0000","last_undegraded":"2024-02-15T23:30:10.807342+0000","last_fullsized":"2024-02-15T23:30:10.807342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.064564+0000","last_change":"2024-02-15T23:29:39.779672+0000","last_active":"2024-02-15T23:30:58.064564+0000","last_peered":"2024-02-15T23:30:58.064564+0000","last_clean":"2024-02-15T23:30:58.064564+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:30:58.064564+0000","last_undegraded":"2024-02-15T23:30:58.064564+0000","last_fullsized":"2024-02-15T23:30:58.064564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.937207+0000","last_change":"2024-02-15T23:29:31.694236+0000","last_active":"2024-02-15T23:31:03.937207+0000","last_peered":"2024-02-15T23:31:03.937207+0000","last_clean":"2024-02-15T23:31:03.937207+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:03.937207+0000","last_undegraded":"2024-02-15T23:31:03.937207+0000","last_fullsized":"2024-02-15T23:31:03.937207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.852861+0000","last_change":"2024-02-15T23:29:21.622454+0000","last_active":"2024-02-15T23:31:15.852861+0000","last_peered":"2024-02-15T23:31:15.852861+0000","last_clean":"2024-02-15T23:31:15.852861+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:31:15.852861+0000","last_undegraded":"2024-02-15T23:31:15.852861+0000","last_fullsized":"2024-02-15T23:31:15.852861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955131+0000","last_change":"2024-02-15T23:29:29.718869+0000","last_active":"2024-02-15T23:31:14.955131+0000","last_peered":"2024-02-15T23:31:14.955131+0000","last_clean":"2024-02-15T23:31:14.955131+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:31:14.955131+0000","last_undegraded":"2024-02-15T23:31:14.955131+0000","last_fullsized":"2024-02-15T23:31:14.955131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.778456+0000","last_change":"2024-02-15T23:29:33.703250+0000","last_active":"2024-02-15T23:30:10.778456+0000","last_peered":"2024-02-15T23:30:10.778456+0000","last_clean":"2024-02-15T23:30:10.778456+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:30:10.778456+0000","last_undegraded":"2024-02-15T23:30:10.778456+0000","last_fullsized":"2024-02-15T23:30:10.778456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.811662+0000","last_change":"2024-02-15T23:31:19.811746+0000","last_active":"2024-02-15T23:31:19.811662+0000","last_peered":"2024-02-15T23:31:19.811662+0000","last_clean":"2024-02-15T23:31:19.811662+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:19.811662+0000","last_undegraded":"2024-02-15T23:31:19.811662+0000","last_fullsized":"2024-02-15T23:31:19.811662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.811464+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:28:44.508275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.546459+0000","last_change":"2024-02-15T23:31:32.546516+0000","last_active":"2024-02-15T23:31:32.546459+0000","last_peered":"2024-02-15T23:31:32.546459+0000","last_clean":"2024-02-15T23:31:32.546459+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:31:32.546459+0000","last_undegraded":"2024-02-15T23:31:32.546459+0000","last_fullsized":"2024-02-15T23:31:32.546459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.546263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.575111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798760+0000","last_change":"2024-02-15T23:29:39.769538+0000","last_active":"2024-02-15T23:30:10.798760+0000","last_peered":"2024-02-15T23:30:10.798760+0000","last_clean":"2024-02-15T23:30:10.798760+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:30:10.798760+0000","last_undegraded":"2024-02-15T23:30:10.798760+0000","last_fullsized":"2024-02-15T23:30:10.798760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.937177+0000","last_change":"2024-02-15T23:29:31.691195+0000","last_active":"2024-02-15T23:31:03.937177+0000","last_peered":"2024-02-15T23:31:03.937177+0000","last_clean":"2024-02-15T23:31:03.937177+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:03.937177+0000","last_undegraded":"2024-02-15T23:31:03.937177+0000","last_fullsized":"2024-02-15T23:31:03.937177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314245+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:31:16.314245+0000","last_peered":"2024-02-15T23:31:16.314245+0000","last_clean":"2024-02-15T23:31:16.314245+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:31:16.314245+0000","last_undegraded":"2024-02-15T23:31:16.314245+0000","last_fullsized":"2024-02-15T23:31:16.314245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.852855+0000","last_change":"2024-02-15T23:29:29.721410+0000","last_active":"2024-02-15T23:31:15.852855+0000","last_peered":"2024-02-15T23:31:15.852855+0000","last_clean":"2024-02-15T23:31:15.852855+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:31:15.852855+0000","last_undegraded":"2024-02-15T23:31:15.852855+0000","last_fullsized":"2024-02-15T23:31:15.852855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787163+0000","last_change":"2024-02-15T23:29:33.720740+0000","last_active":"2024-02-15T23:30:10.787163+0000","last_peered":"2024-02-15T23:30:10.787163+0000","last_clean":"2024-02-15T23:30:10.787163+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:30:10.787163+0000","last_undegraded":"2024-02-15T23:30:10.787163+0000","last_fullsized":"2024-02-15T23:30:10.787163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:05.274897+0000","last_change":"2024-02-15T23:29:35.749663+0000","last_active":"2024-02-15T23:31:05.274897+0000","last_peered":"2024-02-15T23:31:05.274897+0000","last_clean":"2024-02-15T23:31:05.274897+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:31:05.274897+0000","last_undegraded":"2024-02-15T23:31:05.274897+0000","last_fullsized":"2024-02-15T23:31:05.274897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813150+0000","last_change":"2024-02-15T23:29:37.774191+0000","last_active":"2024-02-15T23:30:10.813150+0000","last_peered":"2024-02-15T23:30:10.813150+0000","last_clean":"2024-02-15T23:30:10.813150+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:30:10.813150+0000","last_undegraded":"2024-02-15T23:30:10.813150+0000","last_fullsized":"2024-02-15T23:30:10.813150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781939+0000","last_change":"2024-02-15T23:29:39.768032+0000","last_active":"2024-02-15T23:30:10.781939+0000","last_peered":"2024-02-15T23:30:10.781939+0000","last_clean":"2024-02-15T23:30:10.781939+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:30:10.781939+0000","last_undegraded":"2024-02-15T23:30:10.781939+0000","last_fullsized":"2024-02-15T23:30:10.781939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'11","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.321751+0000","last_change":"2024-02-15T23:30:10.810101+0000","last_active":"2024-02-15T23:30:58.321751+0000","last_peered":"2024-02-15T23:30:58.321751+0000","last_clean":"2024-02-15T23:30:58.321751+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:30:58.321751+0000","last_undegraded":"2024-02-15T23:30:58.321751+0000","last_fullsized":"2024-02-15T23:30:58.321751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.853149+0000","last_change":"2024-02-15T23:29:29.733697+0000","last_active":"2024-02-15T23:31:15.853149+0000","last_peered":"2024-02-15T23:31:15.853149+0000","last_clean":"2024-02-15T23:31:15.853149+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:31:15.853149+0000","last_undegraded":"2024-02-15T23:31:15.853149+0000","last_fullsized":"2024-02-15T23:31:15.853149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955213+0000","last_change":"2024-02-15T23:29:21.627861+0000","last_active":"2024-02-15T23:31:14.955213+0000","last_peered":"2024-02-15T23:31:14.955213+0000","last_clean":"2024-02-15T23:31:14.955213+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:31:14.955213+0000","last_undegraded":"2024-02-15T23:31:14.955213+0000","last_fullsized":"2024-02-15T23:31:14.955213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.579288+0000","last_change":"2024-02-15T23:30:10.801694+0000","last_active":"2024-02-15T23:30:14.579288+0000","last_peered":"2024-02-15T23:30:14.579288+0000","last_clean":"2024-02-15T23:30:14.579288+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:30:14.579288+0000","last_undegraded":"2024-02-15T23:30:14.579288+0000","last_fullsized":"2024-02-15T23:30:14.579288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":143,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.630039+0000","last_change":"2024-02-15T23:31:23.630125+0000","last_active":"2024-02-15T23:31:23.630039+0000","last_peered":"2024-02-15T23:31:23.630039+0000","last_clean":"2024-02-15T23:31:23.630039+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:23.630039+0000","last_undegraded":"2024-02-15T23:31:23.630039+0000","last_fullsized":"2024-02-15T23:31:23.630039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.629845+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:22:36.251662+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.871562+0000","last_change":"2024-02-15T23:31:17.871614+0000","last_active":"2024-02-15T23:31:17.871562+0000","last_peered":"2024-02-15T23:31:17.871562+0000","last_clean":"2024-02-15T23:31:17.871562+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:31:17.871562+0000","last_undegraded":"2024-02-15T23:31:17.871562+0000","last_fullsized":"2024-02-15T23:31:17.871562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.871335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:42.844132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.336866+0000","last_change":"2024-02-15T23:29:39.767710+0000","last_active":"2024-02-15T23:30:58.336866+0000","last_peered":"2024-02-15T23:30:58.336866+0000","last_clean":"2024-02-15T23:30:58.336866+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:30:58.336866+0000","last_undegraded":"2024-02-15T23:30:58.336866+0000","last_fullsized":"2024-02-15T23:30:58.336866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.805535+0000","last_change":"2024-02-15T23:30:10.804317+0000","last_active":"2024-02-15T23:30:10.805535+0000","last_peered":"2024-02-15T23:30:10.805535+0000","last_clean":"2024-02-15T23:30:10.805535+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:30:10.805535+0000","last_undegraded":"2024-02-15T23:30:10.805535+0000","last_fullsized":"2024-02-15T23:30:10.805535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955269+0000","last_change":"2024-02-15T23:29:29.717068+0000","last_active":"2024-02-15T23:31:14.955269+0000","last_peered":"2024-02-15T23:31:14.955269+0000","last_clean":"2024-02-15T23:31:14.955269+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:31:14.955269+0000","last_undegraded":"2024-02-15T23:31:14.955269+0000","last_fullsized":"2024-02-15T23:31:14.955269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314230+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:31:16.314230+0000","last_peered":"2024-02-15T23:31:16.314230+0000","last_clean":"2024-02-15T23:31:16.314230+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:31:16.314230+0000","last_undegraded":"2024-02-15T23:31:16.314230+0000","last_fullsized":"2024-02-15T23:31:16.314230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.396702+0000","last_change":"2024-02-15T23:31:17.396757+0000","last_active":"2024-02-15T23:31:17.396702+0000","last_peered":"2024-02-15T23:31:17.396702+0000","last_clean":"2024-02-15T23:31:17.396702+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:31:17.396702+0000","last_undegraded":"2024-02-15T23:31:17.396702+0000","last_fullsized":"2024-02-15T23:31:17.396702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.396500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:51.906597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.394147+0000","last_change":"2024-02-15T23:31:19.394229+0000","last_active":"2024-02-15T23:31:19.394147+0000","last_peered":"2024-02-15T23:31:19.394147+0000","last_clean":"2024-02-15T23:31:19.394147+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:31:19.394147+0000","last_undegraded":"2024-02-15T23:31:19.394147+0000","last_fullsized":"2024-02-15T23:31:19.394147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.393966+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:40.563671+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.413546+0000","last_change":"2024-02-15T23:31:15.413611+0000","last_active":"2024-02-15T23:31:15.413546+0000","last_peered":"2024-02-15T23:31:15.413546+0000","last_clean":"2024-02-15T23:31:15.413546+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:15.413546+0000","last_undegraded":"2024-02-15T23:31:15.413546+0000","last_fullsized":"2024-02-15T23:31:15.413546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.413363+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:05.337748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.934857+0000","last_change":"2024-02-15T23:29:39.771638+0000","last_active":"2024-02-15T23:31:03.934857+0000","last_peered":"2024-02-15T23:31:03.934857+0000","last_clean":"2024-02-15T23:31:03.934857+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:31:03.934857+0000","last_undegraded":"2024-02-15T23:31:03.934857+0000","last_fullsized":"2024-02-15T23:31:03.934857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315207+0000","last_change":"2024-02-15T23:29:31.701536+0000","last_active":"2024-02-15T23:31:16.315207+0000","last_peered":"2024-02-15T23:31:16.315207+0000","last_clean":"2024-02-15T23:31:16.315207+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:31:16.315207+0000","last_undegraded":"2024-02-15T23:31:16.315207+0000","last_fullsized":"2024-02-15T23:31:16.315207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.070664+0000","last_change":"2024-02-15T23:29:29.714312+0000","last_active":"2024-02-15T23:30:15.070664+0000","last_peered":"2024-02-15T23:30:15.070664+0000","last_clean":"2024-02-15T23:30:15.070664+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:30:15.070664+0000","last_undegraded":"2024-02-15T23:30:15.070664+0000","last_fullsized":"2024-02-15T23:30:15.070664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955093+0000","last_change":"2024-02-15T23:29:21.629944+0000","last_active":"2024-02-15T23:31:14.955093+0000","last_peered":"2024-02-15T23:31:14.955093+0000","last_clean":"2024-02-15T23:31:14.955093+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:31:14.955093+0000","last_undegraded":"2024-02-15T23:31:14.955093+0000","last_fullsized":"2024-02-15T23:31:14.955093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.405648+0000","last_change":"2024-02-15T23:31:21.405756+0000","last_active":"2024-02-15T23:31:21.405648+0000","last_peered":"2024-02-15T23:31:21.405648+0000","last_clean":"2024-02-15T23:31:21.405648+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:31:21.405648+0000","last_undegraded":"2024-02-15T23:31:21.405648+0000","last_fullsized":"2024-02-15T23:31:21.405648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.405364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:58.637097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806668+0000","last_change":"2024-02-15T23:29:35.749284+0000","last_active":"2024-02-15T23:30:10.806668+0000","last_peered":"2024-02-15T23:30:10.806668+0000","last_clean":"2024-02-15T23:30:10.806668+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:30:10.806668+0000","last_undegraded":"2024-02-15T23:30:10.806668+0000","last_fullsized":"2024-02-15T23:30:10.806668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":323,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.594850+0000","last_change":"2024-02-15T23:31:19.594968+0000","last_active":"2024-02-15T23:31:19.594850+0000","last_peered":"2024-02-15T23:31:19.594850+0000","last_clean":"2024-02-15T23:31:19.594850+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:19.594850+0000","last_undegraded":"2024-02-15T23:31:19.594850+0000","last_fullsized":"2024-02-15T23:31:19.594850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.594660+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:58.295976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.544017+0000","last_change":"2024-02-15T23:31:34.544082+0000","last_active":"2024-02-15T23:31:34.544017+0000","last_peered":"2024-02-15T23:31:34.544017+0000","last_clean":"2024-02-15T23:31:34.544017+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:31:34.544017+0000","last_undegraded":"2024-02-15T23:31:34.544017+0000","last_fullsized":"2024-02-15T23:31:34.544017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.543832+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.512019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.936758+0000","last_change":"2024-02-15T23:29:31.709896+0000","last_active":"2024-02-15T23:31:03.936758+0000","last_peered":"2024-02-15T23:31:03.936758+0000","last_clean":"2024-02-15T23:31:03.936758+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:03.936758+0000","last_undegraded":"2024-02-15T23:31:03.936758+0000","last_fullsized":"2024-02-15T23:31:03.936758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786346+0000","last_change":"2024-02-15T23:29:29.720515+0000","last_active":"2024-02-15T23:30:10.786346+0000","last_peered":"2024-02-15T23:30:10.786346+0000","last_clean":"2024-02-15T23:30:10.786346+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:30:10.786346+0000","last_undegraded":"2024-02-15T23:30:10.786346+0000","last_fullsized":"2024-02-15T23:30:10.786346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314282+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:31:16.314282+0000","last_peered":"2024-02-15T23:31:16.314282+0000","last_clean":"2024-02-15T23:31:16.314282+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:31:16.314282+0000","last_undegraded":"2024-02-15T23:31:16.314282+0000","last_fullsized":"2024-02-15T23:31:16.314282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.386313+0000","last_change":"2024-02-15T23:31:26.386313+0000","last_active":"2024-02-15T23:31:26.386313+0000","last_peered":"2024-02-15T23:31:26.386313+0000","last_clean":"2024-02-15T23:31:26.386313+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:31:26.386313+0000","last_undegraded":"2024-02-15T23:31:26.386313+0000","last_fullsized":"2024-02-15T23:31:26.386313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.386074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:29.907866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.809481+0000","last_change":"2024-02-15T23:31:25.809672+0000","last_active":"2024-02-15T23:31:25.809481+0000","last_peered":"2024-02-15T23:31:25.809481+0000","last_clean":"2024-02-15T23:31:25.809481+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:25.809481+0000","last_undegraded":"2024-02-15T23:31:25.809481+0000","last_fullsized":"2024-02-15T23:31:25.809481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.809268+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:15.733653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.613310+0000","last_change":"2024-02-15T23:31:22.613362+0000","last_active":"2024-02-15T23:31:22.613310+0000","last_peered":"2024-02-15T23:31:22.613310+0000","last_clean":"2024-02-15T23:31:22.613310+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:31:22.613310+0000","last_undegraded":"2024-02-15T23:31:22.613310+0000","last_fullsized":"2024-02-15T23:31:22.613310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.613116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:43.072580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780671+0000","last_change":"2024-02-15T23:29:39.781085+0000","last_active":"2024-02-15T23:30:10.780671+0000","last_peered":"2024-02-15T23:30:10.780671+0000","last_clean":"2024-02-15T23:30:10.780671+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:30:10.780671+0000","last_undegraded":"2024-02-15T23:30:10.780671+0000","last_fullsized":"2024-02-15T23:30:10.780671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780049+0000","last_change":"2024-02-15T23:29:39.777993+0000","last_active":"2024-02-15T23:30:10.780049+0000","last_peered":"2024-02-15T23:30:10.780049+0000","last_clean":"2024-02-15T23:30:10.780049+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:30:10.780049+0000","last_undegraded":"2024-02-15T23:30:10.780049+0000","last_fullsized":"2024-02-15T23:30:10.780049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784609+0000","last_change":"2024-02-15T23:29:31.704768+0000","last_active":"2024-02-15T23:30:10.784609+0000","last_peered":"2024-02-15T23:30:10.784609+0000","last_clean":"2024-02-15T23:30:10.784609+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:30:10.784609+0000","last_undegraded":"2024-02-15T23:30:10.784609+0000","last_fullsized":"2024-02-15T23:30:10.784609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.808203+0000","last_change":"2024-02-15T23:29:29.728542+0000","last_active":"2024-02-15T23:30:10.808203+0000","last_peered":"2024-02-15T23:30:10.808203+0000","last_clean":"2024-02-15T23:30:10.808203+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:30:10.808203+0000","last_undegraded":"2024-02-15T23:30:10.808203+0000","last_fullsized":"2024-02-15T23:30:10.808203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'2","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.627529+0000","last_change":"2024-02-15T23:29:33.711524+0000","last_active":"2024-02-15T23:31:11.627529+0000","last_peered":"2024-02-15T23:31:11.627529+0000","last_clean":"2024-02-15T23:31:11.627529+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:11.627529+0000","last_undegraded":"2024-02-15T23:31:11.627529+0000","last_fullsized":"2024-02-15T23:31:11.627529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.391276+0000","last_change":"2024-02-15T23:31:22.391356+0000","last_active":"2024-02-15T23:31:22.391276+0000","last_peered":"2024-02-15T23:31:22.391276+0000","last_clean":"2024-02-15T23:31:22.391276+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:31:22.391276+0000","last_undegraded":"2024-02-15T23:31:22.391276+0000","last_fullsized":"2024-02-15T23:31:22.391276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.391105+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:17.676736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797659+0000","last_change":"2024-02-15T23:29:37.765986+0000","last_active":"2024-02-15T23:30:10.797659+0000","last_peered":"2024-02-15T23:30:10.797659+0000","last_clean":"2024-02-15T23:30:10.797659+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:30:10.797659+0000","last_undegraded":"2024-02-15T23:30:10.797659+0000","last_fullsized":"2024-02-15T23:30:10.797659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786548+0000","last_change":"2024-02-15T23:29:39.766083+0000","last_active":"2024-02-15T23:30:10.786548+0000","last_peered":"2024-02-15T23:30:10.786548+0000","last_clean":"2024-02-15T23:30:10.786548+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:30:10.786548+0000","last_undegraded":"2024-02-15T23:30:10.786548+0000","last_fullsized":"2024-02-15T23:30:10.786548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.103516+0000","last_change":"2024-02-15T23:29:31.711705+0000","last_active":"2024-02-15T23:30:15.103516+0000","last_peered":"2024-02-15T23:30:15.103516+0000","last_clean":"2024-02-15T23:30:15.103516+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:30:15.103516+0000","last_undegraded":"2024-02-15T23:30:15.103516+0000","last_fullsized":"2024-02-15T23:30:15.103516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777519+0000","last_change":"2024-02-15T23:29:29.723948+0000","last_active":"2024-02-15T23:30:10.777519+0000","last_peered":"2024-02-15T23:30:10.777519+0000","last_clean":"2024-02-15T23:30:10.777519+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:30:10.777519+0000","last_undegraded":"2024-02-15T23:30:10.777519+0000","last_fullsized":"2024-02-15T23:30:10.777519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.359753+0000","last_change":"2024-02-15T23:31:25.359814+0000","last_active":"2024-02-15T23:31:25.359753+0000","last_peered":"2024-02-15T23:31:25.359753+0000","last_clean":"2024-02-15T23:31:25.359753+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:31:25.359753+0000","last_undegraded":"2024-02-15T23:31:25.359753+0000","last_fullsized":"2024-02-15T23:31:25.359753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.359571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:32.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.537578+0000","last_change":"2024-02-15T23:31:27.537676+0000","last_active":"2024-02-15T23:31:27.537578+0000","last_peered":"2024-02-15T23:31:27.537578+0000","last_clean":"2024-02-15T23:31:27.537578+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:31:27.537578+0000","last_undegraded":"2024-02-15T23:31:27.537578+0000","last_fullsized":"2024-02-15T23:31:27.537578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.537385+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.232882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.781850+0000","last_change":"2024-02-15T23:31:20.781906+0000","last_active":"2024-02-15T23:31:20.781850+0000","last_peered":"2024-02-15T23:31:20.781850+0000","last_clean":"2024-02-15T23:31:20.781850+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:31:20.781850+0000","last_undegraded":"2024-02-15T23:31:20.781850+0000","last_fullsized":"2024-02-15T23:31:20.781850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.781647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:41:14.417063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786138+0000","last_change":"2024-02-15T23:29:39.783805+0000","last_active":"2024-02-15T23:30:10.786138+0000","last_peered":"2024-02-15T23:30:10.786138+0000","last_clean":"2024-02-15T23:30:10.786138+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:30:10.786138+0000","last_undegraded":"2024-02-15T23:30:10.786138+0000","last_fullsized":"2024-02-15T23:30:10.786138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'9","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.321492+0000","last_change":"2024-02-15T23:29:31.709732+0000","last_active":"2024-02-15T23:30:58.321492+0000","last_peered":"2024-02-15T23:30:58.321492+0000","last_clean":"2024-02-15T23:30:58.321492+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:30:58.321492+0000","last_undegraded":"2024-02-15T23:30:58.321492+0000","last_fullsized":"2024-02-15T23:30:58.321492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780260+0000","last_change":"2024-02-15T23:29:29.723953+0000","last_active":"2024-02-15T23:30:10.780260+0000","last_peered":"2024-02-15T23:30:10.780260+0000","last_clean":"2024-02-15T23:30:10.780260+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:30:10.780260+0000","last_undegraded":"2024-02-15T23:30:10.780260+0000","last_fullsized":"2024-02-15T23:30:10.780260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.710448+0000","last_change":"2024-02-15T23:31:29.710546+0000","last_active":"2024-02-15T23:31:29.710448+0000","last_peered":"2024-02-15T23:31:29.710448+0000","last_clean":"2024-02-15T23:31:29.710448+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:31:29.710448+0000","last_undegraded":"2024-02-15T23:31:29.710448+0000","last_fullsized":"2024-02-15T23:31:29.710448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.710190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:50.879896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'43","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.526032+0000","last_change":"2024-02-15T23:31:26.526124+0000","last_active":"2024-02-15T23:31:26.526032+0000","last_peered":"2024-02-15T23:31:26.526032+0000","last_clean":"2024-02-15T23:31:26.526032+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:26.526032+0000","last_undegraded":"2024-02-15T23:31:26.526032+0000","last_fullsized":"2024-02-15T23:31:26.526032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.525844+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:36.827174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.360654+0000","last_change":"2024-02-15T23:31:17.360759+0000","last_active":"2024-02-15T23:31:17.360654+0000","last_peered":"2024-02-15T23:31:17.360654+0000","last_clean":"2024-02-15T23:31:17.360654+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:31:17.360654+0000","last_undegraded":"2024-02-15T23:31:17.360654+0000","last_fullsized":"2024-02-15T23:31:17.360654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.360411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.189143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806975+0000","last_change":"2024-02-15T23:29:39.784430+0000","last_active":"2024-02-15T23:30:10.806975+0000","last_peered":"2024-02-15T23:30:10.806975+0000","last_clean":"2024-02-15T23:30:10.806975+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:30:10.806975+0000","last_undegraded":"2024-02-15T23:30:10.806975+0000","last_fullsized":"2024-02-15T23:30:10.806975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.322147+0000","last_change":"2024-02-15T23:29:31.701986+0000","last_active":"2024-02-15T23:30:58.322147+0000","last_peered":"2024-02-15T23:30:58.322147+0000","last_clean":"2024-02-15T23:30:58.322147+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:30:58.322147+0000","last_undegraded":"2024-02-15T23:30:58.322147+0000","last_fullsized":"2024-02-15T23:30:58.322147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:13.506576+0000","last_change":"2024-02-15T23:29:29.736668+0000","last_active":"2024-02-15T23:30:13.506576+0000","last_peered":"2024-02-15T23:30:13.506576+0000","last_clean":"2024-02-15T23:30:13.506576+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:30:13.506576+0000","last_undegraded":"2024-02-15T23:30:13.506576+0000","last_fullsized":"2024-02-15T23:30:13.506576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.371929+0000","last_change":"2024-02-15T23:31:18.372027+0000","last_active":"2024-02-15T23:31:18.371929+0000","last_peered":"2024-02-15T23:31:18.371929+0000","last_clean":"2024-02-15T23:31:18.371929+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:31:18.371929+0000","last_undegraded":"2024-02-15T23:31:18.371929+0000","last_fullsized":"2024-02-15T23:31:18.371929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.371701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:25.403990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.817316+0000","last_change":"2024-02-15T23:31:26.817387+0000","last_active":"2024-02-15T23:31:26.817316+0000","last_peered":"2024-02-15T23:31:26.817316+0000","last_clean":"2024-02-15T23:31:26.817316+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:31:26.817316+0000","last_undegraded":"2024-02-15T23:31:26.817316+0000","last_fullsized":"2024-02-15T23:31:26.817316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.817124+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:53.251206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.927912+0000","last_change":"2024-02-15T23:31:15.927965+0000","last_active":"2024-02-15T23:31:15.927912+0000","last_peered":"2024-02-15T23:31:15.927912+0000","last_clean":"2024-02-15T23:31:15.927912+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:31:15.927912+0000","last_undegraded":"2024-02-15T23:31:15.927912+0000","last_fullsized":"2024-02-15T23:31:15.927912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.927696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:57:32.034698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.814505+0000","last_change":"2024-02-15T23:29:31.705672+0000","last_active":"2024-02-15T23:30:10.814505+0000","last_peered":"2024-02-15T23:30:10.814505+0000","last_clean":"2024-02-15T23:30:10.814505+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:30:10.814505+0000","last_undegraded":"2024-02-15T23:30:10.814505+0000","last_fullsized":"2024-02-15T23:30:10.814505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795421+0000","last_change":"2024-02-15T23:29:29.721645+0000","last_active":"2024-02-15T23:30:10.795421+0000","last_peered":"2024-02-15T23:30:10.795421+0000","last_clean":"2024-02-15T23:30:10.795421+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:30:10.795421+0000","last_undegraded":"2024-02-15T23:30:10.795421+0000","last_fullsized":"2024-02-15T23:30:10.795421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.533581+0000","last_change":"2024-02-15T23:31:34.533581+0000","last_active":"2024-02-15T23:31:34.533581+0000","last_peered":"2024-02-15T23:31:34.533581+0000","last_clean":"2024-02-15T23:31:34.533581+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:31:34.533581+0000","last_undegraded":"2024-02-15T23:31:34.533581+0000","last_fullsized":"2024-02-15T23:31:34.533581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.533297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.501484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.507729+0000","last_change":"2024-02-15T23:31:29.507799+0000","last_active":"2024-02-15T23:31:29.507729+0000","last_peered":"2024-02-15T23:31:29.507729+0000","last_clean":"2024-02-15T23:31:29.507729+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:29.507729+0000","last_undegraded":"2024-02-15T23:31:29.507729+0000","last_fullsized":"2024-02-15T23:31:29.507729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.507529+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.492158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.901536+0000","last_change":"2024-02-15T23:31:16.901594+0000","last_active":"2024-02-15T23:31:16.901536+0000","last_peered":"2024-02-15T23:31:16.901536+0000","last_clean":"2024-02-15T23:31:16.901536+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:31:16.901536+0000","last_undegraded":"2024-02-15T23:31:16.901536+0000","last_fullsized":"2024-02-15T23:31:16.901536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.901336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:01:50.745987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.329295+0000","last_change":"2024-02-15T23:29:39.778768+0000","last_active":"2024-02-15T23:30:58.329295+0000","last_peered":"2024-02-15T23:30:58.329295+0000","last_clean":"2024-02-15T23:30:58.329295+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:30:58.329295+0000","last_undegraded":"2024-02-15T23:30:58.329295+0000","last_fullsized":"2024-02-15T23:30:58.329295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955514+0000","last_change":"2024-02-15T23:29:31.695343+0000","last_active":"2024-02-15T23:31:14.955514+0000","last_peered":"2024-02-15T23:31:14.955514+0000","last_clean":"2024-02-15T23:31:14.955514+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:31:14.955514+0000","last_undegraded":"2024-02-15T23:31:14.955514+0000","last_fullsized":"2024-02-15T23:31:14.955514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.782405+0000","last_change":"2024-02-15T23:29:29.737932+0000","last_active":"2024-02-15T23:30:10.782405+0000","last_peered":"2024-02-15T23:30:10.782405+0000","last_clean":"2024-02-15T23:30:10.782405+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:30:10.782405+0000","last_undegraded":"2024-02-15T23:30:10.782405+0000","last_fullsized":"2024-02-15T23:30:10.782405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781120+0000","last_change":"2024-02-15T23:29:33.704716+0000","last_active":"2024-02-15T23:30:10.781120+0000","last_peered":"2024-02-15T23:30:10.781120+0000","last_clean":"2024-02-15T23:30:10.781120+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:30:10.781120+0000","last_undegraded":"2024-02-15T23:30:10.781120+0000","last_fullsized":"2024-02-15T23:30:10.781120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.444939+0000","last_change":"2024-02-15T23:31:28.445025+0000","last_active":"2024-02-15T23:31:28.444939+0000","last_peered":"2024-02-15T23:31:28.444939+0000","last_clean":"2024-02-15T23:31:28.444939+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:31:28.444939+0000","last_undegraded":"2024-02-15T23:31:28.444939+0000","last_fullsized":"2024-02-15T23:31:28.444939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.444726+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:09.360474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.369874+0000","last_change":"2024-02-15T23:31:22.369935+0000","last_active":"2024-02-15T23:31:22.369874+0000","last_peered":"2024-02-15T23:31:22.369874+0000","last_clean":"2024-02-15T23:31:22.369874+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:31:22.369874+0000","last_undegraded":"2024-02-15T23:31:22.369874+0000","last_fullsized":"2024-02-15T23:31:22.369874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.369655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:03.533673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797646+0000","last_change":"2024-02-15T23:29:39.769995+0000","last_active":"2024-02-15T23:30:10.797646+0000","last_peered":"2024-02-15T23:30:10.797646+0000","last_clean":"2024-02-15T23:30:10.797646+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:30:10.797646+0000","last_undegraded":"2024-02-15T23:30:10.797646+0000","last_fullsized":"2024-02-15T23:30:10.797646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.454838+0000","last_change":"2024-02-15T23:31:29.454965+0000","last_active":"2024-02-15T23:31:29.454838+0000","last_peered":"2024-02-15T23:31:29.454838+0000","last_clean":"2024-02-15T23:31:29.454838+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:29.454838+0000","last_undegraded":"2024-02-15T23:31:29.454838+0000","last_fullsized":"2024-02-15T23:31:29.454838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.454568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:03.856437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.080507+0000","last_change":"2024-02-15T23:29:29.706515+0000","last_active":"2024-02-15T23:30:15.080507+0000","last_peered":"2024-02-15T23:30:15.080507+0000","last_clean":"2024-02-15T23:30:15.080507+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:30:15.080507+0000","last_undegraded":"2024-02-15T23:30:15.080507+0000","last_fullsized":"2024-02-15T23:30:15.080507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.714383+0000","last_change":"2024-02-15T23:31:31.714462+0000","last_active":"2024-02-15T23:31:31.714383+0000","last_peered":"2024-02-15T23:31:31.714383+0000","last_clean":"2024-02-15T23:31:31.714383+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:31:31.714383+0000","last_undegraded":"2024-02-15T23:31:31.714383+0000","last_fullsized":"2024-02-15T23:31:31.714383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.714124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:31.708391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.561806+0000","last_change":"2024-02-15T23:31:25.561879+0000","last_active":"2024-02-15T23:31:25.561806+0000","last_peered":"2024-02-15T23:31:25.561806+0000","last_clean":"2024-02-15T23:31:25.561806+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:31:25.561806+0000","last_undegraded":"2024-02-15T23:31:25.561806+0000","last_fullsized":"2024-02-15T23:31:25.561806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.561617+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:41.337167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787722+0000","last_change":"2024-02-15T23:29:37.765611+0000","last_active":"2024-02-15T23:30:10.787722+0000","last_peered":"2024-02-15T23:30:10.787722+0000","last_clean":"2024-02-15T23:30:10.787722+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:30:10.787722+0000","last_undegraded":"2024-02-15T23:30:10.787722+0000","last_fullsized":"2024-02-15T23:30:10.787722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797840+0000","last_change":"2024-02-15T23:29:39.769430+0000","last_active":"2024-02-15T23:30:10.797840+0000","last_peered":"2024-02-15T23:30:10.797840+0000","last_clean":"2024-02-15T23:30:10.797840+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:30:10.797840+0000","last_undegraded":"2024-02-15T23:30:10.797840+0000","last_fullsized":"2024-02-15T23:30:10.797840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791139+0000","last_change":"2024-02-15T23:29:31.691631+0000","last_active":"2024-02-15T23:30:10.791139+0000","last_peered":"2024-02-15T23:30:10.791139+0000","last_clean":"2024-02-15T23:30:10.791139+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:30:10.791139+0000","last_undegraded":"2024-02-15T23:30:10.791139+0000","last_fullsized":"2024-02-15T23:30:10.791139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:13.509778+0000","last_change":"2024-02-15T23:29:29.720236+0000","last_active":"2024-02-15T23:30:13.509778+0000","last_peered":"2024-02-15T23:30:13.509778+0000","last_clean":"2024-02-15T23:30:13.509778+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:30:13.509778+0000","last_undegraded":"2024-02-15T23:30:13.509778+0000","last_fullsized":"2024-02-15T23:30:13.509778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.554250+0000","last_change":"2024-02-15T23:31:33.554311+0000","last_active":"2024-02-15T23:31:33.554250+0000","last_peered":"2024-02-15T23:31:33.554250+0000","last_clean":"2024-02-15T23:31:33.554250+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:31:33.554250+0000","last_undegraded":"2024-02-15T23:31:33.554250+0000","last_fullsized":"2024-02-15T23:31:33.554250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.554047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.257009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810788+0000","last_change":"2024-02-15T23:29:35.751777+0000","last_active":"2024-02-15T23:30:10.810788+0000","last_peered":"2024-02-15T23:30:10.810788+0000","last_clean":"2024-02-15T23:30:10.810788+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:30:10.810788+0000","last_undegraded":"2024-02-15T23:30:10.810788+0000","last_fullsized":"2024-02-15T23:30:10.810788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.756088+0000","last_change":"2024-02-15T23:31:28.756163+0000","last_active":"2024-02-15T23:31:28.756088+0000","last_peered":"2024-02-15T23:31:28.756088+0000","last_clean":"2024-02-15T23:31:28.756088+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:28.756088+0000","last_undegraded":"2024-02-15T23:31:28.756088+0000","last_fullsized":"2024-02-15T23:31:28.756088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.755882+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:32.706979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794063+0000","last_change":"2024-02-15T23:29:39.775113+0000","last_active":"2024-02-15T23:30:10.794063+0000","last_peered":"2024-02-15T23:30:10.794063+0000","last_clean":"2024-02-15T23:30:10.794063+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:30:10.794063+0000","last_undegraded":"2024-02-15T23:30:10.794063+0000","last_fullsized":"2024-02-15T23:30:10.794063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.774613+0000","last_change":"2024-02-15T23:29:31.684239+0000","last_active":"2024-02-15T23:30:15.774613+0000","last_peered":"2024-02-15T23:30:15.774613+0000","last_clean":"2024-02-15T23:30:15.774613+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:30:15.774613+0000","last_undegraded":"2024-02-15T23:30:15.774613+0000","last_fullsized":"2024-02-15T23:30:15.774613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796775+0000","last_change":"2024-02-15T23:29:29.725067+0000","last_active":"2024-02-15T23:30:10.796775+0000","last_peered":"2024-02-15T23:30:10.796775+0000","last_clean":"2024-02-15T23:30:10.796775+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:30:10.796775+0000","last_undegraded":"2024-02-15T23:30:10.796775+0000","last_fullsized":"2024-02-15T23:30:10.796775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.518536+0000","last_change":"2024-02-15T23:31:31.518612+0000","last_active":"2024-02-15T23:31:31.518536+0000","last_peered":"2024-02-15T23:31:31.518536+0000","last_clean":"2024-02-15T23:31:31.518536+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:31:31.518536+0000","last_undegraded":"2024-02-15T23:31:31.518536+0000","last_fullsized":"2024-02-15T23:31:31.518536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.518312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.640014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.423777+0000","last_change":"2024-02-15T23:31:23.423852+0000","last_active":"2024-02-15T23:31:23.423777+0000","last_peered":"2024-02-15T23:31:23.423777+0000","last_clean":"2024-02-15T23:31:23.423777+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:31:23.423777+0000","last_undegraded":"2024-02-15T23:31:23.423777+0000","last_fullsized":"2024-02-15T23:31:23.423777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.423607+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:37.518487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.569028+0000","last_change":"2024-02-15T23:31:15.569048+0000","last_active":"2024-02-15T23:31:15.569028+0000","last_peered":"2024-02-15T23:31:15.569028+0000","last_clean":"2024-02-15T23:31:15.569028+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:31:15.569028+0000","last_undegraded":"2024-02-15T23:31:15.569028+0000","last_fullsized":"2024-02-15T23:31:15.569028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.568926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:10.440118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796043+0000","last_change":"2024-02-15T23:29:39.782265+0000","last_active":"2024-02-15T23:30:10.796043+0000","last_peered":"2024-02-15T23:30:10.796043+0000","last_clean":"2024-02-15T23:30:10.796043+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:30:10.796043+0000","last_undegraded":"2024-02-15T23:30:10.796043+0000","last_fullsized":"2024-02-15T23:30:10.796043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.759848+0000","last_change":"2024-02-15T23:29:31.685467+0000","last_active":"2024-02-15T23:30:14.759848+0000","last_peered":"2024-02-15T23:30:14.759848+0000","last_clean":"2024-02-15T23:30:14.759848+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:30:14.759848+0000","last_undegraded":"2024-02-15T23:30:14.759848+0000","last_fullsized":"2024-02-15T23:30:14.759848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809624+0000","last_change":"2024-02-15T23:29:29.728334+0000","last_active":"2024-02-15T23:30:10.809624+0000","last_peered":"2024-02-15T23:30:10.809624+0000","last_clean":"2024-02-15T23:30:10.809624+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:30:10.809624+0000","last_undegraded":"2024-02-15T23:30:10.809624+0000","last_fullsized":"2024-02-15T23:30:10.809624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.758510+0000","last_change":"2024-02-15T23:31:30.758567+0000","last_active":"2024-02-15T23:31:30.758510+0000","last_peered":"2024-02-15T23:31:30.758510+0000","last_clean":"2024-02-15T23:31:30.758510+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:31:30.758510+0000","last_undegraded":"2024-02-15T23:31:30.758510+0000","last_fullsized":"2024-02-15T23:31:30.758510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.758324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:34.432457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.549687+0000","last_change":"2024-02-15T23:31:30.549776+0000","last_active":"2024-02-15T23:31:30.549687+0000","last_peered":"2024-02-15T23:31:30.549687+0000","last_clean":"2024-02-15T23:31:30.549687+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:31:30.549687+0000","last_undegraded":"2024-02-15T23:31:30.549687+0000","last_fullsized":"2024-02-15T23:31:30.549687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.549503+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.362864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794547+0000","last_change":"2024-02-15T23:29:37.765925+0000","last_active":"2024-02-15T23:30:10.794547+0000","last_peered":"2024-02-15T23:30:10.794547+0000","last_clean":"2024-02-15T23:30:10.794547+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:30:10.794547+0000","last_undegraded":"2024-02-15T23:30:10.794547+0000","last_fullsized":"2024-02-15T23:30:10.794547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813467+0000","last_change":"2024-02-15T23:29:39.784125+0000","last_active":"2024-02-15T23:30:10.813467+0000","last_peered":"2024-02-15T23:30:10.813467+0000","last_clean":"2024-02-15T23:30:10.813467+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:30:10.813467+0000","last_undegraded":"2024-02-15T23:30:10.813467+0000","last_fullsized":"2024-02-15T23:30:10.813467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795226+0000","last_change":"2024-02-15T23:29:31.701274+0000","last_active":"2024-02-15T23:30:10.795226+0000","last_peered":"2024-02-15T23:30:10.795226+0000","last_clean":"2024-02-15T23:30:10.795226+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:30:10.795226+0000","last_undegraded":"2024-02-15T23:30:10.795226+0000","last_fullsized":"2024-02-15T23:30:10.795226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955150+0000","last_change":"2024-02-15T23:29:29.717620+0000","last_active":"2024-02-15T23:31:14.955150+0000","last_peered":"2024-02-15T23:31:14.955150+0000","last_clean":"2024-02-15T23:31:14.955150+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:31:14.955150+0000","last_undegraded":"2024-02-15T23:31:14.955150+0000","last_fullsized":"2024-02-15T23:31:14.955150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":210,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.436424+0000","last_change":"2024-02-15T23:31:28.436490+0000","last_active":"2024-02-15T23:31:28.436424+0000","last_peered":"2024-02-15T23:31:28.436424+0000","last_clean":"2024-02-15T23:31:28.436424+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:28.436424+0000","last_undegraded":"2024-02-15T23:31:28.436424+0000","last_fullsized":"2024-02-15T23:31:28.436424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.436171+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:39.946344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'27","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.755776+0000","last_change":"2024-02-15T23:29:35.752343+0000","last_active":"2024-02-15T23:31:11.755776+0000","last_peered":"2024-02-15T23:31:11.755776+0000","last_clean":"2024-02-15T23:31:11.755776+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:31:11.755776+0000","last_undegraded":"2024-02-15T23:31:11.755776+0000","last_fullsized":"2024-02-15T23:31:11.755776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.799069+0000","last_change":"2024-02-15T23:29:37.770670+0000","last_active":"2024-02-15T23:30:10.799069+0000","last_peered":"2024-02-15T23:30:10.799069+0000","last_clean":"2024-02-15T23:30:10.799069+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:30:10.799069+0000","last_undegraded":"2024-02-15T23:30:10.799069+0000","last_fullsized":"2024-02-15T23:30:10.799069+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807752+0000","last_change":"2024-02-15T23:29:39.784728+0000","last_active":"2024-02-15T23:30:10.807752+0000","last_peered":"2024-02-15T23:30:10.807752+0000","last_clean":"2024-02-15T23:30:10.807752+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:30:10.807752+0000","last_undegraded":"2024-02-15T23:30:10.807752+0000","last_fullsized":"2024-02-15T23:30:10.807752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.774551+0000","last_change":"2024-02-15T23:29:31.684323+0000","last_active":"2024-02-15T23:30:15.774551+0000","last_peered":"2024-02-15T23:30:15.774551+0000","last_clean":"2024-02-15T23:30:15.774551+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:30:15.774551+0000","last_undegraded":"2024-02-15T23:30:15.774551+0000","last_fullsized":"2024-02-15T23:30:15.774551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397829+0000","last_change":"2024-02-15T23:29:29.719123+0000","last_active":"2024-02-15T23:31:15.397829+0000","last_peered":"2024-02-15T23:31:15.397829+0000","last_clean":"2024-02-15T23:31:15.397829+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:31:15.397829+0000","last_undegraded":"2024-02-15T23:31:15.397829+0000","last_fullsized":"2024-02-15T23:31:15.397829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.519390+0000","last_change":"2024-02-15T23:31:32.519469+0000","last_active":"2024-02-15T23:31:32.519390+0000","last_peered":"2024-02-15T23:31:32.519390+0000","last_clean":"2024-02-15T23:31:32.519390+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:31:32.519390+0000","last_undegraded":"2024-02-15T23:31:32.519390+0000","last_fullsized":"2024-02-15T23:31:32.519390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.519211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.548059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:11.774555+0000","last_change":"2024-02-15T23:29:35.748095+0000","last_active":"2024-02-15T23:31:11.774555+0000","last_peered":"2024-02-15T23:31:11.774555+0000","last_clean":"2024-02-15T23:31:11.774555+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:11.774555+0000","last_undegraded":"2024-02-15T23:31:11.774555+0000","last_fullsized":"2024-02-15T23:31:11.774555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:34.685506+0000","last_clean_scrub_stamp":"2024-02-15T23:29:34.685506+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.576878+0000","last_change":"2024-02-15T23:31:24.576932+0000","last_active":"2024-02-15T23:31:24.576878+0000","last_peered":"2024-02-15T23:31:24.576878+0000","last_clean":"2024-02-15T23:31:24.576878+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:31:24.576878+0000","last_undegraded":"2024-02-15T23:31:24.576878+0000","last_fullsized":"2024-02-15T23:31:24.576878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.576683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:19:16.045656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.100277+0000","last_change":"2024-02-15T23:29:39.784447+0000","last_active":"2024-02-15T23:30:15.100277+0000","last_peered":"2024-02-15T23:30:15.100277+0000","last_clean":"2024-02-15T23:30:15.100277+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:30:15.100277+0000","last_undegraded":"2024-02-15T23:30:15.100277+0000","last_fullsized":"2024-02-15T23:30:15.100277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796803+0000","last_change":"2024-02-15T23:29:31.710180+0000","last_active":"2024-02-15T23:30:10.796803+0000","last_peered":"2024-02-15T23:30:10.796803+0000","last_clean":"2024-02-15T23:30:10.796803+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:30:10.796803+0000","last_undegraded":"2024-02-15T23:30:10.796803+0000","last_fullsized":"2024-02-15T23:30:10.796803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.853072+0000","last_change":"2024-02-15T23:29:29.733523+0000","last_active":"2024-02-15T23:31:15.853072+0000","last_peered":"2024-02-15T23:31:15.853072+0000","last_clean":"2024-02-15T23:31:15.853072+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:31:15.853072+0000","last_undegraded":"2024-02-15T23:31:15.853072+0000","last_fullsized":"2024-02-15T23:31:15.853072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.311886+0000","last_change":"2024-02-15T23:29:31.689326+0000","last_active":"2024-02-15T23:30:14.311886+0000","last_peered":"2024-02-15T23:30:14.311886+0000","last_clean":"2024-02-15T23:30:14.311886+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:30:14.311886+0000","last_undegraded":"2024-02-15T23:30:14.311886+0000","last_fullsized":"2024-02-15T23:30:14.311886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955127+0000","last_change":"2024-02-15T23:29:29.708496+0000","last_active":"2024-02-15T23:31:14.955127+0000","last_peered":"2024-02-15T23:31:14.955127+0000","last_clean":"2024-02-15T23:31:14.955127+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:31:14.955127+0000","last_undegraded":"2024-02-15T23:31:14.955127+0000","last_fullsized":"2024-02-15T23:31:14.955127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.465346+0000","last_change":"2024-02-15T23:31:34.465414+0000","last_active":"2024-02-15T23:31:34.465346+0000","last_peered":"2024-02-15T23:31:34.465346+0000","last_clean":"2024-02-15T23:31:34.465346+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:34.465346+0000","last_undegraded":"2024-02-15T23:31:34.465346+0000","last_fullsized":"2024-02-15T23:31:34.465346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.465154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:45.028387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314669+0000","last_change":"2024-02-15T23:29:29.728191+0000","last_active":"2024-02-15T23:31:16.314669+0000","last_peered":"2024-02-15T23:31:16.314669+0000","last_clean":"2024-02-15T23:31:16.314669+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:31:16.314669+0000","last_undegraded":"2024-02-15T23:31:16.314669+0000","last_fullsized":"2024-02-15T23:31:16.314669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.937400+0000","last_change":"2024-02-15T23:29:31.693908+0000","last_active":"2024-02-15T23:31:03.937400+0000","last_peered":"2024-02-15T23:31:03.937400+0000","last_clean":"2024-02-15T23:31:03.937400+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:03.937400+0000","last_undegraded":"2024-02-15T23:31:03.937400+0000","last_fullsized":"2024-02-15T23:31:03.937400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955214+0000","last_change":"2024-02-15T23:29:29.707236+0000","last_active":"2024-02-15T23:31:14.955214+0000","last_peered":"2024-02-15T23:31:14.955214+0000","last_clean":"2024-02-15T23:31:14.955214+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:31:14.955214+0000","last_undegraded":"2024-02-15T23:31:14.955214+0000","last_fullsized":"2024-02-15T23:31:14.955214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.937272+0000","last_change":"2024-02-15T23:29:31.709341+0000","last_active":"2024-02-15T23:31:03.937272+0000","last_peered":"2024-02-15T23:31:03.937272+0000","last_clean":"2024-02-15T23:31:03.937272+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:03.937272+0000","last_undegraded":"2024-02-15T23:31:03.937272+0000","last_fullsized":"2024-02-15T23:31:03.937272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.787330+0000","last_change":"2024-02-15T23:29:29.716033+0000","last_active":"2024-02-15T23:30:10.787330+0000","last_peered":"2024-02-15T23:30:10.787330+0000","last_clean":"2024-02-15T23:30:10.787330+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:30:10.787330+0000","last_undegraded":"2024-02-15T23:30:10.787330+0000","last_fullsized":"2024-02-15T23:30:10.787330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.322057+0000","last_change":"2024-02-15T23:29:31.704944+0000","last_active":"2024-02-15T23:30:58.322057+0000","last_peered":"2024-02-15T23:30:58.322057+0000","last_clean":"2024-02-15T23:30:58.322057+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:30:58.322057+0000","last_undegraded":"2024-02-15T23:30:58.322057+0000","last_fullsized":"2024-02-15T23:30:58.322057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790488+0000","last_change":"2024-02-15T23:29:29.738175+0000","last_active":"2024-02-15T23:30:10.790488+0000","last_peered":"2024-02-15T23:30:10.790488+0000","last_clean":"2024-02-15T23:30:10.790488+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:30:10.790488+0000","last_undegraded":"2024-02-15T23:30:10.790488+0000","last_fullsized":"2024-02-15T23:30:10.790488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.785448+0000","last_change":"2024-02-15T23:29:31.695350+0000","last_active":"2024-02-15T23:30:10.785448+0000","last_peered":"2024-02-15T23:30:10.785448+0000","last_clean":"2024-02-15T23:30:10.785448+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:30:10.785448+0000","last_undegraded":"2024-02-15T23:30:10.785448+0000","last_fullsized":"2024-02-15T23:30:10.785448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.780513+0000","last_change":"2024-02-15T23:29:29.731948+0000","last_active":"2024-02-15T23:30:10.780513+0000","last_peered":"2024-02-15T23:30:10.780513+0000","last_clean":"2024-02-15T23:30:10.780513+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:30:10.780513+0000","last_undegraded":"2024-02-15T23:30:10.780513+0000","last_fullsized":"2024-02-15T23:30:10.780513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:03.937246+0000","last_change":"2024-02-15T23:29:31.693023+0000","last_active":"2024-02-15T23:31:03.937246+0000","last_peered":"2024-02-15T23:31:03.937246+0000","last_clean":"2024-02-15T23:31:03.937246+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:03.937246+0000","last_undegraded":"2024-02-15T23:31:03.937246+0000","last_fullsized":"2024-02-15T23:31:03.937246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791039+0000","last_change":"2024-02-15T23:29:29.710596+0000","last_active":"2024-02-15T23:30:10.791039+0000","last_peered":"2024-02-15T23:30:10.791039+0000","last_clean":"2024-02-15T23:30:10.791039+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:30:10.791039+0000","last_undegraded":"2024-02-15T23:30:10.791039+0000","last_fullsized":"2024-02-15T23:30:10.791039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797067+0000","last_change":"2024-02-15T23:29:31.689541+0000","last_active":"2024-02-15T23:30:10.797067+0000","last_peered":"2024-02-15T23:30:10.797067+0000","last_clean":"2024-02-15T23:30:10.797067+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:30:10.797067+0000","last_undegraded":"2024-02-15T23:30:10.797067+0000","last_fullsized":"2024-02-15T23:30:10.797067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795945+0000","last_change":"2024-02-15T23:29:29.716896+0000","last_active":"2024-02-15T23:30:10.795945+0000","last_peered":"2024-02-15T23:30:10.795945+0000","last_clean":"2024-02-15T23:30:10.795945+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:30:10.795945+0000","last_undegraded":"2024-02-15T23:30:10.795945+0000","last_fullsized":"2024-02-15T23:30:10.795945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.780011+0000","last_change":"2024-02-15T23:30:10.793574+0000","last_active":"2024-02-15T23:30:15.780011+0000","last_peered":"2024-02-15T23:30:15.780011+0000","last_clean":"2024-02-15T23:30:15.780011+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:30:15.780011+0000","last_undegraded":"2024-02-15T23:30:15.780011+0000","last_fullsized":"2024-02-15T23:30:15.780011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784465+0000","last_change":"2024-02-15T23:29:29.719351+0000","last_active":"2024-02-15T23:30:10.784465+0000","last_peered":"2024-02-15T23:30:10.784465+0000","last_clean":"2024-02-15T23:30:10.784465+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:30:10.784465+0000","last_undegraded":"2024-02-15T23:30:10.784465+0000","last_fullsized":"2024-02-15T23:30:10.784465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'21","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.854759+0000","last_change":"2024-02-15T23:29:31.713582+0000","last_active":"2024-02-15T23:30:57.854759+0000","last_peered":"2024-02-15T23:30:57.854759+0000","last_clean":"2024-02-15T23:30:57.854759+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:30:57.854759+0000","last_undegraded":"2024-02-15T23:30:57.854759+0000","last_fullsized":"2024-02-15T23:30:57.854759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.783892+0000","last_change":"2024-02-15T23:29:29.741437+0000","last_active":"2024-02-15T23:30:10.783892+0000","last_peered":"2024-02-15T23:30:10.783892+0000","last_clean":"2024-02-15T23:30:10.783892+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:30:10.783892+0000","last_undegraded":"2024-02-15T23:30:10.783892+0000","last_fullsized":"2024-02-15T23:30:10.783892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786502+0000","last_change":"2024-02-15T23:29:31.694663+0000","last_active":"2024-02-15T23:30:10.786502+0000","last_peered":"2024-02-15T23:30:10.786502+0000","last_clean":"2024-02-15T23:30:10.786502+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:30:10.786502+0000","last_undegraded":"2024-02-15T23:30:10.786502+0000","last_fullsized":"2024-02-15T23:30:10.786502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.790746+0000","last_change":"2024-02-15T23:29:29.720975+0000","last_active":"2024-02-15T23:30:10.790746+0000","last_peered":"2024-02-15T23:30:10.790746+0000","last_clean":"2024-02-15T23:30:10.790746+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:30:10.790746+0000","last_undegraded":"2024-02-15T23:30:10.790746+0000","last_fullsized":"2024-02-15T23:30:10.790746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.103465+0000","last_change":"2024-02-15T23:29:31.703991+0000","last_active":"2024-02-15T23:30:15.103465+0000","last_peered":"2024-02-15T23:30:15.103465+0000","last_clean":"2024-02-15T23:30:15.103465+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:30:15.103465+0000","last_undegraded":"2024-02-15T23:30:15.103465+0000","last_fullsized":"2024-02-15T23:30:15.103465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.254710+0000","last_change":"2024-02-15T23:29:29.714331+0000","last_active":"2024-02-15T23:30:14.254710+0000","last_peered":"2024-02-15T23:30:14.254710+0000","last_clean":"2024-02-15T23:30:14.254710+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:30:14.254710+0000","last_undegraded":"2024-02-15T23:30:14.254710+0000","last_fullsized":"2024-02-15T23:30:14.254710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'1","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.854972+0000","last_change":"2024-02-15T23:29:31.689861+0000","last_active":"2024-02-15T23:30:57.854972+0000","last_peered":"2024-02-15T23:30:57.854972+0000","last_clean":"2024-02-15T23:30:57.854972+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:30:57.854972+0000","last_undegraded":"2024-02-15T23:30:57.854972+0000","last_fullsized":"2024-02-15T23:30:57.854972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.810139+0000","last_change":"2024-02-15T23:29:29.720292+0000","last_active":"2024-02-15T23:30:10.810139+0000","last_peered":"2024-02-15T23:30:10.810139+0000","last_clean":"2024-02-15T23:30:10.810139+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:30:10.810139+0000","last_undegraded":"2024-02-15T23:30:10.810139+0000","last_fullsized":"2024-02-15T23:30:10.810139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.322201+0000","last_change":"2024-02-15T23:29:31.699375+0000","last_active":"2024-02-15T23:30:58.322201+0000","last_peered":"2024-02-15T23:30:58.322201+0000","last_clean":"2024-02-15T23:30:58.322201+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:30:58.322201+0000","last_undegraded":"2024-02-15T23:30:58.322201+0000","last_fullsized":"2024-02-15T23:30:58.322201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.781368+0000","last_change":"2024-02-15T23:29:29.730792+0000","last_active":"2024-02-15T23:30:10.781368+0000","last_peered":"2024-02-15T23:30:10.781368+0000","last_clean":"2024-02-15T23:30:10.781368+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:30:10.781368+0000","last_undegraded":"2024-02-15T23:30:10.781368+0000","last_fullsized":"2024-02-15T23:30:10.781368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:57.855235+0000","last_change":"2024-02-15T23:29:31.694898+0000","last_active":"2024-02-15T23:30:57.855235+0000","last_peered":"2024-02-15T23:30:57.855235+0000","last_clean":"2024-02-15T23:30:57.855235+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:30:57.855235+0000","last_undegraded":"2024-02-15T23:30:57.855235+0000","last_fullsized":"2024-02-15T23:30:57.855235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.087039+0000","last_change":"2024-02-15T23:29:29.714026+0000","last_active":"2024-02-15T23:30:15.087039+0000","last_peered":"2024-02-15T23:30:15.087039+0000","last_clean":"2024-02-15T23:30:15.087039+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:30:15.087039+0000","last_undegraded":"2024-02-15T23:30:15.087039+0000","last_fullsized":"2024-02-15T23:30:15.087039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797024+0000","last_change":"2024-02-15T23:29:29.714394+0000","last_active":"2024-02-15T23:30:10.797024+0000","last_peered":"2024-02-15T23:30:10.797024+0000","last_clean":"2024-02-15T23:30:10.797024+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:30:10.797024+0000","last_undegraded":"2024-02-15T23:30:10.797024+0000","last_fullsized":"2024-02-15T23:30:10.797024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791944+0000","last_change":"2024-02-15T23:29:31.696441+0000","last_active":"2024-02-15T23:30:10.791944+0000","last_peered":"2024-02-15T23:30:10.791944+0000","last_clean":"2024-02-15T23:30:10.791944+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:30:10.791944+0000","last_undegraded":"2024-02-15T23:30:10.791944+0000","last_fullsized":"2024-02-15T23:30:10.791944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.784563+0000","last_change":"2024-02-15T23:29:29.716351+0000","last_active":"2024-02-15T23:30:10.784563+0000","last_peered":"2024-02-15T23:30:10.784563+0000","last_clean":"2024-02-15T23:30:10.784563+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:30:10.784563+0000","last_undegraded":"2024-02-15T23:30:10.784563+0000","last_fullsized":"2024-02-15T23:30:10.784563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.103423+0000","last_change":"2024-02-15T23:29:31.709385+0000","last_active":"2024-02-15T23:30:15.103423+0000","last_peered":"2024-02-15T23:30:15.103423+0000","last_clean":"2024-02-15T23:30:15.103423+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:30:15.103423+0000","last_undegraded":"2024-02-15T23:30:15.103423+0000","last_fullsized":"2024-02-15T23:30:15.103423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1383,"ondisk_log_size":1383,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705697,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.76300000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.751,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.23100000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.78600000000000003,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.26300000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.78600000000000003,"5min":1.103,"15min":1.103},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72899999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57699999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705695,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75600000000000001,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.55600000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80700000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.43099999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.75900000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.77200000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.79800000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.38200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76800000000000002,"5min":2.452,"15min":2.452},"last":0.68999999999999995}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.38,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78400000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.68600000000000005,"15min":0.69499999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":1.036,"15min":1.036},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.246,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80600000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.82499999999999996,"5min":1.034,"15min":1.034},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.628,"15min":0.629},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.83799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60999999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88,"5min":1.24,"15min":1.24},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.746,"15min":0.751},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.54500000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.83199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:31:37.104 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.104 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.104 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.104 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.104 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.105 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.105 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.105 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.105 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.105 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.105 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.106 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.106 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.106 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.106 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.106 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.106 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.106 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.107 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.107 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.107 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.107 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.107 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.107 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.107 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.108 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.108 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.108 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.108 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.108 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.108 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.109 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.109 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.109 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.109 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.109 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.109 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.110 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.110 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.110 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.110 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.110 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.110 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.111 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.111 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.111 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.111 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.111 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.111 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.112 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.112 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.112 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.112 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.112 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.112 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.113 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.113 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.113 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.113 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.113 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.113 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.114 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.114 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.114 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.114 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.114 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.114 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.115 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.115 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.115 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-15T23:29:15.580621+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=15, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.115 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.115 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.115 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.115 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.116 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.116 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.116 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.116 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.116 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.116 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.117 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.117 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.117 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.117 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.117 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.117 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.117 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.118 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.118 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.118 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.118 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.118 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.118 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.119 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.119 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.119 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.119 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.119 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.119 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.119 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.120 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.120 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.120 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.120 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.120 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.120 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.121 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.121 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.121 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.121 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.121 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.121 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.122 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.122 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.122 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.122 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.122 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.122 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.123 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.123 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.123 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.123 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.123 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.123 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.124 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.124 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.124 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.124 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.124 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.124 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.125 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.125 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.125 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.125 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.125 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.125 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.126 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.126 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.126 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.126 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.126 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.126 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.127 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.127 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.127 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.127 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.127 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.127 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.128 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.128 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.128 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-15T23:29:34.685506+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.128 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.128 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.128 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.129 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.129 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.129 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.129 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.129 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.129 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.129 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.130 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.130 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.130 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.130 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.130 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.130 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.130 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.131 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.131 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.131 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.131 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.131 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.131 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.131 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.132 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.132 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.132 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.132 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.132 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.132 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.133 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.133 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.133 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.133 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.133 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.133 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:37.134 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T23:31:57.134 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:31:57.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.255+0000 7efffb46f640 1 Processor -- start 2024-02-15T23:31:57.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.255+0000 7efffb46f640 1 -- start start 2024-02-15T23:31:57.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.255+0000 7efffb46f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efff41290f0 0x7efff412c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:57.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.255+0000 7efffb46f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff4095ee0 con 0x7efff4128d10 2024-02-15T23:31:57.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.255+0000 7efffb46f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff4096320 con 0x7efff41290f0 2024-02-15T23:31:57.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efff8a0a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efff41290f0 0x7efff412c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:57.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efff920b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efff4128d10 0x7efff412bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34978/0 (socket says 172.21.15.131:34978) 2024-02-15T23:31:57.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efff920b640 1 -- 172.21.15.131:0/3814970245 learned_addr learned my addr 172.21.15.131:0/3814970245 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:31:57.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efff8a0a640 1 -- 172.21.15.131:0/3814970245 >> v1:172.21.15.131:6789/0 conn(0x7efff4128d10 legacy=0x7efff412bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:57.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efff8a0a640 1 -- 172.21.15.131:0/3814970245 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4128620 con 0x7efff41290f0 2024-02-15T23:31:57.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7effebfff640 1 -- 172.21.15.131:0/3814970245 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346603823 0 0) 0x7efff4095ee0 con 0x7efff4128d10 2024-02-15T23:31:57.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efff8a0a640 1 --2- 172.21.15.131:0/3814970245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff41290f0 0x7efff412c230 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7effe4009740 tx=0x7effe401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e6948890aa1a55 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:57.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7effebfff640 1 -- 172.21.15.131:0/3814970245 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effe40ac530 con 0x7efff41290f0 2024-02-15T23:31:57.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7effebfff640 1 -- 172.21.15.131:0/3814970245 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe40a8050 con 0x7efff41290f0 2024-02-15T23:31:57.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7effebfff640 1 -- 172.21.15.131:0/3814970245 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effe40ac7e0 con 0x7efff41290f0 2024-02-15T23:31:57.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efffb46f640 1 -- 172.21.15.131:0/3814970245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff41290f0 msgr2=0x7efff412c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:57.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efffb46f640 1 --2- 172.21.15.131:0/3814970245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff41290f0 0x7efff412c230 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7effe4009740 tx=0x7effe401c490 comp rx=0 tx=0).stop 2024-02-15T23:31:57.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efffb46f640 1 -- 172.21.15.131:0/3814970245 shutdown_connections 2024-02-15T23:31:57.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efffb46f640 1 --2- 172.21.15.131:0/3814970245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff41290f0 0x7efff412c230 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:57.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efffb46f640 1 -- 172.21.15.131:0/3814970245 >> 172.21.15.131:0/3814970245 conn(0x7efff409a2f0 msgr2=0x7efff409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:57.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efffb46f640 1 -- 172.21.15.131:0/3814970245 shutdown_connections 2024-02-15T23:31:57.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.259+0000 7efffb46f640 1 -- 172.21.15.131:0/3814970245 wait complete. 2024-02-15T23:31:57.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efffb46f640 1 Processor -- start 2024-02-15T23:31:57.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efffb46f640 1 -- start start 2024-02-15T23:31:57.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efffb46f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4128d10 0x7efff41c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:57.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efffb46f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff408ef80 con 0x7efff4128d10 2024-02-15T23:31:57.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efff920b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4128d10 0x7efff41c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:57.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efff920b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4128d10 0x7efff41c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33742/0 (socket says 172.21.15.131:33742) 2024-02-15T23:31:57.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efff920b640 1 -- 172.21.15.131:0/1725739369 learned_addr learned my addr 172.21.15.131:0/1725739369 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:31:57.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efff920b640 1 -- 172.21.15.131:0/1725739369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4009420 con 0x7efff4128d10 2024-02-15T23:31:57.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efff920b640 1 --2- 172.21.15.131:0/1725739369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4128d10 0x7efff41c5030 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7efff000c420 tx=0x7efff000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:57.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7effe9ffb640 1 -- 172.21.15.131:0/1725739369 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efff00074d0 con 0x7efff4128d10 2024-02-15T23:31:57.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7effe9ffb640 1 -- 172.21.15.131:0/1725739369 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff0007630 con 0x7efff4128d10 2024-02-15T23:31:57.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff408e400 con 0x7efff4128d10 2024-02-15T23:31:57.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7effe9ffb640 1 -- 172.21.15.131:0/1725739369 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efff0004960 con 0x7efff4128d10 2024-02-15T23:31:57.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff408c720 con 0x7efff4128d10 2024-02-15T23:31:57.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff408df10 con 0x7efff4128d10 2024-02-15T23:31:57.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7effe9ffb640 1 -- 172.21.15.131:0/1725739369 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efff0004ac0 con 0x7efff4128d10 2024-02-15T23:31:57.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7effe9ffb640 1 --2- 172.21.15.131:0/1725739369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7effd80359c0 0x7effd8037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:31:57.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7effe9ffb640 1 -- 172.21.15.131:0/1725739369 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7efff0047e40 con 0x7efff4128d10 2024-02-15T23:31:57.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efff8a0a640 1 --2- 172.21.15.131:0/1725739369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7effd80359c0 0x7effd8037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:31:57.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.263+0000 7efff8a0a640 1 --2- 172.21.15.131:0/1725739369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7effd80359c0 0x7effd8037e80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7effe40ae000 tx=0x7effe40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:31:57.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.267+0000 7effe9ffb640 1 -- 172.21.15.131:0/1725739369 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efff001ad70 con 0x7efff4128d10 2024-02-15T23:31:57.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.423+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efff4133e80 con 0x7effd80359c0 2024-02-15T23:31:57.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.471+0000 7effe9ffb640 1 -- 172.21.15.131:0/1725739369 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669985 (secure 0 0 0) 0x7effe40ac6c0 con 0x7effd80359c0 2024-02-15T23:31:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:31:57.492 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:31:57.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7effd80359c0 msgr2=0x7effd8037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:57.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 --2- 172.21.15.131:0/1725739369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7effd80359c0 0x7effd8037e80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7effe40ae000 tx=0x7effe40a7000 comp rx=0 tx=0).stop 2024-02-15T23:31:57.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4128d10 msgr2=0x7efff41c5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:31:57.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 --2- 172.21.15.131:0/1725739369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4128d10 0x7efff41c5030 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7efff000c420 tx=0x7efff000c8e0 comp rx=0 tx=0).stop 2024-02-15T23:31:57.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 shutdown_connections 2024-02-15T23:31:57.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 --2- 172.21.15.131:0/1725739369 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7effd80359c0 0x7effd8037e80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:57.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 --2- 172.21.15.131:0/1725739369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efff4128d10 0x7efff41c5030 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:31:57.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 >> 172.21.15.131:0/1725739369 conn(0x7efff409a2f0 msgr2=0x7efff4092970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:31:57.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 shutdown_connections 2024-02-15T23:31:57.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:31:57.475+0000 7efffb46f640 1 -- 172.21.15.131:0/1725739369 wait complete. 2024-02-15T23:31:57.505 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-02-15T23:31:55.563831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1709,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3959,"ondisk_log_size":3959,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":559,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005833"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.668252+0000","last_change":"2024-02-15T23:31:53.668312+0000","last_active":"2024-02-15T23:31:53.668252+0000","last_peered":"2024-02-15T23:31:53.668252+0000","last_clean":"2024-02-15T23:31:53.668252+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:31:53.668252+0000","last_undegraded":"2024-02-15T23:31:53.668252+0000","last_fullsized":"2024-02-15T23:31:53.668252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.668051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.668051+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.668051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:56.433332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.498912+0000","last_change":"2024-02-15T23:31:52.499037+0000","last_active":"2024-02-15T23:31:52.498912+0000","last_peered":"2024-02-15T23:31:52.498912+0000","last_clean":"2024-02-15T23:31:52.498912+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:31:52.498912+0000","last_undegraded":"2024-02-15T23:31:52.498912+0000","last_fullsized":"2024-02-15T23:31:52.498912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:52.498705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:52.498705+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.498705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:34.262188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.419135+0000","last_change":"2024-02-15T23:31:49.419197+0000","last_active":"2024-02-15T23:31:49.419135+0000","last_peered":"2024-02-15T23:31:49.419135+0000","last_clean":"2024-02-15T23:31:49.419135+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:31:49.419135+0000","last_undegraded":"2024-02-15T23:31:49.419135+0000","last_fullsized":"2024-02-15T23:31:49.419135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.418938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.418938+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.418938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:26.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.798466+0000","last_change":"2024-02-15T23:29:31.701574+0000","last_active":"2024-02-15T23:30:10.798466+0000","last_peered":"2024-02-15T23:30:10.798466+0000","last_clean":"2024-02-15T23:30:10.798466+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:30:10.798466+0000","last_undegraded":"2024-02-15T23:30:10.798466+0000","last_fullsized":"2024-02-15T23:30:10.798466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315010+0000","last_change":"2024-02-15T23:29:29.725919+0000","last_active":"2024-02-15T23:31:16.315010+0000","last_peered":"2024-02-15T23:31:16.315010+0000","last_clean":"2024-02-15T23:31:16.315010+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:31:16.315010+0000","last_undegraded":"2024-02-15T23:31:16.315010+0000","last_fullsized":"2024-02-15T23:31:16.315010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807067+0000","last_change":"2024-02-15T23:29:31.701595+0000","last_active":"2024-02-15T23:30:10.807067+0000","last_peered":"2024-02-15T23:30:10.807067+0000","last_clean":"2024-02-15T23:30:10.807067+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:30:10.807067+0000","last_undegraded":"2024-02-15T23:30:10.807067+0000","last_fullsized":"2024-02-15T23:30:10.807067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.853116+0000","last_change":"2024-02-15T23:29:29.725199+0000","last_active":"2024-02-15T23:31:15.853116+0000","last_peered":"2024-02-15T23:31:15.853116+0000","last_clean":"2024-02-15T23:31:15.853116+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:31:15.853116+0000","last_undegraded":"2024-02-15T23:31:15.853116+0000","last_fullsized":"2024-02-15T23:31:15.853116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.224845+0000","last_change":"2024-02-15T23:31:53.224937+0000","last_active":"2024-02-15T23:31:53.224845+0000","last_peered":"2024-02-15T23:31:53.224845+0000","last_clean":"2024-02-15T23:31:53.224845+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:31:53.224845+0000","last_undegraded":"2024-02-15T23:31:53.224845+0000","last_fullsized":"2024-02-15T23:31:53.224845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.224656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.224656+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.224656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:31.631150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806022+0000","last_change":"2024-02-15T23:29:29.710832+0000","last_active":"2024-02-15T23:30:10.806022+0000","last_peered":"2024-02-15T23:30:10.806022+0000","last_clean":"2024-02-15T23:30:10.806022+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:30:10.806022+0000","last_undegraded":"2024-02-15T23:30:10.806022+0000","last_fullsized":"2024-02-15T23:30:10.806022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.477578+0000","last_change":"2024-02-15T23:31:47.477646+0000","last_active":"2024-02-15T23:31:47.477578+0000","last_peered":"2024-02-15T23:31:47.477578+0000","last_clean":"2024-02-15T23:31:47.477578+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:47.477578+0000","last_undegraded":"2024-02-15T23:31:47.477578+0000","last_fullsized":"2024-02-15T23:31:47.477578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:47.477403+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:47.477403+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.477403+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:54.301986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.777225+0000","last_change":"2024-02-15T23:29:29.729934+0000","last_active":"2024-02-15T23:30:10.777225+0000","last_peered":"2024-02-15T23:30:10.777225+0000","last_clean":"2024-02-15T23:30:10.777225+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:30:10.777225+0000","last_undegraded":"2024-02-15T23:30:10.777225+0000","last_fullsized":"2024-02-15T23:30:10.777225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.400579+0000","last_change":"2024-02-15T23:31:37.400579+0000","last_active":"2024-02-15T23:31:37.400579+0000","last_peered":"2024-02-15T23:31:37.400579+0000","last_clean":"2024-02-15T23:31:37.400579+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:31:37.400579+0000","last_undegraded":"2024-02-15T23:31:37.400579+0000","last_fullsized":"2024-02-15T23:31:37.400579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.400334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.400334+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.400334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:49:40.355253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:13.509809+0000","last_change":"2024-02-15T23:29:29.707555+0000","last_active":"2024-02-15T23:30:13.509809+0000","last_peered":"2024-02-15T23:30:13.509809+0000","last_clean":"2024-02-15T23:30:13.509809+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:30:13.509809+0000","last_undegraded":"2024-02-15T23:30:13.509809+0000","last_fullsized":"2024-02-15T23:30:13.509809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.635991+0000","last_change":"2024-02-15T23:31:44.636058+0000","last_active":"2024-02-15T23:31:44.635991+0000","last_peered":"2024-02-15T23:31:44.635991+0000","last_clean":"2024-02-15T23:31:44.635991+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:31:44.635991+0000","last_undegraded":"2024-02-15T23:31:44.635991+0000","last_fullsized":"2024-02-15T23:31:44.635991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-15T23:31:44.635777+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-15T23:31:44.635777+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.635777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:42.603964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.506156+0000","last_change":"2024-02-15T23:31:47.506217+0000","last_active":"2024-02-15T23:31:47.506156+0000","last_peered":"2024-02-15T23:31:47.506156+0000","last_clean":"2024-02-15T23:31:47.506156+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:31:47.506156+0000","last_undegraded":"2024-02-15T23:31:47.506156+0000","last_fullsized":"2024-02-15T23:31:47.506156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:47.505968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:47.505968+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.505968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:54.330551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.709654+0000","last_change":"2024-02-15T23:31:37.709654+0000","last_active":"2024-02-15T23:31:37.709654+0000","last_peered":"2024-02-15T23:31:37.709654+0000","last_clean":"2024-02-15T23:31:37.709654+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:31:37.709654+0000","last_undegraded":"2024-02-15T23:31:37.709654+0000","last_fullsized":"2024-02-15T23:31:37.709654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:37.709401+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:37.709401+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.709401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:33.404898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315581+0000","last_change":"2024-02-15T23:29:31.699913+0000","last_active":"2024-02-15T23:31:16.315581+0000","last_peered":"2024-02-15T23:31:16.315581+0000","last_clean":"2024-02-15T23:31:16.315581+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:31:16.315581+0000","last_undegraded":"2024-02-15T23:31:16.315581+0000","last_fullsized":"2024-02-15T23:31:16.315581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398180+0000","last_change":"2024-02-15T23:29:29.720102+0000","last_active":"2024-02-15T23:31:15.398180+0000","last_peered":"2024-02-15T23:31:15.398180+0000","last_clean":"2024-02-15T23:31:15.398180+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:31:15.398180+0000","last_undegraded":"2024-02-15T23:31:15.398180+0000","last_fullsized":"2024-02-15T23:31:15.398180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.524000+0000","last_change":"2024-02-15T23:31:50.524000+0000","last_active":"2024-02-15T23:31:50.524000+0000","last_peered":"2024-02-15T23:31:50.524000+0000","last_clean":"2024-02-15T23:31:50.524000+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:31:50.524000+0000","last_undegraded":"2024-02-15T23:31:50.524000+0000","last_fullsized":"2024-02-15T23:31:50.524000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:50.523751+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:50.523751+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.523751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:31.439499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.662952+0000","last_change":"2024-02-15T23:31:41.662952+0000","last_active":"2024-02-15T23:31:41.662952+0000","last_peered":"2024-02-15T23:31:41.662952+0000","last_clean":"2024-02-15T23:31:41.662952+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:31:41.662952+0000","last_undegraded":"2024-02-15T23:31:41.662952+0000","last_fullsized":"2024-02-15T23:31:41.662952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:41.662713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:41.662713+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.662713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:16.784415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.471993+0000","last_change":"2024-02-15T23:31:48.471993+0000","last_active":"2024-02-15T23:31:48.471993+0000","last_peered":"2024-02-15T23:31:48.471993+0000","last_clean":"2024-02-15T23:31:48.471993+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:48.471993+0000","last_undegraded":"2024-02-15T23:31:48.471993+0000","last_fullsized":"2024-02-15T23:31:48.471993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:48.471732+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:48.471732+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.471732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:51.993523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.506627+0000","last_change":"2024-02-15T23:31:51.506627+0000","last_active":"2024-02-15T23:31:51.506627+0000","last_peered":"2024-02-15T23:31:51.506627+0000","last_clean":"2024-02-15T23:31:51.506627+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:31:51.506627+0000","last_undegraded":"2024-02-15T23:31:51.506627+0000","last_fullsized":"2024-02-15T23:31:51.506627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:51.506363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:51.506363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.506363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:25.908233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.453068+0000","last_change":"2024-02-15T23:31:45.453219+0000","last_active":"2024-02-15T23:31:45.453068+0000","last_peered":"2024-02-15T23:31:45.453068+0000","last_clean":"2024-02-15T23:31:45.453068+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:31:45.453068+0000","last_undegraded":"2024-02-15T23:31:45.453068+0000","last_fullsized":"2024-02-15T23:31:45.453068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:45.452811+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:45.452811+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.452811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:03.503688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397924+0000","last_change":"2024-02-15T23:29:29.720464+0000","last_active":"2024-02-15T23:31:15.397924+0000","last_peered":"2024-02-15T23:31:15.397924+0000","last_clean":"2024-02-15T23:31:15.397924+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:31:15.397924+0000","last_undegraded":"2024-02-15T23:31:15.397924+0000","last_fullsized":"2024-02-15T23:31:15.397924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.711568+0000","last_change":"2024-02-15T23:31:46.711628+0000","last_active":"2024-02-15T23:31:46.711568+0000","last_peered":"2024-02-15T23:31:46.711568+0000","last_clean":"2024-02-15T23:31:46.711568+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:31:46.711568+0000","last_undegraded":"2024-02-15T23:31:46.711568+0000","last_fullsized":"2024-02-15T23:31:46.711568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-02-15T23:31:46.711368+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-02-15T23:31:46.711368+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.711368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:56.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.478507+0000","last_change":"2024-02-15T23:31:51.478507+0000","last_active":"2024-02-15T23:31:51.478507+0000","last_peered":"2024-02-15T23:31:51.478507+0000","last_clean":"2024-02-15T23:31:51.478507+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:31:51.478507+0000","last_undegraded":"2024-02-15T23:31:51.478507+0000","last_fullsized":"2024-02-15T23:31:51.478507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:51.478248+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:51.478248+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.478248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:25.880117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.551280+0000","last_change":"2024-02-15T23:31:44.551340+0000","last_active":"2024-02-15T23:31:44.551280+0000","last_peered":"2024-02-15T23:31:44.551280+0000","last_clean":"2024-02-15T23:31:44.551280+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:31:44.551280+0000","last_undegraded":"2024-02-15T23:31:44.551280+0000","last_fullsized":"2024-02-15T23:31:44.551280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-02-15T23:31:44.551091+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-02-15T23:31:44.551091+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.551091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:41:29.596164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314746+0000","last_change":"2024-02-15T23:29:29.717627+0000","last_active":"2024-02-15T23:31:16.314746+0000","last_peered":"2024-02-15T23:31:16.314746+0000","last_clean":"2024-02-15T23:31:16.314746+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:31:16.314746+0000","last_undegraded":"2024-02-15T23:31:16.314746+0000","last_fullsized":"2024-02-15T23:31:16.314746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'18","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.561868+0000","last_change":"2024-02-15T23:31:42.562029+0000","last_active":"2024-02-15T23:31:42.561868+0000","last_peered":"2024-02-15T23:31:42.561868+0000","last_clean":"2024-02-15T23:31:42.561868+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:42.561868+0000","last_undegraded":"2024-02-15T23:31:42.561868+0000","last_fullsized":"2024-02-15T23:31:42.561868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-02-15T23:31:42.561648+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-02-15T23:31:42.561648+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.561648+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:06.676715+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.186119+0000","last_change":"2024-02-15T23:31:54.186119+0000","last_active":"2024-02-15T23:31:54.186119+0000","last_peered":"2024-02-15T23:31:54.186119+0000","last_clean":"2024-02-15T23:31:54.186119+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:31:54.186119+0000","last_undegraded":"2024-02-15T23:31:54.186119+0000","last_fullsized":"2024-02-15T23:31:54.186119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:54.185856+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:54.185856+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.185856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:06:08.657140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314518+0000","last_change":"2024-02-15T23:29:29.711609+0000","last_active":"2024-02-15T23:31:16.314518+0000","last_peered":"2024-02-15T23:31:16.314518+0000","last_clean":"2024-02-15T23:31:16.314518+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:31:16.314518+0000","last_undegraded":"2024-02-15T23:31:16.314518+0000","last_fullsized":"2024-02-15T23:31:16.314518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.381596+0000","last_change":"2024-02-15T23:31:23.381651+0000","last_active":"2024-02-15T23:31:23.381596+0000","last_peered":"2024-02-15T23:31:23.381596+0000","last_clean":"2024-02-15T23:31:23.381596+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:31:23.381596+0000","last_undegraded":"2024-02-15T23:31:23.381596+0000","last_fullsized":"2024-02-15T23:31:23.381596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.381406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:53.788740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.240824+0000","last_change":"2024-02-15T23:31:49.240923+0000","last_active":"2024-02-15T23:31:49.240824+0000","last_peered":"2024-02-15T23:31:49.240824+0000","last_clean":"2024-02-15T23:31:49.240824+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:31:49.240824+0000","last_undegraded":"2024-02-15T23:31:49.240824+0000","last_fullsized":"2024-02-15T23:31:49.240824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-15T23:31:49.240607+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-15T23:31:49.240607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.240607+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:27:40.630524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.464854+0000","last_change":"2024-02-15T23:31:26.464923+0000","last_active":"2024-02-15T23:31:26.464854+0000","last_peered":"2024-02-15T23:31:26.464854+0000","last_clean":"2024-02-15T23:31:26.464854+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:31:26.464854+0000","last_undegraded":"2024-02-15T23:31:26.464854+0000","last_fullsized":"2024-02-15T23:31:26.464854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.464676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:15.850726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.067453+0000","last_change":"2024-02-15T23:29:39.772828+0000","last_active":"2024-02-15T23:30:58.067453+0000","last_peered":"2024-02-15T23:30:58.067453+0000","last_clean":"2024-02-15T23:30:58.067453+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:30:58.067453+0000","last_undegraded":"2024-02-15T23:30:58.067453+0000","last_fullsized":"2024-02-15T23:30:58.067453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.462915+0000","last_change":"2024-02-15T23:31:33.462983+0000","last_active":"2024-02-15T23:31:33.462915+0000","last_peered":"2024-02-15T23:31:33.462915+0000","last_clean":"2024-02-15T23:31:33.462915+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:31:33.462915+0000","last_undegraded":"2024-02-15T23:31:33.462915+0000","last_fullsized":"2024-02-15T23:31:33.462915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.462731+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:08.999822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.852985+0000","last_change":"2024-02-15T23:29:29.722314+0000","last_active":"2024-02-15T23:31:15.852985+0000","last_peered":"2024-02-15T23:31:15.852985+0000","last_clean":"2024-02-15T23:31:15.852985+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:31:15.852985+0000","last_undegraded":"2024-02-15T23:31:15.852985+0000","last_fullsized":"2024-02-15T23:31:15.852985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.492105+0000","last_change":"2024-02-15T23:31:39.492105+0000","last_active":"2024-02-15T23:31:39.492105+0000","last_peered":"2024-02-15T23:31:39.492105+0000","last_clean":"2024-02-15T23:31:39.492105+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:31:39.492105+0000","last_undegraded":"2024-02-15T23:31:39.492105+0000","last_fullsized":"2024-02-15T23:31:39.492105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.491862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.491862+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.491862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:46.524152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.354123+0000","last_change":"2024-02-15T23:31:20.354191+0000","last_active":"2024-02-15T23:31:20.354123+0000","last_peered":"2024-02-15T23:31:20.354123+0000","last_clean":"2024-02-15T23:31:20.354123+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:31:20.354123+0000","last_undegraded":"2024-02-15T23:31:20.354123+0000","last_fullsized":"2024-02-15T23:31:20.354123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.353944+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:24.028078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.362264+0000","last_change":"2024-02-15T23:31:18.362319+0000","last_active":"2024-02-15T23:31:18.362264+0000","last_peered":"2024-02-15T23:31:18.362264+0000","last_clean":"2024-02-15T23:31:18.362264+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:31:18.362264+0000","last_undegraded":"2024-02-15T23:31:18.362264+0000","last_fullsized":"2024-02-15T23:31:18.362264+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.362075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.313172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.452199+0000","last_change":"2024-02-15T23:31:40.452261+0000","last_active":"2024-02-15T23:31:40.452199+0000","last_peered":"2024-02-15T23:31:40.452199+0000","last_clean":"2024-02-15T23:31:40.452199+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:31:40.452199+0000","last_undegraded":"2024-02-15T23:31:40.452199+0000","last_fullsized":"2024-02-15T23:31:40.452199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:40.452005+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:40.452005+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.452005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:24.188956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.236790+0000","last_change":"2024-02-15T23:31:50.236850+0000","last_active":"2024-02-15T23:31:50.236790+0000","last_peered":"2024-02-15T23:31:50.236790+0000","last_clean":"2024-02-15T23:31:50.236790+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:31:50.236790+0000","last_undegraded":"2024-02-15T23:31:50.236790+0000","last_fullsized":"2024-02-15T23:31:50.236790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:50.236582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:50.236582+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.236582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:37.333982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314562+0000","last_change":"2024-02-15T23:29:29.728584+0000","last_active":"2024-02-15T23:31:16.314562+0000","last_peered":"2024-02-15T23:31:16.314562+0000","last_clean":"2024-02-15T23:31:16.314562+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:31:16.314562+0000","last_undegraded":"2024-02-15T23:31:16.314562+0000","last_fullsized":"2024-02-15T23:31:16.314562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.525956+0000","last_change":"2024-02-15T23:31:33.526018+0000","last_active":"2024-02-15T23:31:33.525956+0000","last_peered":"2024-02-15T23:31:33.525956+0000","last_clean":"2024-02-15T23:31:33.525956+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:31:33.525956+0000","last_undegraded":"2024-02-15T23:31:33.525956+0000","last_fullsized":"2024-02-15T23:31:33.525956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.525754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.228715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.758809+0000","last_change":"2024-02-15T23:31:21.758890+0000","last_active":"2024-02-15T23:31:21.758809+0000","last_peered":"2024-02-15T23:31:21.758809+0000","last_clean":"2024-02-15T23:31:21.758809+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:31:21.758809+0000","last_undegraded":"2024-02-15T23:31:21.758809+0000","last_fullsized":"2024-02-15T23:31:21.758809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.758604+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:00:21.378855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":315,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.276822+0000","last_change":"2024-02-15T23:31:52.276965+0000","last_active":"2024-02-15T23:31:52.276822+0000","last_peered":"2024-02-15T23:31:52.276822+0000","last_clean":"2024-02-15T23:31:52.276822+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:52.276822+0000","last_undegraded":"2024-02-15T23:31:52.276822+0000","last_fullsized":"2024-02-15T23:31:52.276822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-15T23:31:52.276608+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-15T23:31:52.276608+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.276608+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:23:11.852737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.712162+0000","last_change":"2024-02-15T23:31:36.712221+0000","last_active":"2024-02-15T23:31:36.712162+0000","last_peered":"2024-02-15T23:31:36.712162+0000","last_clean":"2024-02-15T23:31:36.712162+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:31:36.712162+0000","last_undegraded":"2024-02-15T23:31:36.712162+0000","last_fullsized":"2024-02-15T23:31:36.712162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:36.711954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:36.711954+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.711954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:26.098004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791871+0000","last_change":"2024-02-15T23:29:31.696768+0000","last_active":"2024-02-15T23:30:10.791871+0000","last_peered":"2024-02-15T23:30:10.791871+0000","last_clean":"2024-02-15T23:30:10.791871+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:30:10.791871+0000","last_undegraded":"2024-02-15T23:30:10.791871+0000","last_fullsized":"2024-02-15T23:30:10.791871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397633+0000","last_change":"2024-02-15T23:29:29.737866+0000","last_active":"2024-02-15T23:31:15.397633+0000","last_peered":"2024-02-15T23:31:15.397633+0000","last_clean":"2024-02-15T23:31:15.397633+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:31:15.397633+0000","last_undegraded":"2024-02-15T23:31:15.397633+0000","last_fullsized":"2024-02-15T23:31:15.397633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.380144+0000","last_change":"2024-02-15T23:31:19.380202+0000","last_active":"2024-02-15T23:31:19.380144+0000","last_peered":"2024-02-15T23:31:19.380144+0000","last_clean":"2024-02-15T23:31:19.380144+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:31:19.380144+0000","last_undegraded":"2024-02-15T23:31:19.380144+0000","last_fullsized":"2024-02-15T23:31:19.380144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.379961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:22.107728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.801386+0000","last_change":"2024-02-15T23:31:23.801467+0000","last_active":"2024-02-15T23:31:23.801386+0000","last_peered":"2024-02-15T23:31:23.801386+0000","last_clean":"2024-02-15T23:31:23.801386+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:31:23.801386+0000","last_undegraded":"2024-02-15T23:31:23.801386+0000","last_fullsized":"2024-02-15T23:31:23.801386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.801176+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:09.278307+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":342,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.592027+0000","last_change":"2024-02-15T23:31:18.592156+0000","last_active":"2024-02-15T23:31:18.592027+0000","last_peered":"2024-02-15T23:31:18.592027+0000","last_clean":"2024-02-15T23:31:18.592027+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:18.592027+0000","last_undegraded":"2024-02-15T23:31:18.592027+0000","last_fullsized":"2024-02-15T23:31:18.592027+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.591821+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.542917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315228+0000","last_change":"2024-02-15T23:29:31.702049+0000","last_active":"2024-02-15T23:31:16.315228+0000","last_peered":"2024-02-15T23:31:16.315228+0000","last_clean":"2024-02-15T23:31:16.315228+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:31:16.315228+0000","last_undegraded":"2024-02-15T23:31:16.315228+0000","last_fullsized":"2024-02-15T23:31:16.315228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.686615+0000","last_change":"2024-02-15T23:31:49.686753+0000","last_active":"2024-02-15T23:31:49.686615+0000","last_peered":"2024-02-15T23:31:49.686615+0000","last_clean":"2024-02-15T23:31:49.686615+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:31:49.686615+0000","last_undegraded":"2024-02-15T23:31:49.686615+0000","last_fullsized":"2024-02-15T23:31:49.686615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.686352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.686352+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.686352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:56.718642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.477281+0000","last_change":"2024-02-15T23:31:29.477281+0000","last_active":"2024-02-15T23:31:29.477281+0000","last_peered":"2024-02-15T23:31:29.477281+0000","last_clean":"2024-02-15T23:31:29.477281+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:31:29.477281+0000","last_undegraded":"2024-02-15T23:31:29.477281+0000","last_fullsized":"2024-02-15T23:31:29.477281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.477038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.461667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.798531+0000","last_change":"2024-02-15T23:31:22.798531+0000","last_active":"2024-02-15T23:31:22.798531+0000","last_peered":"2024-02-15T23:31:22.798531+0000","last_clean":"2024-02-15T23:31:22.798531+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:31:22.798531+0000","last_undegraded":"2024-02-15T23:31:22.798531+0000","last_fullsized":"2024-02-15T23:31:22.798531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.798209+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:35.238195+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.541487+0000","last_change":"2024-02-15T23:31:17.541487+0000","last_active":"2024-02-15T23:31:17.541487+0000","last_peered":"2024-02-15T23:31:17.541487+0000","last_clean":"2024-02-15T23:31:17.541487+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:31:17.541487+0000","last_undegraded":"2024-02-15T23:31:17.541487+0000","last_fullsized":"2024-02-15T23:31:17.541487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.541232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.369965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.854596+0000","last_change":"2024-02-15T23:29:39.779875+0000","last_active":"2024-02-15T23:31:15.854596+0000","last_peered":"2024-02-15T23:31:15.854596+0000","last_clean":"2024-02-15T23:31:15.854596+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:31:15.854596+0000","last_undegraded":"2024-02-15T23:31:15.854596+0000","last_fullsized":"2024-02-15T23:31:15.854596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398253+0000","last_change":"2024-02-15T23:29:31.694940+0000","last_active":"2024-02-15T23:31:15.398253+0000","last_peered":"2024-02-15T23:31:15.398253+0000","last_clean":"2024-02-15T23:31:15.398253+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:31:15.398253+0000","last_undegraded":"2024-02-15T23:31:15.398253+0000","last_fullsized":"2024-02-15T23:31:15.398253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.852855+0000","last_change":"2024-02-15T23:29:29.723619+0000","last_active":"2024-02-15T23:31:15.852855+0000","last_peered":"2024-02-15T23:31:15.852855+0000","last_clean":"2024-02-15T23:31:15.852855+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:31:15.852855+0000","last_undegraded":"2024-02-15T23:31:15.852855+0000","last_fullsized":"2024-02-15T23:31:15.852855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.579242+0000","last_change":"2024-02-15T23:30:10.788609+0000","last_active":"2024-02-15T23:30:14.579242+0000","last_peered":"2024-02-15T23:30:14.579242+0000","last_clean":"2024-02-15T23:30:14.579242+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:30:14.579242+0000","last_undegraded":"2024-02-15T23:30:14.579242+0000","last_fullsized":"2024-02-15T23:30:14.579242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.459639+0000","last_change":"2024-02-15T23:31:32.459639+0000","last_active":"2024-02-15T23:31:32.459639+0000","last_peered":"2024-02-15T23:31:32.459639+0000","last_clean":"2024-02-15T23:31:32.459639+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:31:32.459639+0000","last_undegraded":"2024-02-15T23:31:32.459639+0000","last_fullsized":"2024-02-15T23:31:32.459639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.459345+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:19.866069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.577110+0000","last_change":"2024-02-15T23:31:16.577110+0000","last_active":"2024-02-15T23:31:16.577110+0000","last_peered":"2024-02-15T23:31:16.577110+0000","last_clean":"2024-02-15T23:31:16.577110+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:31:16.577110+0000","last_undegraded":"2024-02-15T23:31:16.577110+0000","last_fullsized":"2024-02-15T23:31:16.577110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.576722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:35.480941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'7","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.399844+0000","last_change":"2024-02-15T23:29:39.781125+0000","last_active":"2024-02-15T23:31:15.399844+0000","last_peered":"2024-02-15T23:31:15.399844+0000","last_clean":"2024-02-15T23:31:15.399844+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:31:15.399844+0000","last_undegraded":"2024-02-15T23:31:15.399844+0000","last_fullsized":"2024-02-15T23:31:15.399844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.853384+0000","last_change":"2024-02-15T23:29:31.710943+0000","last_active":"2024-02-15T23:31:15.853384+0000","last_peered":"2024-02-15T23:31:15.853384+0000","last_clean":"2024-02-15T23:31:15.853384+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:31:15.853384+0000","last_undegraded":"2024-02-15T23:31:15.853384+0000","last_fullsized":"2024-02-15T23:31:15.853384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314476+0000","last_change":"2024-02-15T23:29:29.725600+0000","last_active":"2024-02-15T23:31:16.314476+0000","last_peered":"2024-02-15T23:31:16.314476+0000","last_clean":"2024-02-15T23:31:16.314476+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:31:16.314476+0000","last_undegraded":"2024-02-15T23:31:16.314476+0000","last_fullsized":"2024-02-15T23:31:16.314476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.484374+0000","last_change":"2024-02-15T23:31:37.484374+0000","last_active":"2024-02-15T23:31:37.484374+0000","last_peered":"2024-02-15T23:31:37.484374+0000","last_clean":"2024-02-15T23:31:37.484374+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:31:37.484374+0000","last_undegraded":"2024-02-15T23:31:37.484374+0000","last_fullsized":"2024-02-15T23:31:37.484374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.484130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.484130+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.484130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:59.045203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.514009+0000","last_change":"2024-02-15T23:31:30.514009+0000","last_active":"2024-02-15T23:31:30.514009+0000","last_peered":"2024-02-15T23:31:30.514009+0000","last_clean":"2024-02-15T23:31:30.514009+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:31:30.514009+0000","last_undegraded":"2024-02-15T23:31:30.514009+0000","last_fullsized":"2024-02-15T23:31:30.514009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.513714+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:12.277197+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.644582+0000","last_change":"2024-02-15T23:31:20.644582+0000","last_active":"2024-02-15T23:31:20.644582+0000","last_peered":"2024-02-15T23:31:20.644582+0000","last_clean":"2024-02-15T23:31:20.644582+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:20.644582+0000","last_undegraded":"2024-02-15T23:31:20.644582+0000","last_fullsized":"2024-02-15T23:31:20.644582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.644319+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:29.139495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.956377+0000","last_change":"2024-02-15T23:29:39.784076+0000","last_active":"2024-02-15T23:31:14.956377+0000","last_peered":"2024-02-15T23:31:14.956377+0000","last_clean":"2024-02-15T23:31:14.956377+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:31:14.956377+0000","last_undegraded":"2024-02-15T23:31:14.956377+0000","last_fullsized":"2024-02-15T23:31:14.956377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.687575+0000","last_change":"2024-02-15T23:31:39.687575+0000","last_active":"2024-02-15T23:31:39.687575+0000","last_peered":"2024-02-15T23:31:39.687575+0000","last_clean":"2024-02-15T23:31:39.687575+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:31:39.687575+0000","last_undegraded":"2024-02-15T23:31:39.687575+0000","last_fullsized":"2024-02-15T23:31:39.687575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.687336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:21.671965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314433+0000","last_change":"2024-02-15T23:29:29.717855+0000","last_active":"2024-02-15T23:31:16.314433+0000","last_peered":"2024-02-15T23:31:16.314433+0000","last_clean":"2024-02-15T23:31:16.314433+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:31:16.314433+0000","last_undegraded":"2024-02-15T23:31:16.314433+0000","last_fullsized":"2024-02-15T23:31:16.314433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.499881+0000","last_change":"2024-02-15T23:31:31.499881+0000","last_active":"2024-02-15T23:31:31.499881+0000","last_peered":"2024-02-15T23:31:31.499881+0000","last_clean":"2024-02-15T23:31:31.499881+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:31:31.499881+0000","last_undegraded":"2024-02-15T23:31:31.499881+0000","last_fullsized":"2024-02-15T23:31:31.499881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.499481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.621183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.287683+0000","last_change":"2024-02-15T23:31:47.287683+0000","last_active":"2024-02-15T23:31:47.287683+0000","last_peered":"2024-02-15T23:31:47.287683+0000","last_clean":"2024-02-15T23:31:47.287683+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:47.287683+0000","last_undegraded":"2024-02-15T23:31:47.287683+0000","last_fullsized":"2024-02-15T23:31:47.287683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-02-15T23:31:47.287351+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-02-15T23:31:47.287351+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.287351+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:28.564071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.657045+0000","last_change":"2024-02-15T23:31:21.657045+0000","last_active":"2024-02-15T23:31:21.657045+0000","last_peered":"2024-02-15T23:31:21.657045+0000","last_clean":"2024-02-15T23:31:21.657045+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:31:21.657045+0000","last_undegraded":"2024-02-15T23:31:21.657045+0000","last_fullsized":"2024-02-15T23:31:21.657045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.656809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:38.124016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.956252+0000","last_change":"2024-02-15T23:29:39.766366+0000","last_active":"2024-02-15T23:31:14.956252+0000","last_peered":"2024-02-15T23:31:14.956252+0000","last_clean":"2024-02-15T23:31:14.956252+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:31:14.956252+0000","last_undegraded":"2024-02-15T23:31:14.956252+0000","last_fullsized":"2024-02-15T23:31:14.956252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.773260+0000","last_change":"2024-02-15T23:30:10.801846+0000","last_active":"2024-02-15T23:30:15.773260+0000","last_peered":"2024-02-15T23:30:15.773260+0000","last_clean":"2024-02-15T23:30:15.773260+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:30:15.773260+0000","last_undegraded":"2024-02-15T23:30:15.773260+0000","last_fullsized":"2024-02-15T23:30:15.773260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955122+0000","last_change":"2024-02-15T23:29:29.716793+0000","last_active":"2024-02-15T23:31:14.955122+0000","last_peered":"2024-02-15T23:31:14.955122+0000","last_clean":"2024-02-15T23:31:14.955122+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:31:14.955122+0000","last_undegraded":"2024-02-15T23:31:14.955122+0000","last_fullsized":"2024-02-15T23:31:14.955122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.636155+0000","last_change":"2024-02-15T23:31:33.636155+0000","last_active":"2024-02-15T23:31:33.636155+0000","last_peered":"2024-02-15T23:31:33.636155+0000","last_clean":"2024-02-15T23:31:33.636155+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:31:33.636155+0000","last_undegraded":"2024-02-15T23:31:33.636155+0000","last_fullsized":"2024-02-15T23:31:33.636155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.635864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:47.730744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.407975+0000","last_change":"2024-02-15T23:31:24.407975+0000","last_active":"2024-02-15T23:31:24.407975+0000","last_peered":"2024-02-15T23:31:24.407975+0000","last_clean":"2024-02-15T23:31:24.407975+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:24.407975+0000","last_undegraded":"2024-02-15T23:31:24.407975+0000","last_fullsized":"2024-02-15T23:31:24.407975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.407715+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:36.649762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.276712+0000","last_change":"2024-02-15T23:31:48.276712+0000","last_active":"2024-02-15T23:31:48.276712+0000","last_peered":"2024-02-15T23:31:48.276712+0000","last_clean":"2024-02-15T23:31:48.276712+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:31:48.276712+0000","last_undegraded":"2024-02-15T23:31:48.276712+0000","last_fullsized":"2024-02-15T23:31:48.276712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:48.276447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:48.276447+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.276447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:14:35.402031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316951+0000","last_change":"2024-02-15T23:29:39.775394+0000","last_active":"2024-02-15T23:31:16.316951+0000","last_peered":"2024-02-15T23:31:16.316951+0000","last_clean":"2024-02-15T23:31:16.316951+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:31:16.316951+0000","last_undegraded":"2024-02-15T23:31:16.316951+0000","last_fullsized":"2024-02-15T23:31:16.316951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.404343+0000","last_change":"2024-02-15T23:31:27.404343+0000","last_active":"2024-02-15T23:31:27.404343+0000","last_peered":"2024-02-15T23:31:27.404343+0000","last_clean":"2024-02-15T23:31:27.404343+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:31:27.404343+0000","last_undegraded":"2024-02-15T23:31:27.404343+0000","last_fullsized":"2024-02-15T23:31:27.404343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.404065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:04.056272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314454+0000","last_change":"2024-02-15T23:29:29.725808+0000","last_active":"2024-02-15T23:31:16.314454+0000","last_peered":"2024-02-15T23:31:16.314454+0000","last_clean":"2024-02-15T23:31:16.314454+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:31:16.314454+0000","last_undegraded":"2024-02-15T23:31:16.314454+0000","last_fullsized":"2024-02-15T23:31:16.314454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.466268+0000","last_change":"2024-02-15T23:31:38.466268+0000","last_active":"2024-02-15T23:31:38.466268+0000","last_peered":"2024-02-15T23:31:38.466268+0000","last_clean":"2024-02-15T23:31:38.466268+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:31:38.466268+0000","last_undegraded":"2024-02-15T23:31:38.466268+0000","last_fullsized":"2024-02-15T23:31:38.466268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:38.466027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:38.466027+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.466027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:12.976124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.812184+0000","last_change":"2024-02-15T23:31:27.812184+0000","last_active":"2024-02-15T23:31:27.812184+0000","last_peered":"2024-02-15T23:31:27.812184+0000","last_clean":"2024-02-15T23:31:27.812184+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:31:27.812184+0000","last_undegraded":"2024-02-15T23:31:27.812184+0000","last_fullsized":"2024-02-15T23:31:27.812184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.812031+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:53.640763+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":345,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.837313+0000","last_change":"2024-02-15T23:31:18.837313+0000","last_active":"2024-02-15T23:31:18.837313+0000","last_peered":"2024-02-15T23:31:18.837313+0000","last_clean":"2024-02-15T23:31:18.837313+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:18.837313+0000","last_undegraded":"2024-02-15T23:31:18.837313+0000","last_fullsized":"2024-02-15T23:31:18.837313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.836996+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:26.809047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.437875+0000","last_change":"2024-02-15T23:31:44.437875+0000","last_active":"2024-02-15T23:31:44.437875+0000","last_peered":"2024-02-15T23:31:44.437875+0000","last_clean":"2024-02-15T23:31:44.437875+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:31:44.437875+0000","last_undegraded":"2024-02-15T23:31:44.437875+0000","last_fullsized":"2024-02-15T23:31:44.437875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:44.437626+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:44.437626+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.437626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:01.530419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.694509+0000","last_change":"2024-02-15T23:31:50.694563+0000","last_active":"2024-02-15T23:31:50.694509+0000","last_peered":"2024-02-15T23:31:50.694509+0000","last_clean":"2024-02-15T23:31:50.694509+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:31:50.694509+0000","last_undegraded":"2024-02-15T23:31:50.694509+0000","last_fullsized":"2024-02-15T23:31:50.694509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:50.694320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:50.694320+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.694320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:34.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314406+0000","last_change":"2024-02-15T23:29:29.720429+0000","last_active":"2024-02-15T23:31:16.314406+0000","last_peered":"2024-02-15T23:31:16.314406+0000","last_clean":"2024-02-15T23:31:16.314406+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:31:16.314406+0000","last_undegraded":"2024-02-15T23:31:16.314406+0000","last_fullsized":"2024-02-15T23:31:16.314406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.474688+0000","last_change":"2024-02-15T23:31:27.474688+0000","last_active":"2024-02-15T23:31:27.474688+0000","last_peered":"2024-02-15T23:31:27.474688+0000","last_clean":"2024-02-15T23:31:27.474688+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:27.474688+0000","last_undegraded":"2024-02-15T23:31:27.474688+0000","last_fullsized":"2024-02-15T23:31:27.474688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.474436+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.169933+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.325111+0000","last_change":"2024-02-15T23:31:43.325111+0000","last_active":"2024-02-15T23:31:43.325111+0000","last_peered":"2024-02-15T23:31:43.325111+0000","last_clean":"2024-02-15T23:31:43.325111+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:31:43.325111+0000","last_undegraded":"2024-02-15T23:31:43.325111+0000","last_fullsized":"2024-02-15T23:31:43.325111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:43.324799+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:43.324799+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.324799+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:21.930488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.408189+0000","last_change":"2024-02-15T23:31:16.408189+0000","last_active":"2024-02-15T23:31:16.408189+0000","last_peered":"2024-02-15T23:31:16.408189+0000","last_clean":"2024-02-15T23:31:16.408189+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:16.408189+0000","last_undegraded":"2024-02-15T23:31:16.408189+0000","last_fullsized":"2024-02-15T23:31:16.408189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.407927+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:42.842010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.684561+0000","last_change":"2024-02-15T23:31:32.684561+0000","last_active":"2024-02-15T23:31:32.684561+0000","last_peered":"2024-02-15T23:31:32.684561+0000","last_clean":"2024-02-15T23:31:32.684561+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:31:32.684561+0000","last_undegraded":"2024-02-15T23:31:32.684561+0000","last_fullsized":"2024-02-15T23:31:32.684561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.684302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:13.848320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.605287+0000","last_change":"2024-02-15T23:31:39.605287+0000","last_active":"2024-02-15T23:31:39.605287+0000","last_peered":"2024-02-15T23:31:39.605287+0000","last_clean":"2024-02-15T23:31:39.605287+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:31:39.605287+0000","last_undegraded":"2024-02-15T23:31:39.605287+0000","last_fullsized":"2024-02-15T23:31:39.605287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:39.605037+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:39.605037+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.605037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:46.637327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314455+0000","last_change":"2024-02-15T23:29:29.724689+0000","last_active":"2024-02-15T23:31:16.314455+0000","last_peered":"2024-02-15T23:31:16.314455+0000","last_clean":"2024-02-15T23:31:16.314455+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:31:16.314455+0000","last_undegraded":"2024-02-15T23:31:16.314455+0000","last_fullsized":"2024-02-15T23:31:16.314455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.443979+0000","last_change":"2024-02-15T23:31:16.443979+0000","last_active":"2024-02-15T23:31:16.443979+0000","last_peered":"2024-02-15T23:31:16.443979+0000","last_clean":"2024-02-15T23:31:16.443979+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:31:16.443979+0000","last_undegraded":"2024-02-15T23:31:16.443979+0000","last_fullsized":"2024-02-15T23:31:16.443979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.443730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:16:47.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.362479+0000","last_change":"2024-02-15T23:31:21.362479+0000","last_active":"2024-02-15T23:31:21.362479+0000","last_peered":"2024-02-15T23:31:21.362479+0000","last_clean":"2024-02-15T23:31:21.362479+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:31:21.362479+0000","last_undegraded":"2024-02-15T23:31:21.362479+0000","last_fullsized":"2024-02-15T23:31:21.362479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.362097+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:21.356365+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.792994+0000","last_change":"2024-02-15T23:31:24.792994+0000","last_active":"2024-02-15T23:31:24.792994+0000","last_peered":"2024-02-15T23:31:24.792994+0000","last_clean":"2024-02-15T23:31:24.792994+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:31:24.792994+0000","last_undegraded":"2024-02-15T23:31:24.792994+0000","last_fullsized":"2024-02-15T23:31:24.792994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.792712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:03:10.186879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.472926+0000","last_change":"2024-02-15T23:31:30.472926+0000","last_active":"2024-02-15T23:31:30.472926+0000","last_peered":"2024-02-15T23:31:30.472926+0000","last_clean":"2024-02-15T23:31:30.472926+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:31:30.472926+0000","last_undegraded":"2024-02-15T23:31:30.472926+0000","last_fullsized":"2024-02-15T23:31:30.472926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.472637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.285998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.502716+0000","last_change":"2024-02-15T23:31:31.502716+0000","last_active":"2024-02-15T23:31:31.502716+0000","last_peered":"2024-02-15T23:31:31.502716+0000","last_clean":"2024-02-15T23:31:31.502716+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:31:31.502716+0000","last_undegraded":"2024-02-15T23:31:31.502716+0000","last_fullsized":"2024-02-15T23:31:31.502716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.502461+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:37.162072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397571+0000","last_change":"2024-02-15T23:29:17.391071+0000","last_active":"2024-02-15T23:31:15.397571+0000","last_peered":"2024-02-15T23:31:15.397571+0000","last_clean":"2024-02-15T23:31:15.397571+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:31:15.397571+0000","last_undegraded":"2024-02-15T23:31:15.397571+0000","last_fullsized":"2024-02-15T23:31:15.397571+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:15.580621+0000","last_clean_scrub_stamp":"2024-02-15T23:29:15.580621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314216+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:31:16.314216+0000","last_peered":"2024-02-15T23:31:16.314216+0000","last_clean":"2024-02-15T23:31:16.314216+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:31:16.314216+0000","last_undegraded":"2024-02-15T23:31:16.314216+0000","last_fullsized":"2024-02-15T23:31:16.314216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314269+0000","last_change":"2024-02-15T23:29:29.725524+0000","last_active":"2024-02-15T23:31:16.314269+0000","last_peered":"2024-02-15T23:31:16.314269+0000","last_clean":"2024-02-15T23:31:16.314269+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:31:16.314269+0000","last_undegraded":"2024-02-15T23:31:16.314269+0000","last_fullsized":"2024-02-15T23:31:16.314269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398956+0000","last_change":"2024-02-15T23:30:10.801490+0000","last_active":"2024-02-15T23:31:15.398956+0000","last_peered":"2024-02-15T23:31:15.398956+0000","last_clean":"2024-02-15T23:31:15.398956+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:31:15.398956+0000","last_undegraded":"2024-02-15T23:31:15.398956+0000","last_fullsized":"2024-02-15T23:31:15.398956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.412677+0000","last_change":"2024-02-15T23:31:24.412677+0000","last_active":"2024-02-15T23:31:24.412677+0000","last_peered":"2024-02-15T23:31:24.412677+0000","last_clean":"2024-02-15T23:31:24.412677+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:24.412677+0000","last_undegraded":"2024-02-15T23:31:24.412677+0000","last_fullsized":"2024-02-15T23:31:24.412677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.412389+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:34.534030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.511629+0000","last_change":"2024-02-15T23:31:28.511629+0000","last_active":"2024-02-15T23:31:28.511629+0000","last_peered":"2024-02-15T23:31:28.511629+0000","last_clean":"2024-02-15T23:31:28.511629+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:31:28.511629+0000","last_undegraded":"2024-02-15T23:31:28.511629+0000","last_fullsized":"2024-02-15T23:31:28.511629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.511388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:40.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.854603+0000","last_change":"2024-02-15T23:29:39.777587+0000","last_active":"2024-02-15T23:31:15.854603+0000","last_peered":"2024-02-15T23:31:15.854603+0000","last_clean":"2024-02-15T23:31:15.854603+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:31:15.854603+0000","last_undegraded":"2024-02-15T23:31:15.854603+0000","last_fullsized":"2024-02-15T23:31:15.854603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'14","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.249776+0000","last_change":"2024-02-15T23:31:51.249938+0000","last_active":"2024-02-15T23:31:51.249776+0000","last_peered":"2024-02-15T23:31:51.249776+0000","last_clean":"2024-02-15T23:31:51.249776+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:31:51.249776+0000","last_undegraded":"2024-02-15T23:31:51.249776+0000","last_fullsized":"2024-02-15T23:31:51.249776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:31:51.249530+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:31:51.249530+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.249530+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:17.586232+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314236+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:31:16.314236+0000","last_peered":"2024-02-15T23:31:16.314236+0000","last_clean":"2024-02-15T23:31:16.314236+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:31:16.314236+0000","last_undegraded":"2024-02-15T23:31:16.314236+0000","last_fullsized":"2024-02-15T23:31:16.314236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955118+0000","last_change":"2024-02-15T23:29:29.708594+0000","last_active":"2024-02-15T23:31:14.955118+0000","last_peered":"2024-02-15T23:31:14.955118+0000","last_clean":"2024-02-15T23:31:14.955118+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:31:14.955118+0000","last_undegraded":"2024-02-15T23:31:14.955118+0000","last_fullsized":"2024-02-15T23:31:14.955118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.399165+0000","last_change":"2024-02-15T23:31:20.399165+0000","last_active":"2024-02-15T23:31:20.399165+0000","last_peered":"2024-02-15T23:31:20.399165+0000","last_clean":"2024-02-15T23:31:20.399165+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:31:20.399165+0000","last_undegraded":"2024-02-15T23:31:20.399165+0000","last_fullsized":"2024-02-15T23:31:20.399165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.398920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:13.693335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.428280+0000","last_change":"2024-02-15T23:31:25.428280+0000","last_active":"2024-02-15T23:31:25.428280+0000","last_peered":"2024-02-15T23:31:25.428280+0000","last_clean":"2024-02-15T23:31:25.428280+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:25.428280+0000","last_undegraded":"2024-02-15T23:31:25.428280+0000","last_fullsized":"2024-02-15T23:31:25.428280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.427985+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:29.336924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.323076+0000","last_change":"2024-02-15T23:31:40.323076+0000","last_active":"2024-02-15T23:31:40.323076+0000","last_peered":"2024-02-15T23:31:40.323076+0000","last_clean":"2024-02-15T23:31:40.323076+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:31:40.323076+0000","last_undegraded":"2024-02-15T23:31:40.323076+0000","last_fullsized":"2024-02-15T23:31:40.323076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:40.322696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:40.322696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.322696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:29.911537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.399850+0000","last_change":"2024-02-15T23:29:39.779672+0000","last_active":"2024-02-15T23:31:15.399850+0000","last_peered":"2024-02-15T23:31:15.399850+0000","last_clean":"2024-02-15T23:31:15.399850+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:31:15.399850+0000","last_undegraded":"2024-02-15T23:31:15.399850+0000","last_fullsized":"2024-02-15T23:31:15.399850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.339402+0000","last_change":"2024-02-15T23:31:54.339463+0000","last_active":"2024-02-15T23:31:54.339402+0000","last_peered":"2024-02-15T23:31:54.339402+0000","last_clean":"2024-02-15T23:31:54.339402+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:54.339402+0000","last_undegraded":"2024-02-15T23:31:54.339402+0000","last_fullsized":"2024-02-15T23:31:54.339402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:54.339211+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:54.339211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.339211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:41.745936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.852861+0000","last_change":"2024-02-15T23:29:21.622454+0000","last_active":"2024-02-15T23:31:15.852861+0000","last_peered":"2024-02-15T23:31:15.852861+0000","last_clean":"2024-02-15T23:31:15.852861+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:31:15.852861+0000","last_undegraded":"2024-02-15T23:31:15.852861+0000","last_fullsized":"2024-02-15T23:31:15.852861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955131+0000","last_change":"2024-02-15T23:29:29.718869+0000","last_active":"2024-02-15T23:31:14.955131+0000","last_peered":"2024-02-15T23:31:14.955131+0000","last_clean":"2024-02-15T23:31:14.955131+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:31:14.955131+0000","last_undegraded":"2024-02-15T23:31:14.955131+0000","last_fullsized":"2024-02-15T23:31:14.955131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.696551+0000","last_change":"2024-02-15T23:31:35.696551+0000","last_active":"2024-02-15T23:31:35.696551+0000","last_peered":"2024-02-15T23:31:35.696551+0000","last_clean":"2024-02-15T23:31:35.696551+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:31:35.696551+0000","last_undegraded":"2024-02-15T23:31:35.696551+0000","last_fullsized":"2024-02-15T23:31:35.696551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:35.696295+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:35.696295+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.696295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:39.605234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.811746+0000","last_change":"2024-02-15T23:31:19.811746+0000","last_active":"2024-02-15T23:31:19.811746+0000","last_peered":"2024-02-15T23:31:19.811746+0000","last_clean":"2024-02-15T23:31:19.811746+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:19.811746+0000","last_undegraded":"2024-02-15T23:31:19.811746+0000","last_fullsized":"2024-02-15T23:31:19.811746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.811464+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:28:44.508275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.546516+0000","last_change":"2024-02-15T23:31:32.546516+0000","last_active":"2024-02-15T23:31:32.546516+0000","last_peered":"2024-02-15T23:31:32.546516+0000","last_clean":"2024-02-15T23:31:32.546516+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:31:32.546516+0000","last_undegraded":"2024-02-15T23:31:32.546516+0000","last_fullsized":"2024-02-15T23:31:32.546516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.546263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.575111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316700+0000","last_change":"2024-02-15T23:29:39.769538+0000","last_active":"2024-02-15T23:31:16.316700+0000","last_peered":"2024-02-15T23:31:16.316700+0000","last_clean":"2024-02-15T23:31:16.316700+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:31:16.316700+0000","last_undegraded":"2024-02-15T23:31:16.316700+0000","last_fullsized":"2024-02-15T23:31:16.316700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.467094+0000","last_change":"2024-02-15T23:31:48.467222+0000","last_active":"2024-02-15T23:31:48.467094+0000","last_peered":"2024-02-15T23:31:48.467094+0000","last_clean":"2024-02-15T23:31:48.467094+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:48.467094+0000","last_undegraded":"2024-02-15T23:31:48.467094+0000","last_fullsized":"2024-02-15T23:31:48.467094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:31:48.466864+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:31:48.466864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.466864+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:04:45.986887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314245+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:31:16.314245+0000","last_peered":"2024-02-15T23:31:16.314245+0000","last_clean":"2024-02-15T23:31:16.314245+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:31:16.314245+0000","last_undegraded":"2024-02-15T23:31:16.314245+0000","last_fullsized":"2024-02-15T23:31:16.314245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.852855+0000","last_change":"2024-02-15T23:29:29.721410+0000","last_active":"2024-02-15T23:31:15.852855+0000","last_peered":"2024-02-15T23:31:15.852855+0000","last_clean":"2024-02-15T23:31:15.852855+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:31:15.852855+0000","last_undegraded":"2024-02-15T23:31:15.852855+0000","last_fullsized":"2024-02-15T23:31:15.852855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.558062+0000","last_change":"2024-02-15T23:31:35.558062+0000","last_active":"2024-02-15T23:31:35.558062+0000","last_peered":"2024-02-15T23:31:35.558062+0000","last_clean":"2024-02-15T23:31:35.558062+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:31:35.558062+0000","last_undegraded":"2024-02-15T23:31:35.558062+0000","last_fullsized":"2024-02-15T23:31:35.558062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:35.557819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:35.557819+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.557819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:02.418349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.310142+0000","last_change":"2024-02-15T23:31:45.310142+0000","last_active":"2024-02-15T23:31:45.310142+0000","last_peered":"2024-02-15T23:31:45.310142+0000","last_clean":"2024-02-15T23:31:45.310142+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:31:45.310142+0000","last_undegraded":"2024-02-15T23:31:45.310142+0000","last_fullsized":"2024-02-15T23:31:45.310142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-02-15T23:31:45.309885+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-02-15T23:31:45.309885+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.309885+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:11.973068+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316526+0000","last_change":"2024-02-15T23:29:37.774191+0000","last_active":"2024-02-15T23:31:16.316526+0000","last_peered":"2024-02-15T23:31:16.316526+0000","last_clean":"2024-02-15T23:31:16.316526+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:31:16.316526+0000","last_undegraded":"2024-02-15T23:31:16.316526+0000","last_fullsized":"2024-02-15T23:31:16.316526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:36.701479+0000","last_clean_scrub_stamp":"2024-02-15T23:29:36.701479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.560635+0000","last_change":"2024-02-15T23:31:38.560635+0000","last_active":"2024-02-15T23:31:38.560635+0000","last_peered":"2024-02-15T23:31:38.560635+0000","last_clean":"2024-02-15T23:31:38.560635+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:31:38.560635+0000","last_undegraded":"2024-02-15T23:31:38.560635+0000","last_fullsized":"2024-02-15T23:31:38.560635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:38.560266+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:38.560266+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.560266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:13.070363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'11","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398196+0000","last_change":"2024-02-15T23:30:10.810101+0000","last_active":"2024-02-15T23:31:15.398196+0000","last_peered":"2024-02-15T23:31:15.398196+0000","last_clean":"2024-02-15T23:31:15.398196+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:31:15.398196+0000","last_undegraded":"2024-02-15T23:31:15.398196+0000","last_fullsized":"2024-02-15T23:31:15.398196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.640528+0000","last_change":"2024-02-15T23:31:43.640596+0000","last_active":"2024-02-15T23:31:43.640528+0000","last_peered":"2024-02-15T23:31:43.640528+0000","last_clean":"2024-02-15T23:31:43.640528+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:31:43.640528+0000","last_undegraded":"2024-02-15T23:31:43.640528+0000","last_fullsized":"2024-02-15T23:31:43.640528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:43.640321+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:43.640321+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.640321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:40.343283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955213+0000","last_change":"2024-02-15T23:29:21.627861+0000","last_active":"2024-02-15T23:31:14.955213+0000","last_peered":"2024-02-15T23:31:14.955213+0000","last_clean":"2024-02-15T23:31:14.955213+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:31:14.955213+0000","last_undegraded":"2024-02-15T23:31:14.955213+0000","last_fullsized":"2024-02-15T23:31:14.955213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:14.579288+0000","last_change":"2024-02-15T23:30:10.801694+0000","last_active":"2024-02-15T23:30:14.579288+0000","last_peered":"2024-02-15T23:30:14.579288+0000","last_clean":"2024-02-15T23:30:14.579288+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:30:14.579288+0000","last_undegraded":"2024-02-15T23:30:14.579288+0000","last_fullsized":"2024-02-15T23:30:14.579288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:32.668080+0000","last_clean_scrub_stamp":"2024-02-15T23:29:32.668080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.630125+0000","last_change":"2024-02-15T23:31:23.630125+0000","last_active":"2024-02-15T23:31:23.630125+0000","last_peered":"2024-02-15T23:31:23.630125+0000","last_clean":"2024-02-15T23:31:23.630125+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:23.630125+0000","last_undegraded":"2024-02-15T23:31:23.630125+0000","last_fullsized":"2024-02-15T23:31:23.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.629845+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:22:36.251662+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.871614+0000","last_change":"2024-02-15T23:31:17.871614+0000","last_active":"2024-02-15T23:31:17.871614+0000","last_peered":"2024-02-15T23:31:17.871614+0000","last_clean":"2024-02-15T23:31:17.871614+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:31:17.871614+0000","last_undegraded":"2024-02-15T23:31:17.871614+0000","last_fullsized":"2024-02-15T23:31:17.871614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.871335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:42.844132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.956391+0000","last_change":"2024-02-15T23:29:39.767710+0000","last_active":"2024-02-15T23:31:14.956391+0000","last_peered":"2024-02-15T23:31:14.956391+0000","last_clean":"2024-02-15T23:31:14.956391+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:31:14.956391+0000","last_undegraded":"2024-02-15T23:31:14.956391+0000","last_fullsized":"2024-02-15T23:31:14.956391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398196+0000","last_change":"2024-02-15T23:30:10.804317+0000","last_active":"2024-02-15T23:31:15.398196+0000","last_peered":"2024-02-15T23:31:15.398196+0000","last_clean":"2024-02-15T23:31:15.398196+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:31:15.398196+0000","last_undegraded":"2024-02-15T23:31:15.398196+0000","last_fullsized":"2024-02-15T23:31:15.398196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955269+0000","last_change":"2024-02-15T23:29:29.717068+0000","last_active":"2024-02-15T23:31:14.955269+0000","last_peered":"2024-02-15T23:31:14.955269+0000","last_clean":"2024-02-15T23:31:14.955269+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:31:14.955269+0000","last_undegraded":"2024-02-15T23:31:14.955269+0000","last_fullsized":"2024-02-15T23:31:14.955269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314230+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:31:16.314230+0000","last_peered":"2024-02-15T23:31:16.314230+0000","last_clean":"2024-02-15T23:31:16.314230+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:31:16.314230+0000","last_undegraded":"2024-02-15T23:31:16.314230+0000","last_fullsized":"2024-02-15T23:31:16.314230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.396757+0000","last_change":"2024-02-15T23:31:17.396757+0000","last_active":"2024-02-15T23:31:17.396757+0000","last_peered":"2024-02-15T23:31:17.396757+0000","last_clean":"2024-02-15T23:31:17.396757+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:31:17.396757+0000","last_undegraded":"2024-02-15T23:31:17.396757+0000","last_fullsized":"2024-02-15T23:31:17.396757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.396500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:51.906597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.394229+0000","last_change":"2024-02-15T23:31:19.394229+0000","last_active":"2024-02-15T23:31:19.394229+0000","last_peered":"2024-02-15T23:31:19.394229+0000","last_clean":"2024-02-15T23:31:19.394229+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:31:19.394229+0000","last_undegraded":"2024-02-15T23:31:19.394229+0000","last_fullsized":"2024-02-15T23:31:19.394229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.393966+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:40.563671+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.413611+0000","last_change":"2024-02-15T23:31:15.413611+0000","last_active":"2024-02-15T23:31:15.413611+0000","last_peered":"2024-02-15T23:31:15.413611+0000","last_clean":"2024-02-15T23:31:15.413611+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:15.413611+0000","last_undegraded":"2024-02-15T23:31:15.413611+0000","last_fullsized":"2024-02-15T23:31:15.413611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.413363+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:05.337748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316755+0000","last_change":"2024-02-15T23:29:39.771638+0000","last_active":"2024-02-15T23:31:16.316755+0000","last_peered":"2024-02-15T23:31:16.316755+0000","last_clean":"2024-02-15T23:31:16.316755+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:31:16.316755+0000","last_undegraded":"2024-02-15T23:31:16.316755+0000","last_fullsized":"2024-02-15T23:31:16.316755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315207+0000","last_change":"2024-02-15T23:29:31.701536+0000","last_active":"2024-02-15T23:31:16.315207+0000","last_peered":"2024-02-15T23:31:16.315207+0000","last_clean":"2024-02-15T23:31:16.315207+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:31:16.315207+0000","last_undegraded":"2024-02-15T23:31:16.315207+0000","last_fullsized":"2024-02-15T23:31:16.315207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314457+0000","last_change":"2024-02-15T23:29:29.714312+0000","last_active":"2024-02-15T23:31:16.314457+0000","last_peered":"2024-02-15T23:31:16.314457+0000","last_clean":"2024-02-15T23:31:16.314457+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:31:16.314457+0000","last_undegraded":"2024-02-15T23:31:16.314457+0000","last_fullsized":"2024-02-15T23:31:16.314457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955093+0000","last_change":"2024-02-15T23:29:21.629944+0000","last_active":"2024-02-15T23:31:14.955093+0000","last_peered":"2024-02-15T23:31:14.955093+0000","last_clean":"2024-02-15T23:31:14.955093+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:31:14.955093+0000","last_undegraded":"2024-02-15T23:31:14.955093+0000","last_fullsized":"2024-02-15T23:31:14.955093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.405756+0000","last_change":"2024-02-15T23:31:21.405756+0000","last_active":"2024-02-15T23:31:21.405756+0000","last_peered":"2024-02-15T23:31:21.405756+0000","last_clean":"2024-02-15T23:31:21.405756+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:31:21.405756+0000","last_undegraded":"2024-02-15T23:31:21.405756+0000","last_fullsized":"2024-02-15T23:31:21.405756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.405364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:58.637097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.322259+0000","last_change":"2024-02-15T23:31:46.322334+0000","last_active":"2024-02-15T23:31:46.322259+0000","last_peered":"2024-02-15T23:31:46.322259+0000","last_clean":"2024-02-15T23:31:46.322259+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:31:46.322259+0000","last_undegraded":"2024-02-15T23:31:46.322259+0000","last_fullsized":"2024-02-15T23:31:46.322259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:46.322070+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:46.322070+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.322070+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:06.972017+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.594968+0000","last_change":"2024-02-15T23:31:19.594968+0000","last_active":"2024-02-15T23:31:19.594968+0000","last_peered":"2024-02-15T23:31:19.594968+0000","last_clean":"2024-02-15T23:31:19.594968+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:19.594968+0000","last_undegraded":"2024-02-15T23:31:19.594968+0000","last_fullsized":"2024-02-15T23:31:19.594968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.594660+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:58.295976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.544082+0000","last_change":"2024-02-15T23:31:34.544082+0000","last_active":"2024-02-15T23:31:34.544082+0000","last_peered":"2024-02-15T23:31:34.544082+0000","last_clean":"2024-02-15T23:31:34.544082+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:31:34.544082+0000","last_undegraded":"2024-02-15T23:31:34.544082+0000","last_fullsized":"2024-02-15T23:31:34.544082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.543832+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.512019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.664125+0000","last_change":"2024-02-15T23:31:52.664201+0000","last_active":"2024-02-15T23:31:52.664125+0000","last_peered":"2024-02-15T23:31:52.664125+0000","last_clean":"2024-02-15T23:31:52.664125+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:52.664125+0000","last_undegraded":"2024-02-15T23:31:52.664125+0000","last_fullsized":"2024-02-15T23:31:52.664125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-15T23:31:52.663884+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-15T23:31:52.663884+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.663884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:16.778950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397535+0000","last_change":"2024-02-15T23:29:29.720515+0000","last_active":"2024-02-15T23:31:15.397535+0000","last_peered":"2024-02-15T23:31:15.397535+0000","last_clean":"2024-02-15T23:31:15.397535+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:31:15.397535+0000","last_undegraded":"2024-02-15T23:31:15.397535+0000","last_fullsized":"2024-02-15T23:31:15.397535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314282+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:31:16.314282+0000","last_peered":"2024-02-15T23:31:16.314282+0000","last_clean":"2024-02-15T23:31:16.314282+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:31:16.314282+0000","last_undegraded":"2024-02-15T23:31:16.314282+0000","last_fullsized":"2024-02-15T23:31:16.314282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.386313+0000","last_change":"2024-02-15T23:31:26.386313+0000","last_active":"2024-02-15T23:31:26.386313+0000","last_peered":"2024-02-15T23:31:26.386313+0000","last_clean":"2024-02-15T23:31:26.386313+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:31:26.386313+0000","last_undegraded":"2024-02-15T23:31:26.386313+0000","last_fullsized":"2024-02-15T23:31:26.386313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.386074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:29.907866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.809672+0000","last_change":"2024-02-15T23:31:25.809672+0000","last_active":"2024-02-15T23:31:25.809672+0000","last_peered":"2024-02-15T23:31:25.809672+0000","last_clean":"2024-02-15T23:31:25.809672+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:25.809672+0000","last_undegraded":"2024-02-15T23:31:25.809672+0000","last_fullsized":"2024-02-15T23:31:25.809672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.809268+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:15.733653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.613362+0000","last_change":"2024-02-15T23:31:22.613362+0000","last_active":"2024-02-15T23:31:22.613362+0000","last_peered":"2024-02-15T23:31:22.613362+0000","last_clean":"2024-02-15T23:31:22.613362+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:31:22.613362+0000","last_undegraded":"2024-02-15T23:31:22.613362+0000","last_fullsized":"2024-02-15T23:31:22.613362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.613116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:43.072580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.854675+0000","last_change":"2024-02-15T23:29:39.781085+0000","last_active":"2024-02-15T23:31:15.854675+0000","last_peered":"2024-02-15T23:31:15.854675+0000","last_clean":"2024-02-15T23:31:15.854675+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:31:15.854675+0000","last_undegraded":"2024-02-15T23:31:15.854675+0000","last_fullsized":"2024-02-15T23:31:15.854675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.854685+0000","last_change":"2024-02-15T23:29:39.777993+0000","last_active":"2024-02-15T23:31:15.854685+0000","last_peered":"2024-02-15T23:31:15.854685+0000","last_clean":"2024-02-15T23:31:15.854685+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:31:15.854685+0000","last_undegraded":"2024-02-15T23:31:15.854685+0000","last_fullsized":"2024-02-15T23:31:15.854685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.692986+0000","last_change":"2024-02-15T23:31:48.692986+0000","last_active":"2024-02-15T23:31:48.692986+0000","last_peered":"2024-02-15T23:31:48.692986+0000","last_clean":"2024-02-15T23:31:48.692986+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:31:48.692986+0000","last_undegraded":"2024-02-15T23:31:48.692986+0000","last_fullsized":"2024-02-15T23:31:48.692986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:48.692708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:48.692708+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.692708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:23.202805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314615+0000","last_change":"2024-02-15T23:29:29.728542+0000","last_active":"2024-02-15T23:31:16.314615+0000","last_peered":"2024-02-15T23:31:16.314615+0000","last_clean":"2024-02-15T23:31:16.314615+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:31:16.314615+0000","last_undegraded":"2024-02-15T23:31:16.314615+0000","last_fullsized":"2024-02-15T23:31:16.314615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'3","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.544544+0000","last_change":"2024-02-15T23:31:35.544544+0000","last_active":"2024-02-15T23:31:35.544544+0000","last_peered":"2024-02-15T23:31:35.544544+0000","last_clean":"2024-02-15T23:31:35.544544+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:35.544544+0000","last_undegraded":"2024-02-15T23:31:35.544544+0000","last_fullsized":"2024-02-15T23:31:35.544544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:35.544287+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:35.544287+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.544287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:02.404817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.391276+0000","last_change":"2024-02-15T23:31:22.391356+0000","last_active":"2024-02-15T23:31:22.391276+0000","last_peered":"2024-02-15T23:31:22.391276+0000","last_clean":"2024-02-15T23:31:22.391276+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:31:22.391276+0000","last_undegraded":"2024-02-15T23:31:22.391276+0000","last_fullsized":"2024-02-15T23:31:22.391276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.391105+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:17.676736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.367838+0000","last_change":"2024-02-15T23:31:38.367893+0000","last_active":"2024-02-15T23:31:38.367838+0000","last_peered":"2024-02-15T23:31:38.367838+0000","last_clean":"2024-02-15T23:31:38.367838+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:31:38.367838+0000","last_undegraded":"2024-02-15T23:31:38.367838+0000","last_fullsized":"2024-02-15T23:31:38.367838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:38.367646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:38.367646+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.367646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:55.873044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.956457+0000","last_change":"2024-02-15T23:29:39.766083+0000","last_active":"2024-02-15T23:31:14.956457+0000","last_peered":"2024-02-15T23:31:14.956457+0000","last_clean":"2024-02-15T23:31:14.956457+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:31:14.956457+0000","last_undegraded":"2024-02-15T23:31:14.956457+0000","last_fullsized":"2024-02-15T23:31:14.956457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.583056+0000","last_change":"2024-02-15T23:31:36.583056+0000","last_active":"2024-02-15T23:31:36.583056+0000","last_peered":"2024-02-15T23:31:36.583056+0000","last_clean":"2024-02-15T23:31:36.583056+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:31:36.583056+0000","last_undegraded":"2024-02-15T23:31:36.583056+0000","last_fullsized":"2024-02-15T23:31:36.583056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:36.582666+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:36.582666+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.582666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:45.901692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.852999+0000","last_change":"2024-02-15T23:29:29.723948+0000","last_active":"2024-02-15T23:31:15.852999+0000","last_peered":"2024-02-15T23:31:15.852999+0000","last_clean":"2024-02-15T23:31:15.852999+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:31:15.852999+0000","last_undegraded":"2024-02-15T23:31:15.852999+0000","last_fullsized":"2024-02-15T23:31:15.852999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.359814+0000","last_change":"2024-02-15T23:31:25.359814+0000","last_active":"2024-02-15T23:31:25.359814+0000","last_peered":"2024-02-15T23:31:25.359814+0000","last_clean":"2024-02-15T23:31:25.359814+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:31:25.359814+0000","last_undegraded":"2024-02-15T23:31:25.359814+0000","last_fullsized":"2024-02-15T23:31:25.359814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.359571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:32.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.537578+0000","last_change":"2024-02-15T23:31:27.537676+0000","last_active":"2024-02-15T23:31:27.537578+0000","last_peered":"2024-02-15T23:31:27.537578+0000","last_clean":"2024-02-15T23:31:27.537578+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:31:27.537578+0000","last_undegraded":"2024-02-15T23:31:27.537578+0000","last_fullsized":"2024-02-15T23:31:27.537578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.537385+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.232882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.781850+0000","last_change":"2024-02-15T23:31:20.781906+0000","last_active":"2024-02-15T23:31:20.781850+0000","last_peered":"2024-02-15T23:31:20.781850+0000","last_clean":"2024-02-15T23:31:20.781850+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:31:20.781850+0000","last_undegraded":"2024-02-15T23:31:20.781850+0000","last_fullsized":"2024-02-15T23:31:20.781850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.781647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:41:14.417063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.786138+0000","last_change":"2024-02-15T23:29:39.783805+0000","last_active":"2024-02-15T23:30:10.786138+0000","last_peered":"2024-02-15T23:30:10.786138+0000","last_clean":"2024-02-15T23:30:10.786138+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:30:10.786138+0000","last_undegraded":"2024-02-15T23:30:10.786138+0000","last_fullsized":"2024-02-15T23:30:10.786138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.473112+0000","last_change":"2024-02-15T23:31:42.473112+0000","last_active":"2024-02-15T23:31:42.473112+0000","last_peered":"2024-02-15T23:31:42.473112+0000","last_clean":"2024-02-15T23:31:42.473112+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:31:42.473112+0000","last_undegraded":"2024-02-15T23:31:42.473112+0000","last_fullsized":"2024-02-15T23:31:42.473112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-15T23:31:42.472867+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-15T23:31:42.472867+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.472867+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:06.587933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.853106+0000","last_change":"2024-02-15T23:29:29.723953+0000","last_active":"2024-02-15T23:31:15.853106+0000","last_peered":"2024-02-15T23:31:15.853106+0000","last_clean":"2024-02-15T23:31:15.853106+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:31:15.853106+0000","last_undegraded":"2024-02-15T23:31:15.853106+0000","last_fullsized":"2024-02-15T23:31:15.853106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.710546+0000","last_change":"2024-02-15T23:31:29.710546+0000","last_active":"2024-02-15T23:31:29.710546+0000","last_peered":"2024-02-15T23:31:29.710546+0000","last_clean":"2024-02-15T23:31:29.710546+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:31:29.710546+0000","last_undegraded":"2024-02-15T23:31:29.710546+0000","last_fullsized":"2024-02-15T23:31:29.710546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.710190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:50.879896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'43","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.526032+0000","last_change":"2024-02-15T23:31:26.526124+0000","last_active":"2024-02-15T23:31:26.526032+0000","last_peered":"2024-02-15T23:31:26.526032+0000","last_clean":"2024-02-15T23:31:26.526032+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:26.526032+0000","last_undegraded":"2024-02-15T23:31:26.526032+0000","last_fullsized":"2024-02-15T23:31:26.526032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.525844+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:36.827174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.360654+0000","last_change":"2024-02-15T23:31:17.360759+0000","last_active":"2024-02-15T23:31:17.360654+0000","last_peered":"2024-02-15T23:31:17.360654+0000","last_clean":"2024-02-15T23:31:17.360654+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:31:17.360654+0000","last_undegraded":"2024-02-15T23:31:17.360654+0000","last_fullsized":"2024-02-15T23:31:17.360654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.360411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.189143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.806975+0000","last_change":"2024-02-15T23:29:39.784430+0000","last_active":"2024-02-15T23:30:10.806975+0000","last_peered":"2024-02-15T23:30:10.806975+0000","last_clean":"2024-02-15T23:30:10.806975+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:30:10.806975+0000","last_undegraded":"2024-02-15T23:30:10.806975+0000","last_fullsized":"2024-02-15T23:30:10.806975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315376+0000","last_change":"2024-02-15T23:29:31.701986+0000","last_active":"2024-02-15T23:31:16.315376+0000","last_peered":"2024-02-15T23:31:16.315376+0000","last_clean":"2024-02-15T23:31:16.315376+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:31:16.315376+0000","last_undegraded":"2024-02-15T23:31:16.315376+0000","last_fullsized":"2024-02-15T23:31:16.315376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397533+0000","last_change":"2024-02-15T23:29:29.736668+0000","last_active":"2024-02-15T23:31:15.397533+0000","last_peered":"2024-02-15T23:31:15.397533+0000","last_clean":"2024-02-15T23:31:15.397533+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:31:15.397533+0000","last_undegraded":"2024-02-15T23:31:15.397533+0000","last_fullsized":"2024-02-15T23:31:15.397533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.372027+0000","last_change":"2024-02-15T23:31:18.372027+0000","last_active":"2024-02-15T23:31:18.372027+0000","last_peered":"2024-02-15T23:31:18.372027+0000","last_clean":"2024-02-15T23:31:18.372027+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:31:18.372027+0000","last_undegraded":"2024-02-15T23:31:18.372027+0000","last_fullsized":"2024-02-15T23:31:18.372027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.371701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:25.403990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.817316+0000","last_change":"2024-02-15T23:31:26.817387+0000","last_active":"2024-02-15T23:31:26.817316+0000","last_peered":"2024-02-15T23:31:26.817316+0000","last_clean":"2024-02-15T23:31:26.817316+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:31:26.817316+0000","last_undegraded":"2024-02-15T23:31:26.817316+0000","last_fullsized":"2024-02-15T23:31:26.817316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.817124+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:53.251206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.927912+0000","last_change":"2024-02-15T23:31:15.927965+0000","last_active":"2024-02-15T23:31:15.927912+0000","last_peered":"2024-02-15T23:31:15.927912+0000","last_clean":"2024-02-15T23:31:15.927912+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:31:15.927912+0000","last_undegraded":"2024-02-15T23:31:15.927912+0000","last_fullsized":"2024-02-15T23:31:15.927912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.927696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:57:32.034698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.455640+0000","last_change":"2024-02-15T23:31:35.455640+0000","last_active":"2024-02-15T23:31:35.455640+0000","last_peered":"2024-02-15T23:31:35.455640+0000","last_clean":"2024-02-15T23:31:35.455640+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:31:35.455640+0000","last_undegraded":"2024-02-15T23:31:35.455640+0000","last_fullsized":"2024-02-15T23:31:35.455640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:35.455367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:35.455367+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.455367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:32:41.304232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314694+0000","last_change":"2024-02-15T23:29:29.721645+0000","last_active":"2024-02-15T23:31:16.314694+0000","last_peered":"2024-02-15T23:31:16.314694+0000","last_clean":"2024-02-15T23:31:16.314694+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:31:16.314694+0000","last_undegraded":"2024-02-15T23:31:16.314694+0000","last_fullsized":"2024-02-15T23:31:16.314694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.533581+0000","last_change":"2024-02-15T23:31:34.533581+0000","last_active":"2024-02-15T23:31:34.533581+0000","last_peered":"2024-02-15T23:31:34.533581+0000","last_clean":"2024-02-15T23:31:34.533581+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:31:34.533581+0000","last_undegraded":"2024-02-15T23:31:34.533581+0000","last_fullsized":"2024-02-15T23:31:34.533581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.533297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.501484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.507729+0000","last_change":"2024-02-15T23:31:29.507799+0000","last_active":"2024-02-15T23:31:29.507729+0000","last_peered":"2024-02-15T23:31:29.507729+0000","last_clean":"2024-02-15T23:31:29.507729+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:29.507729+0000","last_undegraded":"2024-02-15T23:31:29.507729+0000","last_fullsized":"2024-02-15T23:31:29.507729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.507529+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.492158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.901536+0000","last_change":"2024-02-15T23:31:16.901594+0000","last_active":"2024-02-15T23:31:16.901536+0000","last_peered":"2024-02-15T23:31:16.901536+0000","last_clean":"2024-02-15T23:31:16.901536+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:31:16.901536+0000","last_undegraded":"2024-02-15T23:31:16.901536+0000","last_fullsized":"2024-02-15T23:31:16.901536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.901336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:01:50.745987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:58.329295+0000","last_change":"2024-02-15T23:29:39.778768+0000","last_active":"2024-02-15T23:30:58.329295+0000","last_peered":"2024-02-15T23:30:58.329295+0000","last_clean":"2024-02-15T23:30:58.329295+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:30:58.329295+0000","last_undegraded":"2024-02-15T23:30:58.329295+0000","last_fullsized":"2024-02-15T23:30:58.329295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955514+0000","last_change":"2024-02-15T23:29:31.695343+0000","last_active":"2024-02-15T23:31:14.955514+0000","last_peered":"2024-02-15T23:31:14.955514+0000","last_clean":"2024-02-15T23:31:14.955514+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:31:14.955514+0000","last_undegraded":"2024-02-15T23:31:14.955514+0000","last_fullsized":"2024-02-15T23:31:14.955514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397578+0000","last_change":"2024-02-15T23:29:29.737932+0000","last_active":"2024-02-15T23:31:15.397578+0000","last_peered":"2024-02-15T23:31:15.397578+0000","last_clean":"2024-02-15T23:31:15.397578+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:31:15.397578+0000","last_undegraded":"2024-02-15T23:31:15.397578+0000","last_fullsized":"2024-02-15T23:31:15.397578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.651082+0000","last_change":"2024-02-15T23:31:34.651082+0000","last_active":"2024-02-15T23:31:34.651082+0000","last_peered":"2024-02-15T23:31:34.651082+0000","last_clean":"2024-02-15T23:31:34.651082+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:31:34.651082+0000","last_undegraded":"2024-02-15T23:31:34.651082+0000","last_fullsized":"2024-02-15T23:31:34.651082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.650808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.650808+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.650808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:46.892855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.444939+0000","last_change":"2024-02-15T23:31:28.445025+0000","last_active":"2024-02-15T23:31:28.444939+0000","last_peered":"2024-02-15T23:31:28.444939+0000","last_clean":"2024-02-15T23:31:28.444939+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:31:28.444939+0000","last_undegraded":"2024-02-15T23:31:28.444939+0000","last_fullsized":"2024-02-15T23:31:28.444939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.444726+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:09.360474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.369874+0000","last_change":"2024-02-15T23:31:22.369935+0000","last_active":"2024-02-15T23:31:22.369874+0000","last_peered":"2024-02-15T23:31:22.369874+0000","last_clean":"2024-02-15T23:31:22.369874+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:31:22.369874+0000","last_undegraded":"2024-02-15T23:31:22.369874+0000","last_fullsized":"2024-02-15T23:31:22.369874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.369655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:03.533673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797646+0000","last_change":"2024-02-15T23:29:39.769995+0000","last_active":"2024-02-15T23:30:10.797646+0000","last_peered":"2024-02-15T23:30:10.797646+0000","last_clean":"2024-02-15T23:30:10.797646+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:30:10.797646+0000","last_undegraded":"2024-02-15T23:30:10.797646+0000","last_fullsized":"2024-02-15T23:30:10.797646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.454838+0000","last_change":"2024-02-15T23:31:29.454965+0000","last_active":"2024-02-15T23:31:29.454838+0000","last_peered":"2024-02-15T23:31:29.454838+0000","last_clean":"2024-02-15T23:31:29.454838+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:29.454838+0000","last_undegraded":"2024-02-15T23:31:29.454838+0000","last_fullsized":"2024-02-15T23:31:29.454838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.454568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:03.856437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.080507+0000","last_change":"2024-02-15T23:29:29.706515+0000","last_active":"2024-02-15T23:30:15.080507+0000","last_peered":"2024-02-15T23:30:15.080507+0000","last_clean":"2024-02-15T23:30:15.080507+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:30:15.080507+0000","last_undegraded":"2024-02-15T23:30:15.080507+0000","last_fullsized":"2024-02-15T23:30:15.080507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.714383+0000","last_change":"2024-02-15T23:31:31.714462+0000","last_active":"2024-02-15T23:31:31.714383+0000","last_peered":"2024-02-15T23:31:31.714383+0000","last_clean":"2024-02-15T23:31:31.714383+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:31:31.714383+0000","last_undegraded":"2024-02-15T23:31:31.714383+0000","last_fullsized":"2024-02-15T23:31:31.714383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.714124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:31.708391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.561879+0000","last_change":"2024-02-15T23:31:25.561879+0000","last_active":"2024-02-15T23:31:25.561879+0000","last_peered":"2024-02-15T23:31:25.561879+0000","last_clean":"2024-02-15T23:31:25.561879+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:31:25.561879+0000","last_undegraded":"2024-02-15T23:31:25.561879+0000","last_fullsized":"2024-02-15T23:31:25.561879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.561617+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:41.337167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.529167+0000","last_change":"2024-02-15T23:31:36.529167+0000","last_active":"2024-02-15T23:31:36.529167+0000","last_peered":"2024-02-15T23:31:36.529167+0000","last_clean":"2024-02-15T23:31:36.529167+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:31:36.529167+0000","last_undegraded":"2024-02-15T23:31:36.529167+0000","last_fullsized":"2024-02-15T23:31:36.529167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:36.528916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:36.528916+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.528916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:45.847942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.797840+0000","last_change":"2024-02-15T23:29:39.769430+0000","last_active":"2024-02-15T23:30:10.797840+0000","last_peered":"2024-02-15T23:30:10.797840+0000","last_clean":"2024-02-15T23:30:10.797840+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:30:10.797840+0000","last_undegraded":"2024-02-15T23:30:10.797840+0000","last_fullsized":"2024-02-15T23:30:10.797840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.440365+0000","last_change":"2024-02-15T23:31:50.440425+0000","last_active":"2024-02-15T23:31:50.440365+0000","last_peered":"2024-02-15T23:31:50.440365+0000","last_clean":"2024-02-15T23:31:50.440365+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:31:50.440365+0000","last_undegraded":"2024-02-15T23:31:50.440365+0000","last_fullsized":"2024-02-15T23:31:50.440365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:50.440173+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:50.440173+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.440173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:31.355921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:13.509778+0000","last_change":"2024-02-15T23:29:29.720236+0000","last_active":"2024-02-15T23:30:13.509778+0000","last_peered":"2024-02-15T23:30:13.509778+0000","last_clean":"2024-02-15T23:30:13.509778+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:30:13.509778+0000","last_undegraded":"2024-02-15T23:30:13.509778+0000","last_fullsized":"2024-02-15T23:30:13.509778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.554250+0000","last_change":"2024-02-15T23:31:33.554311+0000","last_active":"2024-02-15T23:31:33.554250+0000","last_peered":"2024-02-15T23:31:33.554250+0000","last_clean":"2024-02-15T23:31:33.554250+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:31:33.554250+0000","last_undegraded":"2024-02-15T23:31:33.554250+0000","last_fullsized":"2024-02-15T23:31:33.554250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.554047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.257009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.356251+0000","last_change":"2024-02-15T23:31:42.356344+0000","last_active":"2024-02-15T23:31:42.356251+0000","last_peered":"2024-02-15T23:31:42.356251+0000","last_clean":"2024-02-15T23:31:42.356251+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:31:42.356251+0000","last_undegraded":"2024-02-15T23:31:42.356251+0000","last_fullsized":"2024-02-15T23:31:42.356251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:42.356050+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:42.356050+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.356050+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:50.625885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.756163+0000","last_change":"2024-02-15T23:31:28.756163+0000","last_active":"2024-02-15T23:31:28.756163+0000","last_peered":"2024-02-15T23:31:28.756163+0000","last_clean":"2024-02-15T23:31:28.756163+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:28.756163+0000","last_undegraded":"2024-02-15T23:31:28.756163+0000","last_fullsized":"2024-02-15T23:31:28.756163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.755882+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:32.706979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.794063+0000","last_change":"2024-02-15T23:29:39.775113+0000","last_active":"2024-02-15T23:30:10.794063+0000","last_peered":"2024-02-15T23:30:10.794063+0000","last_clean":"2024-02-15T23:30:10.794063+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:30:10.794063+0000","last_undegraded":"2024-02-15T23:30:10.794063+0000","last_fullsized":"2024-02-15T23:30:10.794063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.673489+0000","last_change":"2024-02-15T23:31:38.673550+0000","last_active":"2024-02-15T23:31:38.673489+0000","last_peered":"2024-02-15T23:31:38.673489+0000","last_clean":"2024-02-15T23:31:38.673489+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:31:38.673489+0000","last_undegraded":"2024-02-15T23:31:38.673489+0000","last_fullsized":"2024-02-15T23:31:38.673489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:38.673299+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:38.673299+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.673299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:50.183471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796775+0000","last_change":"2024-02-15T23:29:29.725067+0000","last_active":"2024-02-15T23:30:10.796775+0000","last_peered":"2024-02-15T23:30:10.796775+0000","last_clean":"2024-02-15T23:30:10.796775+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:30:10.796775+0000","last_undegraded":"2024-02-15T23:30:10.796775+0000","last_fullsized":"2024-02-15T23:30:10.796775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.518536+0000","last_change":"2024-02-15T23:31:31.518612+0000","last_active":"2024-02-15T23:31:31.518536+0000","last_peered":"2024-02-15T23:31:31.518536+0000","last_clean":"2024-02-15T23:31:31.518536+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:31:31.518536+0000","last_undegraded":"2024-02-15T23:31:31.518536+0000","last_fullsized":"2024-02-15T23:31:31.518536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.518312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.640014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.423777+0000","last_change":"2024-02-15T23:31:23.423852+0000","last_active":"2024-02-15T23:31:23.423777+0000","last_peered":"2024-02-15T23:31:23.423777+0000","last_clean":"2024-02-15T23:31:23.423777+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:31:23.423777+0000","last_undegraded":"2024-02-15T23:31:23.423777+0000","last_fullsized":"2024-02-15T23:31:23.423777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.423607+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:37.518487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.569028+0000","last_change":"2024-02-15T23:31:15.569048+0000","last_active":"2024-02-15T23:31:15.569028+0000","last_peered":"2024-02-15T23:31:15.569028+0000","last_clean":"2024-02-15T23:31:15.569028+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:31:15.569028+0000","last_undegraded":"2024-02-15T23:31:15.569028+0000","last_fullsized":"2024-02-15T23:31:15.569028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.568926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:10.440118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.796043+0000","last_change":"2024-02-15T23:29:39.782265+0000","last_active":"2024-02-15T23:30:10.796043+0000","last_peered":"2024-02-15T23:30:10.796043+0000","last_clean":"2024-02-15T23:30:10.796043+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:30:10.796043+0000","last_undegraded":"2024-02-15T23:30:10.796043+0000","last_fullsized":"2024-02-15T23:30:10.796043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.635407+0000","last_change":"2024-02-15T23:31:42.635470+0000","last_active":"2024-02-15T23:31:42.635407+0000","last_peered":"2024-02-15T23:31:42.635407+0000","last_clean":"2024-02-15T23:31:42.635407+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:31:42.635407+0000","last_undegraded":"2024-02-15T23:31:42.635407+0000","last_fullsized":"2024-02-15T23:31:42.635407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:42.635214+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:42.635214+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.635214+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:35.664062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.809624+0000","last_change":"2024-02-15T23:29:29.728334+0000","last_active":"2024-02-15T23:30:10.809624+0000","last_peered":"2024-02-15T23:30:10.809624+0000","last_clean":"2024-02-15T23:30:10.809624+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:30:10.809624+0000","last_undegraded":"2024-02-15T23:30:10.809624+0000","last_fullsized":"2024-02-15T23:30:10.809624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.758510+0000","last_change":"2024-02-15T23:31:30.758567+0000","last_active":"2024-02-15T23:31:30.758510+0000","last_peered":"2024-02-15T23:31:30.758510+0000","last_clean":"2024-02-15T23:31:30.758510+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:31:30.758510+0000","last_undegraded":"2024-02-15T23:31:30.758510+0000","last_fullsized":"2024-02-15T23:31:30.758510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.758324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:34.432457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.549687+0000","last_change":"2024-02-15T23:31:30.549776+0000","last_active":"2024-02-15T23:31:30.549687+0000","last_peered":"2024-02-15T23:31:30.549687+0000","last_clean":"2024-02-15T23:31:30.549687+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:31:30.549687+0000","last_undegraded":"2024-02-15T23:31:30.549687+0000","last_fullsized":"2024-02-15T23:31:30.549687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.549503+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.362864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.350358+0000","last_change":"2024-02-15T23:31:39.350413+0000","last_active":"2024-02-15T23:31:39.350358+0000","last_peered":"2024-02-15T23:31:39.350358+0000","last_clean":"2024-02-15T23:31:39.350358+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:31:39.350358+0000","last_undegraded":"2024-02-15T23:31:39.350358+0000","last_fullsized":"2024-02-15T23:31:39.350358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.350163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.350163+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.350163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:00.377352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.813467+0000","last_change":"2024-02-15T23:29:39.784125+0000","last_active":"2024-02-15T23:30:10.813467+0000","last_peered":"2024-02-15T23:30:10.813467+0000","last_clean":"2024-02-15T23:30:10.813467+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:30:10.813467+0000","last_undegraded":"2024-02-15T23:30:10.813467+0000","last_fullsized":"2024-02-15T23:30:10.813467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.795226+0000","last_change":"2024-02-15T23:29:31.701274+0000","last_active":"2024-02-15T23:30:10.795226+0000","last_peered":"2024-02-15T23:30:10.795226+0000","last_clean":"2024-02-15T23:30:10.795226+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:30:10.795226+0000","last_undegraded":"2024-02-15T23:30:10.795226+0000","last_fullsized":"2024-02-15T23:30:10.795226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955150+0000","last_change":"2024-02-15T23:29:29.717620+0000","last_active":"2024-02-15T23:31:14.955150+0000","last_peered":"2024-02-15T23:31:14.955150+0000","last_clean":"2024-02-15T23:31:14.955150+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:31:14.955150+0000","last_undegraded":"2024-02-15T23:31:14.955150+0000","last_fullsized":"2024-02-15T23:31:14.955150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":210,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.436424+0000","last_change":"2024-02-15T23:31:28.436490+0000","last_active":"2024-02-15T23:31:28.436424+0000","last_peered":"2024-02-15T23:31:28.436424+0000","last_clean":"2024-02-15T23:31:28.436424+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:28.436424+0000","last_undegraded":"2024-02-15T23:31:28.436424+0000","last_fullsized":"2024-02-15T23:31:28.436424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.436171+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:39.946344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'28","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.362325+0000","last_change":"2024-02-15T23:31:41.362393+0000","last_active":"2024-02-15T23:31:41.362325+0000","last_peered":"2024-02-15T23:31:41.362325+0000","last_clean":"2024-02-15T23:31:41.362325+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:31:41.362325+0000","last_undegraded":"2024-02-15T23:31:41.362325+0000","last_fullsized":"2024-02-15T23:31:41.362325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-02-15T23:31:41.362130+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-02-15T23:31:41.362130+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.362130+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:58.292943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.335886+0000","last_change":"2024-02-15T23:31:44.335984+0000","last_active":"2024-02-15T23:31:44.335886+0000","last_peered":"2024-02-15T23:31:44.335886+0000","last_clean":"2024-02-15T23:31:44.335886+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:31:44.335886+0000","last_undegraded":"2024-02-15T23:31:44.335886+0000","last_fullsized":"2024-02-15T23:31:44.335886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:44.335687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:44.335687+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.335687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:23.592145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.807752+0000","last_change":"2024-02-15T23:29:39.784728+0000","last_active":"2024-02-15T23:30:10.807752+0000","last_peered":"2024-02-15T23:30:10.807752+0000","last_clean":"2024-02-15T23:30:10.807752+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:30:10.807752+0000","last_undegraded":"2024-02-15T23:30:10.807752+0000","last_fullsized":"2024-02-15T23:30:10.807752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.649599+0000","last_change":"2024-02-15T23:31:40.649753+0000","last_active":"2024-02-15T23:31:40.649599+0000","last_peered":"2024-02-15T23:31:40.649599+0000","last_clean":"2024-02-15T23:31:40.649599+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:31:40.649599+0000","last_undegraded":"2024-02-15T23:31:40.649599+0000","last_fullsized":"2024-02-15T23:31:40.649599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:40.649389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:40.649389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.649389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:48.462750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397829+0000","last_change":"2024-02-15T23:29:29.719123+0000","last_active":"2024-02-15T23:31:15.397829+0000","last_peered":"2024-02-15T23:31:15.397829+0000","last_clean":"2024-02-15T23:31:15.397829+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:31:15.397829+0000","last_undegraded":"2024-02-15T23:31:15.397829+0000","last_fullsized":"2024-02-15T23:31:15.397829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.519390+0000","last_change":"2024-02-15T23:31:32.519469+0000","last_active":"2024-02-15T23:31:32.519390+0000","last_peered":"2024-02-15T23:31:32.519390+0000","last_clean":"2024-02-15T23:31:32.519390+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:31:32.519390+0000","last_undegraded":"2024-02-15T23:31:32.519390+0000","last_fullsized":"2024-02-15T23:31:32.519390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.519211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.548059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'36","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.414291+0000","last_change":"2024-02-15T23:31:36.414372+0000","last_active":"2024-02-15T23:31:36.414291+0000","last_peered":"2024-02-15T23:31:36.414291+0000","last_clean":"2024-02-15T23:31:36.414291+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:36.414291+0000","last_undegraded":"2024-02-15T23:31:36.414291+0000","last_fullsized":"2024-02-15T23:31:36.414291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-15T23:31:36.414095+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-15T23:31:36.414095+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.414095+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:12.670293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.576878+0000","last_change":"2024-02-15T23:31:24.576932+0000","last_active":"2024-02-15T23:31:24.576878+0000","last_peered":"2024-02-15T23:31:24.576878+0000","last_clean":"2024-02-15T23:31:24.576878+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:31:24.576878+0000","last_undegraded":"2024-02-15T23:31:24.576878+0000","last_fullsized":"2024-02-15T23:31:24.576878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.576683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:19:16.045656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.100277+0000","last_change":"2024-02-15T23:29:39.784447+0000","last_active":"2024-02-15T23:30:15.100277+0000","last_peered":"2024-02-15T23:30:15.100277+0000","last_clean":"2024-02-15T23:30:15.100277+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:30:15.100277+0000","last_undegraded":"2024-02-15T23:30:15.100277+0000","last_fullsized":"2024-02-15T23:30:15.100277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.577577+0000","last_change":"2024-02-15T23:31:37.577577+0000","last_active":"2024-02-15T23:31:37.577577+0000","last_peered":"2024-02-15T23:31:37.577577+0000","last_clean":"2024-02-15T23:31:37.577577+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:31:37.577577+0000","last_undegraded":"2024-02-15T23:31:37.577577+0000","last_fullsized":"2024-02-15T23:31:37.577577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.577323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.577323+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.577323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:59.138396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.666415+0000","last_change":"2024-02-15T23:31:45.666475+0000","last_active":"2024-02-15T23:31:45.666415+0000","last_peered":"2024-02-15T23:31:45.666415+0000","last_clean":"2024-02-15T23:31:45.666415+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:31:45.666415+0000","last_undegraded":"2024-02-15T23:31:45.666415+0000","last_fullsized":"2024-02-15T23:31:45.666415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:45.666217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:45.666217+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.666217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:12.526747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.471185+0000","last_change":"2024-02-15T23:31:46.471250+0000","last_active":"2024-02-15T23:31:46.471185+0000","last_peered":"2024-02-15T23:31:46.471185+0000","last_clean":"2024-02-15T23:31:46.471185+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:31:46.471185+0000","last_undegraded":"2024-02-15T23:31:46.471185+0000","last_fullsized":"2024-02-15T23:31:46.471185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:46.471000+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:46.471000+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.471000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:30:13.169741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955127+0000","last_change":"2024-02-15T23:29:29.708496+0000","last_active":"2024-02-15T23:31:14.955127+0000","last_peered":"2024-02-15T23:31:14.955127+0000","last_clean":"2024-02-15T23:31:14.955127+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:31:14.955127+0000","last_undegraded":"2024-02-15T23:31:14.955127+0000","last_fullsized":"2024-02-15T23:31:14.955127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.465414+0000","last_change":"2024-02-15T23:31:34.465414+0000","last_active":"2024-02-15T23:31:34.465414+0000","last_peered":"2024-02-15T23:31:34.465414+0000","last_clean":"2024-02-15T23:31:34.465414+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:34.465414+0000","last_undegraded":"2024-02-15T23:31:34.465414+0000","last_fullsized":"2024-02-15T23:31:34.465414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.465154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:45.028387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314669+0000","last_change":"2024-02-15T23:29:29.728191+0000","last_active":"2024-02-15T23:31:16.314669+0000","last_peered":"2024-02-15T23:31:16.314669+0000","last_clean":"2024-02-15T23:31:16.314669+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:31:16.314669+0000","last_undegraded":"2024-02-15T23:31:16.314669+0000","last_fullsized":"2024-02-15T23:31:16.314669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.429461+0000","last_change":"2024-02-15T23:31:52.429522+0000","last_active":"2024-02-15T23:31:52.429461+0000","last_peered":"2024-02-15T23:31:52.429461+0000","last_clean":"2024-02-15T23:31:52.429461+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:52.429461+0000","last_undegraded":"2024-02-15T23:31:52.429461+0000","last_fullsized":"2024-02-15T23:31:52.429461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:52.429268+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:52.429268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.429268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:34.192751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955214+0000","last_change":"2024-02-15T23:29:29.707236+0000","last_active":"2024-02-15T23:31:14.955214+0000","last_peered":"2024-02-15T23:31:14.955214+0000","last_clean":"2024-02-15T23:31:14.955214+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:31:14.955214+0000","last_undegraded":"2024-02-15T23:31:14.955214+0000","last_fullsized":"2024-02-15T23:31:14.955214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.431824+0000","last_change":"2024-02-15T23:31:43.431966+0000","last_active":"2024-02-15T23:31:43.431824+0000","last_peered":"2024-02-15T23:31:43.431824+0000","last_clean":"2024-02-15T23:31:43.431824+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:43.431824+0000","last_undegraded":"2024-02-15T23:31:43.431824+0000","last_fullsized":"2024-02-15T23:31:43.431824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:43.431598+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:43.431598+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.431598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:46.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955316+0000","last_change":"2024-02-15T23:29:29.716033+0000","last_active":"2024-02-15T23:31:14.955316+0000","last_peered":"2024-02-15T23:31:14.955316+0000","last_clean":"2024-02-15T23:31:14.955316+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:31:14.955316+0000","last_undegraded":"2024-02-15T23:31:14.955316+0000","last_fullsized":"2024-02-15T23:31:14.955316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.569475+0000","last_change":"2024-02-15T23:31:41.569613+0000","last_active":"2024-02-15T23:31:41.569475+0000","last_peered":"2024-02-15T23:31:41.569475+0000","last_clean":"2024-02-15T23:31:41.569475+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:31:41.569475+0000","last_undegraded":"2024-02-15T23:31:41.569475+0000","last_fullsized":"2024-02-15T23:31:41.569475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:41.569264+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:41.569264+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.569264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:36.816368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.460098+0000","last_change":"2024-02-15T23:31:53.460237+0000","last_active":"2024-02-15T23:31:53.460098+0000","last_peered":"2024-02-15T23:31:53.460098+0000","last_clean":"2024-02-15T23:31:53.460098+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:31:53.460098+0000","last_undegraded":"2024-02-15T23:31:53.460098+0000","last_fullsized":"2024-02-15T23:31:53.460098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.459858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.459858+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.459858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:59.119468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955460+0000","last_change":"2024-02-15T23:29:31.695350+0000","last_active":"2024-02-15T23:31:14.955460+0000","last_peered":"2024-02-15T23:31:14.955460+0000","last_clean":"2024-02-15T23:31:14.955460+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:31:14.955460+0000","last_undegraded":"2024-02-15T23:31:14.955460+0000","last_fullsized":"2024-02-15T23:31:14.955460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.669309+0000","last_change":"2024-02-15T23:31:47.669477+0000","last_active":"2024-02-15T23:31:47.669309+0000","last_peered":"2024-02-15T23:31:47.669309+0000","last_clean":"2024-02-15T23:31:47.669309+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:31:47.669309+0000","last_undegraded":"2024-02-15T23:31:47.669309+0000","last_fullsized":"2024-02-15T23:31:47.669309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:47.669042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:47.669042+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.669042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:58:09.230115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.507539+0000","last_change":"2024-02-15T23:31:54.507596+0000","last_active":"2024-02-15T23:31:54.507539+0000","last_peered":"2024-02-15T23:31:54.507539+0000","last_clean":"2024-02-15T23:31:54.507539+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:54.507539+0000","last_undegraded":"2024-02-15T23:31:54.507539+0000","last_fullsized":"2024-02-15T23:31:54.507539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:54.507342+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:54.507342+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.507342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:41.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955401+0000","last_change":"2024-02-15T23:29:29.710596+0000","last_active":"2024-02-15T23:31:14.955401+0000","last_peered":"2024-02-15T23:31:14.955401+0000","last_clean":"2024-02-15T23:31:14.955401+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:31:14.955401+0000","last_undegraded":"2024-02-15T23:31:14.955401+0000","last_fullsized":"2024-02-15T23:31:14.955401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.530211+0000","last_change":"2024-02-15T23:31:45.530211+0000","last_active":"2024-02-15T23:31:45.530211+0000","last_peered":"2024-02-15T23:31:45.530211+0000","last_clean":"2024-02-15T23:31:45.530211+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:31:45.530211+0000","last_undegraded":"2024-02-15T23:31:45.530211+0000","last_fullsized":"2024-02-15T23:31:45.530211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:45.529928+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:45.529928+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.529928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:15.937262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314943+0000","last_change":"2024-02-15T23:29:29.716896+0000","last_active":"2024-02-15T23:31:16.314943+0000","last_peered":"2024-02-15T23:31:16.314943+0000","last_clean":"2024-02-15T23:31:16.314943+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:31:16.314943+0000","last_undegraded":"2024-02-15T23:31:16.314943+0000","last_fullsized":"2024-02-15T23:31:16.314943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.780011+0000","last_change":"2024-02-15T23:30:10.793574+0000","last_active":"2024-02-15T23:30:15.780011+0000","last_peered":"2024-02-15T23:30:15.780011+0000","last_clean":"2024-02-15T23:30:15.780011+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:30:15.780011+0000","last_undegraded":"2024-02-15T23:30:15.780011+0000","last_fullsized":"2024-02-15T23:30:15.780011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.388509+0000","last_change":"2024-02-15T23:31:53.388574+0000","last_active":"2024-02-15T23:31:53.388509+0000","last_peered":"2024-02-15T23:31:53.388509+0000","last_clean":"2024-02-15T23:31:53.388509+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:31:53.388509+0000","last_undegraded":"2024-02-15T23:31:53.388509+0000","last_fullsized":"2024-02-15T23:31:53.388509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:53.388287+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:53.388287+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.388287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:38.067265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'22","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.424844+0000","last_change":"2024-02-15T23:31:41.424844+0000","last_active":"2024-02-15T23:31:41.424844+0000","last_peered":"2024-02-15T23:31:41.424844+0000","last_clean":"2024-02-15T23:31:41.424844+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:31:41.424844+0000","last_undegraded":"2024-02-15T23:31:41.424844+0000","last_fullsized":"2024-02-15T23:31:41.424844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-02-15T23:31:41.424484+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-02-15T23:31:41.424484+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.424484+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:46:22.213060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.485141+0000","last_change":"2024-02-15T23:31:49.485212+0000","last_active":"2024-02-15T23:31:49.485141+0000","last_peered":"2024-02-15T23:31:49.485141+0000","last_clean":"2024-02-15T23:31:49.485141+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:31:49.485141+0000","last_undegraded":"2024-02-15T23:31:49.485141+0000","last_fullsized":"2024-02-15T23:31:49.485141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.484951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.484951+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.484951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:26.137159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398393+0000","last_change":"2024-02-15T23:29:31.694663+0000","last_active":"2024-02-15T23:31:15.398393+0000","last_peered":"2024-02-15T23:31:15.398393+0000","last_clean":"2024-02-15T23:31:15.398393+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:31:15.398393+0000","last_undegraded":"2024-02-15T23:31:15.398393+0000","last_fullsized":"2024-02-15T23:31:15.398393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.397934+0000","last_change":"2024-02-15T23:29:29.720975+0000","last_active":"2024-02-15T23:31:15.397934+0000","last_peered":"2024-02-15T23:31:15.397934+0000","last_clean":"2024-02-15T23:31:15.397934+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:31:15.397934+0000","last_undegraded":"2024-02-15T23:31:15.397934+0000","last_fullsized":"2024-02-15T23:31:15.397934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.514883+0000","last_change":"2024-02-15T23:31:43.514883+0000","last_active":"2024-02-15T23:31:43.514883+0000","last_peered":"2024-02-15T23:31:43.514883+0000","last_clean":"2024-02-15T23:31:43.514883+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:31:43.514883+0000","last_undegraded":"2024-02-15T23:31:43.514883+0000","last_fullsized":"2024-02-15T23:31:43.514883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:43.514514+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:43.514514+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.514514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:46.279795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314816+0000","last_change":"2024-02-15T23:29:29.714331+0000","last_active":"2024-02-15T23:31:16.314816+0000","last_peered":"2024-02-15T23:31:16.314816+0000","last_clean":"2024-02-15T23:31:16.314816+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:31:16.314816+0000","last_undegraded":"2024-02-15T23:31:16.314816+0000","last_fullsized":"2024-02-15T23:31:16.314816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.498328+0000","last_change":"2024-02-15T23:31:46.498328+0000","last_active":"2024-02-15T23:31:46.498328+0000","last_peered":"2024-02-15T23:31:46.498328+0000","last_clean":"2024-02-15T23:31:46.498328+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:31:46.498328+0000","last_undegraded":"2024-02-15T23:31:46.498328+0000","last_fullsized":"2024-02-15T23:31:46.498328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:46.497968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:46.497968+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.497968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:56.619609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314817+0000","last_change":"2024-02-15T23:29:29.720292+0000","last_active":"2024-02-15T23:31:16.314817+0000","last_peered":"2024-02-15T23:31:16.314817+0000","last_clean":"2024-02-15T23:31:16.314817+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:31:16.314817+0000","last_undegraded":"2024-02-15T23:31:16.314817+0000","last_fullsized":"2024-02-15T23:31:16.314817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315444+0000","last_change":"2024-02-15T23:29:31.699375+0000","last_active":"2024-02-15T23:31:16.315444+0000","last_peered":"2024-02-15T23:31:16.315444+0000","last_clean":"2024-02-15T23:31:16.315444+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:31:16.315444+0000","last_undegraded":"2024-02-15T23:31:16.315444+0000","last_fullsized":"2024-02-15T23:31:16.315444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.663850+0000","last_change":"2024-02-15T23:31:51.663905+0000","last_active":"2024-02-15T23:31:51.663850+0000","last_peered":"2024-02-15T23:31:51.663850+0000","last_clean":"2024-02-15T23:31:51.663850+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:31:51.663850+0000","last_undegraded":"2024-02-15T23:31:51.663850+0000","last_fullsized":"2024-02-15T23:31:51.663850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:51.663652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:51.663652+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.663652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:46:32.452228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398545+0000","last_change":"2024-02-15T23:29:31.694898+0000","last_active":"2024-02-15T23:31:15.398545+0000","last_peered":"2024-02-15T23:31:15.398545+0000","last_clean":"2024-02-15T23:31:15.398545+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:31:15.398545+0000","last_undegraded":"2024-02-15T23:31:15.398545+0000","last_fullsized":"2024-02-15T23:31:15.398545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314839+0000","last_change":"2024-02-15T23:29:29.714026+0000","last_active":"2024-02-15T23:31:16.314839+0000","last_peered":"2024-02-15T23:31:16.314839+0000","last_clean":"2024-02-15T23:31:16.314839+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:31:16.314839+0000","last_undegraded":"2024-02-15T23:31:16.314839+0000","last_fullsized":"2024-02-15T23:31:16.314839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315060+0000","last_change":"2024-02-15T23:29:29.714394+0000","last_active":"2024-02-15T23:31:16.315060+0000","last_peered":"2024-02-15T23:31:16.315060+0000","last_clean":"2024-02-15T23:31:16.315060+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:31:16.315060+0000","last_undegraded":"2024-02-15T23:31:16.315060+0000","last_fullsized":"2024-02-15T23:31:16.315060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:10.791944+0000","last_change":"2024-02-15T23:29:31.696441+0000","last_active":"2024-02-15T23:30:10.791944+0000","last_peered":"2024-02-15T23:30:10.791944+0000","last_clean":"2024-02-15T23:30:10.791944+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:30:10.791944+0000","last_undegraded":"2024-02-15T23:30:10.791944+0000","last_fullsized":"2024-02-15T23:30:10.791944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.955311+0000","last_change":"2024-02-15T23:29:29.716351+0000","last_active":"2024-02-15T23:31:14.955311+0000","last_peered":"2024-02-15T23:31:14.955311+0000","last_clean":"2024-02-15T23:31:14.955311+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:31:14.955311+0000","last_undegraded":"2024-02-15T23:31:14.955311+0000","last_fullsized":"2024-02-15T23:31:14.955311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.574247+0000","last_change":"2024-02-15T23:31:40.574309+0000","last_active":"2024-02-15T23:31:40.574247+0000","last_peered":"2024-02-15T23:31:40.574247+0000","last_clean":"2024-02-15T23:31:40.574247+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:31:40.574247+0000","last_undegraded":"2024-02-15T23:31:40.574247+0000","last_fullsized":"2024-02-15T23:31:40.574247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:40.574041+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:40.574041+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.574041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:24.310993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705701,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.76300000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.751,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.23100000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.78600000000000003,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.26300000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.78600000000000003,"5min":1.103,"15min":1.103},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72899999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.75}]}]},{"osd":2,"up_from":9,"seq":38654705699,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75600000000000001,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.55600000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80700000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.43099999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.75900000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.77200000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.79800000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.38200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76800000000000002,"5min":2.452,"15min":2.452},"last":0.75}]}]},{"osd":1,"up_from":9,"seq":38654705700,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.38,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78400000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.68600000000000005,"15min":0.69499999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":1.036,"15min":1.036},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.246,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80600000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.82499999999999996,"5min":1.034,"15min":1.034},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.628,"15min":0.629},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.83799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.94199999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88,"5min":1.24,"15min":1.24},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.746,"15min":0.751},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.54500000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:31:57.517 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.517 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.517 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.517 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.517 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.518 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.518 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.518 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.518 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.518 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.519 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.519 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.519 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.519 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.519 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.520 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.520 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.520 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.520 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.520 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.520 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.521 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.521 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.521 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.521 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.521 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.522 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.522 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.522 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.522 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.522 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.523 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.523 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.523 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.523 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-15T23:29:15.580621+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=15, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.523 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.524 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.524 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.524 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.524 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.524 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.525 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.525 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.525 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.525 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.525 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.526 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.526 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-15T23:29:36.701479+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=36, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.526 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.526 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.526 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-15T23:29:32.668080+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=32, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.526 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.527 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.527 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.527 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.527 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.527 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.528 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.528 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.528 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.528 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.528 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.529 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.529 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.529 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.529 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.529 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.529 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.530 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.530 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.530 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.530 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.530 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.530 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.531 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.531 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.531 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.531 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.531 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.532 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.532 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.532 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.532 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.532 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.533 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.533 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.533 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.533 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.533 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.533 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.534 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.534 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.534 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.534 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.534 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.535 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.535 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.535 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.535 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.535 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.536 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.536 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.536 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.536 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.536 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.537 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.537 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:31:57.537 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T23:32:17.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0c26b8640 1 Processor -- start 2024-02-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0c26b8640 1 -- start start 2024-02-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0c26b8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe0bc128b00 0x7fe0bc128ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0c26b8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0bc094bb0 con 0x7fe0bc12bb30 2024-02-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0c26b8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc09c160 con 0x7fe0bc128b00 2024-02-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0bbfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe0bc128b00 0x7fe0bc128ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0b3fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe0bc12bb30 0x7fe0bc12bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38672/0 (socket says 172.21.15.131:38672) 2024-02-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0b3fff640 1 -- 172.21.15.131:0/2697784515 learned_addr learned my addr 172.21.15.131:0/2697784515 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0bbfff640 1 -- 172.21.15.131:0/2697784515 >> v1:172.21.15.131:6789/0 conn(0x7fe0bc12bb30 legacy=0x7fe0bc12bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0bbfff640 1 -- 172.21.15.131:0/2697784515 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc1288e0 con 0x7fe0bc128b00 2024-02-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0bb7fe640 1 -- 172.21.15.131:0/2697784515 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754684342 0 0) 0x7fe0bc094bb0 con 0x7fe0bc12bb30 2024-02-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0bbfff640 1 --2- 172.21.15.131:0/2697784515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc128ee0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009740 tx=0x7fe0ac01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cb141d4402632d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0bb7fe640 1 -- 172.21.15.131:0/2697784515 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac0ab530 con 0x7fe0bc128b00 2024-02-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0bb7fe640 1 -- 172.21.15.131:0/2697784515 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac0a7050 con 0x7fe0bc128b00 2024-02-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.662+0000 7fe0bb7fe640 1 -- 172.21.15.131:0/2697784515 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac0ab7e0 con 0x7fe0bc128b00 2024-02-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- 172.21.15.131:0/2697784515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 msgr2=0x7fe0bc128ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 --2- 172.21.15.131:0/2697784515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc128ee0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009740 tx=0x7fe0ac01c370 comp rx=0 tx=0).stop 2024-02-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- 172.21.15.131:0/2697784515 shutdown_connections 2024-02-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 --2- 172.21.15.131:0/2697784515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc128ee0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- 172.21.15.131:0/2697784515 >> 172.21.15.131:0/2697784515 conn(0x7fe0bc09a2f0 msgr2=0x7fe0bc09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- 172.21.15.131:0/2697784515 shutdown_connections 2024-02-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- 172.21.15.131:0/2697784515 wait complete. 2024-02-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 Processor -- start 2024-02-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- start start 2024-02-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc1c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc127b90 con 0x7fe0bc128b00 2024-02-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0bbfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc1c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0bbfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc1c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36298/0 (socket says 172.21.15.131:36298) 2024-02-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0bbfff640 1 -- 172.21.15.131:0/864427641 learned_addr learned my addr 172.21.15.131:0/864427641 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0bbfff640 1 -- 172.21.15.131:0/864427641 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac009420 con 0x7fe0bc128b00 2024-02-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0bbfff640 1 --2- 172.21.15.131:0/864427641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc1c39f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0ae040 tx=0x7fe0ac01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0b97fa640 1 -- 172.21.15.131:0/864427641 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac0b7450 con 0x7fe0bc128b00 2024-02-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0b97fa640 1 -- 172.21.15.131:0/864427641 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac0b75b0 con 0x7fe0bc128b00 2024-02-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0bc125090 con 0x7fe0bc128b00 2024-02-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0b97fa640 1 -- 172.21.15.131:0/864427641 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac0b7890 con 0x7fe0bc128b00 2024-02-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc12ce40 con 0x7fe0bc128b00 2024-02-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0bc067e00 con 0x7fe0bc128b00 2024-02-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0b97fa640 1 -- 172.21.15.131:0/864427641 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe0ac0b79f0 con 0x7fe0bc128b00 2024-02-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0b97fa640 1 --2- 172.21.15.131:0/864427641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe09c035a10 0x7fe09c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0b97fa640 1 -- 172.21.15.131:0/864427641 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fe0ac0e3520 con 0x7fe0bc128b00 2024-02-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.666+0000 7fe0b3fff640 1 --2- 172.21.15.131:0/864427641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe09c035a10 0x7fe09c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.670+0000 7fe0b3fff640 1 --2- 172.21.15.131:0/864427641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe09c035a10 0x7fe09c037ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4007fd0 tx=0x7fe0a4007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.674+0000 7fe0b97fa640 1 -- 172.21.15.131:0/864427641 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0ac0c74e0 con 0x7fe0bc128b00 2024-02-15T23:32:17.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.830+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0bc129420 con 0x7fe09c035a10 2024-02-15T23:32:17.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.878+0000 7fe0b97fa640 1 -- 172.21.15.131:0/864427641 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+672837 (secure 0 0 0) 0x7fe0a40070d0 con 0x7fe09c035a10 2024-02-15T23:32:17.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:32:17.901 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:32:17.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe09c035a10 msgr2=0x7fe09c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 --2- 172.21.15.131:0/864427641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe09c035a10 0x7fe09c037ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4007fd0 tx=0x7fe0a4007940 comp rx=0 tx=0).stop 2024-02-15T23:32:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 msgr2=0x7fe0bc1c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 --2- 172.21.15.131:0/864427641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc1c39f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0ae040 tx=0x7fe0ac01abb0 comp rx=0 tx=0).stop 2024-02-15T23:32:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 shutdown_connections 2024-02-15T23:32:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 --2- 172.21.15.131:0/864427641 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fe09c035a10 0x7fe09c037ed0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 --2- 172.21.15.131:0/864427641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0bc128b00 0x7fe0bc1c39f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 >> 172.21.15.131:0/864427641 conn(0x7fe0bc09a2f0 msgr2=0x7fe0bc126960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:32:17.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 shutdown_connections 2024-02-15T23:32:17.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:17.886+0000 7fe0c26b8640 1 -- 172.21.15.131:0/864427641 wait complete. 2024-02-15T23:32:17.918 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-02-15T23:32:17.575833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.668252+0000","last_change":"2024-02-15T23:31:53.668312+0000","last_active":"2024-02-15T23:31:53.668252+0000","last_peered":"2024-02-15T23:31:53.668252+0000","last_clean":"2024-02-15T23:31:53.668252+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:31:53.668252+0000","last_undegraded":"2024-02-15T23:31:53.668252+0000","last_fullsized":"2024-02-15T23:31:53.668252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.668051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.668051+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.668051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:56.433332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.499037+0000","last_change":"2024-02-15T23:31:52.499037+0000","last_active":"2024-02-15T23:31:52.499037+0000","last_peered":"2024-02-15T23:31:52.499037+0000","last_clean":"2024-02-15T23:31:52.499037+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:31:52.499037+0000","last_undegraded":"2024-02-15T23:31:52.499037+0000","last_fullsized":"2024-02-15T23:31:52.499037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:52.498705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:52.498705+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.498705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:34.262188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.419135+0000","last_change":"2024-02-15T23:31:49.419197+0000","last_active":"2024-02-15T23:31:49.419135+0000","last_peered":"2024-02-15T23:31:49.419135+0000","last_clean":"2024-02-15T23:31:49.419135+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:31:49.419135+0000","last_undegraded":"2024-02-15T23:31:49.419135+0000","last_fullsized":"2024-02-15T23:31:49.419135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.418938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.418938+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.418938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:26.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.093766+0000","last_change":"2024-02-15T23:31:59.093766+0000","last_active":"2024-02-15T23:31:59.093766+0000","last_peered":"2024-02-15T23:31:59.093766+0000","last_clean":"2024-02-15T23:31:59.093766+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:31:59.093766+0000","last_undegraded":"2024-02-15T23:31:59.093766+0000","last_fullsized":"2024-02-15T23:31:59.093766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:59.093513+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.093513+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.093513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:08:54.559676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315010+0000","last_change":"2024-02-15T23:29:29.725919+0000","last_active":"2024-02-15T23:31:16.315010+0000","last_peered":"2024-02-15T23:31:16.315010+0000","last_clean":"2024-02-15T23:31:16.315010+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:31:16.315010+0000","last_undegraded":"2024-02-15T23:31:16.315010+0000","last_fullsized":"2024-02-15T23:31:16.315010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.127896+0000","last_change":"2024-02-15T23:31:58.127896+0000","last_active":"2024-02-15T23:31:58.127896+0000","last_peered":"2024-02-15T23:31:58.127896+0000","last_clean":"2024-02-15T23:31:58.127896+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:31:58.127896+0000","last_undegraded":"2024-02-15T23:31:58.127896+0000","last_fullsized":"2024-02-15T23:31:58.127896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:58.127630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:58.127630+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.127630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:23:10.804456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.757267+0000","last_change":"2024-02-15T23:32:00.757326+0000","last_active":"2024-02-15T23:32:00.757267+0000","last_peered":"2024-02-15T23:32:00.757267+0000","last_clean":"2024-02-15T23:32:00.757267+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:32:00.757267+0000","last_undegraded":"2024-02-15T23:32:00.757267+0000","last_fullsized":"2024-02-15T23:32:00.757267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:00.757064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:00.757064+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.757064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:48:08.010450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.224937+0000","last_change":"2024-02-15T23:31:53.224937+0000","last_active":"2024-02-15T23:31:53.224937+0000","last_peered":"2024-02-15T23:31:53.224937+0000","last_clean":"2024-02-15T23:31:53.224937+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:31:53.224937+0000","last_undegraded":"2024-02-15T23:31:53.224937+0000","last_fullsized":"2024-02-15T23:31:53.224937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.224656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.224656+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.224656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:31.631150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314953+0000","last_change":"2024-02-15T23:29:29.710832+0000","last_active":"2024-02-15T23:31:16.314953+0000","last_peered":"2024-02-15T23:31:16.314953+0000","last_clean":"2024-02-15T23:31:16.314953+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:31:16.314953+0000","last_undegraded":"2024-02-15T23:31:16.314953+0000","last_fullsized":"2024-02-15T23:31:16.314953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.477578+0000","last_change":"2024-02-15T23:31:47.477646+0000","last_active":"2024-02-15T23:31:47.477578+0000","last_peered":"2024-02-15T23:31:47.477578+0000","last_clean":"2024-02-15T23:31:47.477578+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:47.477578+0000","last_undegraded":"2024-02-15T23:31:47.477578+0000","last_fullsized":"2024-02-15T23:31:47.477578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:47.477403+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:47.477403+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.477403+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:54.301986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.733100+0000","last_change":"2024-02-15T23:32:01.733158+0000","last_active":"2024-02-15T23:32:01.733100+0000","last_peered":"2024-02-15T23:32:01.733100+0000","last_clean":"2024-02-15T23:32:01.733100+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:32:01.733100+0000","last_undegraded":"2024-02-15T23:32:01.733100+0000","last_fullsized":"2024-02-15T23:32:01.733100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:01.732866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:01.732866+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.732866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:39.379554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.400579+0000","last_change":"2024-02-15T23:31:37.400579+0000","last_active":"2024-02-15T23:31:37.400579+0000","last_peered":"2024-02-15T23:31:37.400579+0000","last_clean":"2024-02-15T23:31:37.400579+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:31:37.400579+0000","last_undegraded":"2024-02-15T23:31:37.400579+0000","last_fullsized":"2024-02-15T23:31:37.400579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.400334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.400334+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.400334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:49:40.355253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314735+0000","last_change":"2024-02-15T23:29:29.707555+0000","last_active":"2024-02-15T23:31:16.314735+0000","last_peered":"2024-02-15T23:31:16.314735+0000","last_clean":"2024-02-15T23:31:16.314735+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:31:16.314735+0000","last_undegraded":"2024-02-15T23:31:16.314735+0000","last_fullsized":"2024-02-15T23:31:16.314735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.635991+0000","last_change":"2024-02-15T23:31:44.636058+0000","last_active":"2024-02-15T23:31:44.635991+0000","last_peered":"2024-02-15T23:31:44.635991+0000","last_clean":"2024-02-15T23:31:44.635991+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:31:44.635991+0000","last_undegraded":"2024-02-15T23:31:44.635991+0000","last_fullsized":"2024-02-15T23:31:44.635991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-15T23:31:44.635777+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-15T23:31:44.635777+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.635777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:42.603964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.506217+0000","last_change":"2024-02-15T23:31:47.506217+0000","last_active":"2024-02-15T23:31:47.506217+0000","last_peered":"2024-02-15T23:31:47.506217+0000","last_clean":"2024-02-15T23:31:47.506217+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:31:47.506217+0000","last_undegraded":"2024-02-15T23:31:47.506217+0000","last_fullsized":"2024-02-15T23:31:47.506217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:47.505968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:47.505968+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.505968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:54.330551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.709654+0000","last_change":"2024-02-15T23:31:37.709654+0000","last_active":"2024-02-15T23:31:37.709654+0000","last_peered":"2024-02-15T23:31:37.709654+0000","last_clean":"2024-02-15T23:31:37.709654+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:31:37.709654+0000","last_undegraded":"2024-02-15T23:31:37.709654+0000","last_fullsized":"2024-02-15T23:31:37.709654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:37.709401+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:37.709401+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.709401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:33.404898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.070933+0000","last_change":"2024-02-15T23:32:03.070988+0000","last_active":"2024-02-15T23:32:03.070933+0000","last_peered":"2024-02-15T23:32:03.070933+0000","last_clean":"2024-02-15T23:32:03.070933+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:32:03.070933+0000","last_undegraded":"2024-02-15T23:32:03.070933+0000","last_fullsized":"2024-02-15T23:32:03.070933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:03.070745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:03.070745+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.070745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:50.320974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.545582+0000","last_change":"2024-02-15T23:32:03.545657+0000","last_active":"2024-02-15T23:32:03.545582+0000","last_peered":"2024-02-15T23:32:03.545582+0000","last_clean":"2024-02-15T23:32:03.545582+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:32:03.545582+0000","last_undegraded":"2024-02-15T23:32:03.545582+0000","last_fullsized":"2024-02-15T23:32:03.545582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:03.545376+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:03.545376+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.545376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:03:37.413362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.524000+0000","last_change":"2024-02-15T23:31:50.524000+0000","last_active":"2024-02-15T23:31:50.524000+0000","last_peered":"2024-02-15T23:31:50.524000+0000","last_clean":"2024-02-15T23:31:50.524000+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:31:50.524000+0000","last_undegraded":"2024-02-15T23:31:50.524000+0000","last_fullsized":"2024-02-15T23:31:50.524000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:50.523751+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:50.523751+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.523751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:31.439499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.662952+0000","last_change":"2024-02-15T23:31:41.662952+0000","last_active":"2024-02-15T23:31:41.662952+0000","last_peered":"2024-02-15T23:31:41.662952+0000","last_clean":"2024-02-15T23:31:41.662952+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:31:41.662952+0000","last_undegraded":"2024-02-15T23:31:41.662952+0000","last_fullsized":"2024-02-15T23:31:41.662952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:41.662713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:41.662713+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.662713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:16.784415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.471993+0000","last_change":"2024-02-15T23:31:48.471993+0000","last_active":"2024-02-15T23:31:48.471993+0000","last_peered":"2024-02-15T23:31:48.471993+0000","last_clean":"2024-02-15T23:31:48.471993+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:48.471993+0000","last_undegraded":"2024-02-15T23:31:48.471993+0000","last_fullsized":"2024-02-15T23:31:48.471993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:48.471732+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:48.471732+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.471732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:51.993523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.506627+0000","last_change":"2024-02-15T23:31:51.506627+0000","last_active":"2024-02-15T23:31:51.506627+0000","last_peered":"2024-02-15T23:31:51.506627+0000","last_clean":"2024-02-15T23:31:51.506627+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:31:51.506627+0000","last_undegraded":"2024-02-15T23:31:51.506627+0000","last_fullsized":"2024-02-15T23:31:51.506627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:51.506363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:51.506363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.506363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:25.908233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.453219+0000","last_change":"2024-02-15T23:31:45.453219+0000","last_active":"2024-02-15T23:31:45.453219+0000","last_peered":"2024-02-15T23:31:45.453219+0000","last_clean":"2024-02-15T23:31:45.453219+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:31:45.453219+0000","last_undegraded":"2024-02-15T23:31:45.453219+0000","last_fullsized":"2024-02-15T23:31:45.453219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:45.452811+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:45.452811+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.452811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:03.503688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.529592+0000","last_change":"2024-02-15T23:32:04.529655+0000","last_active":"2024-02-15T23:32:04.529592+0000","last_peered":"2024-02-15T23:32:04.529592+0000","last_clean":"2024-02-15T23:32:04.529592+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:32:04.529592+0000","last_undegraded":"2024-02-15T23:32:04.529592+0000","last_fullsized":"2024-02-15T23:32:04.529592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.529406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.529406+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.529406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:12.799241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.711628+0000","last_change":"2024-02-15T23:31:46.711628+0000","last_active":"2024-02-15T23:31:46.711628+0000","last_peered":"2024-02-15T23:31:46.711628+0000","last_clean":"2024-02-15T23:31:46.711628+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:31:46.711628+0000","last_undegraded":"2024-02-15T23:31:46.711628+0000","last_fullsized":"2024-02-15T23:31:46.711628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-02-15T23:31:46.711368+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-02-15T23:31:46.711368+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.711368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:56.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.478507+0000","last_change":"2024-02-15T23:31:51.478507+0000","last_active":"2024-02-15T23:31:51.478507+0000","last_peered":"2024-02-15T23:31:51.478507+0000","last_clean":"2024-02-15T23:31:51.478507+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:31:51.478507+0000","last_undegraded":"2024-02-15T23:31:51.478507+0000","last_fullsized":"2024-02-15T23:31:51.478507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:51.478248+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:51.478248+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.478248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:25.880117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.551340+0000","last_change":"2024-02-15T23:31:44.551340+0000","last_active":"2024-02-15T23:31:44.551340+0000","last_peered":"2024-02-15T23:31:44.551340+0000","last_clean":"2024-02-15T23:31:44.551340+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:31:44.551340+0000","last_undegraded":"2024-02-15T23:31:44.551340+0000","last_fullsized":"2024-02-15T23:31:44.551340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-02-15T23:31:44.551091+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-02-15T23:31:44.551091+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.551091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:41:29.596164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314746+0000","last_change":"2024-02-15T23:29:29.717627+0000","last_active":"2024-02-15T23:31:16.314746+0000","last_peered":"2024-02-15T23:31:16.314746+0000","last_clean":"2024-02-15T23:31:16.314746+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:31:16.314746+0000","last_undegraded":"2024-02-15T23:31:16.314746+0000","last_fullsized":"2024-02-15T23:31:16.314746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'18","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.562029+0000","last_change":"2024-02-15T23:31:42.562029+0000","last_active":"2024-02-15T23:31:42.562029+0000","last_peered":"2024-02-15T23:31:42.562029+0000","last_clean":"2024-02-15T23:31:42.562029+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:42.562029+0000","last_undegraded":"2024-02-15T23:31:42.562029+0000","last_fullsized":"2024-02-15T23:31:42.562029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-02-15T23:31:42.561648+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-02-15T23:31:42.561648+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.561648+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:06.676715+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.186119+0000","last_change":"2024-02-15T23:31:54.186119+0000","last_active":"2024-02-15T23:31:54.186119+0000","last_peered":"2024-02-15T23:31:54.186119+0000","last_clean":"2024-02-15T23:31:54.186119+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:31:54.186119+0000","last_undegraded":"2024-02-15T23:31:54.186119+0000","last_fullsized":"2024-02-15T23:31:54.186119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:54.185856+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:54.185856+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.185856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:06:08.657140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314518+0000","last_change":"2024-02-15T23:29:29.711609+0000","last_active":"2024-02-15T23:31:16.314518+0000","last_peered":"2024-02-15T23:31:16.314518+0000","last_clean":"2024-02-15T23:31:16.314518+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:31:16.314518+0000","last_undegraded":"2024-02-15T23:31:16.314518+0000","last_fullsized":"2024-02-15T23:31:16.314518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.381651+0000","last_change":"2024-02-15T23:31:23.381651+0000","last_active":"2024-02-15T23:31:23.381651+0000","last_peered":"2024-02-15T23:31:23.381651+0000","last_clean":"2024-02-15T23:31:23.381651+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:31:23.381651+0000","last_undegraded":"2024-02-15T23:31:23.381651+0000","last_fullsized":"2024-02-15T23:31:23.381651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.381406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:53.788740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.240923+0000","last_change":"2024-02-15T23:31:49.240923+0000","last_active":"2024-02-15T23:31:49.240923+0000","last_peered":"2024-02-15T23:31:49.240923+0000","last_clean":"2024-02-15T23:31:49.240923+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:31:49.240923+0000","last_undegraded":"2024-02-15T23:31:49.240923+0000","last_fullsized":"2024-02-15T23:31:49.240923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-15T23:31:49.240607+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-15T23:31:49.240607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.240607+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:27:40.630524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.464923+0000","last_change":"2024-02-15T23:31:26.464923+0000","last_active":"2024-02-15T23:31:26.464923+0000","last_peered":"2024-02-15T23:31:26.464923+0000","last_clean":"2024-02-15T23:31:26.464923+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:31:26.464923+0000","last_undegraded":"2024-02-15T23:31:26.464923+0000","last_fullsized":"2024-02-15T23:31:26.464923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.464676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:15.850726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.491181+0000","last_change":"2024-02-15T23:32:09.491239+0000","last_active":"2024-02-15T23:32:09.491181+0000","last_peered":"2024-02-15T23:32:09.491181+0000","last_clean":"2024-02-15T23:32:09.491181+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:32:09.491181+0000","last_undegraded":"2024-02-15T23:32:09.491181+0000","last_fullsized":"2024-02-15T23:32:09.491181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:09.490996+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:09.490996+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.490996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:50.767715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.462983+0000","last_change":"2024-02-15T23:31:33.462983+0000","last_active":"2024-02-15T23:31:33.462983+0000","last_peered":"2024-02-15T23:31:33.462983+0000","last_clean":"2024-02-15T23:31:33.462983+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:31:33.462983+0000","last_undegraded":"2024-02-15T23:31:33.462983+0000","last_fullsized":"2024-02-15T23:31:33.462983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.462731+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:08.999822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.713072+0000","last_change":"2024-02-15T23:31:56.713134+0000","last_active":"2024-02-15T23:31:56.713072+0000","last_peered":"2024-02-15T23:31:56.713072+0000","last_clean":"2024-02-15T23:31:56.713072+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:31:56.713072+0000","last_undegraded":"2024-02-15T23:31:56.713072+0000","last_fullsized":"2024-02-15T23:31:56.713072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.712850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.712850+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.712850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:06:56.264686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.492105+0000","last_change":"2024-02-15T23:31:39.492105+0000","last_active":"2024-02-15T23:31:39.492105+0000","last_peered":"2024-02-15T23:31:39.492105+0000","last_clean":"2024-02-15T23:31:39.492105+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:31:39.492105+0000","last_undegraded":"2024-02-15T23:31:39.492105+0000","last_fullsized":"2024-02-15T23:31:39.492105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.491862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.491862+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.491862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:46.524152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.354191+0000","last_change":"2024-02-15T23:31:20.354191+0000","last_active":"2024-02-15T23:31:20.354191+0000","last_peered":"2024-02-15T23:31:20.354191+0000","last_clean":"2024-02-15T23:31:20.354191+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:31:20.354191+0000","last_undegraded":"2024-02-15T23:31:20.354191+0000","last_fullsized":"2024-02-15T23:31:20.354191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.353944+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:24.028078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.362319+0000","last_change":"2024-02-15T23:31:18.362319+0000","last_active":"2024-02-15T23:31:18.362319+0000","last_peered":"2024-02-15T23:31:18.362319+0000","last_clean":"2024-02-15T23:31:18.362319+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:31:18.362319+0000","last_undegraded":"2024-02-15T23:31:18.362319+0000","last_fullsized":"2024-02-15T23:31:18.362319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.362075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.313172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.452261+0000","last_change":"2024-02-15T23:31:40.452261+0000","last_active":"2024-02-15T23:31:40.452261+0000","last_peered":"2024-02-15T23:31:40.452261+0000","last_clean":"2024-02-15T23:31:40.452261+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:31:40.452261+0000","last_undegraded":"2024-02-15T23:31:40.452261+0000","last_fullsized":"2024-02-15T23:31:40.452261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:40.452005+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:40.452005+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.452005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:24.188956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.236850+0000","last_change":"2024-02-15T23:31:50.236850+0000","last_active":"2024-02-15T23:31:50.236850+0000","last_peered":"2024-02-15T23:31:50.236850+0000","last_clean":"2024-02-15T23:31:50.236850+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:31:50.236850+0000","last_undegraded":"2024-02-15T23:31:50.236850+0000","last_fullsized":"2024-02-15T23:31:50.236850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:50.236582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:50.236582+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.236582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:37.333982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.154845+0000","last_change":"2024-02-15T23:32:07.154906+0000","last_active":"2024-02-15T23:32:07.154845+0000","last_peered":"2024-02-15T23:32:07.154845+0000","last_clean":"2024-02-15T23:32:07.154845+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:32:07.154845+0000","last_undegraded":"2024-02-15T23:32:07.154845+0000","last_fullsized":"2024-02-15T23:32:07.154845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.154654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.154654+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.154654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:44:01.539488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.526018+0000","last_change":"2024-02-15T23:31:33.526018+0000","last_active":"2024-02-15T23:31:33.526018+0000","last_peered":"2024-02-15T23:31:33.526018+0000","last_clean":"2024-02-15T23:31:33.526018+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:31:33.526018+0000","last_undegraded":"2024-02-15T23:31:33.526018+0000","last_fullsized":"2024-02-15T23:31:33.526018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.525754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.228715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.758890+0000","last_change":"2024-02-15T23:31:21.758890+0000","last_active":"2024-02-15T23:31:21.758890+0000","last_peered":"2024-02-15T23:31:21.758890+0000","last_clean":"2024-02-15T23:31:21.758890+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:31:21.758890+0000","last_undegraded":"2024-02-15T23:31:21.758890+0000","last_fullsized":"2024-02-15T23:31:21.758890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.758604+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:00:21.378855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.276965+0000","last_change":"2024-02-15T23:31:52.276965+0000","last_active":"2024-02-15T23:31:52.276965+0000","last_peered":"2024-02-15T23:31:52.276965+0000","last_clean":"2024-02-15T23:31:52.276965+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:52.276965+0000","last_undegraded":"2024-02-15T23:31:52.276965+0000","last_fullsized":"2024-02-15T23:31:52.276965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-15T23:31:52.276608+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-15T23:31:52.276608+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.276608+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:23:11.852737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.712221+0000","last_change":"2024-02-15T23:31:36.712221+0000","last_active":"2024-02-15T23:31:36.712221+0000","last_peered":"2024-02-15T23:31:36.712221+0000","last_clean":"2024-02-15T23:31:36.712221+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:31:36.712221+0000","last_undegraded":"2024-02-15T23:31:36.712221+0000","last_fullsized":"2024-02-15T23:31:36.712221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:36.711954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:36.711954+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.711954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:26.098004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.434830+0000","last_change":"2024-02-15T23:32:10.434925+0000","last_active":"2024-02-15T23:32:10.434830+0000","last_peered":"2024-02-15T23:32:10.434830+0000","last_clean":"2024-02-15T23:32:10.434830+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:32:10.434830+0000","last_undegraded":"2024-02-15T23:32:10.434830+0000","last_fullsized":"2024-02-15T23:32:10.434830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:10.434636+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:10.434636+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.434636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:14:57.560221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.472959+0000","last_change":"2024-02-15T23:31:57.473029+0000","last_active":"2024-02-15T23:31:57.472959+0000","last_peered":"2024-02-15T23:31:57.472959+0000","last_clean":"2024-02-15T23:31:57.472959+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:31:57.472959+0000","last_undegraded":"2024-02-15T23:31:57.472959+0000","last_fullsized":"2024-02-15T23:31:57.472959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:57.472748+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:57.472748+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.472748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:03.321613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.380202+0000","last_change":"2024-02-15T23:31:19.380202+0000","last_active":"2024-02-15T23:31:19.380202+0000","last_peered":"2024-02-15T23:31:19.380202+0000","last_clean":"2024-02-15T23:31:19.380202+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:31:19.380202+0000","last_undegraded":"2024-02-15T23:31:19.380202+0000","last_fullsized":"2024-02-15T23:31:19.380202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.379961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:22.107728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.801467+0000","last_change":"2024-02-15T23:31:23.801467+0000","last_active":"2024-02-15T23:31:23.801467+0000","last_peered":"2024-02-15T23:31:23.801467+0000","last_clean":"2024-02-15T23:31:23.801467+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:31:23.801467+0000","last_undegraded":"2024-02-15T23:31:23.801467+0000","last_fullsized":"2024-02-15T23:31:23.801467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.801176+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:09.278307+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":343,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.592156+0000","last_change":"2024-02-15T23:31:18.592156+0000","last_active":"2024-02-15T23:31:18.592156+0000","last_peered":"2024-02-15T23:31:18.592156+0000","last_clean":"2024-02-15T23:31:18.592156+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:18.592156+0000","last_undegraded":"2024-02-15T23:31:18.592156+0000","last_fullsized":"2024-02-15T23:31:18.592156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.591821+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.542917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.166029+0000","last_change":"2024-02-15T23:31:55.166087+0000","last_active":"2024-02-15T23:31:55.166029+0000","last_peered":"2024-02-15T23:31:55.166029+0000","last_clean":"2024-02-15T23:31:55.166029+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:31:55.166029+0000","last_undegraded":"2024-02-15T23:31:55.166029+0000","last_fullsized":"2024-02-15T23:31:55.166029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.165845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.165845+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.165845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:42:57.047533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.686615+0000","last_change":"2024-02-15T23:31:49.686753+0000","last_active":"2024-02-15T23:31:49.686615+0000","last_peered":"2024-02-15T23:31:49.686615+0000","last_clean":"2024-02-15T23:31:49.686615+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:31:49.686615+0000","last_undegraded":"2024-02-15T23:31:49.686615+0000","last_fullsized":"2024-02-15T23:31:49.686615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.686352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.686352+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.686352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:56.718642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.477281+0000","last_change":"2024-02-15T23:31:29.477281+0000","last_active":"2024-02-15T23:31:29.477281+0000","last_peered":"2024-02-15T23:31:29.477281+0000","last_clean":"2024-02-15T23:31:29.477281+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:31:29.477281+0000","last_undegraded":"2024-02-15T23:31:29.477281+0000","last_fullsized":"2024-02-15T23:31:29.477281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.477038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.461667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.798531+0000","last_change":"2024-02-15T23:31:22.798531+0000","last_active":"2024-02-15T23:31:22.798531+0000","last_peered":"2024-02-15T23:31:22.798531+0000","last_clean":"2024-02-15T23:31:22.798531+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:31:22.798531+0000","last_undegraded":"2024-02-15T23:31:22.798531+0000","last_fullsized":"2024-02-15T23:31:22.798531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.798209+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:35.238195+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.541487+0000","last_change":"2024-02-15T23:31:17.541487+0000","last_active":"2024-02-15T23:31:17.541487+0000","last_peered":"2024-02-15T23:31:17.541487+0000","last_clean":"2024-02-15T23:31:17.541487+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:31:17.541487+0000","last_undegraded":"2024-02-15T23:31:17.541487+0000","last_fullsized":"2024-02-15T23:31:17.541487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.541232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.369965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.759456+0000","last_change":"2024-02-15T23:32:05.759513+0000","last_active":"2024-02-15T23:32:05.759456+0000","last_peered":"2024-02-15T23:32:05.759456+0000","last_clean":"2024-02-15T23:32:05.759456+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:32:05.759456+0000","last_undegraded":"2024-02-15T23:32:05.759456+0000","last_fullsized":"2024-02-15T23:32:05.759456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:32:05.759232+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:32:05.759232+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.759232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:16.322465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.500820+0000","last_change":"2024-02-15T23:32:08.500905+0000","last_active":"2024-02-15T23:32:08.500820+0000","last_peered":"2024-02-15T23:32:08.500820+0000","last_clean":"2024-02-15T23:32:08.500820+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:32:08.500820+0000","last_undegraded":"2024-02-15T23:32:08.500820+0000","last_fullsized":"2024-02-15T23:32:08.500820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:08.500638+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:08.500638+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.500638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:29.150585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.686068+0000","last_change":"2024-02-15T23:31:57.686194+0000","last_active":"2024-02-15T23:31:57.686068+0000","last_peered":"2024-02-15T23:31:57.686068+0000","last_clean":"2024-02-15T23:31:57.686068+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:31:57.686068+0000","last_undegraded":"2024-02-15T23:31:57.686068+0000","last_fullsized":"2024-02-15T23:31:57.686068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:57.685774+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:57.685774+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.685774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:04:55.205797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.757401+0000","last_change":"2024-02-15T23:32:07.757464+0000","last_active":"2024-02-15T23:32:07.757401+0000","last_peered":"2024-02-15T23:32:07.757401+0000","last_clean":"2024-02-15T23:32:07.757401+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:32:07.757401+0000","last_undegraded":"2024-02-15T23:32:07.757401+0000","last_fullsized":"2024-02-15T23:32:07.757401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.757197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.757197+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.757197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:44.013395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.459639+0000","last_change":"2024-02-15T23:31:32.459639+0000","last_active":"2024-02-15T23:31:32.459639+0000","last_peered":"2024-02-15T23:31:32.459639+0000","last_clean":"2024-02-15T23:31:32.459639+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:31:32.459639+0000","last_undegraded":"2024-02-15T23:31:32.459639+0000","last_fullsized":"2024-02-15T23:31:32.459639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.459345+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:19.866069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.577110+0000","last_change":"2024-02-15T23:31:16.577110+0000","last_active":"2024-02-15T23:31:16.577110+0000","last_peered":"2024-02-15T23:31:16.577110+0000","last_clean":"2024-02-15T23:31:16.577110+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:31:16.577110+0000","last_undegraded":"2024-02-15T23:31:16.577110+0000","last_fullsized":"2024-02-15T23:31:16.577110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.576722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:35.480941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.438325+0000","last_change":"2024-02-15T23:32:11.438395+0000","last_active":"2024-02-15T23:32:11.438325+0000","last_peered":"2024-02-15T23:32:11.438325+0000","last_clean":"2024-02-15T23:32:11.438325+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:32:11.438325+0000","last_undegraded":"2024-02-15T23:32:11.438325+0000","last_fullsized":"2024-02-15T23:32:11.438325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:32:11.438129+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:32:11.438129+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.438129+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:02.828046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.730502+0000","last_change":"2024-02-15T23:32:02.730563+0000","last_active":"2024-02-15T23:32:02.730502+0000","last_peered":"2024-02-15T23:32:02.730502+0000","last_clean":"2024-02-15T23:32:02.730502+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:32:02.730502+0000","last_undegraded":"2024-02-15T23:32:02.730502+0000","last_fullsized":"2024-02-15T23:32:02.730502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:02.730290+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:02.730290+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.730290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:47.409268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314476+0000","last_change":"2024-02-15T23:29:29.725600+0000","last_active":"2024-02-15T23:31:16.314476+0000","last_peered":"2024-02-15T23:31:16.314476+0000","last_clean":"2024-02-15T23:31:16.314476+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:31:16.314476+0000","last_undegraded":"2024-02-15T23:31:16.314476+0000","last_fullsized":"2024-02-15T23:31:16.314476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.484374+0000","last_change":"2024-02-15T23:31:37.484374+0000","last_active":"2024-02-15T23:31:37.484374+0000","last_peered":"2024-02-15T23:31:37.484374+0000","last_clean":"2024-02-15T23:31:37.484374+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:31:37.484374+0000","last_undegraded":"2024-02-15T23:31:37.484374+0000","last_fullsized":"2024-02-15T23:31:37.484374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.484130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.484130+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.484130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:59.045203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.514009+0000","last_change":"2024-02-15T23:31:30.514009+0000","last_active":"2024-02-15T23:31:30.514009+0000","last_peered":"2024-02-15T23:31:30.514009+0000","last_clean":"2024-02-15T23:31:30.514009+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:31:30.514009+0000","last_undegraded":"2024-02-15T23:31:30.514009+0000","last_fullsized":"2024-02-15T23:31:30.514009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.513714+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:12.277197+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.644582+0000","last_change":"2024-02-15T23:31:20.644582+0000","last_active":"2024-02-15T23:31:20.644582+0000","last_peered":"2024-02-15T23:31:20.644582+0000","last_clean":"2024-02-15T23:31:20.644582+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:20.644582+0000","last_undegraded":"2024-02-15T23:31:20.644582+0000","last_fullsized":"2024-02-15T23:31:20.644582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.644319+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:29.139495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.956377+0000","last_change":"2024-02-15T23:29:39.784076+0000","last_active":"2024-02-15T23:31:14.956377+0000","last_peered":"2024-02-15T23:31:14.956377+0000","last_clean":"2024-02-15T23:31:14.956377+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:31:14.956377+0000","last_undegraded":"2024-02-15T23:31:14.956377+0000","last_fullsized":"2024-02-15T23:31:14.956377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.687575+0000","last_change":"2024-02-15T23:31:39.687575+0000","last_active":"2024-02-15T23:31:39.687575+0000","last_peered":"2024-02-15T23:31:39.687575+0000","last_clean":"2024-02-15T23:31:39.687575+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:31:39.687575+0000","last_undegraded":"2024-02-15T23:31:39.687575+0000","last_fullsized":"2024-02-15T23:31:39.687575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.687336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:21.671965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.249440+0000","last_change":"2024-02-15T23:32:13.249521+0000","last_active":"2024-02-15T23:32:13.249440+0000","last_peered":"2024-02-15T23:32:13.249440+0000","last_clean":"2024-02-15T23:32:13.249440+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:32:13.249440+0000","last_undegraded":"2024-02-15T23:32:13.249440+0000","last_fullsized":"2024-02-15T23:32:13.249440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:13.249231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:13.249231+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.249231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:10:51.698632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.499881+0000","last_change":"2024-02-15T23:31:31.499881+0000","last_active":"2024-02-15T23:31:31.499881+0000","last_peered":"2024-02-15T23:31:31.499881+0000","last_clean":"2024-02-15T23:31:31.499881+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:31:31.499881+0000","last_undegraded":"2024-02-15T23:31:31.499881+0000","last_fullsized":"2024-02-15T23:31:31.499881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.499481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.621183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.287683+0000","last_change":"2024-02-15T23:31:47.287683+0000","last_active":"2024-02-15T23:31:47.287683+0000","last_peered":"2024-02-15T23:31:47.287683+0000","last_clean":"2024-02-15T23:31:47.287683+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:47.287683+0000","last_undegraded":"2024-02-15T23:31:47.287683+0000","last_fullsized":"2024-02-15T23:31:47.287683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-02-15T23:31:47.287351+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-02-15T23:31:47.287351+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.287351+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:28.564071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.657045+0000","last_change":"2024-02-15T23:31:21.657045+0000","last_active":"2024-02-15T23:31:21.657045+0000","last_peered":"2024-02-15T23:31:21.657045+0000","last_clean":"2024-02-15T23:31:21.657045+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:31:21.657045+0000","last_undegraded":"2024-02-15T23:31:21.657045+0000","last_fullsized":"2024-02-15T23:31:21.657045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.656809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:38.124016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.397706+0000","last_change":"2024-02-15T23:32:12.397767+0000","last_active":"2024-02-15T23:32:12.397706+0000","last_peered":"2024-02-15T23:32:12.397706+0000","last_clean":"2024-02-15T23:32:12.397706+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:32:12.397706+0000","last_undegraded":"2024-02-15T23:32:12.397706+0000","last_fullsized":"2024-02-15T23:32:12.397706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:12.397514+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:12.397514+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.397514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:14.468246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.760748+0000","last_change":"2024-02-15T23:32:09.760813+0000","last_active":"2024-02-15T23:32:09.760748+0000","last_peered":"2024-02-15T23:32:09.760748+0000","last_clean":"2024-02-15T23:32:09.760748+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:32:09.760748+0000","last_undegraded":"2024-02-15T23:32:09.760748+0000","last_fullsized":"2024-02-15T23:32:09.760748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:09.760563+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:09.760563+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.760563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:25.177173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.471453+0000","last_change":"2024-02-15T23:32:01.471535+0000","last_active":"2024-02-15T23:32:01.471453+0000","last_peered":"2024-02-15T23:32:01.471453+0000","last_clean":"2024-02-15T23:32:01.471453+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:32:01.471453+0000","last_undegraded":"2024-02-15T23:32:01.471453+0000","last_fullsized":"2024-02-15T23:32:01.471453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:01.471256+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:01.471256+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.471256+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:37.525983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.636155+0000","last_change":"2024-02-15T23:31:33.636155+0000","last_active":"2024-02-15T23:31:33.636155+0000","last_peered":"2024-02-15T23:31:33.636155+0000","last_clean":"2024-02-15T23:31:33.636155+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:31:33.636155+0000","last_undegraded":"2024-02-15T23:31:33.636155+0000","last_fullsized":"2024-02-15T23:31:33.636155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.635864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:47.730744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.407975+0000","last_change":"2024-02-15T23:31:24.407975+0000","last_active":"2024-02-15T23:31:24.407975+0000","last_peered":"2024-02-15T23:31:24.407975+0000","last_clean":"2024-02-15T23:31:24.407975+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:24.407975+0000","last_undegraded":"2024-02-15T23:31:24.407975+0000","last_fullsized":"2024-02-15T23:31:24.407975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.407715+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:36.649762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.276712+0000","last_change":"2024-02-15T23:31:48.276712+0000","last_active":"2024-02-15T23:31:48.276712+0000","last_peered":"2024-02-15T23:31:48.276712+0000","last_clean":"2024-02-15T23:31:48.276712+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:31:48.276712+0000","last_undegraded":"2024-02-15T23:31:48.276712+0000","last_fullsized":"2024-02-15T23:31:48.276712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:48.276447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:48.276447+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.276447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:14:35.402031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316951+0000","last_change":"2024-02-15T23:29:39.775394+0000","last_active":"2024-02-15T23:31:16.316951+0000","last_peered":"2024-02-15T23:31:16.316951+0000","last_clean":"2024-02-15T23:31:16.316951+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:31:16.316951+0000","last_undegraded":"2024-02-15T23:31:16.316951+0000","last_fullsized":"2024-02-15T23:31:16.316951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.404343+0000","last_change":"2024-02-15T23:31:27.404343+0000","last_active":"2024-02-15T23:31:27.404343+0000","last_peered":"2024-02-15T23:31:27.404343+0000","last_clean":"2024-02-15T23:31:27.404343+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:31:27.404343+0000","last_undegraded":"2024-02-15T23:31:27.404343+0000","last_fullsized":"2024-02-15T23:31:27.404343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.404065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:04.056272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314454+0000","last_change":"2024-02-15T23:29:29.725808+0000","last_active":"2024-02-15T23:31:16.314454+0000","last_peered":"2024-02-15T23:31:16.314454+0000","last_clean":"2024-02-15T23:31:16.314454+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:31:16.314454+0000","last_undegraded":"2024-02-15T23:31:16.314454+0000","last_fullsized":"2024-02-15T23:31:16.314454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.466268+0000","last_change":"2024-02-15T23:31:38.466268+0000","last_active":"2024-02-15T23:31:38.466268+0000","last_peered":"2024-02-15T23:31:38.466268+0000","last_clean":"2024-02-15T23:31:38.466268+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:31:38.466268+0000","last_undegraded":"2024-02-15T23:31:38.466268+0000","last_fullsized":"2024-02-15T23:31:38.466268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:38.466027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:38.466027+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.466027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:12.976124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.812184+0000","last_change":"2024-02-15T23:31:27.812184+0000","last_active":"2024-02-15T23:31:27.812184+0000","last_peered":"2024-02-15T23:31:27.812184+0000","last_clean":"2024-02-15T23:31:27.812184+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:31:27.812184+0000","last_undegraded":"2024-02-15T23:31:27.812184+0000","last_fullsized":"2024-02-15T23:31:27.812184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.812031+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:53.640763+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":345,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.837313+0000","last_change":"2024-02-15T23:31:18.837313+0000","last_active":"2024-02-15T23:31:18.837313+0000","last_peered":"2024-02-15T23:31:18.837313+0000","last_clean":"2024-02-15T23:31:18.837313+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:18.837313+0000","last_undegraded":"2024-02-15T23:31:18.837313+0000","last_fullsized":"2024-02-15T23:31:18.837313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.836996+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:26.809047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.437875+0000","last_change":"2024-02-15T23:31:44.437875+0000","last_active":"2024-02-15T23:31:44.437875+0000","last_peered":"2024-02-15T23:31:44.437875+0000","last_clean":"2024-02-15T23:31:44.437875+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:31:44.437875+0000","last_undegraded":"2024-02-15T23:31:44.437875+0000","last_fullsized":"2024-02-15T23:31:44.437875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:44.437626+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:44.437626+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.437626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:01.530419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.694509+0000","last_change":"2024-02-15T23:31:50.694563+0000","last_active":"2024-02-15T23:31:50.694509+0000","last_peered":"2024-02-15T23:31:50.694509+0000","last_clean":"2024-02-15T23:31:50.694509+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:31:50.694509+0000","last_undegraded":"2024-02-15T23:31:50.694509+0000","last_fullsized":"2024-02-15T23:31:50.694509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:50.694320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:50.694320+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.694320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:34.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.224812+0000","last_change":"2024-02-15T23:32:12.224902+0000","last_active":"2024-02-15T23:32:12.224812+0000","last_peered":"2024-02-15T23:32:12.224812+0000","last_clean":"2024-02-15T23:32:12.224812+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:32:12.224812+0000","last_undegraded":"2024-02-15T23:32:12.224812+0000","last_fullsized":"2024-02-15T23:32:12.224812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:12.224617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:12.224617+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.224617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:48:16.867139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.474688+0000","last_change":"2024-02-15T23:31:27.474688+0000","last_active":"2024-02-15T23:31:27.474688+0000","last_peered":"2024-02-15T23:31:27.474688+0000","last_clean":"2024-02-15T23:31:27.474688+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:27.474688+0000","last_undegraded":"2024-02-15T23:31:27.474688+0000","last_fullsized":"2024-02-15T23:31:27.474688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.474436+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.169933+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.325111+0000","last_change":"2024-02-15T23:31:43.325111+0000","last_active":"2024-02-15T23:31:43.325111+0000","last_peered":"2024-02-15T23:31:43.325111+0000","last_clean":"2024-02-15T23:31:43.325111+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:31:43.325111+0000","last_undegraded":"2024-02-15T23:31:43.325111+0000","last_fullsized":"2024-02-15T23:31:43.325111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:43.324799+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:43.324799+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.324799+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:21.930488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.408189+0000","last_change":"2024-02-15T23:31:16.408189+0000","last_active":"2024-02-15T23:31:16.408189+0000","last_peered":"2024-02-15T23:31:16.408189+0000","last_clean":"2024-02-15T23:31:16.408189+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:16.408189+0000","last_undegraded":"2024-02-15T23:31:16.408189+0000","last_fullsized":"2024-02-15T23:31:16.408189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.407927+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:42.842010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.684561+0000","last_change":"2024-02-15T23:31:32.684561+0000","last_active":"2024-02-15T23:31:32.684561+0000","last_peered":"2024-02-15T23:31:32.684561+0000","last_clean":"2024-02-15T23:31:32.684561+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:31:32.684561+0000","last_undegraded":"2024-02-15T23:31:32.684561+0000","last_fullsized":"2024-02-15T23:31:32.684561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.684302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:13.848320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.605287+0000","last_change":"2024-02-15T23:31:39.605287+0000","last_active":"2024-02-15T23:31:39.605287+0000","last_peered":"2024-02-15T23:31:39.605287+0000","last_clean":"2024-02-15T23:31:39.605287+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:31:39.605287+0000","last_undegraded":"2024-02-15T23:31:39.605287+0000","last_fullsized":"2024-02-15T23:31:39.605287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:39.605037+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:39.605037+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.605037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:46.637327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314455+0000","last_change":"2024-02-15T23:29:29.724689+0000","last_active":"2024-02-15T23:31:16.314455+0000","last_peered":"2024-02-15T23:31:16.314455+0000","last_clean":"2024-02-15T23:31:16.314455+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:31:16.314455+0000","last_undegraded":"2024-02-15T23:31:16.314455+0000","last_fullsized":"2024-02-15T23:31:16.314455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.443979+0000","last_change":"2024-02-15T23:31:16.443979+0000","last_active":"2024-02-15T23:31:16.443979+0000","last_peered":"2024-02-15T23:31:16.443979+0000","last_clean":"2024-02-15T23:31:16.443979+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:31:16.443979+0000","last_undegraded":"2024-02-15T23:31:16.443979+0000","last_fullsized":"2024-02-15T23:31:16.443979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.443730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:16:47.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.362479+0000","last_change":"2024-02-15T23:31:21.362479+0000","last_active":"2024-02-15T23:31:21.362479+0000","last_peered":"2024-02-15T23:31:21.362479+0000","last_clean":"2024-02-15T23:31:21.362479+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:31:21.362479+0000","last_undegraded":"2024-02-15T23:31:21.362479+0000","last_fullsized":"2024-02-15T23:31:21.362479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.362097+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:21.356365+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.792994+0000","last_change":"2024-02-15T23:31:24.792994+0000","last_active":"2024-02-15T23:31:24.792994+0000","last_peered":"2024-02-15T23:31:24.792994+0000","last_clean":"2024-02-15T23:31:24.792994+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:31:24.792994+0000","last_undegraded":"2024-02-15T23:31:24.792994+0000","last_fullsized":"2024-02-15T23:31:24.792994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.792712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:03:10.186879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.472926+0000","last_change":"2024-02-15T23:31:30.472926+0000","last_active":"2024-02-15T23:31:30.472926+0000","last_peered":"2024-02-15T23:31:30.472926+0000","last_clean":"2024-02-15T23:31:30.472926+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:31:30.472926+0000","last_undegraded":"2024-02-15T23:31:30.472926+0000","last_fullsized":"2024-02-15T23:31:30.472926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.472637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.285998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.502716+0000","last_change":"2024-02-15T23:31:31.502716+0000","last_active":"2024-02-15T23:31:31.502716+0000","last_peered":"2024-02-15T23:31:31.502716+0000","last_clean":"2024-02-15T23:31:31.502716+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:31:31.502716+0000","last_undegraded":"2024-02-15T23:31:31.502716+0000","last_fullsized":"2024-02-15T23:31:31.502716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.502461+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:37.162072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.499666+0000","last_change":"2024-02-15T23:32:00.499823+0000","last_active":"2024-02-15T23:32:00.499666+0000","last_peered":"2024-02-15T23:32:00.499666+0000","last_clean":"2024-02-15T23:32:00.499666+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:32:00.499666+0000","last_undegraded":"2024-02-15T23:32:00.499666+0000","last_fullsized":"2024-02-15T23:32:00.499666+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-15T23:32:00.499419+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-15T23:32:00.499419+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.499419+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:15.916028+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314216+0000","last_change":"2024-02-15T23:29:21.626096+0000","last_active":"2024-02-15T23:31:16.314216+0000","last_peered":"2024-02-15T23:31:16.314216+0000","last_clean":"2024-02-15T23:31:16.314216+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:31:16.314216+0000","last_undegraded":"2024-02-15T23:31:16.314216+0000","last_fullsized":"2024-02-15T23:31:16.314216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.209733+0000","last_change":"2024-02-15T23:32:14.209811+0000","last_active":"2024-02-15T23:32:14.209733+0000","last_peered":"2024-02-15T23:32:14.209733+0000","last_clean":"2024-02-15T23:32:14.209733+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:32:14.209733+0000","last_undegraded":"2024-02-15T23:32:14.209733+0000","last_fullsized":"2024-02-15T23:32:14.209733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:14.209520+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:14.209520+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.209520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:41.619949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.454296+0000","last_change":"2024-02-15T23:32:13.454356+0000","last_active":"2024-02-15T23:32:13.454296+0000","last_peered":"2024-02-15T23:32:13.454296+0000","last_clean":"2024-02-15T23:32:13.454296+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:32:13.454296+0000","last_undegraded":"2024-02-15T23:32:13.454296+0000","last_fullsized":"2024-02-15T23:32:13.454296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:13.454116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:13.454116+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.454116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:39.790818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.412677+0000","last_change":"2024-02-15T23:31:24.412677+0000","last_active":"2024-02-15T23:31:24.412677+0000","last_peered":"2024-02-15T23:31:24.412677+0000","last_clean":"2024-02-15T23:31:24.412677+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:24.412677+0000","last_undegraded":"2024-02-15T23:31:24.412677+0000","last_fullsized":"2024-02-15T23:31:24.412677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.412389+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:34.534030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.511629+0000","last_change":"2024-02-15T23:31:28.511629+0000","last_active":"2024-02-15T23:31:28.511629+0000","last_peered":"2024-02-15T23:31:28.511629+0000","last_clean":"2024-02-15T23:31:28.511629+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:31:28.511629+0000","last_undegraded":"2024-02-15T23:31:28.511629+0000","last_fullsized":"2024-02-15T23:31:28.511629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.511388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:40.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.745962+0000","last_change":"2024-02-15T23:32:03.746023+0000","last_active":"2024-02-15T23:32:03.745962+0000","last_peered":"2024-02-15T23:32:03.745962+0000","last_clean":"2024-02-15T23:32:03.745962+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:32:03.745962+0000","last_undegraded":"2024-02-15T23:32:03.745962+0000","last_fullsized":"2024-02-15T23:32:03.745962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-15T23:32:03.745738+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-15T23:32:03.745738+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.745738+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:51.152463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'14","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.249776+0000","last_change":"2024-02-15T23:31:51.249938+0000","last_active":"2024-02-15T23:31:51.249776+0000","last_peered":"2024-02-15T23:31:51.249776+0000","last_clean":"2024-02-15T23:31:51.249776+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:31:51.249776+0000","last_undegraded":"2024-02-15T23:31:51.249776+0000","last_fullsized":"2024-02-15T23:31:51.249776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:31:51.249530+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:31:51.249530+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.249530+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:17.586232+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314236+0000","last_change":"2024-02-15T23:29:21.624387+0000","last_active":"2024-02-15T23:31:16.314236+0000","last_peered":"2024-02-15T23:31:16.314236+0000","last_clean":"2024-02-15T23:31:16.314236+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:31:16.314236+0000","last_undegraded":"2024-02-15T23:31:16.314236+0000","last_fullsized":"2024-02-15T23:31:16.314236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.421539+0000","last_change":"2024-02-15T23:32:06.421606+0000","last_active":"2024-02-15T23:32:06.421539+0000","last_peered":"2024-02-15T23:32:06.421539+0000","last_clean":"2024-02-15T23:32:06.421539+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:32:06.421539+0000","last_undegraded":"2024-02-15T23:32:06.421539+0000","last_fullsized":"2024-02-15T23:32:06.421539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:06.421317+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:06.421317+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.421317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:50.686637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.399165+0000","last_change":"2024-02-15T23:31:20.399165+0000","last_active":"2024-02-15T23:31:20.399165+0000","last_peered":"2024-02-15T23:31:20.399165+0000","last_clean":"2024-02-15T23:31:20.399165+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:31:20.399165+0000","last_undegraded":"2024-02-15T23:31:20.399165+0000","last_fullsized":"2024-02-15T23:31:20.399165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.398920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:13.693335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.428280+0000","last_change":"2024-02-15T23:31:25.428280+0000","last_active":"2024-02-15T23:31:25.428280+0000","last_peered":"2024-02-15T23:31:25.428280+0000","last_clean":"2024-02-15T23:31:25.428280+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:25.428280+0000","last_undegraded":"2024-02-15T23:31:25.428280+0000","last_fullsized":"2024-02-15T23:31:25.428280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.427985+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:29.336924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.323076+0000","last_change":"2024-02-15T23:31:40.323076+0000","last_active":"2024-02-15T23:31:40.323076+0000","last_peered":"2024-02-15T23:31:40.323076+0000","last_clean":"2024-02-15T23:31:40.323076+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:31:40.323076+0000","last_undegraded":"2024-02-15T23:31:40.323076+0000","last_fullsized":"2024-02-15T23:31:40.323076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:40.322696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:40.322696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.322696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:29.911537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.473822+0000","last_change":"2024-02-15T23:32:10.473888+0000","last_active":"2024-02-15T23:32:10.473822+0000","last_peered":"2024-02-15T23:32:10.473822+0000","last_clean":"2024-02-15T23:32:10.473822+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:32:10.473822+0000","last_undegraded":"2024-02-15T23:32:10.473822+0000","last_fullsized":"2024-02-15T23:32:10.473822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-15T23:32:10.473639+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-15T23:32:10.473639+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.473639+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:20:01.304342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.339402+0000","last_change":"2024-02-15T23:31:54.339463+0000","last_active":"2024-02-15T23:31:54.339402+0000","last_peered":"2024-02-15T23:31:54.339402+0000","last_clean":"2024-02-15T23:31:54.339402+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:54.339402+0000","last_undegraded":"2024-02-15T23:31:54.339402+0000","last_fullsized":"2024-02-15T23:31:54.339402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:54.339211+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:54.339211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.339211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:41.745936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.686149+0000","last_change":"2024-02-15T23:31:54.686208+0000","last_active":"2024-02-15T23:31:54.686149+0000","last_peered":"2024-02-15T23:31:54.686149+0000","last_clean":"2024-02-15T23:31:54.686149+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:31:54.686149+0000","last_undegraded":"2024-02-15T23:31:54.686149+0000","last_fullsized":"2024-02-15T23:31:54.686149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:54.685949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:54.685949+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.685949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:41:39.731022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.352158+0000","last_change":"2024-02-15T23:31:55.352273+0000","last_active":"2024-02-15T23:31:55.352158+0000","last_peered":"2024-02-15T23:31:55.352158+0000","last_clean":"2024-02-15T23:31:55.352158+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:31:55.352158+0000","last_undegraded":"2024-02-15T23:31:55.352158+0000","last_fullsized":"2024-02-15T23:31:55.352158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.351912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.351912+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.351912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:30.889003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.696551+0000","last_change":"2024-02-15T23:31:35.696551+0000","last_active":"2024-02-15T23:31:35.696551+0000","last_peered":"2024-02-15T23:31:35.696551+0000","last_clean":"2024-02-15T23:31:35.696551+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:31:35.696551+0000","last_undegraded":"2024-02-15T23:31:35.696551+0000","last_fullsized":"2024-02-15T23:31:35.696551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:35.696295+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:35.696295+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.696295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:39.605234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.811746+0000","last_change":"2024-02-15T23:31:19.811746+0000","last_active":"2024-02-15T23:31:19.811746+0000","last_peered":"2024-02-15T23:31:19.811746+0000","last_clean":"2024-02-15T23:31:19.811746+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:19.811746+0000","last_undegraded":"2024-02-15T23:31:19.811746+0000","last_fullsized":"2024-02-15T23:31:19.811746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.811464+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:28:44.508275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.546516+0000","last_change":"2024-02-15T23:31:32.546516+0000","last_active":"2024-02-15T23:31:32.546516+0000","last_peered":"2024-02-15T23:31:32.546516+0000","last_clean":"2024-02-15T23:31:32.546516+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:31:32.546516+0000","last_undegraded":"2024-02-15T23:31:32.546516+0000","last_fullsized":"2024-02-15T23:31:32.546516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.546263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.575111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.114732+0000","last_change":"2024-02-15T23:32:04.114794+0000","last_active":"2024-02-15T23:32:04.114732+0000","last_peered":"2024-02-15T23:32:04.114732+0000","last_clean":"2024-02-15T23:32:04.114732+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:32:04.114732+0000","last_undegraded":"2024-02-15T23:32:04.114732+0000","last_fullsized":"2024-02-15T23:32:04.114732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.114516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.114516+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.114516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:17.701427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.467094+0000","last_change":"2024-02-15T23:31:48.467222+0000","last_active":"2024-02-15T23:31:48.467094+0000","last_peered":"2024-02-15T23:31:48.467094+0000","last_clean":"2024-02-15T23:31:48.467094+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:48.467094+0000","last_undegraded":"2024-02-15T23:31:48.467094+0000","last_fullsized":"2024-02-15T23:31:48.467094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:31:48.466864+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:31:48.466864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.466864+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:04:45.986887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314245+0000","last_change":"2024-02-15T23:29:21.622838+0000","last_active":"2024-02-15T23:31:16.314245+0000","last_peered":"2024-02-15T23:31:16.314245+0000","last_clean":"2024-02-15T23:31:16.314245+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:31:16.314245+0000","last_undegraded":"2024-02-15T23:31:16.314245+0000","last_fullsized":"2024-02-15T23:31:16.314245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.726468+0000","last_change":"2024-02-15T23:31:55.726530+0000","last_active":"2024-02-15T23:31:55.726468+0000","last_peered":"2024-02-15T23:31:55.726468+0000","last_clean":"2024-02-15T23:31:55.726468+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:31:55.726468+0000","last_undegraded":"2024-02-15T23:31:55.726468+0000","last_fullsized":"2024-02-15T23:31:55.726468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.726248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.726248+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.726248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:22:05.847889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.558062+0000","last_change":"2024-02-15T23:31:35.558062+0000","last_active":"2024-02-15T23:31:35.558062+0000","last_peered":"2024-02-15T23:31:35.558062+0000","last_clean":"2024-02-15T23:31:35.558062+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:31:35.558062+0000","last_undegraded":"2024-02-15T23:31:35.558062+0000","last_fullsized":"2024-02-15T23:31:35.558062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:35.557819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:35.557819+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.557819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:02.418349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.310142+0000","last_change":"2024-02-15T23:31:45.310142+0000","last_active":"2024-02-15T23:31:45.310142+0000","last_peered":"2024-02-15T23:31:45.310142+0000","last_clean":"2024-02-15T23:31:45.310142+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:31:45.310142+0000","last_undegraded":"2024-02-15T23:31:45.310142+0000","last_fullsized":"2024-02-15T23:31:45.310142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-02-15T23:31:45.309885+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-02-15T23:31:45.309885+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.309885+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:11.973068+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.153845+0000","last_change":"2024-02-15T23:31:56.153902+0000","last_active":"2024-02-15T23:31:56.153845+0000","last_peered":"2024-02-15T23:31:56.153845+0000","last_clean":"2024-02-15T23:31:56.153845+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:31:56.153845+0000","last_undegraded":"2024-02-15T23:31:56.153845+0000","last_fullsized":"2024-02-15T23:31:56.153845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.153647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.153647+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.153647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:46.068434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.560635+0000","last_change":"2024-02-15T23:31:38.560635+0000","last_active":"2024-02-15T23:31:38.560635+0000","last_peered":"2024-02-15T23:31:38.560635+0000","last_clean":"2024-02-15T23:31:38.560635+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:31:38.560635+0000","last_undegraded":"2024-02-15T23:31:38.560635+0000","last_fullsized":"2024-02-15T23:31:38.560635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:38.560266+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:38.560266+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.560266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:13.070363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'11","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.398196+0000","last_change":"2024-02-15T23:30:10.810101+0000","last_active":"2024-02-15T23:31:15.398196+0000","last_peered":"2024-02-15T23:31:15.398196+0000","last_clean":"2024-02-15T23:31:15.398196+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:31:15.398196+0000","last_undegraded":"2024-02-15T23:31:15.398196+0000","last_fullsized":"2024-02-15T23:31:15.398196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.640528+0000","last_change":"2024-02-15T23:31:43.640596+0000","last_active":"2024-02-15T23:31:43.640528+0000","last_peered":"2024-02-15T23:31:43.640528+0000","last_clean":"2024-02-15T23:31:43.640528+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:31:43.640528+0000","last_undegraded":"2024-02-15T23:31:43.640528+0000","last_fullsized":"2024-02-15T23:31:43.640528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:43.640321+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:43.640321+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.640321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:40.343283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.505031+0000","last_change":"2024-02-15T23:32:02.505191+0000","last_active":"2024-02-15T23:32:02.505031+0000","last_peered":"2024-02-15T23:32:02.505031+0000","last_clean":"2024-02-15T23:32:02.505031+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:32:02.505031+0000","last_undegraded":"2024-02-15T23:32:02.505031+0000","last_fullsized":"2024-02-15T23:32:02.505031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.504792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.504792+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.504792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:23.531981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.770444+0000","last_change":"2024-02-15T23:32:08.770494+0000","last_active":"2024-02-15T23:32:08.770444+0000","last_peered":"2024-02-15T23:32:08.770444+0000","last_clean":"2024-02-15T23:32:08.770444+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:32:08.770444+0000","last_undegraded":"2024-02-15T23:32:08.770444+0000","last_fullsized":"2024-02-15T23:32:08.770444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.770258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.770258+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.770258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:19.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.630125+0000","last_change":"2024-02-15T23:31:23.630125+0000","last_active":"2024-02-15T23:31:23.630125+0000","last_peered":"2024-02-15T23:31:23.630125+0000","last_clean":"2024-02-15T23:31:23.630125+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:23.630125+0000","last_undegraded":"2024-02-15T23:31:23.630125+0000","last_fullsized":"2024-02-15T23:31:23.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.629845+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:22:36.251662+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.871614+0000","last_change":"2024-02-15T23:31:17.871614+0000","last_active":"2024-02-15T23:31:17.871614+0000","last_peered":"2024-02-15T23:31:17.871614+0000","last_clean":"2024-02-15T23:31:17.871614+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:31:17.871614+0000","last_undegraded":"2024-02-15T23:31:17.871614+0000","last_fullsized":"2024-02-15T23:31:17.871614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.871335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:42.844132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.447006+0000","last_change":"2024-02-15T23:32:13.447073+0000","last_active":"2024-02-15T23:32:13.447006+0000","last_peered":"2024-02-15T23:32:13.447006+0000","last_clean":"2024-02-15T23:32:13.447006+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:32:13.447006+0000","last_undegraded":"2024-02-15T23:32:13.447006+0000","last_fullsized":"2024-02-15T23:32:13.447006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-15T23:32:13.446773+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-15T23:32:13.446773+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.446773+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:15.960783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.407689+0000","last_change":"2024-02-15T23:32:14.407742+0000","last_active":"2024-02-15T23:32:14.407689+0000","last_peered":"2024-02-15T23:32:14.407689+0000","last_clean":"2024-02-15T23:32:14.407689+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:32:14.407689+0000","last_undegraded":"2024-02-15T23:32:14.407689+0000","last_fullsized":"2024-02-15T23:32:14.407689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:14.407508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:14.407508+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.407508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:23:33.983637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.412837+0000","last_change":"2024-02-15T23:31:59.412907+0000","last_active":"2024-02-15T23:31:59.412837+0000","last_peered":"2024-02-15T23:31:59.412837+0000","last_clean":"2024-02-15T23:31:59.412837+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:31:59.412837+0000","last_undegraded":"2024-02-15T23:31:59.412837+0000","last_fullsized":"2024-02-15T23:31:59.412837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:59.412638+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.412638+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.412638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.093453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314230+0000","last_change":"2024-02-15T23:29:21.623482+0000","last_active":"2024-02-15T23:31:16.314230+0000","last_peered":"2024-02-15T23:31:16.314230+0000","last_clean":"2024-02-15T23:31:16.314230+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:31:16.314230+0000","last_undegraded":"2024-02-15T23:31:16.314230+0000","last_fullsized":"2024-02-15T23:31:16.314230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.396757+0000","last_change":"2024-02-15T23:31:17.396757+0000","last_active":"2024-02-15T23:31:17.396757+0000","last_peered":"2024-02-15T23:31:17.396757+0000","last_clean":"2024-02-15T23:31:17.396757+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:31:17.396757+0000","last_undegraded":"2024-02-15T23:31:17.396757+0000","last_fullsized":"2024-02-15T23:31:17.396757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.396500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:51.906597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.394229+0000","last_change":"2024-02-15T23:31:19.394229+0000","last_active":"2024-02-15T23:31:19.394229+0000","last_peered":"2024-02-15T23:31:19.394229+0000","last_clean":"2024-02-15T23:31:19.394229+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:31:19.394229+0000","last_undegraded":"2024-02-15T23:31:19.394229+0000","last_fullsized":"2024-02-15T23:31:19.394229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.393966+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:40.563671+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.413611+0000","last_change":"2024-02-15T23:31:15.413611+0000","last_active":"2024-02-15T23:31:15.413611+0000","last_peered":"2024-02-15T23:31:15.413611+0000","last_clean":"2024-02-15T23:31:15.413611+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:15.413611+0000","last_undegraded":"2024-02-15T23:31:15.413611+0000","last_fullsized":"2024-02-15T23:31:15.413611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.413363+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:05.337748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316755+0000","last_change":"2024-02-15T23:29:39.771638+0000","last_active":"2024-02-15T23:31:16.316755+0000","last_peered":"2024-02-15T23:31:16.316755+0000","last_clean":"2024-02-15T23:31:16.316755+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:31:16.316755+0000","last_undegraded":"2024-02-15T23:31:16.316755+0000","last_fullsized":"2024-02-15T23:31:16.316755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.069553+0000","last_change":"2024-02-15T23:32:01.069605+0000","last_active":"2024-02-15T23:32:01.069553+0000","last_peered":"2024-02-15T23:32:01.069553+0000","last_clean":"2024-02-15T23:32:01.069553+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:32:01.069553+0000","last_undegraded":"2024-02-15T23:32:01.069553+0000","last_fullsized":"2024-02-15T23:32:01.069553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:01.069355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:01.069355+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.069355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:53:55.098770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314457+0000","last_change":"2024-02-15T23:29:29.714312+0000","last_active":"2024-02-15T23:31:16.314457+0000","last_peered":"2024-02-15T23:31:16.314457+0000","last_clean":"2024-02-15T23:31:16.314457+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:31:16.314457+0000","last_undegraded":"2024-02-15T23:31:16.314457+0000","last_fullsized":"2024-02-15T23:31:16.314457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.466820+0000","last_change":"2024-02-15T23:32:03.466873+0000","last_active":"2024-02-15T23:32:03.466820+0000","last_peered":"2024-02-15T23:32:03.466820+0000","last_clean":"2024-02-15T23:32:03.466820+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:32:03.466820+0000","last_undegraded":"2024-02-15T23:32:03.466820+0000","last_fullsized":"2024-02-15T23:32:03.466820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:03.466625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:03.466625+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.466625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:03:37.334611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.405756+0000","last_change":"2024-02-15T23:31:21.405756+0000","last_active":"2024-02-15T23:31:21.405756+0000","last_peered":"2024-02-15T23:31:21.405756+0000","last_clean":"2024-02-15T23:31:21.405756+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:31:21.405756+0000","last_undegraded":"2024-02-15T23:31:21.405756+0000","last_fullsized":"2024-02-15T23:31:21.405756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.405364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:58.637097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.322259+0000","last_change":"2024-02-15T23:31:46.322334+0000","last_active":"2024-02-15T23:31:46.322259+0000","last_peered":"2024-02-15T23:31:46.322259+0000","last_clean":"2024-02-15T23:31:46.322259+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:31:46.322259+0000","last_undegraded":"2024-02-15T23:31:46.322259+0000","last_fullsized":"2024-02-15T23:31:46.322259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:46.322070+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:46.322070+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.322070+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:06.972017+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.594968+0000","last_change":"2024-02-15T23:31:19.594968+0000","last_active":"2024-02-15T23:31:19.594968+0000","last_peered":"2024-02-15T23:31:19.594968+0000","last_clean":"2024-02-15T23:31:19.594968+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:19.594968+0000","last_undegraded":"2024-02-15T23:31:19.594968+0000","last_fullsized":"2024-02-15T23:31:19.594968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.594660+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:58.295976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.544082+0000","last_change":"2024-02-15T23:31:34.544082+0000","last_active":"2024-02-15T23:31:34.544082+0000","last_peered":"2024-02-15T23:31:34.544082+0000","last_clean":"2024-02-15T23:31:34.544082+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:31:34.544082+0000","last_undegraded":"2024-02-15T23:31:34.544082+0000","last_fullsized":"2024-02-15T23:31:34.544082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.543832+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.512019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.664125+0000","last_change":"2024-02-15T23:31:52.664201+0000","last_active":"2024-02-15T23:31:52.664125+0000","last_peered":"2024-02-15T23:31:52.664125+0000","last_clean":"2024-02-15T23:31:52.664125+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:52.664125+0000","last_undegraded":"2024-02-15T23:31:52.664125+0000","last_fullsized":"2024-02-15T23:31:52.664125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-15T23:31:52.663884+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-15T23:31:52.663884+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.663884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:16.778950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.543481+0000","last_change":"2024-02-15T23:32:05.543539+0000","last_active":"2024-02-15T23:32:05.543481+0000","last_peered":"2024-02-15T23:32:05.543481+0000","last_clean":"2024-02-15T23:32:05.543481+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:32:05.543481+0000","last_undegraded":"2024-02-15T23:32:05.543481+0000","last_fullsized":"2024-02-15T23:32:05.543481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:05.543285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:05.543285+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.543285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:44.148974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314282+0000","last_change":"2024-02-15T23:29:21.797389+0000","last_active":"2024-02-15T23:31:16.314282+0000","last_peered":"2024-02-15T23:31:16.314282+0000","last_clean":"2024-02-15T23:31:16.314282+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:31:16.314282+0000","last_undegraded":"2024-02-15T23:31:16.314282+0000","last_fullsized":"2024-02-15T23:31:16.314282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:20.604678+0000","last_clean_scrub_stamp":"2024-02-15T23:29:20.604678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.386313+0000","last_change":"2024-02-15T23:31:26.386313+0000","last_active":"2024-02-15T23:31:26.386313+0000","last_peered":"2024-02-15T23:31:26.386313+0000","last_clean":"2024-02-15T23:31:26.386313+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:31:26.386313+0000","last_undegraded":"2024-02-15T23:31:26.386313+0000","last_fullsized":"2024-02-15T23:31:26.386313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.386074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:29.907866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.809672+0000","last_change":"2024-02-15T23:31:25.809672+0000","last_active":"2024-02-15T23:31:25.809672+0000","last_peered":"2024-02-15T23:31:25.809672+0000","last_clean":"2024-02-15T23:31:25.809672+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:25.809672+0000","last_undegraded":"2024-02-15T23:31:25.809672+0000","last_fullsized":"2024-02-15T23:31:25.809672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.809268+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:15.733653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.613362+0000","last_change":"2024-02-15T23:31:22.613362+0000","last_active":"2024-02-15T23:31:22.613362+0000","last_peered":"2024-02-15T23:31:22.613362+0000","last_clean":"2024-02-15T23:31:22.613362+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:31:22.613362+0000","last_undegraded":"2024-02-15T23:31:22.613362+0000","last_fullsized":"2024-02-15T23:31:22.613362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.613116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:43.072580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.746979+0000","last_change":"2024-02-15T23:32:06.747036+0000","last_active":"2024-02-15T23:32:06.746979+0000","last_peered":"2024-02-15T23:32:06.746979+0000","last_clean":"2024-02-15T23:32:06.746979+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:32:06.746979+0000","last_undegraded":"2024-02-15T23:32:06.746979+0000","last_fullsized":"2024-02-15T23:32:06.746979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.746779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.746779+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.746779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:12.595644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.745722+0000","last_change":"2024-02-15T23:32:04.745780+0000","last_active":"2024-02-15T23:32:04.745722+0000","last_peered":"2024-02-15T23:32:04.745722+0000","last_clean":"2024-02-15T23:32:04.745722+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:32:04.745722+0000","last_undegraded":"2024-02-15T23:32:04.745722+0000","last_fullsized":"2024-02-15T23:32:04.745722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.745496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.745496+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.745496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:40.282587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.692986+0000","last_change":"2024-02-15T23:31:48.692986+0000","last_active":"2024-02-15T23:31:48.692986+0000","last_peered":"2024-02-15T23:31:48.692986+0000","last_clean":"2024-02-15T23:31:48.692986+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:31:48.692986+0000","last_undegraded":"2024-02-15T23:31:48.692986+0000","last_fullsized":"2024-02-15T23:31:48.692986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:48.692708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:48.692708+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.692708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:23.202805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.113539+0000","last_change":"2024-02-15T23:32:06.113674+0000","last_active":"2024-02-15T23:32:06.113539+0000","last_peered":"2024-02-15T23:32:06.113539+0000","last_clean":"2024-02-15T23:32:06.113539+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:32:06.113539+0000","last_undegraded":"2024-02-15T23:32:06.113539+0000","last_fullsized":"2024-02-15T23:32:06.113539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.113292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.113292+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.113292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:49.153473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'3","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.544544+0000","last_change":"2024-02-15T23:31:35.544544+0000","last_active":"2024-02-15T23:31:35.544544+0000","last_peered":"2024-02-15T23:31:35.544544+0000","last_clean":"2024-02-15T23:31:35.544544+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:35.544544+0000","last_undegraded":"2024-02-15T23:31:35.544544+0000","last_fullsized":"2024-02-15T23:31:35.544544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:35.544287+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:35.544287+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.544287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:02.404817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.391356+0000","last_change":"2024-02-15T23:31:22.391356+0000","last_active":"2024-02-15T23:31:22.391356+0000","last_peered":"2024-02-15T23:31:22.391356+0000","last_clean":"2024-02-15T23:31:22.391356+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:31:22.391356+0000","last_undegraded":"2024-02-15T23:31:22.391356+0000","last_fullsized":"2024-02-15T23:31:22.391356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.391105+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:17.676736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.367893+0000","last_change":"2024-02-15T23:31:38.367893+0000","last_active":"2024-02-15T23:31:38.367893+0000","last_peered":"2024-02-15T23:31:38.367893+0000","last_clean":"2024-02-15T23:31:38.367893+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:31:38.367893+0000","last_undegraded":"2024-02-15T23:31:38.367893+0000","last_fullsized":"2024-02-15T23:31:38.367893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:38.367646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:38.367646+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.367646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:55.873044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.402060+0000","last_change":"2024-02-15T23:32:11.402116+0000","last_active":"2024-02-15T23:32:11.402060+0000","last_peered":"2024-02-15T23:32:11.402060+0000","last_clean":"2024-02-15T23:32:11.402060+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:32:11.402060+0000","last_undegraded":"2024-02-15T23:32:11.402060+0000","last_fullsized":"2024-02-15T23:32:11.402060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:11.401862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:11.401862+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.401862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:34.783625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.583056+0000","last_change":"2024-02-15T23:31:36.583056+0000","last_active":"2024-02-15T23:31:36.583056+0000","last_peered":"2024-02-15T23:31:36.583056+0000","last_clean":"2024-02-15T23:31:36.583056+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:31:36.583056+0000","last_undegraded":"2024-02-15T23:31:36.583056+0000","last_fullsized":"2024-02-15T23:31:36.583056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:36.582666+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:36.582666+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.582666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:45.901692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.734055+0000","last_change":"2024-02-15T23:31:59.734172+0000","last_active":"2024-02-15T23:31:59.734055+0000","last_peered":"2024-02-15T23:31:59.734055+0000","last_clean":"2024-02-15T23:31:59.734055+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:31:59.734055+0000","last_undegraded":"2024-02-15T23:31:59.734055+0000","last_fullsized":"2024-02-15T23:31:59.734055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:59.733761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:59.733761+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.733761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:12.574558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.359814+0000","last_change":"2024-02-15T23:31:25.359814+0000","last_active":"2024-02-15T23:31:25.359814+0000","last_peered":"2024-02-15T23:31:25.359814+0000","last_clean":"2024-02-15T23:31:25.359814+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:31:25.359814+0000","last_undegraded":"2024-02-15T23:31:25.359814+0000","last_fullsized":"2024-02-15T23:31:25.359814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.359571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:32.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.537676+0000","last_change":"2024-02-15T23:31:27.537676+0000","last_active":"2024-02-15T23:31:27.537676+0000","last_peered":"2024-02-15T23:31:27.537676+0000","last_clean":"2024-02-15T23:31:27.537676+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:31:27.537676+0000","last_undegraded":"2024-02-15T23:31:27.537676+0000","last_fullsized":"2024-02-15T23:31:27.537676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.537385+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.232882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.781906+0000","last_change":"2024-02-15T23:31:20.781906+0000","last_active":"2024-02-15T23:31:20.781906+0000","last_peered":"2024-02-15T23:31:20.781906+0000","last_clean":"2024-02-15T23:31:20.781906+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:31:20.781906+0000","last_undegraded":"2024-02-15T23:31:20.781906+0000","last_fullsized":"2024-02-15T23:31:20.781906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.781647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:41:14.417063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:14.956323+0000","last_change":"2024-02-15T23:29:39.783805+0000","last_active":"2024-02-15T23:31:14.956323+0000","last_peered":"2024-02-15T23:31:14.956323+0000","last_clean":"2024-02-15T23:31:14.956323+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:31:14.956323+0000","last_undegraded":"2024-02-15T23:31:14.956323+0000","last_fullsized":"2024-02-15T23:31:14.956323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.473112+0000","last_change":"2024-02-15T23:31:42.473112+0000","last_active":"2024-02-15T23:31:42.473112+0000","last_peered":"2024-02-15T23:31:42.473112+0000","last_clean":"2024-02-15T23:31:42.473112+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:31:42.473112+0000","last_undegraded":"2024-02-15T23:31:42.473112+0000","last_fullsized":"2024-02-15T23:31:42.473112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-15T23:31:42.472867+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-15T23:31:42.472867+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.472867+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:06.587933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.732380+0000","last_change":"2024-02-15T23:31:58.732520+0000","last_active":"2024-02-15T23:31:58.732380+0000","last_peered":"2024-02-15T23:31:58.732380+0000","last_clean":"2024-02-15T23:31:58.732380+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:31:58.732380+0000","last_undegraded":"2024-02-15T23:31:58.732380+0000","last_fullsized":"2024-02-15T23:31:58.732380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:58.732121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:58.732121+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.732121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:42:58.692459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.710546+0000","last_change":"2024-02-15T23:31:29.710546+0000","last_active":"2024-02-15T23:31:29.710546+0000","last_peered":"2024-02-15T23:31:29.710546+0000","last_clean":"2024-02-15T23:31:29.710546+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:31:29.710546+0000","last_undegraded":"2024-02-15T23:31:29.710546+0000","last_fullsized":"2024-02-15T23:31:29.710546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.710190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:50.879896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'43","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.526124+0000","last_change":"2024-02-15T23:31:26.526124+0000","last_active":"2024-02-15T23:31:26.526124+0000","last_peered":"2024-02-15T23:31:26.526124+0000","last_clean":"2024-02-15T23:31:26.526124+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:26.526124+0000","last_undegraded":"2024-02-15T23:31:26.526124+0000","last_fullsized":"2024-02-15T23:31:26.526124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.525844+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:36.827174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.360759+0000","last_change":"2024-02-15T23:31:17.360759+0000","last_active":"2024-02-15T23:31:17.360759+0000","last_peered":"2024-02-15T23:31:17.360759+0000","last_clean":"2024-02-15T23:31:17.360759+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:31:17.360759+0000","last_undegraded":"2024-02-15T23:31:17.360759+0000","last_fullsized":"2024-02-15T23:31:17.360759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.360411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.189143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316917+0000","last_change":"2024-02-15T23:29:39.784430+0000","last_active":"2024-02-15T23:31:16.316917+0000","last_peered":"2024-02-15T23:31:16.316917+0000","last_clean":"2024-02-15T23:31:16.316917+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:31:16.316917+0000","last_undegraded":"2024-02-15T23:31:16.316917+0000","last_fullsized":"2024-02-15T23:31:16.316917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'10","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.176987+0000","last_change":"2024-02-15T23:31:57.177054+0000","last_active":"2024-02-15T23:31:57.176987+0000","last_peered":"2024-02-15T23:31:57.176987+0000","last_clean":"2024-02-15T23:31:57.176987+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:31:57.176987+0000","last_undegraded":"2024-02-15T23:31:57.176987+0000","last_fullsized":"2024-02-15T23:31:57.176987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-15T23:31:57.176757+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-15T23:31:57.176757+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.176757+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:24.740746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.496349+0000","last_change":"2024-02-15T23:31:59.496531+0000","last_active":"2024-02-15T23:31:59.496349+0000","last_peered":"2024-02-15T23:31:59.496349+0000","last_clean":"2024-02-15T23:31:59.496349+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:31:59.496349+0000","last_undegraded":"2024-02-15T23:31:59.496349+0000","last_fullsized":"2024-02-15T23:31:59.496349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:59.496102+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.496102+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.496102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.176917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.372027+0000","last_change":"2024-02-15T23:31:18.372027+0000","last_active":"2024-02-15T23:31:18.372027+0000","last_peered":"2024-02-15T23:31:18.372027+0000","last_clean":"2024-02-15T23:31:18.372027+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:31:18.372027+0000","last_undegraded":"2024-02-15T23:31:18.372027+0000","last_fullsized":"2024-02-15T23:31:18.372027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.371701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:25.403990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.817387+0000","last_change":"2024-02-15T23:31:26.817387+0000","last_active":"2024-02-15T23:31:26.817387+0000","last_peered":"2024-02-15T23:31:26.817387+0000","last_clean":"2024-02-15T23:31:26.817387+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:31:26.817387+0000","last_undegraded":"2024-02-15T23:31:26.817387+0000","last_fullsized":"2024-02-15T23:31:26.817387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.817124+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:53.251206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.927965+0000","last_change":"2024-02-15T23:31:15.927965+0000","last_active":"2024-02-15T23:31:15.927965+0000","last_peered":"2024-02-15T23:31:15.927965+0000","last_clean":"2024-02-15T23:31:15.927965+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:31:15.927965+0000","last_undegraded":"2024-02-15T23:31:15.927965+0000","last_fullsized":"2024-02-15T23:31:15.927965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.927696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:57:32.034698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.455640+0000","last_change":"2024-02-15T23:31:35.455640+0000","last_active":"2024-02-15T23:31:35.455640+0000","last_peered":"2024-02-15T23:31:35.455640+0000","last_clean":"2024-02-15T23:31:35.455640+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:31:35.455640+0000","last_undegraded":"2024-02-15T23:31:35.455640+0000","last_fullsized":"2024-02-15T23:31:35.455640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:35.455367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:35.455367+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.455367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:32:41.304232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314694+0000","last_change":"2024-02-15T23:29:29.721645+0000","last_active":"2024-02-15T23:31:16.314694+0000","last_peered":"2024-02-15T23:31:16.314694+0000","last_clean":"2024-02-15T23:31:16.314694+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:31:16.314694+0000","last_undegraded":"2024-02-15T23:31:16.314694+0000","last_fullsized":"2024-02-15T23:31:16.314694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.533581+0000","last_change":"2024-02-15T23:31:34.533581+0000","last_active":"2024-02-15T23:31:34.533581+0000","last_peered":"2024-02-15T23:31:34.533581+0000","last_clean":"2024-02-15T23:31:34.533581+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:31:34.533581+0000","last_undegraded":"2024-02-15T23:31:34.533581+0000","last_fullsized":"2024-02-15T23:31:34.533581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.533297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.501484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.507799+0000","last_change":"2024-02-15T23:31:29.507799+0000","last_active":"2024-02-15T23:31:29.507799+0000","last_peered":"2024-02-15T23:31:29.507799+0000","last_clean":"2024-02-15T23:31:29.507799+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:29.507799+0000","last_undegraded":"2024-02-15T23:31:29.507799+0000","last_fullsized":"2024-02-15T23:31:29.507799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.507529+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.492158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.901594+0000","last_change":"2024-02-15T23:31:16.901594+0000","last_active":"2024-02-15T23:31:16.901594+0000","last_peered":"2024-02-15T23:31:16.901594+0000","last_clean":"2024-02-15T23:31:16.901594+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:31:16.901594+0000","last_undegraded":"2024-02-15T23:31:16.901594+0000","last_fullsized":"2024-02-15T23:31:16.901594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.901336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:01:50.745987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.397828+0000","last_change":"2024-02-15T23:32:14.397984+0000","last_active":"2024-02-15T23:32:14.397828+0000","last_peered":"2024-02-15T23:32:14.397828+0000","last_clean":"2024-02-15T23:32:14.397828+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:32:14.397828+0000","last_undegraded":"2024-02-15T23:32:14.397828+0000","last_fullsized":"2024-02-15T23:32:14.397828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:32:14.397617+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:32:14.397617+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.397617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:29.848259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.369161+0000","last_change":"2024-02-15T23:31:58.369287+0000","last_active":"2024-02-15T23:31:58.369161+0000","last_peered":"2024-02-15T23:31:58.369161+0000","last_clean":"2024-02-15T23:31:58.369161+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:31:58.369161+0000","last_undegraded":"2024-02-15T23:31:58.369161+0000","last_fullsized":"2024-02-15T23:31:58.369161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:58.368897+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:58.368897+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.368897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:34.625095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.461296+0000","last_change":"2024-02-15T23:31:55.461454+0000","last_active":"2024-02-15T23:31:55.461296+0000","last_peered":"2024-02-15T23:31:55.461296+0000","last_clean":"2024-02-15T23:31:55.461296+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:31:55.461296+0000","last_undegraded":"2024-02-15T23:31:55.461296+0000","last_fullsized":"2024-02-15T23:31:55.461296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.461068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.461068+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.461068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:30.998159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.651082+0000","last_change":"2024-02-15T23:31:34.651082+0000","last_active":"2024-02-15T23:31:34.651082+0000","last_peered":"2024-02-15T23:31:34.651082+0000","last_clean":"2024-02-15T23:31:34.651082+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:31:34.651082+0000","last_undegraded":"2024-02-15T23:31:34.651082+0000","last_fullsized":"2024-02-15T23:31:34.651082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.650808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.650808+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.650808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:46.892855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.445025+0000","last_change":"2024-02-15T23:31:28.445025+0000","last_active":"2024-02-15T23:31:28.445025+0000","last_peered":"2024-02-15T23:31:28.445025+0000","last_clean":"2024-02-15T23:31:28.445025+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:31:28.445025+0000","last_undegraded":"2024-02-15T23:31:28.445025+0000","last_fullsized":"2024-02-15T23:31:28.445025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.444726+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:09.360474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.369935+0000","last_change":"2024-02-15T23:31:22.369935+0000","last_active":"2024-02-15T23:31:22.369935+0000","last_peered":"2024-02-15T23:31:22.369935+0000","last_clean":"2024-02-15T23:31:22.369935+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:31:22.369935+0000","last_undegraded":"2024-02-15T23:31:22.369935+0000","last_fullsized":"2024-02-15T23:31:22.369935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.369655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:03.533673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.198053+0000","last_change":"2024-02-15T23:32:08.198105+0000","last_active":"2024-02-15T23:32:08.198053+0000","last_peered":"2024-02-15T23:32:08.198053+0000","last_clean":"2024-02-15T23:32:08.198053+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:32:08.198053+0000","last_undegraded":"2024-02-15T23:32:08.198053+0000","last_fullsized":"2024-02-15T23:32:08.198053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.197854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.197854+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.197854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:10.338610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.454965+0000","last_change":"2024-02-15T23:31:29.454965+0000","last_active":"2024-02-15T23:31:29.454965+0000","last_peered":"2024-02-15T23:31:29.454965+0000","last_clean":"2024-02-15T23:31:29.454965+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:29.454965+0000","last_undegraded":"2024-02-15T23:31:29.454965+0000","last_fullsized":"2024-02-15T23:31:29.454965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.454568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:03.856437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.509155+0000","last_change":"2024-02-15T23:32:01.509226+0000","last_active":"2024-02-15T23:32:01.509155+0000","last_peered":"2024-02-15T23:32:01.509155+0000","last_clean":"2024-02-15T23:32:01.509155+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:32:01.509155+0000","last_undegraded":"2024-02-15T23:32:01.509155+0000","last_fullsized":"2024-02-15T23:32:01.509155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:01.508935+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:01.508935+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.508935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:37.563662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.714462+0000","last_change":"2024-02-15T23:31:31.714462+0000","last_active":"2024-02-15T23:31:31.714462+0000","last_peered":"2024-02-15T23:31:31.714462+0000","last_clean":"2024-02-15T23:31:31.714462+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:31:31.714462+0000","last_undegraded":"2024-02-15T23:31:31.714462+0000","last_fullsized":"2024-02-15T23:31:31.714462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.714124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:31.708391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.561879+0000","last_change":"2024-02-15T23:31:25.561879+0000","last_active":"2024-02-15T23:31:25.561879+0000","last_peered":"2024-02-15T23:31:25.561879+0000","last_clean":"2024-02-15T23:31:25.561879+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:31:25.561879+0000","last_undegraded":"2024-02-15T23:31:25.561879+0000","last_fullsized":"2024-02-15T23:31:25.561879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.561617+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:41.337167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.529167+0000","last_change":"2024-02-15T23:31:36.529167+0000","last_active":"2024-02-15T23:31:36.529167+0000","last_peered":"2024-02-15T23:31:36.529167+0000","last_clean":"2024-02-15T23:31:36.529167+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:31:36.529167+0000","last_undegraded":"2024-02-15T23:31:36.529167+0000","last_fullsized":"2024-02-15T23:31:36.529167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:36.528916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:36.528916+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.528916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:45.847942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.066468+0000","last_change":"2024-02-15T23:32:00.066519+0000","last_active":"2024-02-15T23:32:00.066468+0000","last_peered":"2024-02-15T23:32:00.066468+0000","last_clean":"2024-02-15T23:32:00.066468+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:32:00.066468+0000","last_undegraded":"2024-02-15T23:32:00.066468+0000","last_fullsized":"2024-02-15T23:32:00.066468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:00.066277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:00.066277+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.066277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:06:03.264969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.440425+0000","last_change":"2024-02-15T23:31:50.440425+0000","last_active":"2024-02-15T23:31:50.440425+0000","last_peered":"2024-02-15T23:31:50.440425+0000","last_clean":"2024-02-15T23:31:50.440425+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:31:50.440425+0000","last_undegraded":"2024-02-15T23:31:50.440425+0000","last_fullsized":"2024-02-15T23:31:50.440425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:50.440173+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:50.440173+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.440173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:31.355921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.213365+0000","last_change":"2024-02-15T23:32:11.213514+0000","last_active":"2024-02-15T23:32:11.213365+0000","last_peered":"2024-02-15T23:32:11.213365+0000","last_clean":"2024-02-15T23:32:11.213365+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:32:11.213365+0000","last_undegraded":"2024-02-15T23:32:11.213365+0000","last_fullsized":"2024-02-15T23:32:11.213365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:11.213126+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:11.213126+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.213126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:06.414510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.554311+0000","last_change":"2024-02-15T23:31:33.554311+0000","last_active":"2024-02-15T23:31:33.554311+0000","last_peered":"2024-02-15T23:31:33.554311+0000","last_clean":"2024-02-15T23:31:33.554311+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:31:33.554311+0000","last_undegraded":"2024-02-15T23:31:33.554311+0000","last_fullsized":"2024-02-15T23:31:33.554311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.554047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.257009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.356251+0000","last_change":"2024-02-15T23:31:42.356344+0000","last_active":"2024-02-15T23:31:42.356251+0000","last_peered":"2024-02-15T23:31:42.356251+0000","last_clean":"2024-02-15T23:31:42.356251+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:31:42.356251+0000","last_undegraded":"2024-02-15T23:31:42.356251+0000","last_fullsized":"2024-02-15T23:31:42.356251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:42.356050+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:42.356050+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.356050+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:50.625885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.756163+0000","last_change":"2024-02-15T23:31:28.756163+0000","last_active":"2024-02-15T23:31:28.756163+0000","last_peered":"2024-02-15T23:31:28.756163+0000","last_clean":"2024-02-15T23:31:28.756163+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:28.756163+0000","last_undegraded":"2024-02-15T23:31:28.756163+0000","last_fullsized":"2024-02-15T23:31:28.756163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.755882+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:32.706979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316988+0000","last_change":"2024-02-15T23:29:39.775113+0000","last_active":"2024-02-15T23:31:16.316988+0000","last_peered":"2024-02-15T23:31:16.316988+0000","last_clean":"2024-02-15T23:31:16.316988+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:31:16.316988+0000","last_undegraded":"2024-02-15T23:31:16.316988+0000","last_fullsized":"2024-02-15T23:31:16.316988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.673550+0000","last_change":"2024-02-15T23:31:38.673550+0000","last_active":"2024-02-15T23:31:38.673550+0000","last_peered":"2024-02-15T23:31:38.673550+0000","last_clean":"2024-02-15T23:31:38.673550+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:31:38.673550+0000","last_undegraded":"2024-02-15T23:31:38.673550+0000","last_fullsized":"2024-02-15T23:31:38.673550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:38.673299+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:38.673299+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.673299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:50.183471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.513677+0000","last_change":"2024-02-15T23:32:07.513754+0000","last_active":"2024-02-15T23:32:07.513677+0000","last_peered":"2024-02-15T23:32:07.513677+0000","last_clean":"2024-02-15T23:32:07.513677+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:32:07.513677+0000","last_undegraded":"2024-02-15T23:32:07.513677+0000","last_fullsized":"2024-02-15T23:32:07.513677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:07.513457+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:07.513457+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.513457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:34.176641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.518612+0000","last_change":"2024-02-15T23:31:31.518612+0000","last_active":"2024-02-15T23:31:31.518612+0000","last_peered":"2024-02-15T23:31:31.518612+0000","last_clean":"2024-02-15T23:31:31.518612+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:31:31.518612+0000","last_undegraded":"2024-02-15T23:31:31.518612+0000","last_fullsized":"2024-02-15T23:31:31.518612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.518312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.640014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.423852+0000","last_change":"2024-02-15T23:31:23.423852+0000","last_active":"2024-02-15T23:31:23.423852+0000","last_peered":"2024-02-15T23:31:23.423852+0000","last_clean":"2024-02-15T23:31:23.423852+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:31:23.423852+0000","last_undegraded":"2024-02-15T23:31:23.423852+0000","last_fullsized":"2024-02-15T23:31:23.423852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.423607+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:37.518487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.569048+0000","last_change":"2024-02-15T23:31:15.569048+0000","last_active":"2024-02-15T23:31:15.569048+0000","last_peered":"2024-02-15T23:31:15.569048+0000","last_clean":"2024-02-15T23:31:15.569048+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:31:15.569048+0000","last_undegraded":"2024-02-15T23:31:15.569048+0000","last_fullsized":"2024-02-15T23:31:15.569048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.568926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:10.440118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.430515+0000","last_change":"2024-02-15T23:32:12.430573+0000","last_active":"2024-02-15T23:32:12.430515+0000","last_peered":"2024-02-15T23:32:12.430515+0000","last_clean":"2024-02-15T23:32:12.430515+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:32:12.430515+0000","last_undegraded":"2024-02-15T23:32:12.430515+0000","last_fullsized":"2024-02-15T23:32:12.430515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:12.430261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:12.430261+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.430261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:59.527661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.635470+0000","last_change":"2024-02-15T23:31:42.635470+0000","last_active":"2024-02-15T23:31:42.635470+0000","last_peered":"2024-02-15T23:31:42.635470+0000","last_clean":"2024-02-15T23:31:42.635470+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:31:42.635470+0000","last_undegraded":"2024-02-15T23:31:42.635470+0000","last_fullsized":"2024-02-15T23:31:42.635470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:42.635214+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:42.635214+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.635214+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:35.664062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.163523+0000","last_change":"2024-02-15T23:32:09.163607+0000","last_active":"2024-02-15T23:32:09.163523+0000","last_peered":"2024-02-15T23:32:09.163523+0000","last_clean":"2024-02-15T23:32:09.163523+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:32:09.163523+0000","last_undegraded":"2024-02-15T23:32:09.163523+0000","last_fullsized":"2024-02-15T23:32:09.163523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:09.163292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:09.163292+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.163292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:34.045146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.758567+0000","last_change":"2024-02-15T23:31:30.758567+0000","last_active":"2024-02-15T23:31:30.758567+0000","last_peered":"2024-02-15T23:31:30.758567+0000","last_clean":"2024-02-15T23:31:30.758567+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:31:30.758567+0000","last_undegraded":"2024-02-15T23:31:30.758567+0000","last_fullsized":"2024-02-15T23:31:30.758567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.758324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:34.432457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.549776+0000","last_change":"2024-02-15T23:31:30.549776+0000","last_active":"2024-02-15T23:31:30.549776+0000","last_peered":"2024-02-15T23:31:30.549776+0000","last_clean":"2024-02-15T23:31:30.549776+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:31:30.549776+0000","last_undegraded":"2024-02-15T23:31:30.549776+0000","last_fullsized":"2024-02-15T23:31:30.549776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.549503+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.362864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.350413+0000","last_change":"2024-02-15T23:31:39.350413+0000","last_active":"2024-02-15T23:31:39.350413+0000","last_peered":"2024-02-15T23:31:39.350413+0000","last_clean":"2024-02-15T23:31:39.350413+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:31:39.350413+0000","last_undegraded":"2024-02-15T23:31:39.350413+0000","last_fullsized":"2024-02-15T23:31:39.350413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.350163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.350163+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.350163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:00.377352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316924+0000","last_change":"2024-02-15T23:29:39.784125+0000","last_active":"2024-02-15T23:31:16.316924+0000","last_peered":"2024-02-15T23:31:16.316924+0000","last_clean":"2024-02-15T23:31:16.316924+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:31:16.316924+0000","last_undegraded":"2024-02-15T23:31:16.316924+0000","last_fullsized":"2024-02-15T23:31:16.316924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.116498+0000","last_change":"2024-02-15T23:32:02.116549+0000","last_active":"2024-02-15T23:32:02.116498+0000","last_peered":"2024-02-15T23:32:02.116498+0000","last_clean":"2024-02-15T23:32:02.116498+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:32:02.116498+0000","last_undegraded":"2024-02-15T23:32:02.116498+0000","last_fullsized":"2024-02-15T23:32:02.116498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.116301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.116301+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.116301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:40.094471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.391810+0000","last_change":"2024-02-15T23:31:57.391944+0000","last_active":"2024-02-15T23:31:57.391810+0000","last_peered":"2024-02-15T23:31:57.391810+0000","last_clean":"2024-02-15T23:31:57.391810+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:31:57.391810+0000","last_undegraded":"2024-02-15T23:31:57.391810+0000","last_fullsized":"2024-02-15T23:31:57.391810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:57.391581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:57.391581+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.391581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:03.240446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.436490+0000","last_change":"2024-02-15T23:31:28.436490+0000","last_active":"2024-02-15T23:31:28.436490+0000","last_peered":"2024-02-15T23:31:28.436490+0000","last_clean":"2024-02-15T23:31:28.436490+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:28.436490+0000","last_undegraded":"2024-02-15T23:31:28.436490+0000","last_fullsized":"2024-02-15T23:31:28.436490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.436171+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:39.946344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'28","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.362393+0000","last_change":"2024-02-15T23:31:41.362393+0000","last_active":"2024-02-15T23:31:41.362393+0000","last_peered":"2024-02-15T23:31:41.362393+0000","last_clean":"2024-02-15T23:31:41.362393+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:31:41.362393+0000","last_undegraded":"2024-02-15T23:31:41.362393+0000","last_fullsized":"2024-02-15T23:31:41.362393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-02-15T23:31:41.362130+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-02-15T23:31:41.362130+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.362130+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:58.292943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.335984+0000","last_change":"2024-02-15T23:31:44.335984+0000","last_active":"2024-02-15T23:31:44.335984+0000","last_peered":"2024-02-15T23:31:44.335984+0000","last_clean":"2024-02-15T23:31:44.335984+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:31:44.335984+0000","last_undegraded":"2024-02-15T23:31:44.335984+0000","last_fullsized":"2024-02-15T23:31:44.335984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:44.335687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:44.335687+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.335687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:23.592145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.317047+0000","last_change":"2024-02-15T23:29:39.784728+0000","last_active":"2024-02-15T23:31:16.317047+0000","last_peered":"2024-02-15T23:31:16.317047+0000","last_clean":"2024-02-15T23:31:16.317047+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:31:16.317047+0000","last_undegraded":"2024-02-15T23:31:16.317047+0000","last_fullsized":"2024-02-15T23:31:16.317047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.649753+0000","last_change":"2024-02-15T23:31:40.649753+0000","last_active":"2024-02-15T23:31:40.649753+0000","last_peered":"2024-02-15T23:31:40.649753+0000","last_clean":"2024-02-15T23:31:40.649753+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:31:40.649753+0000","last_undegraded":"2024-02-15T23:31:40.649753+0000","last_fullsized":"2024-02-15T23:31:40.649753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:40.649389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:40.649389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.649389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:48.462750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.522382+0000","last_change":"2024-02-15T23:32:02.522513+0000","last_active":"2024-02-15T23:32:02.522382+0000","last_peered":"2024-02-15T23:32:02.522382+0000","last_clean":"2024-02-15T23:32:02.522382+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:32:02.522382+0000","last_undegraded":"2024-02-15T23:32:02.522382+0000","last_fullsized":"2024-02-15T23:32:02.522382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.522145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.522145+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.522145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:23.549334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.519469+0000","last_change":"2024-02-15T23:31:32.519469+0000","last_active":"2024-02-15T23:31:32.519469+0000","last_peered":"2024-02-15T23:31:32.519469+0000","last_clean":"2024-02-15T23:31:32.519469+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:31:32.519469+0000","last_undegraded":"2024-02-15T23:31:32.519469+0000","last_fullsized":"2024-02-15T23:31:32.519469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.519211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.548059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.414372+0000","last_change":"2024-02-15T23:31:36.414372+0000","last_active":"2024-02-15T23:31:36.414372+0000","last_peered":"2024-02-15T23:31:36.414372+0000","last_clean":"2024-02-15T23:31:36.414372+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:36.414372+0000","last_undegraded":"2024-02-15T23:31:36.414372+0000","last_fullsized":"2024-02-15T23:31:36.414372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-15T23:31:36.414095+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-15T23:31:36.414095+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.414095+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:12.670293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.576932+0000","last_change":"2024-02-15T23:31:24.576932+0000","last_active":"2024-02-15T23:31:24.576932+0000","last_peered":"2024-02-15T23:31:24.576932+0000","last_clean":"2024-02-15T23:31:24.576932+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:31:24.576932+0000","last_undegraded":"2024-02-15T23:31:24.576932+0000","last_fullsized":"2024-02-15T23:31:24.576932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.576683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:19:16.045656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316862+0000","last_change":"2024-02-15T23:29:39.784447+0000","last_active":"2024-02-15T23:31:16.316862+0000","last_peered":"2024-02-15T23:31:16.316862+0000","last_clean":"2024-02-15T23:31:16.316862+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:31:16.316862+0000","last_undegraded":"2024-02-15T23:31:16.316862+0000","last_fullsized":"2024-02-15T23:31:16.316862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.577577+0000","last_change":"2024-02-15T23:31:37.577577+0000","last_active":"2024-02-15T23:31:37.577577+0000","last_peered":"2024-02-15T23:31:37.577577+0000","last_clean":"2024-02-15T23:31:37.577577+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:31:37.577577+0000","last_undegraded":"2024-02-15T23:31:37.577577+0000","last_fullsized":"2024-02-15T23:31:37.577577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.577323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.577323+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.577323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:59.138396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.666415+0000","last_change":"2024-02-15T23:31:45.666475+0000","last_active":"2024-02-15T23:31:45.666415+0000","last_peered":"2024-02-15T23:31:45.666415+0000","last_clean":"2024-02-15T23:31:45.666415+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:31:45.666415+0000","last_undegraded":"2024-02-15T23:31:45.666415+0000","last_fullsized":"2024-02-15T23:31:45.666415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:45.666217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:45.666217+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.666217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:12.526747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.471185+0000","last_change":"2024-02-15T23:31:46.471250+0000","last_active":"2024-02-15T23:31:46.471185+0000","last_peered":"2024-02-15T23:31:46.471185+0000","last_clean":"2024-02-15T23:31:46.471185+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:31:46.471185+0000","last_undegraded":"2024-02-15T23:31:46.471185+0000","last_fullsized":"2024-02-15T23:31:46.471185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:46.471000+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:46.471000+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.471000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:30:13.169741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.402015+0000","last_change":"2024-02-15T23:32:05.402093+0000","last_active":"2024-02-15T23:32:05.402015+0000","last_peered":"2024-02-15T23:32:05.402015+0000","last_clean":"2024-02-15T23:32:05.402015+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:32:05.402015+0000","last_undegraded":"2024-02-15T23:32:05.402015+0000","last_fullsized":"2024-02-15T23:32:05.402015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:05.401804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:05.401804+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.401804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:49:10.224674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.465414+0000","last_change":"2024-02-15T23:31:34.465414+0000","last_active":"2024-02-15T23:31:34.465414+0000","last_peered":"2024-02-15T23:31:34.465414+0000","last_clean":"2024-02-15T23:31:34.465414+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:34.465414+0000","last_undegraded":"2024-02-15T23:31:34.465414+0000","last_fullsized":"2024-02-15T23:31:34.465414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.465154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:45.028387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314669+0000","last_change":"2024-02-15T23:29:29.728191+0000","last_active":"2024-02-15T23:31:16.314669+0000","last_peered":"2024-02-15T23:31:16.314669+0000","last_clean":"2024-02-15T23:31:16.314669+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:31:16.314669+0000","last_undegraded":"2024-02-15T23:31:16.314669+0000","last_fullsized":"2024-02-15T23:31:16.314669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.429461+0000","last_change":"2024-02-15T23:31:52.429522+0000","last_active":"2024-02-15T23:31:52.429461+0000","last_peered":"2024-02-15T23:31:52.429461+0000","last_clean":"2024-02-15T23:31:52.429461+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:52.429461+0000","last_undegraded":"2024-02-15T23:31:52.429461+0000","last_fullsized":"2024-02-15T23:31:52.429461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:52.429268+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:52.429268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.429268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:34.192751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.442518+0000","last_change":"2024-02-15T23:32:04.442579+0000","last_active":"2024-02-15T23:32:04.442518+0000","last_peered":"2024-02-15T23:32:04.442518+0000","last_clean":"2024-02-15T23:32:04.442518+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:32:04.442518+0000","last_undegraded":"2024-02-15T23:32:04.442518+0000","last_fullsized":"2024-02-15T23:32:04.442518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.442322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.442322+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.442322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:12.712157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.431824+0000","last_change":"2024-02-15T23:31:43.431966+0000","last_active":"2024-02-15T23:31:43.431824+0000","last_peered":"2024-02-15T23:31:43.431824+0000","last_clean":"2024-02-15T23:31:43.431824+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:43.431824+0000","last_undegraded":"2024-02-15T23:31:43.431824+0000","last_fullsized":"2024-02-15T23:31:43.431824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:43.431598+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:43.431598+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.431598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:46.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.423709+0000","last_change":"2024-02-15T23:32:08.423847+0000","last_active":"2024-02-15T23:32:08.423709+0000","last_peered":"2024-02-15T23:32:08.423709+0000","last_clean":"2024-02-15T23:32:08.423709+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:32:08.423709+0000","last_undegraded":"2024-02-15T23:32:08.423709+0000","last_fullsized":"2024-02-15T23:32:08.423709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.423428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.423428+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.423428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:15.787731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.569475+0000","last_change":"2024-02-15T23:31:41.569613+0000","last_active":"2024-02-15T23:31:41.569475+0000","last_peered":"2024-02-15T23:31:41.569475+0000","last_clean":"2024-02-15T23:31:41.569475+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:31:41.569475+0000","last_undegraded":"2024-02-15T23:31:41.569475+0000","last_fullsized":"2024-02-15T23:31:41.569475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:41.569264+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:41.569264+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.569264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:36.816368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.460098+0000","last_change":"2024-02-15T23:31:53.460237+0000","last_active":"2024-02-15T23:31:53.460098+0000","last_peered":"2024-02-15T23:31:53.460098+0000","last_clean":"2024-02-15T23:31:53.460098+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:31:53.460098+0000","last_undegraded":"2024-02-15T23:31:53.460098+0000","last_fullsized":"2024-02-15T23:31:53.460098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.459858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.459858+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.459858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:59.119468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.381192+0000","last_change":"2024-02-15T23:31:56.381291+0000","last_active":"2024-02-15T23:31:56.381192+0000","last_peered":"2024-02-15T23:31:56.381192+0000","last_clean":"2024-02-15T23:31:56.381192+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:31:56.381192+0000","last_undegraded":"2024-02-15T23:31:56.381192+0000","last_fullsized":"2024-02-15T23:31:56.381192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.380971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.380971+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.380971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:06.944204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.669309+0000","last_change":"2024-02-15T23:31:47.669477+0000","last_active":"2024-02-15T23:31:47.669309+0000","last_peered":"2024-02-15T23:31:47.669309+0000","last_clean":"2024-02-15T23:31:47.669309+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:31:47.669309+0000","last_undegraded":"2024-02-15T23:31:47.669309+0000","last_fullsized":"2024-02-15T23:31:47.669309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:47.669042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:47.669042+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.669042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:58:09.230115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.507539+0000","last_change":"2024-02-15T23:31:54.507596+0000","last_active":"2024-02-15T23:31:54.507539+0000","last_peered":"2024-02-15T23:31:54.507539+0000","last_clean":"2024-02-15T23:31:54.507539+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:54.507539+0000","last_undegraded":"2024-02-15T23:31:54.507539+0000","last_fullsized":"2024-02-15T23:31:54.507539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:54.507342+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:54.507342+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.507342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:41.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.450623+0000","last_change":"2024-02-15T23:32:07.450688+0000","last_active":"2024-02-15T23:32:07.450623+0000","last_peered":"2024-02-15T23:32:07.450623+0000","last_clean":"2024-02-15T23:32:07.450623+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:32:07.450623+0000","last_undegraded":"2024-02-15T23:32:07.450623+0000","last_fullsized":"2024-02-15T23:32:07.450623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.450435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.450435+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.450435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:34.113619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.530211+0000","last_change":"2024-02-15T23:31:45.530211+0000","last_active":"2024-02-15T23:31:45.530211+0000","last_peered":"2024-02-15T23:31:45.530211+0000","last_clean":"2024-02-15T23:31:45.530211+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:31:45.530211+0000","last_undegraded":"2024-02-15T23:31:45.530211+0000","last_fullsized":"2024-02-15T23:31:45.530211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:45.529928+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:45.529928+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.529928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:15.937262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314943+0000","last_change":"2024-02-15T23:29:29.716896+0000","last_active":"2024-02-15T23:31:16.314943+0000","last_peered":"2024-02-15T23:31:16.314943+0000","last_clean":"2024-02-15T23:31:16.314943+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:31:16.314943+0000","last_undegraded":"2024-02-15T23:31:16.314943+0000","last_fullsized":"2024-02-15T23:31:16.314943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:30:15.780011+0000","last_change":"2024-02-15T23:30:10.793574+0000","last_active":"2024-02-15T23:30:15.780011+0000","last_peered":"2024-02-15T23:30:15.780011+0000","last_clean":"2024-02-15T23:30:15.780011+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:30:15.780011+0000","last_undegraded":"2024-02-15T23:30:15.780011+0000","last_fullsized":"2024-02-15T23:30:15.780011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:30.655288+0000","last_clean_scrub_stamp":"2024-02-15T23:29:30.655288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.388509+0000","last_change":"2024-02-15T23:31:53.388574+0000","last_active":"2024-02-15T23:31:53.388509+0000","last_peered":"2024-02-15T23:31:53.388509+0000","last_clean":"2024-02-15T23:31:53.388509+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:31:53.388509+0000","last_undegraded":"2024-02-15T23:31:53.388509+0000","last_fullsized":"2024-02-15T23:31:53.388509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:53.388287+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:53.388287+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.388287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:38.067265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'22","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.424844+0000","last_change":"2024-02-15T23:31:41.424844+0000","last_active":"2024-02-15T23:31:41.424844+0000","last_peered":"2024-02-15T23:31:41.424844+0000","last_clean":"2024-02-15T23:31:41.424844+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:31:41.424844+0000","last_undegraded":"2024-02-15T23:31:41.424844+0000","last_fullsized":"2024-02-15T23:31:41.424844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-02-15T23:31:41.424484+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-02-15T23:31:41.424484+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.424484+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:46:22.213060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.485141+0000","last_change":"2024-02-15T23:31:49.485212+0000","last_active":"2024-02-15T23:31:49.485141+0000","last_peered":"2024-02-15T23:31:49.485141+0000","last_clean":"2024-02-15T23:31:49.485141+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:31:49.485141+0000","last_undegraded":"2024-02-15T23:31:49.485141+0000","last_fullsized":"2024-02-15T23:31:49.485141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.484951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.484951+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.484951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:26.137159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.421836+0000","last_change":"2024-02-15T23:31:56.421894+0000","last_active":"2024-02-15T23:31:56.421836+0000","last_peered":"2024-02-15T23:31:56.421836+0000","last_clean":"2024-02-15T23:31:56.421836+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:31:56.421836+0000","last_undegraded":"2024-02-15T23:31:56.421836+0000","last_fullsized":"2024-02-15T23:31:56.421836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-02-15T23:31:56.421634+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-02-15T23:31:56.421634+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.421634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:06.984867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.517512+0000","last_change":"2024-02-15T23:32:06.517569+0000","last_active":"2024-02-15T23:32:06.517512+0000","last_peered":"2024-02-15T23:32:06.517512+0000","last_clean":"2024-02-15T23:32:06.517512+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:32:06.517512+0000","last_undegraded":"2024-02-15T23:32:06.517512+0000","last_fullsized":"2024-02-15T23:32:06.517512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.517319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.517319+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.517319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:50.782638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.514883+0000","last_change":"2024-02-15T23:31:43.514883+0000","last_active":"2024-02-15T23:31:43.514883+0000","last_peered":"2024-02-15T23:31:43.514883+0000","last_clean":"2024-02-15T23:31:43.514883+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:31:43.514883+0000","last_undegraded":"2024-02-15T23:31:43.514883+0000","last_fullsized":"2024-02-15T23:31:43.514883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:43.514514+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:43.514514+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.514514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:46.279795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314816+0000","last_change":"2024-02-15T23:29:29.714331+0000","last_active":"2024-02-15T23:31:16.314816+0000","last_peered":"2024-02-15T23:31:16.314816+0000","last_clean":"2024-02-15T23:31:16.314816+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:31:16.314816+0000","last_undegraded":"2024-02-15T23:31:16.314816+0000","last_fullsized":"2024-02-15T23:31:16.314816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.498328+0000","last_change":"2024-02-15T23:31:46.498328+0000","last_active":"2024-02-15T23:31:46.498328+0000","last_peered":"2024-02-15T23:31:46.498328+0000","last_clean":"2024-02-15T23:31:46.498328+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:31:46.498328+0000","last_undegraded":"2024-02-15T23:31:46.498328+0000","last_fullsized":"2024-02-15T23:31:46.498328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:46.497968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:46.497968+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.497968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:56.619609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.165564+0000","last_change":"2024-02-15T23:32:10.165630+0000","last_active":"2024-02-15T23:32:10.165564+0000","last_peered":"2024-02-15T23:32:10.165564+0000","last_clean":"2024-02-15T23:32:10.165564+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:32:10.165564+0000","last_undegraded":"2024-02-15T23:32:10.165564+0000","last_fullsized":"2024-02-15T23:32:10.165564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:10.165366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:10.165366+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.165366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:14:02.611190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.165422+0000","last_change":"2024-02-15T23:32:05.165483+0000","last_active":"2024-02-15T23:32:05.165422+0000","last_peered":"2024-02-15T23:32:05.165422+0000","last_clean":"2024-02-15T23:32:05.165422+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:32:05.165422+0000","last_undegraded":"2024-02-15T23:32:05.165422+0000","last_fullsized":"2024-02-15T23:32:05.165422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:05.165244+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:05.165244+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.165244+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:35:12.231397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.663850+0000","last_change":"2024-02-15T23:31:51.663905+0000","last_active":"2024-02-15T23:31:51.663850+0000","last_peered":"2024-02-15T23:31:51.663850+0000","last_clean":"2024-02-15T23:31:51.663850+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:31:51.663850+0000","last_undegraded":"2024-02-15T23:31:51.663850+0000","last_fullsized":"2024-02-15T23:31:51.663850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:51.663652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:51.663652+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.663652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:46:32.452228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.523615+0000","last_change":"2024-02-15T23:31:58.523763+0000","last_active":"2024-02-15T23:31:58.523615+0000","last_peered":"2024-02-15T23:31:58.523615+0000","last_clean":"2024-02-15T23:31:58.523615+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:31:58.523615+0000","last_undegraded":"2024-02-15T23:31:58.523615+0000","last_fullsized":"2024-02-15T23:31:58.523615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:58.523409+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:58.523409+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.523409+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:34.779607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.314839+0000","last_change":"2024-02-15T23:29:29.714026+0000","last_active":"2024-02-15T23:31:16.314839+0000","last_peered":"2024-02-15T23:31:16.314839+0000","last_clean":"2024-02-15T23:31:16.314839+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:31:16.314839+0000","last_undegraded":"2024-02-15T23:31:16.314839+0000","last_fullsized":"2024-02-15T23:31:16.314839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.315060+0000","last_change":"2024-02-15T23:29:29.714394+0000","last_active":"2024-02-15T23:31:16.315060+0000","last_peered":"2024-02-15T23:31:16.315060+0000","last_clean":"2024-02-15T23:31:16.315060+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:31:16.315060+0000","last_undegraded":"2024-02-15T23:31:16.315060+0000","last_fullsized":"2024-02-15T23:31:16.315060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:28.638433+0000","last_clean_scrub_stamp":"2024-02-15T23:29:28.638433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.421684+0000","last_change":"2024-02-15T23:32:00.421747+0000","last_active":"2024-02-15T23:32:00.421684+0000","last_peered":"2024-02-15T23:32:00.421684+0000","last_clean":"2024-02-15T23:32:00.421684+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:32:00.421684+0000","last_undegraded":"2024-02-15T23:32:00.421684+0000","last_fullsized":"2024-02-15T23:32:00.421684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:00.421498+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:00.421498+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.421498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:15.838107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.405622+0000","last_change":"2024-02-15T23:32:09.405767+0000","last_active":"2024-02-15T23:32:09.405622+0000","last_peered":"2024-02-15T23:32:09.405622+0000","last_clean":"2024-02-15T23:32:09.405622+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:32:09.405622+0000","last_undegraded":"2024-02-15T23:32:09.405622+0000","last_fullsized":"2024-02-15T23:32:09.405622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:09.405404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:09.405404+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.405404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:42.824154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.574309+0000","last_change":"2024-02-15T23:31:40.574309+0000","last_active":"2024-02-15T23:31:40.574309+0000","last_peered":"2024-02-15T23:31:40.574309+0000","last_clean":"2024-02-15T23:31:40.574309+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:31:40.574309+0000","last_undegraded":"2024-02-15T23:31:40.574309+0000","last_fullsized":"2024-02-15T23:31:40.574309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:40.574041+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:40.574041+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.574041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:24.310993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705705,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.41599999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.76300000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.751,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.23100000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.78600000000000003,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Feb 15 23:31:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.26300000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.78600000000000003,"5min":1.103,"15min":1.103},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72899999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65200000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705703,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.55700000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81599999999999995,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.53400000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81699999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.753}]},{"osd":1,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56100000000000005,"15min":0.54000000000000004},"min":{"1min":0.48599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.73499999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.46899999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.68700000000000006,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.48599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.80900000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":2.452,"15min":2.452},"last":0.71299999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.38,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78400000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.68600000000000005,"15min":0.69499999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":1.036,"15min":1.036},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.246,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.80600000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Feb 15 23:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.82499999999999996,"5min":1.034,"15min":1.034},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.628,"15min":0.629},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.83799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63700000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88,"5min":1.24,"15min":1.24},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.746,"15min":0.751},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Feb 15 23:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.54500000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.745}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:32:17.929 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.930 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.930 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.930 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.931 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.931 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.931 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.932 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.932 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.932 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.932 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.933 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.933 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.933 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.933 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.934 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.934 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.934 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-15T23:29:20.604678+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=20, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.935 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.935 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.935 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.936 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.936 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.936 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.936 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.937 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.937 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.937 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-15T23:29:30.655288+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=30, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.937 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.938 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.938 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-15T23:29:28.638433+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:17.938 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T23:32:37.940 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:32:38.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.062+0000 7fd65e9c0640 1 Processor -- start 2024-02-15T23:32:38.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.062+0000 7fd65e9c0640 1 -- start start 2024-02-15T23:32:38.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.062+0000 7fd65e9c0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd658128d10 0x7fd6581290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:38.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd658095ee0 con 0x7fd65812bb20 2024-02-15T23:32:38.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd658095b30 con 0x7fd658128d10 2024-02-15T23:32:38.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd657fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd658128d10 0x7fd6581290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:38.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd6577fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd65812bb20 0x7fd65812bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:56658/0 (socket says 172.21.15.131:56658) 2024-02-15T23:32:38.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd6577fe640 1 -- 172.21.15.131:0/1108282159 learned_addr learned my addr 172.21.15.131:0/1108282159 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:32:38.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd657fff640 1 -- 172.21.15.131:0/1108282159 >> v1:172.21.15.131:6789/0 conn(0x7fd65812bb20 legacy=0x7fd65812bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:38.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd657fff640 1 -- 172.21.15.131:0/1108282159 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd658096320 con 0x7fd658128d10 2024-02-15T23:32:38.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd657fff640 1 --2- 172.21.15.131:0/1108282159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581290f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd648009d90 tx=0x7fd64801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505bf4c6c8d7ef8d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:38.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd656ffd640 1 -- 172.21.15.131:0/1108282159 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6480a56c0 con 0x7fd658128d10 2024-02-15T23:32:38.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd656ffd640 1 -- 172.21.15.131:0/1108282159 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6480a5820 con 0x7fd658128d10 2024-02-15T23:32:38.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd656ffd640 1 -- 172.21.15.131:0/1108282159 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6480a5ae0 con 0x7fd658128d10 2024-02-15T23:32:38.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 -- 172.21.15.131:0/1108282159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 msgr2=0x7fd6581290f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:38.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 --2- 172.21.15.131:0/1108282159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581290f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd648009d90 tx=0x7fd64801c950 comp rx=0 tx=0).stop 2024-02-15T23:32:38.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 -- 172.21.15.131:0/1108282159 shutdown_connections 2024-02-15T23:32:38.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 --2- 172.21.15.131:0/1108282159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581290f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:38.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 -- 172.21.15.131:0/1108282159 >> 172.21.15.131:0/1108282159 conn(0x7fd65809a2f0 msgr2=0x7fd65809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:32:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 -- 172.21.15.131:0/1108282159 shutdown_connections 2024-02-15T23:32:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.066+0000 7fd65e9c0640 1 -- 172.21.15.131:0/1108282159 wait complete. 2024-02-15T23:32:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd65e9c0640 1 Processor -- start 2024-02-15T23:32:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd65e9c0640 1 -- start start 2024-02-15T23:32:38.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd65e9c0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:38.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd65e9c0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd658071970 con 0x7fd658128d10 2024-02-15T23:32:38.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd657fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:38.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd657fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57152/0 (socket says 172.21.15.131:57152) 2024-02-15T23:32:38.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd657fff640 1 -- 172.21.15.131:0/645469404 learned_addr learned my addr 172.21.15.131:0/645469404 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:32:38.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd657fff640 1 -- 172.21.15.131:0/645469404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd648009a70 con 0x7fd658128d10 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd657fff640 1 --2- 172.21.15.131:0/645469404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581c3ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd64801a580 tx=0x7fd6480196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd654ff9640 1 -- 172.21.15.131:0/645469404 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6480adab0 con 0x7fd658128d10 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd654ff9640 1 -- 172.21.15.131:0/645469404 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6480adc10 con 0x7fd658128d10 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd654ff9640 1 -- 172.21.15.131:0/645469404 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6480b9450 con 0x7fd658128d10 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65812cc70 con 0x7fd658128d10 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd658071650 con 0x7fd658128d10 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd658067e00 con 0x7fd658128d10 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd654ff9640 1 -- 172.21.15.131:0/645469404 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd6480b95b0 con 0x7fd658128d10 2024-02-15T23:32:38.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd654ff9640 1 --2- 172.21.15.131:0/645469404 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd6440359c0 0x7fd644037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:38.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd654ff9640 1 -- 172.21.15.131:0/645469404 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd6480e4380 con 0x7fd658128d10 2024-02-15T23:32:38.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.070+0000 7fd6577fe640 1 --2- 172.21.15.131:0/645469404 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd6440359c0 0x7fd644037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:38.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.074+0000 7fd6577fe640 1 --2- 172.21.15.131:0/645469404 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd6440359c0 0x7fd644037e80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd64c001610 tx=0x7fd64c007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:38.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.078+0000 7fd654ff9640 1 -- 172.21.15.131:0/645469404 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6480ac7b0 con 0x7fd658128d10 2024-02-15T23:32:38.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.238+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd658095170 con 0x7fd6440359c0 2024-02-15T23:32:38.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.286+0000 7fd654ff9640 1 -- 172.21.15.131:0/645469404 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673876 (secure 0 0 0) 0x7fd64c001300 con 0x7fd6440359c0 2024-02-15T23:32:38.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:32:38.303 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:32:38.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd6440359c0 msgr2=0x7fd644037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:38.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 --2- 172.21.15.131:0/645469404 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd6440359c0 0x7fd644037e80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd64c001610 tx=0x7fd64c007ad0 comp rx=0 tx=0).stop 2024-02-15T23:32:38.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 msgr2=0x7fd6581c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:38.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 --2- 172.21.15.131:0/645469404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581c3ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd64801a580 tx=0x7fd6480196f0 comp rx=0 tx=0).stop 2024-02-15T23:32:38.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 shutdown_connections 2024-02-15T23:32:38.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 --2- 172.21.15.131:0/645469404 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fd6440359c0 0x7fd644037e80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:38.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 --2- 172.21.15.131:0/645469404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd658128d10 0x7fd6581c3ac0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:38.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 >> 172.21.15.131:0/645469404 conn(0x7fd65809a2f0 msgr2=0x7fd658097170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:32:38.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 shutdown_connections 2024-02-15T23:32:38.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:38.294+0000 7fd65e9c0640 1 -- 172.21.15.131:0/645469404 wait complete. 2024-02-15T23:32:38.315 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-02-15T23:32:37.585994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3968,"ondisk_log_size":3968,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006699"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.668252+0000","last_change":"2024-02-15T23:31:53.668312+0000","last_active":"2024-02-15T23:31:53.668252+0000","last_peered":"2024-02-15T23:31:53.668252+0000","last_clean":"2024-02-15T23:31:53.668252+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:31:53.668252+0000","last_undegraded":"2024-02-15T23:31:53.668252+0000","last_fullsized":"2024-02-15T23:31:53.668252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.668051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.668051+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.668051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:56.433332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.499037+0000","last_change":"2024-02-15T23:31:52.499037+0000","last_active":"2024-02-15T23:31:52.499037+0000","last_peered":"2024-02-15T23:31:52.499037+0000","last_clean":"2024-02-15T23:31:52.499037+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:31:52.499037+0000","last_undegraded":"2024-02-15T23:31:52.499037+0000","last_fullsized":"2024-02-15T23:31:52.499037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:52.498705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:52.498705+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.498705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:34.262188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.419135+0000","last_change":"2024-02-15T23:31:49.419197+0000","last_active":"2024-02-15T23:31:49.419135+0000","last_peered":"2024-02-15T23:31:49.419135+0000","last_clean":"2024-02-15T23:31:49.419135+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:31:49.419135+0000","last_undegraded":"2024-02-15T23:31:49.419135+0000","last_fullsized":"2024-02-15T23:31:49.419135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.418938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.418938+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.418938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:26.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.093766+0000","last_change":"2024-02-15T23:31:59.093766+0000","last_active":"2024-02-15T23:31:59.093766+0000","last_peered":"2024-02-15T23:31:59.093766+0000","last_clean":"2024-02-15T23:31:59.093766+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:31:59.093766+0000","last_undegraded":"2024-02-15T23:31:59.093766+0000","last_fullsized":"2024-02-15T23:31:59.093766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:59.093513+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.093513+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.093513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:08:54.559676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:20.246671+0000","last_change":"2024-02-15T23:32:20.246741+0000","last_active":"2024-02-15T23:32:20.246671+0000","last_peered":"2024-02-15T23:32:20.246671+0000","last_clean":"2024-02-15T23:32:20.246671+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:32:20.246671+0000","last_undegraded":"2024-02-15T23:32:20.246671+0000","last_fullsized":"2024-02-15T23:32:20.246671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:20.246435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:20.246435+0000","last_clean_scrub_stamp":"2024-02-15T23:32:20.246435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:22:49.762005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.127896+0000","last_change":"2024-02-15T23:31:58.127896+0000","last_active":"2024-02-15T23:31:58.127896+0000","last_peered":"2024-02-15T23:31:58.127896+0000","last_clean":"2024-02-15T23:31:58.127896+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:31:58.127896+0000","last_undegraded":"2024-02-15T23:31:58.127896+0000","last_fullsized":"2024-02-15T23:31:58.127896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:58.127630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:58.127630+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.127630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:23:10.804456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.757267+0000","last_change":"2024-02-15T23:32:00.757326+0000","last_active":"2024-02-15T23:32:00.757267+0000","last_peered":"2024-02-15T23:32:00.757267+0000","last_clean":"2024-02-15T23:32:00.757267+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:32:00.757267+0000","last_undegraded":"2024-02-15T23:32:00.757267+0000","last_fullsized":"2024-02-15T23:32:00.757267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:00.757064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:00.757064+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.757064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:48:08.010450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.224937+0000","last_change":"2024-02-15T23:31:53.224937+0000","last_active":"2024-02-15T23:31:53.224937+0000","last_peered":"2024-02-15T23:31:53.224937+0000","last_clean":"2024-02-15T23:31:53.224937+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:31:53.224937+0000","last_undegraded":"2024-02-15T23:31:53.224937+0000","last_fullsized":"2024-02-15T23:31:53.224937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.224656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.224656+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.224656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:31.631150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:32.271255+0000","last_change":"2024-02-15T23:32:32.271334+0000","last_active":"2024-02-15T23:32:32.271255+0000","last_peered":"2024-02-15T23:32:32.271255+0000","last_clean":"2024-02-15T23:32:32.271255+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:32:32.271255+0000","last_undegraded":"2024-02-15T23:32:32.271255+0000","last_fullsized":"2024-02-15T23:32:32.271255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:32.271047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:32.271047+0000","last_clean_scrub_stamp":"2024-02-15T23:32:32.271047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:31.187683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.477578+0000","last_change":"2024-02-15T23:31:47.477646+0000","last_active":"2024-02-15T23:31:47.477578+0000","last_peered":"2024-02-15T23:31:47.477578+0000","last_clean":"2024-02-15T23:31:47.477578+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:47.477578+0000","last_undegraded":"2024-02-15T23:31:47.477578+0000","last_fullsized":"2024-02-15T23:31:47.477578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:47.477403+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:47.477403+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.477403+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:54.301986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.733100+0000","last_change":"2024-02-15T23:32:01.733158+0000","last_active":"2024-02-15T23:32:01.733100+0000","last_peered":"2024-02-15T23:32:01.733100+0000","last_clean":"2024-02-15T23:32:01.733100+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:32:01.733100+0000","last_undegraded":"2024-02-15T23:32:01.733100+0000","last_fullsized":"2024-02-15T23:32:01.733100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:01.732866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:01.732866+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.732866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:39.379554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.400579+0000","last_change":"2024-02-15T23:31:37.400579+0000","last_active":"2024-02-15T23:31:37.400579+0000","last_peered":"2024-02-15T23:31:37.400579+0000","last_clean":"2024-02-15T23:31:37.400579+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:31:37.400579+0000","last_undegraded":"2024-02-15T23:31:37.400579+0000","last_fullsized":"2024-02-15T23:31:37.400579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.400334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.400334+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.400334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:49:40.355253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:31.263987+0000","last_change":"2024-02-15T23:32:31.264051+0000","last_active":"2024-02-15T23:32:31.263987+0000","last_peered":"2024-02-15T23:32:31.263987+0000","last_clean":"2024-02-15T23:32:31.263987+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:32:31.263987+0000","last_undegraded":"2024-02-15T23:32:31.263987+0000","last_fullsized":"2024-02-15T23:32:31.263987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:31.263774+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:31.263774+0000","last_clean_scrub_stamp":"2024-02-15T23:32:31.263774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:36:48.334312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.635991+0000","last_change":"2024-02-15T23:31:44.636058+0000","last_active":"2024-02-15T23:31:44.635991+0000","last_peered":"2024-02-15T23:31:44.635991+0000","last_clean":"2024-02-15T23:31:44.635991+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:31:44.635991+0000","last_undegraded":"2024-02-15T23:31:44.635991+0000","last_fullsized":"2024-02-15T23:31:44.635991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-15T23:31:44.635777+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-15T23:31:44.635777+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.635777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:42.603964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.506217+0000","last_change":"2024-02-15T23:31:47.506217+0000","last_active":"2024-02-15T23:31:47.506217+0000","last_peered":"2024-02-15T23:31:47.506217+0000","last_clean":"2024-02-15T23:31:47.506217+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:31:47.506217+0000","last_undegraded":"2024-02-15T23:31:47.506217+0000","last_fullsized":"2024-02-15T23:31:47.506217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:47.505968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:47.505968+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.505968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:54.330551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.709654+0000","last_change":"2024-02-15T23:31:37.709654+0000","last_active":"2024-02-15T23:31:37.709654+0000","last_peered":"2024-02-15T23:31:37.709654+0000","last_clean":"2024-02-15T23:31:37.709654+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:31:37.709654+0000","last_undegraded":"2024-02-15T23:31:37.709654+0000","last_fullsized":"2024-02-15T23:31:37.709654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:37.709401+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:37.709401+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.709401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:33.404898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.070933+0000","last_change":"2024-02-15T23:32:03.070988+0000","last_active":"2024-02-15T23:32:03.070933+0000","last_peered":"2024-02-15T23:32:03.070933+0000","last_clean":"2024-02-15T23:32:03.070933+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:32:03.070933+0000","last_undegraded":"2024-02-15T23:32:03.070933+0000","last_fullsized":"2024-02-15T23:32:03.070933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:03.070745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:03.070745+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.070745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:50.320974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.545582+0000","last_change":"2024-02-15T23:32:03.545657+0000","last_active":"2024-02-15T23:32:03.545582+0000","last_peered":"2024-02-15T23:32:03.545582+0000","last_clean":"2024-02-15T23:32:03.545582+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:32:03.545582+0000","last_undegraded":"2024-02-15T23:32:03.545582+0000","last_fullsized":"2024-02-15T23:32:03.545582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:03.545376+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:03.545376+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.545376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:03:37.413362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.524000+0000","last_change":"2024-02-15T23:31:50.524000+0000","last_active":"2024-02-15T23:31:50.524000+0000","last_peered":"2024-02-15T23:31:50.524000+0000","last_clean":"2024-02-15T23:31:50.524000+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:31:50.524000+0000","last_undegraded":"2024-02-15T23:31:50.524000+0000","last_fullsized":"2024-02-15T23:31:50.524000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:50.523751+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:50.523751+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.523751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:31.439499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.662952+0000","last_change":"2024-02-15T23:31:41.662952+0000","last_active":"2024-02-15T23:31:41.662952+0000","last_peered":"2024-02-15T23:31:41.662952+0000","last_clean":"2024-02-15T23:31:41.662952+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:31:41.662952+0000","last_undegraded":"2024-02-15T23:31:41.662952+0000","last_fullsized":"2024-02-15T23:31:41.662952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:41.662713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:41.662713+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.662713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:16.784415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.471993+0000","last_change":"2024-02-15T23:31:48.471993+0000","last_active":"2024-02-15T23:31:48.471993+0000","last_peered":"2024-02-15T23:31:48.471993+0000","last_clean":"2024-02-15T23:31:48.471993+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:48.471993+0000","last_undegraded":"2024-02-15T23:31:48.471993+0000","last_fullsized":"2024-02-15T23:31:48.471993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:48.471732+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:48.471732+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.471732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:51.993523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.506627+0000","last_change":"2024-02-15T23:31:51.506627+0000","last_active":"2024-02-15T23:31:51.506627+0000","last_peered":"2024-02-15T23:31:51.506627+0000","last_clean":"2024-02-15T23:31:51.506627+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:31:51.506627+0000","last_undegraded":"2024-02-15T23:31:51.506627+0000","last_fullsized":"2024-02-15T23:31:51.506627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:51.506363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:51.506363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.506363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:25.908233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.453219+0000","last_change":"2024-02-15T23:31:45.453219+0000","last_active":"2024-02-15T23:31:45.453219+0000","last_peered":"2024-02-15T23:31:45.453219+0000","last_clean":"2024-02-15T23:31:45.453219+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:31:45.453219+0000","last_undegraded":"2024-02-15T23:31:45.453219+0000","last_fullsized":"2024-02-15T23:31:45.453219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:45.452811+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:45.452811+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.452811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:03.503688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.529592+0000","last_change":"2024-02-15T23:32:04.529655+0000","last_active":"2024-02-15T23:32:04.529592+0000","last_peered":"2024-02-15T23:32:04.529592+0000","last_clean":"2024-02-15T23:32:04.529592+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:32:04.529592+0000","last_undegraded":"2024-02-15T23:32:04.529592+0000","last_fullsized":"2024-02-15T23:32:04.529592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.529406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.529406+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.529406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:12.799241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.711628+0000","last_change":"2024-02-15T23:31:46.711628+0000","last_active":"2024-02-15T23:31:46.711628+0000","last_peered":"2024-02-15T23:31:46.711628+0000","last_clean":"2024-02-15T23:31:46.711628+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:31:46.711628+0000","last_undegraded":"2024-02-15T23:31:46.711628+0000","last_fullsized":"2024-02-15T23:31:46.711628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-02-15T23:31:46.711368+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-02-15T23:31:46.711368+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.711368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:56.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.478507+0000","last_change":"2024-02-15T23:31:51.478507+0000","last_active":"2024-02-15T23:31:51.478507+0000","last_peered":"2024-02-15T23:31:51.478507+0000","last_clean":"2024-02-15T23:31:51.478507+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:31:51.478507+0000","last_undegraded":"2024-02-15T23:31:51.478507+0000","last_fullsized":"2024-02-15T23:31:51.478507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:51.478248+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:51.478248+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.478248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:25.880117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.551340+0000","last_change":"2024-02-15T23:31:44.551340+0000","last_active":"2024-02-15T23:31:44.551340+0000","last_peered":"2024-02-15T23:31:44.551340+0000","last_clean":"2024-02-15T23:31:44.551340+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:31:44.551340+0000","last_undegraded":"2024-02-15T23:31:44.551340+0000","last_fullsized":"2024-02-15T23:31:44.551340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-02-15T23:31:44.551091+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-02-15T23:31:44.551091+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.551091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:41:29.596164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:15.220575+0000","last_change":"2024-02-15T23:32:15.220646+0000","last_active":"2024-02-15T23:32:15.220575+0000","last_peered":"2024-02-15T23:32:15.220575+0000","last_clean":"2024-02-15T23:32:15.220575+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:32:15.220575+0000","last_undegraded":"2024-02-15T23:32:15.220575+0000","last_fullsized":"2024-02-15T23:32:15.220575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:15.220373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:15.220373+0000","last_clean_scrub_stamp":"2024-02-15T23:32:15.220373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:18:06.499249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'18","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.562029+0000","last_change":"2024-02-15T23:31:42.562029+0000","last_active":"2024-02-15T23:31:42.562029+0000","last_peered":"2024-02-15T23:31:42.562029+0000","last_clean":"2024-02-15T23:31:42.562029+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:42.562029+0000","last_undegraded":"2024-02-15T23:31:42.562029+0000","last_fullsized":"2024-02-15T23:31:42.562029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-02-15T23:31:42.561648+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-02-15T23:31:42.561648+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.561648+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:06.676715+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.186119+0000","last_change":"2024-02-15T23:31:54.186119+0000","last_active":"2024-02-15T23:31:54.186119+0000","last_peered":"2024-02-15T23:31:54.186119+0000","last_clean":"2024-02-15T23:31:54.186119+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:31:54.186119+0000","last_undegraded":"2024-02-15T23:31:54.186119+0000","last_fullsized":"2024-02-15T23:31:54.186119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:54.185856+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:54.185856+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.185856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:06:08.657140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:33.316957+0000","last_change":"2024-02-15T23:32:33.317126+0000","last_active":"2024-02-15T23:32:33.316957+0000","last_peered":"2024-02-15T23:32:33.316957+0000","last_clean":"2024-02-15T23:32:33.316957+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:32:33.316957+0000","last_undegraded":"2024-02-15T23:32:33.316957+0000","last_fullsized":"2024-02-15T23:32:33.316957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:33.316699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:33.316699+0000","last_clean_scrub_stamp":"2024-02-15T23:32:33.316699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:12:01.748905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.381651+0000","last_change":"2024-02-15T23:31:23.381651+0000","last_active":"2024-02-15T23:31:23.381651+0000","last_peered":"2024-02-15T23:31:23.381651+0000","last_clean":"2024-02-15T23:31:23.381651+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:31:23.381651+0000","last_undegraded":"2024-02-15T23:31:23.381651+0000","last_fullsized":"2024-02-15T23:31:23.381651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.381406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:53.788740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.240923+0000","last_change":"2024-02-15T23:31:49.240923+0000","last_active":"2024-02-15T23:31:49.240923+0000","last_peered":"2024-02-15T23:31:49.240923+0000","last_clean":"2024-02-15T23:31:49.240923+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:31:49.240923+0000","last_undegraded":"2024-02-15T23:31:49.240923+0000","last_fullsized":"2024-02-15T23:31:49.240923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-15T23:31:49.240607+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-15T23:31:49.240607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.240607+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:27:40.630524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.464923+0000","last_change":"2024-02-15T23:31:26.464923+0000","last_active":"2024-02-15T23:31:26.464923+0000","last_peered":"2024-02-15T23:31:26.464923+0000","last_clean":"2024-02-15T23:31:26.464923+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:31:26.464923+0000","last_undegraded":"2024-02-15T23:31:26.464923+0000","last_fullsized":"2024-02-15T23:31:26.464923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.464676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:15.850726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.491181+0000","last_change":"2024-02-15T23:32:09.491239+0000","last_active":"2024-02-15T23:32:09.491181+0000","last_peered":"2024-02-15T23:32:09.491181+0000","last_clean":"2024-02-15T23:32:09.491181+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:32:09.491181+0000","last_undegraded":"2024-02-15T23:32:09.491181+0000","last_fullsized":"2024-02-15T23:32:09.491181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:09.490996+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:09.490996+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.490996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:50.767715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.462983+0000","last_change":"2024-02-15T23:31:33.462983+0000","last_active":"2024-02-15T23:31:33.462983+0000","last_peered":"2024-02-15T23:31:33.462983+0000","last_clean":"2024-02-15T23:31:33.462983+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:31:33.462983+0000","last_undegraded":"2024-02-15T23:31:33.462983+0000","last_fullsized":"2024-02-15T23:31:33.462983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.462731+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:08.999822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.713072+0000","last_change":"2024-02-15T23:31:56.713134+0000","last_active":"2024-02-15T23:31:56.713072+0000","last_peered":"2024-02-15T23:31:56.713072+0000","last_clean":"2024-02-15T23:31:56.713072+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:31:56.713072+0000","last_undegraded":"2024-02-15T23:31:56.713072+0000","last_fullsized":"2024-02-15T23:31:56.713072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.712850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.712850+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.712850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:06:56.264686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.492105+0000","last_change":"2024-02-15T23:31:39.492105+0000","last_active":"2024-02-15T23:31:39.492105+0000","last_peered":"2024-02-15T23:31:39.492105+0000","last_clean":"2024-02-15T23:31:39.492105+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:31:39.492105+0000","last_undegraded":"2024-02-15T23:31:39.492105+0000","last_fullsized":"2024-02-15T23:31:39.492105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.491862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.491862+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.491862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:46.524152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.354191+0000","last_change":"2024-02-15T23:31:20.354191+0000","last_active":"2024-02-15T23:31:20.354191+0000","last_peered":"2024-02-15T23:31:20.354191+0000","last_clean":"2024-02-15T23:31:20.354191+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:31:20.354191+0000","last_undegraded":"2024-02-15T23:31:20.354191+0000","last_fullsized":"2024-02-15T23:31:20.354191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.353944+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:24.028078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.362319+0000","last_change":"2024-02-15T23:31:18.362319+0000","last_active":"2024-02-15T23:31:18.362319+0000","last_peered":"2024-02-15T23:31:18.362319+0000","last_clean":"2024-02-15T23:31:18.362319+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:31:18.362319+0000","last_undegraded":"2024-02-15T23:31:18.362319+0000","last_fullsized":"2024-02-15T23:31:18.362319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.362075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.313172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.452261+0000","last_change":"2024-02-15T23:31:40.452261+0000","last_active":"2024-02-15T23:31:40.452261+0000","last_peered":"2024-02-15T23:31:40.452261+0000","last_clean":"2024-02-15T23:31:40.452261+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:31:40.452261+0000","last_undegraded":"2024-02-15T23:31:40.452261+0000","last_fullsized":"2024-02-15T23:31:40.452261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:40.452005+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:40.452005+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.452005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:24.188956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.236850+0000","last_change":"2024-02-15T23:31:50.236850+0000","last_active":"2024-02-15T23:31:50.236850+0000","last_peered":"2024-02-15T23:31:50.236850+0000","last_clean":"2024-02-15T23:31:50.236850+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:31:50.236850+0000","last_undegraded":"2024-02-15T23:31:50.236850+0000","last_fullsized":"2024-02-15T23:31:50.236850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:50.236582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:50.236582+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.236582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:37.333982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.154845+0000","last_change":"2024-02-15T23:32:07.154906+0000","last_active":"2024-02-15T23:32:07.154845+0000","last_peered":"2024-02-15T23:32:07.154845+0000","last_clean":"2024-02-15T23:32:07.154845+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:32:07.154845+0000","last_undegraded":"2024-02-15T23:32:07.154845+0000","last_fullsized":"2024-02-15T23:32:07.154845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.154654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.154654+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.154654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:44:01.539488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.526018+0000","last_change":"2024-02-15T23:31:33.526018+0000","last_active":"2024-02-15T23:31:33.526018+0000","last_peered":"2024-02-15T23:31:33.526018+0000","last_clean":"2024-02-15T23:31:33.526018+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:31:33.526018+0000","last_undegraded":"2024-02-15T23:31:33.526018+0000","last_fullsized":"2024-02-15T23:31:33.526018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.525754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.228715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.758890+0000","last_change":"2024-02-15T23:31:21.758890+0000","last_active":"2024-02-15T23:31:21.758890+0000","last_peered":"2024-02-15T23:31:21.758890+0000","last_clean":"2024-02-15T23:31:21.758890+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:31:21.758890+0000","last_undegraded":"2024-02-15T23:31:21.758890+0000","last_fullsized":"2024-02-15T23:31:21.758890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.758604+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:00:21.378855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.276965+0000","last_change":"2024-02-15T23:31:52.276965+0000","last_active":"2024-02-15T23:31:52.276965+0000","last_peered":"2024-02-15T23:31:52.276965+0000","last_clean":"2024-02-15T23:31:52.276965+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:52.276965+0000","last_undegraded":"2024-02-15T23:31:52.276965+0000","last_fullsized":"2024-02-15T23:31:52.276965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-15T23:31:52.276608+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-15T23:31:52.276608+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.276608+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:23:11.852737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.712221+0000","last_change":"2024-02-15T23:31:36.712221+0000","last_active":"2024-02-15T23:31:36.712221+0000","last_peered":"2024-02-15T23:31:36.712221+0000","last_clean":"2024-02-15T23:31:36.712221+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:31:36.712221+0000","last_undegraded":"2024-02-15T23:31:36.712221+0000","last_fullsized":"2024-02-15T23:31:36.712221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:36.711954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:36.711954+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.711954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:26.098004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.434830+0000","last_change":"2024-02-15T23:32:10.434925+0000","last_active":"2024-02-15T23:32:10.434830+0000","last_peered":"2024-02-15T23:32:10.434830+0000","last_clean":"2024-02-15T23:32:10.434830+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:32:10.434830+0000","last_undegraded":"2024-02-15T23:32:10.434830+0000","last_fullsized":"2024-02-15T23:32:10.434830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:10.434636+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:10.434636+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.434636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:14:57.560221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.472959+0000","last_change":"2024-02-15T23:31:57.473029+0000","last_active":"2024-02-15T23:31:57.472959+0000","last_peered":"2024-02-15T23:31:57.472959+0000","last_clean":"2024-02-15T23:31:57.472959+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:31:57.472959+0000","last_undegraded":"2024-02-15T23:31:57.472959+0000","last_fullsized":"2024-02-15T23:31:57.472959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:57.472748+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:57.472748+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.472748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:03.321613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.380202+0000","last_change":"2024-02-15T23:31:19.380202+0000","last_active":"2024-02-15T23:31:19.380202+0000","last_peered":"2024-02-15T23:31:19.380202+0000","last_clean":"2024-02-15T23:31:19.380202+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:31:19.380202+0000","last_undegraded":"2024-02-15T23:31:19.380202+0000","last_fullsized":"2024-02-15T23:31:19.380202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.379961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:22.107728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.801467+0000","last_change":"2024-02-15T23:31:23.801467+0000","last_active":"2024-02-15T23:31:23.801467+0000","last_peered":"2024-02-15T23:31:23.801467+0000","last_clean":"2024-02-15T23:31:23.801467+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:31:23.801467+0000","last_undegraded":"2024-02-15T23:31:23.801467+0000","last_fullsized":"2024-02-15T23:31:23.801467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.801176+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:09.278307+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":343,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.592156+0000","last_change":"2024-02-15T23:31:18.592156+0000","last_active":"2024-02-15T23:31:18.592156+0000","last_peered":"2024-02-15T23:31:18.592156+0000","last_clean":"2024-02-15T23:31:18.592156+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:18.592156+0000","last_undegraded":"2024-02-15T23:31:18.592156+0000","last_fullsized":"2024-02-15T23:31:18.592156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.591821+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.542917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.166029+0000","last_change":"2024-02-15T23:31:55.166087+0000","last_active":"2024-02-15T23:31:55.166029+0000","last_peered":"2024-02-15T23:31:55.166029+0000","last_clean":"2024-02-15T23:31:55.166029+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:31:55.166029+0000","last_undegraded":"2024-02-15T23:31:55.166029+0000","last_fullsized":"2024-02-15T23:31:55.166029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.165845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.165845+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.165845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:42:57.047533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.686615+0000","last_change":"2024-02-15T23:31:49.686753+0000","last_active":"2024-02-15T23:31:49.686615+0000","last_peered":"2024-02-15T23:31:49.686615+0000","last_clean":"2024-02-15T23:31:49.686615+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:31:49.686615+0000","last_undegraded":"2024-02-15T23:31:49.686615+0000","last_fullsized":"2024-02-15T23:31:49.686615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.686352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.686352+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.686352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:56.718642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.477281+0000","last_change":"2024-02-15T23:31:29.477281+0000","last_active":"2024-02-15T23:31:29.477281+0000","last_peered":"2024-02-15T23:31:29.477281+0000","last_clean":"2024-02-15T23:31:29.477281+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:31:29.477281+0000","last_undegraded":"2024-02-15T23:31:29.477281+0000","last_fullsized":"2024-02-15T23:31:29.477281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.477038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.461667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.798531+0000","last_change":"2024-02-15T23:31:22.798531+0000","last_active":"2024-02-15T23:31:22.798531+0000","last_peered":"2024-02-15T23:31:22.798531+0000","last_clean":"2024-02-15T23:31:22.798531+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:31:22.798531+0000","last_undegraded":"2024-02-15T23:31:22.798531+0000","last_fullsized":"2024-02-15T23:31:22.798531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.798209+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:35.238195+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.541487+0000","last_change":"2024-02-15T23:31:17.541487+0000","last_active":"2024-02-15T23:31:17.541487+0000","last_peered":"2024-02-15T23:31:17.541487+0000","last_clean":"2024-02-15T23:31:17.541487+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:31:17.541487+0000","last_undegraded":"2024-02-15T23:31:17.541487+0000","last_fullsized":"2024-02-15T23:31:17.541487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.541232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.369965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.759456+0000","last_change":"2024-02-15T23:32:05.759513+0000","last_active":"2024-02-15T23:32:05.759456+0000","last_peered":"2024-02-15T23:32:05.759456+0000","last_clean":"2024-02-15T23:32:05.759456+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:32:05.759456+0000","last_undegraded":"2024-02-15T23:32:05.759456+0000","last_fullsized":"2024-02-15T23:32:05.759456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:32:05.759232+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:32:05.759232+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.759232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:16.322465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.500820+0000","last_change":"2024-02-15T23:32:08.500905+0000","last_active":"2024-02-15T23:32:08.500820+0000","last_peered":"2024-02-15T23:32:08.500820+0000","last_clean":"2024-02-15T23:32:08.500820+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:32:08.500820+0000","last_undegraded":"2024-02-15T23:32:08.500820+0000","last_fullsized":"2024-02-15T23:32:08.500820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:08.500638+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:08.500638+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.500638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:29.150585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.686068+0000","last_change":"2024-02-15T23:31:57.686194+0000","last_active":"2024-02-15T23:31:57.686068+0000","last_peered":"2024-02-15T23:31:57.686068+0000","last_clean":"2024-02-15T23:31:57.686068+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:31:57.686068+0000","last_undegraded":"2024-02-15T23:31:57.686068+0000","last_fullsized":"2024-02-15T23:31:57.686068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:57.685774+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:57.685774+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.685774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:04:55.205797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.757464+0000","last_change":"2024-02-15T23:32:07.757464+0000","last_active":"2024-02-15T23:32:07.757464+0000","last_peered":"2024-02-15T23:32:07.757464+0000","last_clean":"2024-02-15T23:32:07.757464+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:32:07.757464+0000","last_undegraded":"2024-02-15T23:32:07.757464+0000","last_fullsized":"2024-02-15T23:32:07.757464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.757197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.757197+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.757197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:44.013395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.459639+0000","last_change":"2024-02-15T23:31:32.459639+0000","last_active":"2024-02-15T23:31:32.459639+0000","last_peered":"2024-02-15T23:31:32.459639+0000","last_clean":"2024-02-15T23:31:32.459639+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:31:32.459639+0000","last_undegraded":"2024-02-15T23:31:32.459639+0000","last_fullsized":"2024-02-15T23:31:32.459639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.459345+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:19.866069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.577110+0000","last_change":"2024-02-15T23:31:16.577110+0000","last_active":"2024-02-15T23:31:16.577110+0000","last_peered":"2024-02-15T23:31:16.577110+0000","last_clean":"2024-02-15T23:31:16.577110+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:31:16.577110+0000","last_undegraded":"2024-02-15T23:31:16.577110+0000","last_fullsized":"2024-02-15T23:31:16.577110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.576722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:35.480941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.438325+0000","last_change":"2024-02-15T23:32:11.438395+0000","last_active":"2024-02-15T23:32:11.438325+0000","last_peered":"2024-02-15T23:32:11.438325+0000","last_clean":"2024-02-15T23:32:11.438325+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:32:11.438325+0000","last_undegraded":"2024-02-15T23:32:11.438325+0000","last_fullsized":"2024-02-15T23:32:11.438325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:32:11.438129+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:32:11.438129+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.438129+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:02.828046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.730502+0000","last_change":"2024-02-15T23:32:02.730563+0000","last_active":"2024-02-15T23:32:02.730502+0000","last_peered":"2024-02-15T23:32:02.730502+0000","last_clean":"2024-02-15T23:32:02.730502+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:32:02.730502+0000","last_undegraded":"2024-02-15T23:32:02.730502+0000","last_fullsized":"2024-02-15T23:32:02.730502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:02.730290+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:02.730290+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.730290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:47.409268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:16.211106+0000","last_change":"2024-02-15T23:32:16.211161+0000","last_active":"2024-02-15T23:32:16.211106+0000","last_peered":"2024-02-15T23:32:16.211106+0000","last_clean":"2024-02-15T23:32:16.211106+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:32:16.211106+0000","last_undegraded":"2024-02-15T23:32:16.211106+0000","last_fullsized":"2024-02-15T23:32:16.211106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:16.210888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:16.210888+0000","last_clean_scrub_stamp":"2024-02-15T23:32:16.210888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:03.500809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.484374+0000","last_change":"2024-02-15T23:31:37.484374+0000","last_active":"2024-02-15T23:31:37.484374+0000","last_peered":"2024-02-15T23:31:37.484374+0000","last_clean":"2024-02-15T23:31:37.484374+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:31:37.484374+0000","last_undegraded":"2024-02-15T23:31:37.484374+0000","last_fullsized":"2024-02-15T23:31:37.484374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.484130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.484130+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.484130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:59.045203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.514009+0000","last_change":"2024-02-15T23:31:30.514009+0000","last_active":"2024-02-15T23:31:30.514009+0000","last_peered":"2024-02-15T23:31:30.514009+0000","last_clean":"2024-02-15T23:31:30.514009+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:31:30.514009+0000","last_undegraded":"2024-02-15T23:31:30.514009+0000","last_fullsized":"2024-02-15T23:31:30.514009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.513714+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:12.277197+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.644582+0000","last_change":"2024-02-15T23:31:20.644582+0000","last_active":"2024-02-15T23:31:20.644582+0000","last_peered":"2024-02-15T23:31:20.644582+0000","last_clean":"2024-02-15T23:31:20.644582+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:20.644582+0000","last_undegraded":"2024-02-15T23:31:20.644582+0000","last_fullsized":"2024-02-15T23:31:20.644582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.644319+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:29.139495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:16.427397+0000","last_change":"2024-02-15T23:32:16.427523+0000","last_active":"2024-02-15T23:32:16.427397+0000","last_peered":"2024-02-15T23:32:16.427397+0000","last_clean":"2024-02-15T23:32:16.427397+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:32:16.427397+0000","last_undegraded":"2024-02-15T23:32:16.427397+0000","last_fullsized":"2024-02-15T23:32:16.427397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:32:16.427165+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:32:16.427165+0000","last_clean_scrub_stamp":"2024-02-15T23:32:16.427165+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:50:11.764451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.687575+0000","last_change":"2024-02-15T23:31:39.687575+0000","last_active":"2024-02-15T23:31:39.687575+0000","last_peered":"2024-02-15T23:31:39.687575+0000","last_clean":"2024-02-15T23:31:39.687575+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:31:39.687575+0000","last_undegraded":"2024-02-15T23:31:39.687575+0000","last_fullsized":"2024-02-15T23:31:39.687575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.687336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:21.671965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.249440+0000","last_change":"2024-02-15T23:32:13.249521+0000","last_active":"2024-02-15T23:32:13.249440+0000","last_peered":"2024-02-15T23:32:13.249440+0000","last_clean":"2024-02-15T23:32:13.249440+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:32:13.249440+0000","last_undegraded":"2024-02-15T23:32:13.249440+0000","last_fullsized":"2024-02-15T23:32:13.249440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:13.249231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:13.249231+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.249231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:10:51.698632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.499881+0000","last_change":"2024-02-15T23:31:31.499881+0000","last_active":"2024-02-15T23:31:31.499881+0000","last_peered":"2024-02-15T23:31:31.499881+0000","last_clean":"2024-02-15T23:31:31.499881+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:31:31.499881+0000","last_undegraded":"2024-02-15T23:31:31.499881+0000","last_fullsized":"2024-02-15T23:31:31.499881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.499481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.621183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.287683+0000","last_change":"2024-02-15T23:31:47.287683+0000","last_active":"2024-02-15T23:31:47.287683+0000","last_peered":"2024-02-15T23:31:47.287683+0000","last_clean":"2024-02-15T23:31:47.287683+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:47.287683+0000","last_undegraded":"2024-02-15T23:31:47.287683+0000","last_fullsized":"2024-02-15T23:31:47.287683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-02-15T23:31:47.287351+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-02-15T23:31:47.287351+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.287351+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:28.564071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.657045+0000","last_change":"2024-02-15T23:31:21.657045+0000","last_active":"2024-02-15T23:31:21.657045+0000","last_peered":"2024-02-15T23:31:21.657045+0000","last_clean":"2024-02-15T23:31:21.657045+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:31:21.657045+0000","last_undegraded":"2024-02-15T23:31:21.657045+0000","last_fullsized":"2024-02-15T23:31:21.657045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.656809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:38.124016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.397706+0000","last_change":"2024-02-15T23:32:12.397767+0000","last_active":"2024-02-15T23:32:12.397706+0000","last_peered":"2024-02-15T23:32:12.397706+0000","last_clean":"2024-02-15T23:32:12.397706+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:32:12.397706+0000","last_undegraded":"2024-02-15T23:32:12.397706+0000","last_fullsized":"2024-02-15T23:32:12.397706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:12.397514+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:12.397514+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.397514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:14.468246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.760813+0000","last_change":"2024-02-15T23:32:09.760813+0000","last_active":"2024-02-15T23:32:09.760813+0000","last_peered":"2024-02-15T23:32:09.760813+0000","last_clean":"2024-02-15T23:32:09.760813+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:32:09.760813+0000","last_undegraded":"2024-02-15T23:32:09.760813+0000","last_fullsized":"2024-02-15T23:32:09.760813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:09.760563+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:09.760563+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.760563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:25.177173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.471453+0000","last_change":"2024-02-15T23:32:01.471535+0000","last_active":"2024-02-15T23:32:01.471453+0000","last_peered":"2024-02-15T23:32:01.471453+0000","last_clean":"2024-02-15T23:32:01.471453+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:32:01.471453+0000","last_undegraded":"2024-02-15T23:32:01.471453+0000","last_fullsized":"2024-02-15T23:32:01.471453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:01.471256+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:01.471256+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.471256+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:37.525983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.636155+0000","last_change":"2024-02-15T23:31:33.636155+0000","last_active":"2024-02-15T23:31:33.636155+0000","last_peered":"2024-02-15T23:31:33.636155+0000","last_clean":"2024-02-15T23:31:33.636155+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:31:33.636155+0000","last_undegraded":"2024-02-15T23:31:33.636155+0000","last_fullsized":"2024-02-15T23:31:33.636155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.635864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:47.730744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.407975+0000","last_change":"2024-02-15T23:31:24.407975+0000","last_active":"2024-02-15T23:31:24.407975+0000","last_peered":"2024-02-15T23:31:24.407975+0000","last_clean":"2024-02-15T23:31:24.407975+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:24.407975+0000","last_undegraded":"2024-02-15T23:31:24.407975+0000","last_fullsized":"2024-02-15T23:31:24.407975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.407715+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:36.649762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.276712+0000","last_change":"2024-02-15T23:31:48.276712+0000","last_active":"2024-02-15T23:31:48.276712+0000","last_peered":"2024-02-15T23:31:48.276712+0000","last_clean":"2024-02-15T23:31:48.276712+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:31:48.276712+0000","last_undegraded":"2024-02-15T23:31:48.276712+0000","last_fullsized":"2024-02-15T23:31:48.276712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:48.276447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:48.276447+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.276447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:14:35.402031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316951+0000","last_change":"2024-02-15T23:29:39.775394+0000","last_active":"2024-02-15T23:31:16.316951+0000","last_peered":"2024-02-15T23:31:16.316951+0000","last_clean":"2024-02-15T23:31:16.316951+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:31:16.316951+0000","last_undegraded":"2024-02-15T23:31:16.316951+0000","last_fullsized":"2024-02-15T23:31:16.316951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.404343+0000","last_change":"2024-02-15T23:31:27.404343+0000","last_active":"2024-02-15T23:31:27.404343+0000","last_peered":"2024-02-15T23:31:27.404343+0000","last_clean":"2024-02-15T23:31:27.404343+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:31:27.404343+0000","last_undegraded":"2024-02-15T23:31:27.404343+0000","last_fullsized":"2024-02-15T23:31:27.404343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.404065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:04.056272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:22.224025+0000","last_change":"2024-02-15T23:32:22.224094+0000","last_active":"2024-02-15T23:32:22.224025+0000","last_peered":"2024-02-15T23:32:22.224025+0000","last_clean":"2024-02-15T23:32:22.224025+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:32:22.224025+0000","last_undegraded":"2024-02-15T23:32:22.224025+0000","last_fullsized":"2024-02-15T23:32:22.224025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:22.223817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:22.223817+0000","last_clean_scrub_stamp":"2024-02-15T23:32:22.223817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:59.143154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.466268+0000","last_change":"2024-02-15T23:31:38.466268+0000","last_active":"2024-02-15T23:31:38.466268+0000","last_peered":"2024-02-15T23:31:38.466268+0000","last_clean":"2024-02-15T23:31:38.466268+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:31:38.466268+0000","last_undegraded":"2024-02-15T23:31:38.466268+0000","last_fullsized":"2024-02-15T23:31:38.466268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:38.466027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:38.466027+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.466027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:12.976124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.812184+0000","last_change":"2024-02-15T23:31:27.812184+0000","last_active":"2024-02-15T23:31:27.812184+0000","last_peered":"2024-02-15T23:31:27.812184+0000","last_clean":"2024-02-15T23:31:27.812184+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:31:27.812184+0000","last_undegraded":"2024-02-15T23:31:27.812184+0000","last_fullsized":"2024-02-15T23:31:27.812184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.812031+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:53.640763+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":345,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.837313+0000","last_change":"2024-02-15T23:31:18.837313+0000","last_active":"2024-02-15T23:31:18.837313+0000","last_peered":"2024-02-15T23:31:18.837313+0000","last_clean":"2024-02-15T23:31:18.837313+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:18.837313+0000","last_undegraded":"2024-02-15T23:31:18.837313+0000","last_fullsized":"2024-02-15T23:31:18.837313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.836996+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:26.809047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.437875+0000","last_change":"2024-02-15T23:31:44.437875+0000","last_active":"2024-02-15T23:31:44.437875+0000","last_peered":"2024-02-15T23:31:44.437875+0000","last_clean":"2024-02-15T23:31:44.437875+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:31:44.437875+0000","last_undegraded":"2024-02-15T23:31:44.437875+0000","last_fullsized":"2024-02-15T23:31:44.437875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:44.437626+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:44.437626+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.437626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:01.530419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.694509+0000","last_change":"2024-02-15T23:31:50.694563+0000","last_active":"2024-02-15T23:31:50.694509+0000","last_peered":"2024-02-15T23:31:50.694509+0000","last_clean":"2024-02-15T23:31:50.694509+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:31:50.694509+0000","last_undegraded":"2024-02-15T23:31:50.694509+0000","last_fullsized":"2024-02-15T23:31:50.694509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:50.694320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:50.694320+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.694320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:34.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.224812+0000","last_change":"2024-02-15T23:32:12.224902+0000","last_active":"2024-02-15T23:32:12.224812+0000","last_peered":"2024-02-15T23:32:12.224812+0000","last_clean":"2024-02-15T23:32:12.224812+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:32:12.224812+0000","last_undegraded":"2024-02-15T23:32:12.224812+0000","last_fullsized":"2024-02-15T23:32:12.224812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:12.224617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:12.224617+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.224617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:48:16.867139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.474688+0000","last_change":"2024-02-15T23:31:27.474688+0000","last_active":"2024-02-15T23:31:27.474688+0000","last_peered":"2024-02-15T23:31:27.474688+0000","last_clean":"2024-02-15T23:31:27.474688+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:27.474688+0000","last_undegraded":"2024-02-15T23:31:27.474688+0000","last_fullsized":"2024-02-15T23:31:27.474688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.474436+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.169933+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.325111+0000","last_change":"2024-02-15T23:31:43.325111+0000","last_active":"2024-02-15T23:31:43.325111+0000","last_peered":"2024-02-15T23:31:43.325111+0000","last_clean":"2024-02-15T23:31:43.325111+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:31:43.325111+0000","last_undegraded":"2024-02-15T23:31:43.325111+0000","last_fullsized":"2024-02-15T23:31:43.325111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:43.324799+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:43.324799+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.324799+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:21.930488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.408189+0000","last_change":"2024-02-15T23:31:16.408189+0000","last_active":"2024-02-15T23:31:16.408189+0000","last_peered":"2024-02-15T23:31:16.408189+0000","last_clean":"2024-02-15T23:31:16.408189+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:16.408189+0000","last_undegraded":"2024-02-15T23:31:16.408189+0000","last_fullsized":"2024-02-15T23:31:16.408189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.407927+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:42.842010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.684561+0000","last_change":"2024-02-15T23:31:32.684561+0000","last_active":"2024-02-15T23:31:32.684561+0000","last_peered":"2024-02-15T23:31:32.684561+0000","last_clean":"2024-02-15T23:31:32.684561+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:31:32.684561+0000","last_undegraded":"2024-02-15T23:31:32.684561+0000","last_fullsized":"2024-02-15T23:31:32.684561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.684302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:13.848320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.605287+0000","last_change":"2024-02-15T23:31:39.605287+0000","last_active":"2024-02-15T23:31:39.605287+0000","last_peered":"2024-02-15T23:31:39.605287+0000","last_clean":"2024-02-15T23:31:39.605287+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:31:39.605287+0000","last_undegraded":"2024-02-15T23:31:39.605287+0000","last_fullsized":"2024-02-15T23:31:39.605287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:39.605037+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:39.605037+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.605037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:46.637327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:24.245225+0000","last_change":"2024-02-15T23:32:24.245282+0000","last_active":"2024-02-15T23:32:24.245225+0000","last_peered":"2024-02-15T23:32:24.245225+0000","last_clean":"2024-02-15T23:32:24.245225+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:32:24.245225+0000","last_undegraded":"2024-02-15T23:32:24.245225+0000","last_fullsized":"2024-02-15T23:32:24.245225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:24.245026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:24.245026+0000","last_clean_scrub_stamp":"2024-02-15T23:32:24.245026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:17:13.229008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.443979+0000","last_change":"2024-02-15T23:31:16.443979+0000","last_active":"2024-02-15T23:31:16.443979+0000","last_peered":"2024-02-15T23:31:16.443979+0000","last_clean":"2024-02-15T23:31:16.443979+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:31:16.443979+0000","last_undegraded":"2024-02-15T23:31:16.443979+0000","last_fullsized":"2024-02-15T23:31:16.443979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.443730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:16:47.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.362479+0000","last_change":"2024-02-15T23:31:21.362479+0000","last_active":"2024-02-15T23:31:21.362479+0000","last_peered":"2024-02-15T23:31:21.362479+0000","last_clean":"2024-02-15T23:31:21.362479+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:31:21.362479+0000","last_undegraded":"2024-02-15T23:31:21.362479+0000","last_fullsized":"2024-02-15T23:31:21.362479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.362097+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:21.356365+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.792994+0000","last_change":"2024-02-15T23:31:24.792994+0000","last_active":"2024-02-15T23:31:24.792994+0000","last_peered":"2024-02-15T23:31:24.792994+0000","last_clean":"2024-02-15T23:31:24.792994+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:31:24.792994+0000","last_undegraded":"2024-02-15T23:31:24.792994+0000","last_fullsized":"2024-02-15T23:31:24.792994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.792712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:03:10.186879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.472926+0000","last_change":"2024-02-15T23:31:30.472926+0000","last_active":"2024-02-15T23:31:30.472926+0000","last_peered":"2024-02-15T23:31:30.472926+0000","last_clean":"2024-02-15T23:31:30.472926+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:31:30.472926+0000","last_undegraded":"2024-02-15T23:31:30.472926+0000","last_fullsized":"2024-02-15T23:31:30.472926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.472637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.285998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.502716+0000","last_change":"2024-02-15T23:31:31.502716+0000","last_active":"2024-02-15T23:31:31.502716+0000","last_peered":"2024-02-15T23:31:31.502716+0000","last_clean":"2024-02-15T23:31:31.502716+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:31:31.502716+0000","last_undegraded":"2024-02-15T23:31:31.502716+0000","last_fullsized":"2024-02-15T23:31:31.502716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.502461+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:37.162072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.499666+0000","last_change":"2024-02-15T23:32:00.499823+0000","last_active":"2024-02-15T23:32:00.499666+0000","last_peered":"2024-02-15T23:32:00.499666+0000","last_clean":"2024-02-15T23:32:00.499666+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:32:00.499666+0000","last_undegraded":"2024-02-15T23:32:00.499666+0000","last_fullsized":"2024-02-15T23:32:00.499666+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-15T23:32:00.499419+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-15T23:32:00.499419+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.499419+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:15.916028+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:29.304044+0000","last_change":"2024-02-15T23:32:29.304096+0000","last_active":"2024-02-15T23:32:29.304044+0000","last_peered":"2024-02-15T23:32:29.304044+0000","last_clean":"2024-02-15T23:32:29.304044+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:32:29.304044+0000","last_undegraded":"2024-02-15T23:32:29.304044+0000","last_fullsized":"2024-02-15T23:32:29.304044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:29.303851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:29.303851+0000","last_clean_scrub_stamp":"2024-02-15T23:32:29.303851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:11:10.227864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.209733+0000","last_change":"2024-02-15T23:32:14.209811+0000","last_active":"2024-02-15T23:32:14.209733+0000","last_peered":"2024-02-15T23:32:14.209733+0000","last_clean":"2024-02-15T23:32:14.209733+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:32:14.209733+0000","last_undegraded":"2024-02-15T23:32:14.209733+0000","last_fullsized":"2024-02-15T23:32:14.209733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:14.209520+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:14.209520+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.209520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:41.619949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.454296+0000","last_change":"2024-02-15T23:32:13.454356+0000","last_active":"2024-02-15T23:32:13.454296+0000","last_peered":"2024-02-15T23:32:13.454296+0000","last_clean":"2024-02-15T23:32:13.454296+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:32:13.454296+0000","last_undegraded":"2024-02-15T23:32:13.454296+0000","last_fullsized":"2024-02-15T23:32:13.454296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:13.454116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:13.454116+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.454116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:39.790818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.412677+0000","last_change":"2024-02-15T23:31:24.412677+0000","last_active":"2024-02-15T23:31:24.412677+0000","last_peered":"2024-02-15T23:31:24.412677+0000","last_clean":"2024-02-15T23:31:24.412677+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:24.412677+0000","last_undegraded":"2024-02-15T23:31:24.412677+0000","last_fullsized":"2024-02-15T23:31:24.412677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.412389+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:34.534030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.511629+0000","last_change":"2024-02-15T23:31:28.511629+0000","last_active":"2024-02-15T23:31:28.511629+0000","last_peered":"2024-02-15T23:31:28.511629+0000","last_clean":"2024-02-15T23:31:28.511629+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:31:28.511629+0000","last_undegraded":"2024-02-15T23:31:28.511629+0000","last_fullsized":"2024-02-15T23:31:28.511629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.511388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:40.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.745962+0000","last_change":"2024-02-15T23:32:03.746023+0000","last_active":"2024-02-15T23:32:03.745962+0000","last_peered":"2024-02-15T23:32:03.745962+0000","last_clean":"2024-02-15T23:32:03.745962+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:32:03.745962+0000","last_undegraded":"2024-02-15T23:32:03.745962+0000","last_fullsized":"2024-02-15T23:32:03.745962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-15T23:32:03.745738+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-15T23:32:03.745738+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.745738+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:51.152463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'14","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.249776+0000","last_change":"2024-02-15T23:31:51.249938+0000","last_active":"2024-02-15T23:31:51.249776+0000","last_peered":"2024-02-15T23:31:51.249776+0000","last_clean":"2024-02-15T23:31:51.249776+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:31:51.249776+0000","last_undegraded":"2024-02-15T23:31:51.249776+0000","last_fullsized":"2024-02-15T23:31:51.249776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:31:51.249530+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:31:51.249530+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.249530+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:17.586232+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:28.279211+0000","last_change":"2024-02-15T23:32:28.279264+0000","last_active":"2024-02-15T23:32:28.279211+0000","last_peered":"2024-02-15T23:32:28.279211+0000","last_clean":"2024-02-15T23:32:28.279211+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:32:28.279211+0000","last_undegraded":"2024-02-15T23:32:28.279211+0000","last_fullsized":"2024-02-15T23:32:28.279211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:28.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:28.279012+0000","last_clean_scrub_stamp":"2024-02-15T23:32:28.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:23.279644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.421539+0000","last_change":"2024-02-15T23:32:06.421606+0000","last_active":"2024-02-15T23:32:06.421539+0000","last_peered":"2024-02-15T23:32:06.421539+0000","last_clean":"2024-02-15T23:32:06.421539+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:32:06.421539+0000","last_undegraded":"2024-02-15T23:32:06.421539+0000","last_fullsized":"2024-02-15T23:32:06.421539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:06.421317+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:06.421317+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.421317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:50.686637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.399165+0000","last_change":"2024-02-15T23:31:20.399165+0000","last_active":"2024-02-15T23:31:20.399165+0000","last_peered":"2024-02-15T23:31:20.399165+0000","last_clean":"2024-02-15T23:31:20.399165+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:31:20.399165+0000","last_undegraded":"2024-02-15T23:31:20.399165+0000","last_fullsized":"2024-02-15T23:31:20.399165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.398920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:13.693335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.428280+0000","last_change":"2024-02-15T23:31:25.428280+0000","last_active":"2024-02-15T23:31:25.428280+0000","last_peered":"2024-02-15T23:31:25.428280+0000","last_clean":"2024-02-15T23:31:25.428280+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:25.428280+0000","last_undegraded":"2024-02-15T23:31:25.428280+0000","last_fullsized":"2024-02-15T23:31:25.428280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.427985+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:29.336924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.323076+0000","last_change":"2024-02-15T23:31:40.323076+0000","last_active":"2024-02-15T23:31:40.323076+0000","last_peered":"2024-02-15T23:31:40.323076+0000","last_clean":"2024-02-15T23:31:40.323076+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:31:40.323076+0000","last_undegraded":"2024-02-15T23:31:40.323076+0000","last_fullsized":"2024-02-15T23:31:40.323076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:40.322696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:40.322696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.322696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:29.911537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.473822+0000","last_change":"2024-02-15T23:32:10.473888+0000","last_active":"2024-02-15T23:32:10.473822+0000","last_peered":"2024-02-15T23:32:10.473822+0000","last_clean":"2024-02-15T23:32:10.473822+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:32:10.473822+0000","last_undegraded":"2024-02-15T23:32:10.473822+0000","last_fullsized":"2024-02-15T23:32:10.473822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-15T23:32:10.473639+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-15T23:32:10.473639+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.473639+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:20:01.304342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.339402+0000","last_change":"2024-02-15T23:31:54.339463+0000","last_active":"2024-02-15T23:31:54.339402+0000","last_peered":"2024-02-15T23:31:54.339402+0000","last_clean":"2024-02-15T23:31:54.339402+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:54.339402+0000","last_undegraded":"2024-02-15T23:31:54.339402+0000","last_fullsized":"2024-02-15T23:31:54.339402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:54.339211+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:54.339211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.339211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:41.745936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.686149+0000","last_change":"2024-02-15T23:31:54.686208+0000","last_active":"2024-02-15T23:31:54.686149+0000","last_peered":"2024-02-15T23:31:54.686149+0000","last_clean":"2024-02-15T23:31:54.686149+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:31:54.686149+0000","last_undegraded":"2024-02-15T23:31:54.686149+0000","last_fullsized":"2024-02-15T23:31:54.686149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:54.685949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:54.685949+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.685949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:41:39.731022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.352158+0000","last_change":"2024-02-15T23:31:55.352273+0000","last_active":"2024-02-15T23:31:55.352158+0000","last_peered":"2024-02-15T23:31:55.352158+0000","last_clean":"2024-02-15T23:31:55.352158+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:31:55.352158+0000","last_undegraded":"2024-02-15T23:31:55.352158+0000","last_fullsized":"2024-02-15T23:31:55.352158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.351912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.351912+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.351912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:30.889003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.696551+0000","last_change":"2024-02-15T23:31:35.696551+0000","last_active":"2024-02-15T23:31:35.696551+0000","last_peered":"2024-02-15T23:31:35.696551+0000","last_clean":"2024-02-15T23:31:35.696551+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:31:35.696551+0000","last_undegraded":"2024-02-15T23:31:35.696551+0000","last_fullsized":"2024-02-15T23:31:35.696551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:35.696295+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:35.696295+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.696295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:39.605234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.811746+0000","last_change":"2024-02-15T23:31:19.811746+0000","last_active":"2024-02-15T23:31:19.811746+0000","last_peered":"2024-02-15T23:31:19.811746+0000","last_clean":"2024-02-15T23:31:19.811746+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:19.811746+0000","last_undegraded":"2024-02-15T23:31:19.811746+0000","last_fullsized":"2024-02-15T23:31:19.811746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.811464+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:28:44.508275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.546516+0000","last_change":"2024-02-15T23:31:32.546516+0000","last_active":"2024-02-15T23:31:32.546516+0000","last_peered":"2024-02-15T23:31:32.546516+0000","last_clean":"2024-02-15T23:31:32.546516+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:31:32.546516+0000","last_undegraded":"2024-02-15T23:31:32.546516+0000","last_fullsized":"2024-02-15T23:31:32.546516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.546263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.575111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.114732+0000","last_change":"2024-02-15T23:32:04.114794+0000","last_active":"2024-02-15T23:32:04.114732+0000","last_peered":"2024-02-15T23:32:04.114732+0000","last_clean":"2024-02-15T23:32:04.114732+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:32:04.114732+0000","last_undegraded":"2024-02-15T23:32:04.114732+0000","last_fullsized":"2024-02-15T23:32:04.114732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.114516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.114516+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.114516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:17.701427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.467094+0000","last_change":"2024-02-15T23:31:48.467222+0000","last_active":"2024-02-15T23:31:48.467094+0000","last_peered":"2024-02-15T23:31:48.467094+0000","last_clean":"2024-02-15T23:31:48.467094+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:48.467094+0000","last_undegraded":"2024-02-15T23:31:48.467094+0000","last_fullsized":"2024-02-15T23:31:48.467094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:31:48.466864+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:31:48.466864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.466864+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:04:45.986887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:26.290704+0000","last_change":"2024-02-15T23:32:26.290758+0000","last_active":"2024-02-15T23:32:26.290704+0000","last_peered":"2024-02-15T23:32:26.290704+0000","last_clean":"2024-02-15T23:32:26.290704+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:32:26.290704+0000","last_undegraded":"2024-02-15T23:32:26.290704+0000","last_fullsized":"2024-02-15T23:32:26.290704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:26.290502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:26.290502+0000","last_clean_scrub_stamp":"2024-02-15T23:32:26.290502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:33:19.527437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.726468+0000","last_change":"2024-02-15T23:31:55.726530+0000","last_active":"2024-02-15T23:31:55.726468+0000","last_peered":"2024-02-15T23:31:55.726468+0000","last_clean":"2024-02-15T23:31:55.726468+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:31:55.726468+0000","last_undegraded":"2024-02-15T23:31:55.726468+0000","last_fullsized":"2024-02-15T23:31:55.726468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.726248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.726248+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.726248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:22:05.847889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.558062+0000","last_change":"2024-02-15T23:31:35.558062+0000","last_active":"2024-02-15T23:31:35.558062+0000","last_peered":"2024-02-15T23:31:35.558062+0000","last_clean":"2024-02-15T23:31:35.558062+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:31:35.558062+0000","last_undegraded":"2024-02-15T23:31:35.558062+0000","last_fullsized":"2024-02-15T23:31:35.558062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:35.557819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:35.557819+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.557819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:02.418349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.310142+0000","last_change":"2024-02-15T23:31:45.310142+0000","last_active":"2024-02-15T23:31:45.310142+0000","last_peered":"2024-02-15T23:31:45.310142+0000","last_clean":"2024-02-15T23:31:45.310142+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:31:45.310142+0000","last_undegraded":"2024-02-15T23:31:45.310142+0000","last_fullsized":"2024-02-15T23:31:45.310142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-02-15T23:31:45.309885+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-02-15T23:31:45.309885+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.309885+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:11.973068+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.153845+0000","last_change":"2024-02-15T23:31:56.153902+0000","last_active":"2024-02-15T23:31:56.153845+0000","last_peered":"2024-02-15T23:31:56.153845+0000","last_clean":"2024-02-15T23:31:56.153845+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:31:56.153845+0000","last_undegraded":"2024-02-15T23:31:56.153845+0000","last_fullsized":"2024-02-15T23:31:56.153845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.153647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.153647+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.153647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:46.068434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.560635+0000","last_change":"2024-02-15T23:31:38.560635+0000","last_active":"2024-02-15T23:31:38.560635+0000","last_peered":"2024-02-15T23:31:38.560635+0000","last_clean":"2024-02-15T23:31:38.560635+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:31:38.560635+0000","last_undegraded":"2024-02-15T23:31:38.560635+0000","last_fullsized":"2024-02-15T23:31:38.560635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:38.560266+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:38.560266+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.560266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:13.070363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'12","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:15.446148+0000","last_change":"2024-02-15T23:32:15.446212+0000","last_active":"2024-02-15T23:32:15.446148+0000","last_peered":"2024-02-15T23:32:15.446148+0000","last_clean":"2024-02-15T23:32:15.446148+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:32:15.446148+0000","last_undegraded":"2024-02-15T23:32:15.446148+0000","last_fullsized":"2024-02-15T23:32:15.446148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:32:15.445965+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:32:15.445965+0000","last_clean_scrub_stamp":"2024-02-15T23:32:15.445965+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:30.896607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.640528+0000","last_change":"2024-02-15T23:31:43.640596+0000","last_active":"2024-02-15T23:31:43.640528+0000","last_peered":"2024-02-15T23:31:43.640528+0000","last_clean":"2024-02-15T23:31:43.640528+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:31:43.640528+0000","last_undegraded":"2024-02-15T23:31:43.640528+0000","last_fullsized":"2024-02-15T23:31:43.640528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:43.640321+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:43.640321+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.640321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:40.343283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.505031+0000","last_change":"2024-02-15T23:32:02.505191+0000","last_active":"2024-02-15T23:32:02.505031+0000","last_peered":"2024-02-15T23:32:02.505031+0000","last_clean":"2024-02-15T23:32:02.505031+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:32:02.505031+0000","last_undegraded":"2024-02-15T23:32:02.505031+0000","last_fullsized":"2024-02-15T23:32:02.505031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.504792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.504792+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.504792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:23.531981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.770494+0000","last_change":"2024-02-15T23:32:08.770494+0000","last_active":"2024-02-15T23:32:08.770494+0000","last_peered":"2024-02-15T23:32:08.770494+0000","last_clean":"2024-02-15T23:32:08.770494+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:32:08.770494+0000","last_undegraded":"2024-02-15T23:32:08.770494+0000","last_fullsized":"2024-02-15T23:32:08.770494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.770258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.770258+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.770258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:19.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.630125+0000","last_change":"2024-02-15T23:31:23.630125+0000","last_active":"2024-02-15T23:31:23.630125+0000","last_peered":"2024-02-15T23:31:23.630125+0000","last_clean":"2024-02-15T23:31:23.630125+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:23.630125+0000","last_undegraded":"2024-02-15T23:31:23.630125+0000","last_fullsized":"2024-02-15T23:31:23.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.629845+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:22:36.251662+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.871614+0000","last_change":"2024-02-15T23:31:17.871614+0000","last_active":"2024-02-15T23:31:17.871614+0000","last_peered":"2024-02-15T23:31:17.871614+0000","last_clean":"2024-02-15T23:31:17.871614+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:31:17.871614+0000","last_undegraded":"2024-02-15T23:31:17.871614+0000","last_fullsized":"2024-02-15T23:31:17.871614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.871335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:42.844132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.447006+0000","last_change":"2024-02-15T23:32:13.447073+0000","last_active":"2024-02-15T23:32:13.447006+0000","last_peered":"2024-02-15T23:32:13.447006+0000","last_clean":"2024-02-15T23:32:13.447006+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:32:13.447006+0000","last_undegraded":"2024-02-15T23:32:13.447006+0000","last_fullsized":"2024-02-15T23:32:13.447006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-15T23:32:13.446773+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-15T23:32:13.446773+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.446773+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:15.960783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.407689+0000","last_change":"2024-02-15T23:32:14.407742+0000","last_active":"2024-02-15T23:32:14.407689+0000","last_peered":"2024-02-15T23:32:14.407689+0000","last_clean":"2024-02-15T23:32:14.407689+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:32:14.407689+0000","last_undegraded":"2024-02-15T23:32:14.407689+0000","last_fullsized":"2024-02-15T23:32:14.407689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:14.407508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:14.407508+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.407508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:23:33.983637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.412837+0000","last_change":"2024-02-15T23:31:59.412907+0000","last_active":"2024-02-15T23:31:59.412837+0000","last_peered":"2024-02-15T23:31:59.412837+0000","last_clean":"2024-02-15T23:31:59.412837+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:31:59.412837+0000","last_undegraded":"2024-02-15T23:31:59.412837+0000","last_fullsized":"2024-02-15T23:31:59.412837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:59.412638+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.412638+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.412638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.093453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:27.326718+0000","last_change":"2024-02-15T23:32:27.326774+0000","last_active":"2024-02-15T23:32:27.326718+0000","last_peered":"2024-02-15T23:32:27.326718+0000","last_clean":"2024-02-15T23:32:27.326718+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:32:27.326718+0000","last_undegraded":"2024-02-15T23:32:27.326718+0000","last_fullsized":"2024-02-15T23:32:27.326718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:27.326521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:27.326521+0000","last_clean_scrub_stamp":"2024-02-15T23:32:27.326521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:17:47.973866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.396757+0000","last_change":"2024-02-15T23:31:17.396757+0000","last_active":"2024-02-15T23:31:17.396757+0000","last_peered":"2024-02-15T23:31:17.396757+0000","last_clean":"2024-02-15T23:31:17.396757+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:31:17.396757+0000","last_undegraded":"2024-02-15T23:31:17.396757+0000","last_fullsized":"2024-02-15T23:31:17.396757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.396500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:51.906597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.394229+0000","last_change":"2024-02-15T23:31:19.394229+0000","last_active":"2024-02-15T23:31:19.394229+0000","last_peered":"2024-02-15T23:31:19.394229+0000","last_clean":"2024-02-15T23:31:19.394229+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:31:19.394229+0000","last_undegraded":"2024-02-15T23:31:19.394229+0000","last_fullsized":"2024-02-15T23:31:19.394229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.393966+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:40.563671+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.413611+0000","last_change":"2024-02-15T23:31:15.413611+0000","last_active":"2024-02-15T23:31:15.413611+0000","last_peered":"2024-02-15T23:31:15.413611+0000","last_clean":"2024-02-15T23:31:15.413611+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:15.413611+0000","last_undegraded":"2024-02-15T23:31:15.413611+0000","last_fullsized":"2024-02-15T23:31:15.413611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.413363+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:05.337748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316755+0000","last_change":"2024-02-15T23:29:39.771638+0000","last_active":"2024-02-15T23:31:16.316755+0000","last_peered":"2024-02-15T23:31:16.316755+0000","last_clean":"2024-02-15T23:31:16.316755+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:31:16.316755+0000","last_undegraded":"2024-02-15T23:31:16.316755+0000","last_fullsized":"2024-02-15T23:31:16.316755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.069553+0000","last_change":"2024-02-15T23:32:01.069605+0000","last_active":"2024-02-15T23:32:01.069553+0000","last_peered":"2024-02-15T23:32:01.069553+0000","last_clean":"2024-02-15T23:32:01.069553+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:32:01.069553+0000","last_undegraded":"2024-02-15T23:32:01.069553+0000","last_fullsized":"2024-02-15T23:32:01.069553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:01.069355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:01.069355+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.069355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:53:55.098770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:23.261617+0000","last_change":"2024-02-15T23:32:23.261747+0000","last_active":"2024-02-15T23:32:23.261617+0000","last_peered":"2024-02-15T23:32:23.261617+0000","last_clean":"2024-02-15T23:32:23.261617+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:32:23.261617+0000","last_undegraded":"2024-02-15T23:32:23.261617+0000","last_fullsized":"2024-02-15T23:32:23.261617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:23.261330+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:23.261330+0000","last_clean_scrub_stamp":"2024-02-15T23:32:23.261330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:21:55.099505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.466820+0000","last_change":"2024-02-15T23:32:03.466873+0000","last_active":"2024-02-15T23:32:03.466820+0000","last_peered":"2024-02-15T23:32:03.466820+0000","last_clean":"2024-02-15T23:32:03.466820+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:32:03.466820+0000","last_undegraded":"2024-02-15T23:32:03.466820+0000","last_fullsized":"2024-02-15T23:32:03.466820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:03.466625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:03.466625+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.466625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:03:37.334611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.405756+0000","last_change":"2024-02-15T23:31:21.405756+0000","last_active":"2024-02-15T23:31:21.405756+0000","last_peered":"2024-02-15T23:31:21.405756+0000","last_clean":"2024-02-15T23:31:21.405756+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:31:21.405756+0000","last_undegraded":"2024-02-15T23:31:21.405756+0000","last_fullsized":"2024-02-15T23:31:21.405756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.405364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:58.637097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.322259+0000","last_change":"2024-02-15T23:31:46.322334+0000","last_active":"2024-02-15T23:31:46.322259+0000","last_peered":"2024-02-15T23:31:46.322259+0000","last_clean":"2024-02-15T23:31:46.322259+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:31:46.322259+0000","last_undegraded":"2024-02-15T23:31:46.322259+0000","last_fullsized":"2024-02-15T23:31:46.322259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:46.322070+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:46.322070+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.322070+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:06.972017+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.594968+0000","last_change":"2024-02-15T23:31:19.594968+0000","last_active":"2024-02-15T23:31:19.594968+0000","last_peered":"2024-02-15T23:31:19.594968+0000","last_clean":"2024-02-15T23:31:19.594968+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:19.594968+0000","last_undegraded":"2024-02-15T23:31:19.594968+0000","last_fullsized":"2024-02-15T23:31:19.594968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.594660+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:58.295976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.544082+0000","last_change":"2024-02-15T23:31:34.544082+0000","last_active":"2024-02-15T23:31:34.544082+0000","last_peered":"2024-02-15T23:31:34.544082+0000","last_clean":"2024-02-15T23:31:34.544082+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:31:34.544082+0000","last_undegraded":"2024-02-15T23:31:34.544082+0000","last_fullsized":"2024-02-15T23:31:34.544082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.543832+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.512019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.664125+0000","last_change":"2024-02-15T23:31:52.664201+0000","last_active":"2024-02-15T23:31:52.664125+0000","last_peered":"2024-02-15T23:31:52.664125+0000","last_clean":"2024-02-15T23:31:52.664125+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:52.664125+0000","last_undegraded":"2024-02-15T23:31:52.664125+0000","last_fullsized":"2024-02-15T23:31:52.664125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-15T23:31:52.663884+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-15T23:31:52.663884+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.663884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:16.778950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.543481+0000","last_change":"2024-02-15T23:32:05.543539+0000","last_active":"2024-02-15T23:32:05.543481+0000","last_peered":"2024-02-15T23:32:05.543481+0000","last_clean":"2024-02-15T23:32:05.543481+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:32:05.543481+0000","last_undegraded":"2024-02-15T23:32:05.543481+0000","last_fullsized":"2024-02-15T23:32:05.543481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:05.543285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:05.543285+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.543285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:44.148974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:30.298174+0000","last_change":"2024-02-15T23:32:30.298227+0000","last_active":"2024-02-15T23:32:30.298174+0000","last_peered":"2024-02-15T23:32:30.298174+0000","last_clean":"2024-02-15T23:32:30.298174+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:32:30.298174+0000","last_undegraded":"2024-02-15T23:32:30.298174+0000","last_fullsized":"2024-02-15T23:32:30.298174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:30.297974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:30.297974+0000","last_clean_scrub_stamp":"2024-02-15T23:32:30.297974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:53:20.753279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.386313+0000","last_change":"2024-02-15T23:31:26.386313+0000","last_active":"2024-02-15T23:31:26.386313+0000","last_peered":"2024-02-15T23:31:26.386313+0000","last_clean":"2024-02-15T23:31:26.386313+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:31:26.386313+0000","last_undegraded":"2024-02-15T23:31:26.386313+0000","last_fullsized":"2024-02-15T23:31:26.386313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.386074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:29.907866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.809672+0000","last_change":"2024-02-15T23:31:25.809672+0000","last_active":"2024-02-15T23:31:25.809672+0000","last_peered":"2024-02-15T23:31:25.809672+0000","last_clean":"2024-02-15T23:31:25.809672+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:25.809672+0000","last_undegraded":"2024-02-15T23:31:25.809672+0000","last_fullsized":"2024-02-15T23:31:25.809672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.809268+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:15.733653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.613362+0000","last_change":"2024-02-15T23:31:22.613362+0000","last_active":"2024-02-15T23:31:22.613362+0000","last_peered":"2024-02-15T23:31:22.613362+0000","last_clean":"2024-02-15T23:31:22.613362+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:31:22.613362+0000","last_undegraded":"2024-02-15T23:31:22.613362+0000","last_fullsized":"2024-02-15T23:31:22.613362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.613116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:43.072580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.746979+0000","last_change":"2024-02-15T23:32:06.747036+0000","last_active":"2024-02-15T23:32:06.746979+0000","last_peered":"2024-02-15T23:32:06.746979+0000","last_clean":"2024-02-15T23:32:06.746979+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:32:06.746979+0000","last_undegraded":"2024-02-15T23:32:06.746979+0000","last_fullsized":"2024-02-15T23:32:06.746979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.746779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.746779+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.746779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:12.595644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.745722+0000","last_change":"2024-02-15T23:32:04.745780+0000","last_active":"2024-02-15T23:32:04.745722+0000","last_peered":"2024-02-15T23:32:04.745722+0000","last_clean":"2024-02-15T23:32:04.745722+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:32:04.745722+0000","last_undegraded":"2024-02-15T23:32:04.745722+0000","last_fullsized":"2024-02-15T23:32:04.745722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.745496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.745496+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.745496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:40.282587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.692986+0000","last_change":"2024-02-15T23:31:48.692986+0000","last_active":"2024-02-15T23:31:48.692986+0000","last_peered":"2024-02-15T23:31:48.692986+0000","last_clean":"2024-02-15T23:31:48.692986+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:31:48.692986+0000","last_undegraded":"2024-02-15T23:31:48.692986+0000","last_fullsized":"2024-02-15T23:31:48.692986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:48.692708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:48.692708+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.692708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:23.202805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.113539+0000","last_change":"2024-02-15T23:32:06.113674+0000","last_active":"2024-02-15T23:32:06.113539+0000","last_peered":"2024-02-15T23:32:06.113539+0000","last_clean":"2024-02-15T23:32:06.113539+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:32:06.113539+0000","last_undegraded":"2024-02-15T23:32:06.113539+0000","last_fullsized":"2024-02-15T23:32:06.113539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.113292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.113292+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.113292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:49.153473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'3","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.544544+0000","last_change":"2024-02-15T23:31:35.544544+0000","last_active":"2024-02-15T23:31:35.544544+0000","last_peered":"2024-02-15T23:31:35.544544+0000","last_clean":"2024-02-15T23:31:35.544544+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:35.544544+0000","last_undegraded":"2024-02-15T23:31:35.544544+0000","last_fullsized":"2024-02-15T23:31:35.544544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:35.544287+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:35.544287+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.544287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:02.404817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.391356+0000","last_change":"2024-02-15T23:31:22.391356+0000","last_active":"2024-02-15T23:31:22.391356+0000","last_peered":"2024-02-15T23:31:22.391356+0000","last_clean":"2024-02-15T23:31:22.391356+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:31:22.391356+0000","last_undegraded":"2024-02-15T23:31:22.391356+0000","last_fullsized":"2024-02-15T23:31:22.391356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.391105+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:17.676736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.367893+0000","last_change":"2024-02-15T23:31:38.367893+0000","last_active":"2024-02-15T23:31:38.367893+0000","last_peered":"2024-02-15T23:31:38.367893+0000","last_clean":"2024-02-15T23:31:38.367893+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:31:38.367893+0000","last_undegraded":"2024-02-15T23:31:38.367893+0000","last_fullsized":"2024-02-15T23:31:38.367893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:38.367646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:38.367646+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.367646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:55.873044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.402060+0000","last_change":"2024-02-15T23:32:11.402116+0000","last_active":"2024-02-15T23:32:11.402060+0000","last_peered":"2024-02-15T23:32:11.402060+0000","last_clean":"2024-02-15T23:32:11.402060+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:32:11.402060+0000","last_undegraded":"2024-02-15T23:32:11.402060+0000","last_fullsized":"2024-02-15T23:32:11.402060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:11.401862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:11.401862+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.401862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:34.783625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.583056+0000","last_change":"2024-02-15T23:31:36.583056+0000","last_active":"2024-02-15T23:31:36.583056+0000","last_peered":"2024-02-15T23:31:36.583056+0000","last_clean":"2024-02-15T23:31:36.583056+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:31:36.583056+0000","last_undegraded":"2024-02-15T23:31:36.583056+0000","last_fullsized":"2024-02-15T23:31:36.583056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:36.582666+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:36.582666+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.582666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:45.901692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.734055+0000","last_change":"2024-02-15T23:31:59.734172+0000","last_active":"2024-02-15T23:31:59.734055+0000","last_peered":"2024-02-15T23:31:59.734055+0000","last_clean":"2024-02-15T23:31:59.734055+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:31:59.734055+0000","last_undegraded":"2024-02-15T23:31:59.734055+0000","last_fullsized":"2024-02-15T23:31:59.734055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:59.733761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:59.733761+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.733761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:12.574558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.359814+0000","last_change":"2024-02-15T23:31:25.359814+0000","last_active":"2024-02-15T23:31:25.359814+0000","last_peered":"2024-02-15T23:31:25.359814+0000","last_clean":"2024-02-15T23:31:25.359814+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:31:25.359814+0000","last_undegraded":"2024-02-15T23:31:25.359814+0000","last_fullsized":"2024-02-15T23:31:25.359814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.359571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:32.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.537676+0000","last_change":"2024-02-15T23:31:27.537676+0000","last_active":"2024-02-15T23:31:27.537676+0000","last_peered":"2024-02-15T23:31:27.537676+0000","last_clean":"2024-02-15T23:31:27.537676+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:31:27.537676+0000","last_undegraded":"2024-02-15T23:31:27.537676+0000","last_fullsized":"2024-02-15T23:31:27.537676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.537385+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.232882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.781906+0000","last_change":"2024-02-15T23:31:20.781906+0000","last_active":"2024-02-15T23:31:20.781906+0000","last_peered":"2024-02-15T23:31:20.781906+0000","last_clean":"2024-02-15T23:31:20.781906+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:31:20.781906+0000","last_undegraded":"2024-02-15T23:31:20.781906+0000","last_fullsized":"2024-02-15T23:31:20.781906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.781647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:41:14.417063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:15.418186+0000","last_change":"2024-02-15T23:32:15.418237+0000","last_active":"2024-02-15T23:32:15.418186+0000","last_peered":"2024-02-15T23:32:15.418186+0000","last_clean":"2024-02-15T23:32:15.418186+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:32:15.418186+0000","last_undegraded":"2024-02-15T23:32:15.418186+0000","last_fullsized":"2024-02-15T23:32:15.418186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:15.417994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:15.417994+0000","last_clean_scrub_stamp":"2024-02-15T23:32:15.417994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:53.824487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.473112+0000","last_change":"2024-02-15T23:31:42.473112+0000","last_active":"2024-02-15T23:31:42.473112+0000","last_peered":"2024-02-15T23:31:42.473112+0000","last_clean":"2024-02-15T23:31:42.473112+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:31:42.473112+0000","last_undegraded":"2024-02-15T23:31:42.473112+0000","last_fullsized":"2024-02-15T23:31:42.473112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-15T23:31:42.472867+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-15T23:31:42.472867+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.472867+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:06.587933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.732380+0000","last_change":"2024-02-15T23:31:58.732520+0000","last_active":"2024-02-15T23:31:58.732380+0000","last_peered":"2024-02-15T23:31:58.732380+0000","last_clean":"2024-02-15T23:31:58.732380+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:31:58.732380+0000","last_undegraded":"2024-02-15T23:31:58.732380+0000","last_fullsized":"2024-02-15T23:31:58.732380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:58.732121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:58.732121+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.732121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:42:58.692459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.710546+0000","last_change":"2024-02-15T23:31:29.710546+0000","last_active":"2024-02-15T23:31:29.710546+0000","last_peered":"2024-02-15T23:31:29.710546+0000","last_clean":"2024-02-15T23:31:29.710546+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:31:29.710546+0000","last_undegraded":"2024-02-15T23:31:29.710546+0000","last_fullsized":"2024-02-15T23:31:29.710546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.710190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:50.879896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'43","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.526124+0000","last_change":"2024-02-15T23:31:26.526124+0000","last_active":"2024-02-15T23:31:26.526124+0000","last_peered":"2024-02-15T23:31:26.526124+0000","last_clean":"2024-02-15T23:31:26.526124+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:26.526124+0000","last_undegraded":"2024-02-15T23:31:26.526124+0000","last_fullsized":"2024-02-15T23:31:26.526124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.525844+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:36.827174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.360759+0000","last_change":"2024-02-15T23:31:17.360759+0000","last_active":"2024-02-15T23:31:17.360759+0000","last_peered":"2024-02-15T23:31:17.360759+0000","last_clean":"2024-02-15T23:31:17.360759+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:31:17.360759+0000","last_undegraded":"2024-02-15T23:31:17.360759+0000","last_fullsized":"2024-02-15T23:31:17.360759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.360411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.189143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316917+0000","last_change":"2024-02-15T23:29:39.784430+0000","last_active":"2024-02-15T23:31:16.316917+0000","last_peered":"2024-02-15T23:31:16.316917+0000","last_clean":"2024-02-15T23:31:16.316917+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:31:16.316917+0000","last_undegraded":"2024-02-15T23:31:16.316917+0000","last_fullsized":"2024-02-15T23:31:16.316917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'10","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.176987+0000","last_change":"2024-02-15T23:31:57.177054+0000","last_active":"2024-02-15T23:31:57.176987+0000","last_peered":"2024-02-15T23:31:57.176987+0000","last_clean":"2024-02-15T23:31:57.176987+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:31:57.176987+0000","last_undegraded":"2024-02-15T23:31:57.176987+0000","last_fullsized":"2024-02-15T23:31:57.176987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-15T23:31:57.176757+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-15T23:31:57.176757+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.176757+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:24.740746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.496349+0000","last_change":"2024-02-15T23:31:59.496531+0000","last_active":"2024-02-15T23:31:59.496349+0000","last_peered":"2024-02-15T23:31:59.496349+0000","last_clean":"2024-02-15T23:31:59.496349+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:31:59.496349+0000","last_undegraded":"2024-02-15T23:31:59.496349+0000","last_fullsized":"2024-02-15T23:31:59.496349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:59.496102+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.496102+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.496102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.176917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.372027+0000","last_change":"2024-02-15T23:31:18.372027+0000","last_active":"2024-02-15T23:31:18.372027+0000","last_peered":"2024-02-15T23:31:18.372027+0000","last_clean":"2024-02-15T23:31:18.372027+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:31:18.372027+0000","last_undegraded":"2024-02-15T23:31:18.372027+0000","last_fullsized":"2024-02-15T23:31:18.372027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.371701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:25.403990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.817387+0000","last_change":"2024-02-15T23:31:26.817387+0000","last_active":"2024-02-15T23:31:26.817387+0000","last_peered":"2024-02-15T23:31:26.817387+0000","last_clean":"2024-02-15T23:31:26.817387+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:31:26.817387+0000","last_undegraded":"2024-02-15T23:31:26.817387+0000","last_fullsized":"2024-02-15T23:31:26.817387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.817124+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:53.251206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.927965+0000","last_change":"2024-02-15T23:31:15.927965+0000","last_active":"2024-02-15T23:31:15.927965+0000","last_peered":"2024-02-15T23:31:15.927965+0000","last_clean":"2024-02-15T23:31:15.927965+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:31:15.927965+0000","last_undegraded":"2024-02-15T23:31:15.927965+0000","last_fullsized":"2024-02-15T23:31:15.927965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.927696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:57:32.034698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.455640+0000","last_change":"2024-02-15T23:31:35.455640+0000","last_active":"2024-02-15T23:31:35.455640+0000","last_peered":"2024-02-15T23:31:35.455640+0000","last_clean":"2024-02-15T23:31:35.455640+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:31:35.455640+0000","last_undegraded":"2024-02-15T23:31:35.455640+0000","last_fullsized":"2024-02-15T23:31:35.455640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:35.455367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:35.455367+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.455367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:32:41.304232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:18.179682+0000","last_change":"2024-02-15T23:32:18.179746+0000","last_active":"2024-02-15T23:32:18.179682+0000","last_peered":"2024-02-15T23:32:18.179682+0000","last_clean":"2024-02-15T23:32:18.179682+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:32:18.179682+0000","last_undegraded":"2024-02-15T23:32:18.179682+0000","last_fullsized":"2024-02-15T23:32:18.179682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:18.179460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:18.179460+0000","last_clean_scrub_stamp":"2024-02-15T23:32:18.179460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:46:10.295456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.533581+0000","last_change":"2024-02-15T23:31:34.533581+0000","last_active":"2024-02-15T23:31:34.533581+0000","last_peered":"2024-02-15T23:31:34.533581+0000","last_clean":"2024-02-15T23:31:34.533581+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:31:34.533581+0000","last_undegraded":"2024-02-15T23:31:34.533581+0000","last_fullsized":"2024-02-15T23:31:34.533581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.533297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.501484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.507799+0000","last_change":"2024-02-15T23:31:29.507799+0000","last_active":"2024-02-15T23:31:29.507799+0000","last_peered":"2024-02-15T23:31:29.507799+0000","last_clean":"2024-02-15T23:31:29.507799+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:29.507799+0000","last_undegraded":"2024-02-15T23:31:29.507799+0000","last_fullsized":"2024-02-15T23:31:29.507799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.507529+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.492158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.901594+0000","last_change":"2024-02-15T23:31:16.901594+0000","last_active":"2024-02-15T23:31:16.901594+0000","last_peered":"2024-02-15T23:31:16.901594+0000","last_clean":"2024-02-15T23:31:16.901594+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:31:16.901594+0000","last_undegraded":"2024-02-15T23:31:16.901594+0000","last_fullsized":"2024-02-15T23:31:16.901594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.901336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:01:50.745987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.397828+0000","last_change":"2024-02-15T23:32:14.397984+0000","last_active":"2024-02-15T23:32:14.397828+0000","last_peered":"2024-02-15T23:32:14.397828+0000","last_clean":"2024-02-15T23:32:14.397828+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:32:14.397828+0000","last_undegraded":"2024-02-15T23:32:14.397828+0000","last_fullsized":"2024-02-15T23:32:14.397828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:32:14.397617+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:32:14.397617+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.397617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:29.848259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.369161+0000","last_change":"2024-02-15T23:31:58.369287+0000","last_active":"2024-02-15T23:31:58.369161+0000","last_peered":"2024-02-15T23:31:58.369161+0000","last_clean":"2024-02-15T23:31:58.369161+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:31:58.369161+0000","last_undegraded":"2024-02-15T23:31:58.369161+0000","last_fullsized":"2024-02-15T23:31:58.369161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:58.368897+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:58.368897+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.368897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:34.625095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.461296+0000","last_change":"2024-02-15T23:31:55.461454+0000","last_active":"2024-02-15T23:31:55.461296+0000","last_peered":"2024-02-15T23:31:55.461296+0000","last_clean":"2024-02-15T23:31:55.461296+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:31:55.461296+0000","last_undegraded":"2024-02-15T23:31:55.461296+0000","last_fullsized":"2024-02-15T23:31:55.461296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.461068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.461068+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.461068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:30.998159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.651082+0000","last_change":"2024-02-15T23:31:34.651082+0000","last_active":"2024-02-15T23:31:34.651082+0000","last_peered":"2024-02-15T23:31:34.651082+0000","last_clean":"2024-02-15T23:31:34.651082+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:31:34.651082+0000","last_undegraded":"2024-02-15T23:31:34.651082+0000","last_fullsized":"2024-02-15T23:31:34.651082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.650808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.650808+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.650808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:46.892855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.445025+0000","last_change":"2024-02-15T23:31:28.445025+0000","last_active":"2024-02-15T23:31:28.445025+0000","last_peered":"2024-02-15T23:31:28.445025+0000","last_clean":"2024-02-15T23:31:28.445025+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:31:28.445025+0000","last_undegraded":"2024-02-15T23:31:28.445025+0000","last_fullsized":"2024-02-15T23:31:28.445025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.444726+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:09.360474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.369935+0000","last_change":"2024-02-15T23:31:22.369935+0000","last_active":"2024-02-15T23:31:22.369935+0000","last_peered":"2024-02-15T23:31:22.369935+0000","last_clean":"2024-02-15T23:31:22.369935+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:31:22.369935+0000","last_undegraded":"2024-02-15T23:31:22.369935+0000","last_fullsized":"2024-02-15T23:31:22.369935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.369655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:03.533673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.198053+0000","last_change":"2024-02-15T23:32:08.198105+0000","last_active":"2024-02-15T23:32:08.198053+0000","last_peered":"2024-02-15T23:32:08.198053+0000","last_clean":"2024-02-15T23:32:08.198053+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:32:08.198053+0000","last_undegraded":"2024-02-15T23:32:08.198053+0000","last_fullsized":"2024-02-15T23:32:08.198053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.197854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.197854+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.197854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:10.338610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.454965+0000","last_change":"2024-02-15T23:31:29.454965+0000","last_active":"2024-02-15T23:31:29.454965+0000","last_peered":"2024-02-15T23:31:29.454965+0000","last_clean":"2024-02-15T23:31:29.454965+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:29.454965+0000","last_undegraded":"2024-02-15T23:31:29.454965+0000","last_fullsized":"2024-02-15T23:31:29.454965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.454568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:03.856437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.509155+0000","last_change":"2024-02-15T23:32:01.509226+0000","last_active":"2024-02-15T23:32:01.509155+0000","last_peered":"2024-02-15T23:32:01.509155+0000","last_clean":"2024-02-15T23:32:01.509155+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:32:01.509155+0000","last_undegraded":"2024-02-15T23:32:01.509155+0000","last_fullsized":"2024-02-15T23:32:01.509155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:01.508935+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:01.508935+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.508935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:37.563662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.714462+0000","last_change":"2024-02-15T23:31:31.714462+0000","last_active":"2024-02-15T23:31:31.714462+0000","last_peered":"2024-02-15T23:31:31.714462+0000","last_clean":"2024-02-15T23:31:31.714462+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:31:31.714462+0000","last_undegraded":"2024-02-15T23:31:31.714462+0000","last_fullsized":"2024-02-15T23:31:31.714462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.714124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:31.708391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.561879+0000","last_change":"2024-02-15T23:31:25.561879+0000","last_active":"2024-02-15T23:31:25.561879+0000","last_peered":"2024-02-15T23:31:25.561879+0000","last_clean":"2024-02-15T23:31:25.561879+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:31:25.561879+0000","last_undegraded":"2024-02-15T23:31:25.561879+0000","last_fullsized":"2024-02-15T23:31:25.561879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.561617+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:41.337167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.529167+0000","last_change":"2024-02-15T23:31:36.529167+0000","last_active":"2024-02-15T23:31:36.529167+0000","last_peered":"2024-02-15T23:31:36.529167+0000","last_clean":"2024-02-15T23:31:36.529167+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:31:36.529167+0000","last_undegraded":"2024-02-15T23:31:36.529167+0000","last_fullsized":"2024-02-15T23:31:36.529167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:36.528916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:36.528916+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.528916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:45.847942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.066468+0000","last_change":"2024-02-15T23:32:00.066519+0000","last_active":"2024-02-15T23:32:00.066468+0000","last_peered":"2024-02-15T23:32:00.066468+0000","last_clean":"2024-02-15T23:32:00.066468+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:32:00.066468+0000","last_undegraded":"2024-02-15T23:32:00.066468+0000","last_fullsized":"2024-02-15T23:32:00.066468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:00.066277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:00.066277+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.066277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:06:03.264969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.440425+0000","last_change":"2024-02-15T23:31:50.440425+0000","last_active":"2024-02-15T23:31:50.440425+0000","last_peered":"2024-02-15T23:31:50.440425+0000","last_clean":"2024-02-15T23:31:50.440425+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:31:50.440425+0000","last_undegraded":"2024-02-15T23:31:50.440425+0000","last_fullsized":"2024-02-15T23:31:50.440425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:50.440173+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:50.440173+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.440173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:31.355921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.213365+0000","last_change":"2024-02-15T23:32:11.213514+0000","last_active":"2024-02-15T23:32:11.213365+0000","last_peered":"2024-02-15T23:32:11.213365+0000","last_clean":"2024-02-15T23:32:11.213365+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:32:11.213365+0000","last_undegraded":"2024-02-15T23:32:11.213365+0000","last_fullsized":"2024-02-15T23:32:11.213365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:11.213126+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:11.213126+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.213126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:06.414510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.554311+0000","last_change":"2024-02-15T23:31:33.554311+0000","last_active":"2024-02-15T23:31:33.554311+0000","last_peered":"2024-02-15T23:31:33.554311+0000","last_clean":"2024-02-15T23:31:33.554311+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:31:33.554311+0000","last_undegraded":"2024-02-15T23:31:33.554311+0000","last_fullsized":"2024-02-15T23:31:33.554311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.554047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.257009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.356251+0000","last_change":"2024-02-15T23:31:42.356344+0000","last_active":"2024-02-15T23:31:42.356251+0000","last_peered":"2024-02-15T23:31:42.356251+0000","last_clean":"2024-02-15T23:31:42.356251+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:31:42.356251+0000","last_undegraded":"2024-02-15T23:31:42.356251+0000","last_fullsized":"2024-02-15T23:31:42.356251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:42.356050+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:42.356050+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.356050+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:50.625885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.756163+0000","last_change":"2024-02-15T23:31:28.756163+0000","last_active":"2024-02-15T23:31:28.756163+0000","last_peered":"2024-02-15T23:31:28.756163+0000","last_clean":"2024-02-15T23:31:28.756163+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:28.756163+0000","last_undegraded":"2024-02-15T23:31:28.756163+0000","last_fullsized":"2024-02-15T23:31:28.756163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.755882+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:32.706979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316988+0000","last_change":"2024-02-15T23:29:39.775113+0000","last_active":"2024-02-15T23:31:16.316988+0000","last_peered":"2024-02-15T23:31:16.316988+0000","last_clean":"2024-02-15T23:31:16.316988+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:31:16.316988+0000","last_undegraded":"2024-02-15T23:31:16.316988+0000","last_fullsized":"2024-02-15T23:31:16.316988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.673550+0000","last_change":"2024-02-15T23:31:38.673550+0000","last_active":"2024-02-15T23:31:38.673550+0000","last_peered":"2024-02-15T23:31:38.673550+0000","last_clean":"2024-02-15T23:31:38.673550+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:31:38.673550+0000","last_undegraded":"2024-02-15T23:31:38.673550+0000","last_fullsized":"2024-02-15T23:31:38.673550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:38.673299+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:38.673299+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.673299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:50.183471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.513677+0000","last_change":"2024-02-15T23:32:07.513754+0000","last_active":"2024-02-15T23:32:07.513677+0000","last_peered":"2024-02-15T23:32:07.513677+0000","last_clean":"2024-02-15T23:32:07.513677+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:32:07.513677+0000","last_undegraded":"2024-02-15T23:32:07.513677+0000","last_fullsized":"2024-02-15T23:32:07.513677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:07.513457+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:07.513457+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.513457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:34.176641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.518612+0000","last_change":"2024-02-15T23:31:31.518612+0000","last_active":"2024-02-15T23:31:31.518612+0000","last_peered":"2024-02-15T23:31:31.518612+0000","last_clean":"2024-02-15T23:31:31.518612+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:31:31.518612+0000","last_undegraded":"2024-02-15T23:31:31.518612+0000","last_fullsized":"2024-02-15T23:31:31.518612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.518312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.640014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.423852+0000","last_change":"2024-02-15T23:31:23.423852+0000","last_active":"2024-02-15T23:31:23.423852+0000","last_peered":"2024-02-15T23:31:23.423852+0000","last_clean":"2024-02-15T23:31:23.423852+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:31:23.423852+0000","last_undegraded":"2024-02-15T23:31:23.423852+0000","last_fullsized":"2024-02-15T23:31:23.423852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.423607+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:37.518487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.569048+0000","last_change":"2024-02-15T23:31:15.569048+0000","last_active":"2024-02-15T23:31:15.569048+0000","last_peered":"2024-02-15T23:31:15.569048+0000","last_clean":"2024-02-15T23:31:15.569048+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:31:15.569048+0000","last_undegraded":"2024-02-15T23:31:15.569048+0000","last_fullsized":"2024-02-15T23:31:15.569048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.568926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:10.440118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.430515+0000","last_change":"2024-02-15T23:32:12.430573+0000","last_active":"2024-02-15T23:32:12.430515+0000","last_peered":"2024-02-15T23:32:12.430515+0000","last_clean":"2024-02-15T23:32:12.430515+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:32:12.430515+0000","last_undegraded":"2024-02-15T23:32:12.430515+0000","last_fullsized":"2024-02-15T23:32:12.430515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:12.430261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:12.430261+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.430261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:59.527661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.635470+0000","last_change":"2024-02-15T23:31:42.635470+0000","last_active":"2024-02-15T23:31:42.635470+0000","last_peered":"2024-02-15T23:31:42.635470+0000","last_clean":"2024-02-15T23:31:42.635470+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:31:42.635470+0000","last_undegraded":"2024-02-15T23:31:42.635470+0000","last_fullsized":"2024-02-15T23:31:42.635470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:42.635214+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:42.635214+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.635214+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:35.664062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.163523+0000","last_change":"2024-02-15T23:32:09.163607+0000","last_active":"2024-02-15T23:32:09.163523+0000","last_peered":"2024-02-15T23:32:09.163523+0000","last_clean":"2024-02-15T23:32:09.163523+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:32:09.163523+0000","last_undegraded":"2024-02-15T23:32:09.163523+0000","last_fullsized":"2024-02-15T23:32:09.163523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:09.163292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:09.163292+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.163292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:34.045146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.758567+0000","last_change":"2024-02-15T23:31:30.758567+0000","last_active":"2024-02-15T23:31:30.758567+0000","last_peered":"2024-02-15T23:31:30.758567+0000","last_clean":"2024-02-15T23:31:30.758567+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:31:30.758567+0000","last_undegraded":"2024-02-15T23:31:30.758567+0000","last_fullsized":"2024-02-15T23:31:30.758567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.758324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:34.432457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.549776+0000","last_change":"2024-02-15T23:31:30.549776+0000","last_active":"2024-02-15T23:31:30.549776+0000","last_peered":"2024-02-15T23:31:30.549776+0000","last_clean":"2024-02-15T23:31:30.549776+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:31:30.549776+0000","last_undegraded":"2024-02-15T23:31:30.549776+0000","last_fullsized":"2024-02-15T23:31:30.549776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.549503+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.362864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.350413+0000","last_change":"2024-02-15T23:31:39.350413+0000","last_active":"2024-02-15T23:31:39.350413+0000","last_peered":"2024-02-15T23:31:39.350413+0000","last_clean":"2024-02-15T23:31:39.350413+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:31:39.350413+0000","last_undegraded":"2024-02-15T23:31:39.350413+0000","last_fullsized":"2024-02-15T23:31:39.350413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.350163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.350163+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.350163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:00.377352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316924+0000","last_change":"2024-02-15T23:29:39.784125+0000","last_active":"2024-02-15T23:31:16.316924+0000","last_peered":"2024-02-15T23:31:16.316924+0000","last_clean":"2024-02-15T23:31:16.316924+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:31:16.316924+0000","last_undegraded":"2024-02-15T23:31:16.316924+0000","last_fullsized":"2024-02-15T23:31:16.316924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.116498+0000","last_change":"2024-02-15T23:32:02.116549+0000","last_active":"2024-02-15T23:32:02.116498+0000","last_peered":"2024-02-15T23:32:02.116498+0000","last_clean":"2024-02-15T23:32:02.116498+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:32:02.116498+0000","last_undegraded":"2024-02-15T23:32:02.116498+0000","last_fullsized":"2024-02-15T23:32:02.116498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.116301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.116301+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.116301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:40.094471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.391810+0000","last_change":"2024-02-15T23:31:57.391944+0000","last_active":"2024-02-15T23:31:57.391810+0000","last_peered":"2024-02-15T23:31:57.391810+0000","last_clean":"2024-02-15T23:31:57.391810+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:31:57.391810+0000","last_undegraded":"2024-02-15T23:31:57.391810+0000","last_fullsized":"2024-02-15T23:31:57.391810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:57.391581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:57.391581+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.391581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:03.240446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.436490+0000","last_change":"2024-02-15T23:31:28.436490+0000","last_active":"2024-02-15T23:31:28.436490+0000","last_peered":"2024-02-15T23:31:28.436490+0000","last_clean":"2024-02-15T23:31:28.436490+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:28.436490+0000","last_undegraded":"2024-02-15T23:31:28.436490+0000","last_fullsized":"2024-02-15T23:31:28.436490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.436171+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:39.946344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'28","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.362393+0000","last_change":"2024-02-15T23:31:41.362393+0000","last_active":"2024-02-15T23:31:41.362393+0000","last_peered":"2024-02-15T23:31:41.362393+0000","last_clean":"2024-02-15T23:31:41.362393+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:31:41.362393+0000","last_undegraded":"2024-02-15T23:31:41.362393+0000","last_fullsized":"2024-02-15T23:31:41.362393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-02-15T23:31:41.362130+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-02-15T23:31:41.362130+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.362130+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:58.292943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.335984+0000","last_change":"2024-02-15T23:31:44.335984+0000","last_active":"2024-02-15T23:31:44.335984+0000","last_peered":"2024-02-15T23:31:44.335984+0000","last_clean":"2024-02-15T23:31:44.335984+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:31:44.335984+0000","last_undegraded":"2024-02-15T23:31:44.335984+0000","last_fullsized":"2024-02-15T23:31:44.335984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:44.335687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:44.335687+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.335687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:23.592145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.317047+0000","last_change":"2024-02-15T23:29:39.784728+0000","last_active":"2024-02-15T23:31:16.317047+0000","last_peered":"2024-02-15T23:31:16.317047+0000","last_clean":"2024-02-15T23:31:16.317047+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:31:16.317047+0000","last_undegraded":"2024-02-15T23:31:16.317047+0000","last_fullsized":"2024-02-15T23:31:16.317047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.649753+0000","last_change":"2024-02-15T23:31:40.649753+0000","last_active":"2024-02-15T23:31:40.649753+0000","last_peered":"2024-02-15T23:31:40.649753+0000","last_clean":"2024-02-15T23:31:40.649753+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:31:40.649753+0000","last_undegraded":"2024-02-15T23:31:40.649753+0000","last_fullsized":"2024-02-15T23:31:40.649753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:40.649389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:40.649389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.649389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:48.462750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.522382+0000","last_change":"2024-02-15T23:32:02.522513+0000","last_active":"2024-02-15T23:32:02.522382+0000","last_peered":"2024-02-15T23:32:02.522382+0000","last_clean":"2024-02-15T23:32:02.522382+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:32:02.522382+0000","last_undegraded":"2024-02-15T23:32:02.522382+0000","last_fullsized":"2024-02-15T23:32:02.522382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.522145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.522145+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.522145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:23.549334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.519469+0000","last_change":"2024-02-15T23:31:32.519469+0000","last_active":"2024-02-15T23:31:32.519469+0000","last_peered":"2024-02-15T23:31:32.519469+0000","last_clean":"2024-02-15T23:31:32.519469+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:31:32.519469+0000","last_undegraded":"2024-02-15T23:31:32.519469+0000","last_fullsized":"2024-02-15T23:31:32.519469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.519211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.548059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.414372+0000","last_change":"2024-02-15T23:31:36.414372+0000","last_active":"2024-02-15T23:31:36.414372+0000","last_peered":"2024-02-15T23:31:36.414372+0000","last_clean":"2024-02-15T23:31:36.414372+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:36.414372+0000","last_undegraded":"2024-02-15T23:31:36.414372+0000","last_fullsized":"2024-02-15T23:31:36.414372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-15T23:31:36.414095+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-15T23:31:36.414095+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.414095+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:12.670293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.576932+0000","last_change":"2024-02-15T23:31:24.576932+0000","last_active":"2024-02-15T23:31:24.576932+0000","last_peered":"2024-02-15T23:31:24.576932+0000","last_clean":"2024-02-15T23:31:24.576932+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:31:24.576932+0000","last_undegraded":"2024-02-15T23:31:24.576932+0000","last_fullsized":"2024-02-15T23:31:24.576932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.576683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:19:16.045656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.316862+0000","last_change":"2024-02-15T23:29:39.784447+0000","last_active":"2024-02-15T23:31:16.316862+0000","last_peered":"2024-02-15T23:31:16.316862+0000","last_clean":"2024-02-15T23:31:16.316862+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:31:16.316862+0000","last_undegraded":"2024-02-15T23:31:16.316862+0000","last_fullsized":"2024-02-15T23:31:16.316862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:29:38.714005+0000","last_clean_scrub_stamp":"2024-02-15T23:29:38.714005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.577577+0000","last_change":"2024-02-15T23:31:37.577577+0000","last_active":"2024-02-15T23:31:37.577577+0000","last_peered":"2024-02-15T23:31:37.577577+0000","last_clean":"2024-02-15T23:31:37.577577+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:31:37.577577+0000","last_undegraded":"2024-02-15T23:31:37.577577+0000","last_fullsized":"2024-02-15T23:31:37.577577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.577323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.577323+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.577323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:59.138396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.666415+0000","last_change":"2024-02-15T23:31:45.666475+0000","last_active":"2024-02-15T23:31:45.666415+0000","last_peered":"2024-02-15T23:31:45.666415+0000","last_clean":"2024-02-15T23:31:45.666415+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:31:45.666415+0000","last_undegraded":"2024-02-15T23:31:45.666415+0000","last_fullsized":"2024-02-15T23:31:45.666415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:45.666217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:45.666217+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.666217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:12.526747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.471185+0000","last_change":"2024-02-15T23:31:46.471250+0000","last_active":"2024-02-15T23:31:46.471185+0000","last_peered":"2024-02-15T23:31:46.471185+0000","last_clean":"2024-02-15T23:31:46.471185+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:31:46.471185+0000","last_undegraded":"2024-02-15T23:31:46.471185+0000","last_fullsized":"2024-02-15T23:31:46.471185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:46.471000+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:46.471000+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.471000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:30:13.169741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.402015+0000","last_change":"2024-02-15T23:32:05.402093+0000","last_active":"2024-02-15T23:32:05.402015+0000","last_peered":"2024-02-15T23:32:05.402015+0000","last_clean":"2024-02-15T23:32:05.402015+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:32:05.402015+0000","last_undegraded":"2024-02-15T23:32:05.402015+0000","last_fullsized":"2024-02-15T23:32:05.402015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:05.401804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:05.401804+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.401804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:49:10.224674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.465414+0000","last_change":"2024-02-15T23:31:34.465414+0000","last_active":"2024-02-15T23:31:34.465414+0000","last_peered":"2024-02-15T23:31:34.465414+0000","last_clean":"2024-02-15T23:31:34.465414+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:34.465414+0000","last_undegraded":"2024-02-15T23:31:34.465414+0000","last_fullsized":"2024-02-15T23:31:34.465414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.465154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:45.028387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:34.366233+0000","last_change":"2024-02-15T23:32:34.366323+0000","last_active":"2024-02-15T23:32:34.366233+0000","last_peered":"2024-02-15T23:32:34.366233+0000","last_clean":"2024-02-15T23:32:34.366233+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:32:34.366233+0000","last_undegraded":"2024-02-15T23:32:34.366233+0000","last_fullsized":"2024-02-15T23:32:34.366233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:34.366003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:34.366003+0000","last_clean_scrub_stamp":"2024-02-15T23:32:34.366003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:05.213171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.429461+0000","last_change":"2024-02-15T23:31:52.429522+0000","last_active":"2024-02-15T23:31:52.429461+0000","last_peered":"2024-02-15T23:31:52.429461+0000","last_clean":"2024-02-15T23:31:52.429461+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:52.429461+0000","last_undegraded":"2024-02-15T23:31:52.429461+0000","last_fullsized":"2024-02-15T23:31:52.429461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:52.429268+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:52.429268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.429268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:34.192751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.442518+0000","last_change":"2024-02-15T23:32:04.442579+0000","last_active":"2024-02-15T23:32:04.442518+0000","last_peered":"2024-02-15T23:32:04.442518+0000","last_clean":"2024-02-15T23:32:04.442518+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:32:04.442518+0000","last_undegraded":"2024-02-15T23:32:04.442518+0000","last_fullsized":"2024-02-15T23:32:04.442518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.442322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.442322+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.442322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:12.712157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.431824+0000","last_change":"2024-02-15T23:31:43.431966+0000","last_active":"2024-02-15T23:31:43.431824+0000","last_peered":"2024-02-15T23:31:43.431824+0000","last_clean":"2024-02-15T23:31:43.431824+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:43.431824+0000","last_undegraded":"2024-02-15T23:31:43.431824+0000","last_fullsized":"2024-02-15T23:31:43.431824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:43.431598+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:43.431598+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.431598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:46.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.423709+0000","last_change":"2024-02-15T23:32:08.423847+0000","last_active":"2024-02-15T23:32:08.423709+0000","last_peered":"2024-02-15T23:32:08.423709+0000","last_clean":"2024-02-15T23:32:08.423709+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:32:08.423709+0000","last_undegraded":"2024-02-15T23:32:08.423709+0000","last_fullsized":"2024-02-15T23:32:08.423709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.423428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.423428+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.423428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:15.787731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.569475+0000","last_change":"2024-02-15T23:31:41.569613+0000","last_active":"2024-02-15T23:31:41.569475+0000","last_peered":"2024-02-15T23:31:41.569475+0000","last_clean":"2024-02-15T23:31:41.569475+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:31:41.569475+0000","last_undegraded":"2024-02-15T23:31:41.569475+0000","last_fullsized":"2024-02-15T23:31:41.569475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:41.569264+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:41.569264+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.569264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:36.816368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.460098+0000","last_change":"2024-02-15T23:31:53.460237+0000","last_active":"2024-02-15T23:31:53.460098+0000","last_peered":"2024-02-15T23:31:53.460098+0000","last_clean":"2024-02-15T23:31:53.460098+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:31:53.460098+0000","last_undegraded":"2024-02-15T23:31:53.460098+0000","last_fullsized":"2024-02-15T23:31:53.460098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.459858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.459858+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.459858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:59.119468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.381192+0000","last_change":"2024-02-15T23:31:56.381291+0000","last_active":"2024-02-15T23:31:56.381192+0000","last_peered":"2024-02-15T23:31:56.381192+0000","last_clean":"2024-02-15T23:31:56.381192+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:31:56.381192+0000","last_undegraded":"2024-02-15T23:31:56.381192+0000","last_fullsized":"2024-02-15T23:31:56.381192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.380971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.380971+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.380971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:06.944204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.669309+0000","last_change":"2024-02-15T23:31:47.669477+0000","last_active":"2024-02-15T23:31:47.669309+0000","last_peered":"2024-02-15T23:31:47.669309+0000","last_clean":"2024-02-15T23:31:47.669309+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:31:47.669309+0000","last_undegraded":"2024-02-15T23:31:47.669309+0000","last_fullsized":"2024-02-15T23:31:47.669309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:47.669042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:47.669042+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.669042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:58:09.230115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.507539+0000","last_change":"2024-02-15T23:31:54.507596+0000","last_active":"2024-02-15T23:31:54.507539+0000","last_peered":"2024-02-15T23:31:54.507539+0000","last_clean":"2024-02-15T23:31:54.507539+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:54.507539+0000","last_undegraded":"2024-02-15T23:31:54.507539+0000","last_fullsized":"2024-02-15T23:31:54.507539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:54.507342+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:54.507342+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.507342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:41.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.450623+0000","last_change":"2024-02-15T23:32:07.450688+0000","last_active":"2024-02-15T23:32:07.450623+0000","last_peered":"2024-02-15T23:32:07.450623+0000","last_clean":"2024-02-15T23:32:07.450623+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:32:07.450623+0000","last_undegraded":"2024-02-15T23:32:07.450623+0000","last_fullsized":"2024-02-15T23:32:07.450623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.450435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.450435+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.450435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:34.113619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.530211+0000","last_change":"2024-02-15T23:31:45.530211+0000","last_active":"2024-02-15T23:31:45.530211+0000","last_peered":"2024-02-15T23:31:45.530211+0000","last_clean":"2024-02-15T23:31:45.530211+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:31:45.530211+0000","last_undegraded":"2024-02-15T23:31:45.530211+0000","last_fullsized":"2024-02-15T23:31:45.530211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:45.529928+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:45.529928+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.529928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:15.937262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:17.227637+0000","last_change":"2024-02-15T23:32:17.227705+0000","last_active":"2024-02-15T23:32:17.227637+0000","last_peered":"2024-02-15T23:32:17.227637+0000","last_clean":"2024-02-15T23:32:17.227637+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:32:17.227637+0000","last_undegraded":"2024-02-15T23:32:17.227637+0000","last_fullsized":"2024-02-15T23:32:17.227637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:17.227431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:17.227431+0000","last_clean_scrub_stamp":"2024-02-15T23:32:17.227431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:05.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:17.401101+0000","last_change":"2024-02-15T23:32:17.401101+0000","last_active":"2024-02-15T23:32:17.401101+0000","last_peered":"2024-02-15T23:32:17.401101+0000","last_clean":"2024-02-15T23:32:17.401101+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:32:17.401101+0000","last_undegraded":"2024-02-15T23:32:17.401101+0000","last_fullsized":"2024-02-15T23:32:17.401101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:32:17.400686+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:32:17.400686+0000","last_clean_scrub_stamp":"2024-02-15T23:32:17.400686+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:24:40.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.388509+0000","last_change":"2024-02-15T23:31:53.388574+0000","last_active":"2024-02-15T23:31:53.388509+0000","last_peered":"2024-02-15T23:31:53.388509+0000","last_clean":"2024-02-15T23:31:53.388509+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:31:53.388509+0000","last_undegraded":"2024-02-15T23:31:53.388509+0000","last_fullsized":"2024-02-15T23:31:53.388509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:53.388287+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:53.388287+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.388287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:38.067265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'22","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.424844+0000","last_change":"2024-02-15T23:31:41.424844+0000","last_active":"2024-02-15T23:31:41.424844+0000","last_peered":"2024-02-15T23:31:41.424844+0000","last_clean":"2024-02-15T23:31:41.424844+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:31:41.424844+0000","last_undegraded":"2024-02-15T23:31:41.424844+0000","last_fullsized":"2024-02-15T23:31:41.424844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-02-15T23:31:41.424484+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-02-15T23:31:41.424484+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.424484+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:46:22.213060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.485141+0000","last_change":"2024-02-15T23:31:49.485212+0000","last_active":"2024-02-15T23:31:49.485141+0000","last_peered":"2024-02-15T23:31:49.485141+0000","last_clean":"2024-02-15T23:31:49.485141+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:31:49.485141+0000","last_undegraded":"2024-02-15T23:31:49.485141+0000","last_fullsized":"2024-02-15T23:31:49.485141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.484951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.484951+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.484951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:26.137159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.421836+0000","last_change":"2024-02-15T23:31:56.421894+0000","last_active":"2024-02-15T23:31:56.421836+0000","last_peered":"2024-02-15T23:31:56.421836+0000","last_clean":"2024-02-15T23:31:56.421836+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:31:56.421836+0000","last_undegraded":"2024-02-15T23:31:56.421836+0000","last_fullsized":"2024-02-15T23:31:56.421836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-02-15T23:31:56.421634+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-02-15T23:31:56.421634+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.421634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:06.984867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.517512+0000","last_change":"2024-02-15T23:32:06.517569+0000","last_active":"2024-02-15T23:32:06.517512+0000","last_peered":"2024-02-15T23:32:06.517512+0000","last_clean":"2024-02-15T23:32:06.517512+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:32:06.517512+0000","last_undegraded":"2024-02-15T23:32:06.517512+0000","last_fullsized":"2024-02-15T23:32:06.517512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.517319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.517319+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.517319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:50.782638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.514883+0000","last_change":"2024-02-15T23:31:43.514883+0000","last_active":"2024-02-15T23:31:43.514883+0000","last_peered":"2024-02-15T23:31:43.514883+0000","last_clean":"2024-02-15T23:31:43.514883+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:31:43.514883+0000","last_undegraded":"2024-02-15T23:31:43.514883+0000","last_fullsized":"2024-02-15T23:31:43.514883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:43.514514+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:43.514514+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.514514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:46.279795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:21.228565+0000","last_change":"2024-02-15T23:32:21.228641+0000","last_active":"2024-02-15T23:32:21.228565+0000","last_peered":"2024-02-15T23:32:21.228565+0000","last_clean":"2024-02-15T23:32:21.228565+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:32:21.228565+0000","last_undegraded":"2024-02-15T23:32:21.228565+0000","last_fullsized":"2024-02-15T23:32:21.228565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:21.228366+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:21.228366+0000","last_clean_scrub_stamp":"2024-02-15T23:32:21.228366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:08.186351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.498328+0000","last_change":"2024-02-15T23:31:46.498328+0000","last_active":"2024-02-15T23:31:46.498328+0000","last_peered":"2024-02-15T23:31:46.498328+0000","last_clean":"2024-02-15T23:31:46.498328+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:31:46.498328+0000","last_undegraded":"2024-02-15T23:31:46.498328+0000","last_fullsized":"2024-02-15T23:31:46.498328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:46.497968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:46.497968+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.497968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:56.619609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.165564+0000","last_change":"2024-02-15T23:32:10.165630+0000","last_active":"2024-02-15T23:32:10.165564+0000","last_peered":"2024-02-15T23:32:10.165564+0000","last_clean":"2024-02-15T23:32:10.165564+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:32:10.165564+0000","last_undegraded":"2024-02-15T23:32:10.165564+0000","last_fullsized":"2024-02-15T23:32:10.165564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:10.165366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:10.165366+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.165366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:14:02.611190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.165422+0000","last_change":"2024-02-15T23:32:05.165483+0000","last_active":"2024-02-15T23:32:05.165422+0000","last_peered":"2024-02-15T23:32:05.165422+0000","last_clean":"2024-02-15T23:32:05.165422+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:32:05.165422+0000","last_undegraded":"2024-02-15T23:32:05.165422+0000","last_fullsized":"2024-02-15T23:32:05.165422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:05.165244+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:05.165244+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.165244+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:35:12.231397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.663850+0000","last_change":"2024-02-15T23:31:51.663905+0000","last_active":"2024-02-15T23:31:51.663850+0000","last_peered":"2024-02-15T23:31:51.663850+0000","last_clean":"2024-02-15T23:31:51.663850+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:31:51.663850+0000","last_undegraded":"2024-02-15T23:31:51.663850+0000","last_fullsized":"2024-02-15T23:31:51.663850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:51.663652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:51.663652+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.663652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:46:32.452228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.523615+0000","last_change":"2024-02-15T23:31:58.523763+0000","last_active":"2024-02-15T23:31:58.523615+0000","last_peered":"2024-02-15T23:31:58.523615+0000","last_clean":"2024-02-15T23:31:58.523615+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:31:58.523615+0000","last_undegraded":"2024-02-15T23:31:58.523615+0000","last_fullsized":"2024-02-15T23:31:58.523615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:58.523409+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:58.523409+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.523409+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:34.779607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:25.294587+0000","last_change":"2024-02-15T23:32:25.294742+0000","last_active":"2024-02-15T23:32:25.294587+0000","last_peered":"2024-02-15T23:32:25.294587+0000","last_clean":"2024-02-15T23:32:25.294587+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:32:25.294587+0000","last_undegraded":"2024-02-15T23:32:25.294587+0000","last_fullsized":"2024-02-15T23:32:25.294587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:25.294275+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:25.294275+0000","last_clean_scrub_stamp":"2024-02-15T23:32:25.294275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:50:19.400906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:19.218583+0000","last_change":"2024-02-15T23:32:19.218733+0000","last_active":"2024-02-15T23:32:19.218583+0000","last_peered":"2024-02-15T23:32:19.218583+0000","last_clean":"2024-02-15T23:32:19.218583+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:32:19.218583+0000","last_undegraded":"2024-02-15T23:32:19.218583+0000","last_fullsized":"2024-02-15T23:32:19.218583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:19.218351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:19.218351+0000","last_clean_scrub_stamp":"2024-02-15T23:32:19.218351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:29:27.312666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.421684+0000","last_change":"2024-02-15T23:32:00.421747+0000","last_active":"2024-02-15T23:32:00.421684+0000","last_peered":"2024-02-15T23:32:00.421684+0000","last_clean":"2024-02-15T23:32:00.421684+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:32:00.421684+0000","last_undegraded":"2024-02-15T23:32:00.421684+0000","last_fullsized":"2024-02-15T23:32:00.421684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:00.421498+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:00.421498+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.421498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:15.838107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.405622+0000","last_change":"2024-02-15T23:32:09.405767+0000","last_active":"2024-02-15T23:32:09.405622+0000","last_peered":"2024-02-15T23:32:09.405622+0000","last_clean":"2024-02-15T23:32:09.405622+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:32:09.405622+0000","last_undegraded":"2024-02-15T23:32:09.405622+0000","last_fullsized":"2024-02-15T23:32:09.405622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:09.405404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:09.405404+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.405404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:42.824154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.574309+0000","last_change":"2024-02-15T23:31:40.574309+0000","last_active":"2024-02-15T23:31:40.574309+0000","last_peered":"2024-02-15T23:31:40.574309+0000","last_clean":"2024-02-15T23:31:40.574309+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:31:40.574309+0000","last_undegraded":"2024-02-15T23:31:40.574309+0000","last_fullsized":"2024-02-15T23:31:40.574309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:40.574041+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:40.574041+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.574041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:24.310993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.53700000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77300000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.48399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.83099999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Feb 15 23:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.76900000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.223,"15min":0.223},"max":{"1min":0.78600000000000003,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Feb 15 23:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.48099999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.90200000000000002,"5min":1.103,"15min":1.103},"last":0.754},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.47299999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.83599999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57899999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705707,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.55700000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81599999999999995,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.53400000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81699999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56100000000000005,"15min":0.54000000000000004},"min":{"1min":0.48599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.73499999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.46899999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.68700000000000006,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.498}]},{"osd":3,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.48599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.80900000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":2.452,"15min":2.452},"last":0.70399999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.499,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81000000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.54300000000000004,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77700000000000002,"5min":1.036,"15min":1.036},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Feb 15 23:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.48299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.73799999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.47399999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.89900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Feb 15 23:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.48799999999999999,"5min":0.247,"15min":0.247},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72399999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.56399999999999995,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.89700000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.59899999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91700000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Feb 15 23:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.54300000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":1.24,"15min":1.24},"last":0.872},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.872,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Feb 15 23:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.57599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.63300000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.80100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:32:38.327 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:38.328 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:38.329 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:38.329 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:38.330 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:38.330 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:38.330 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T23:29:38.714005+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=29, tm_sec=38, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=13, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T23:32:38.331 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T23:32:58.331 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T23:32:58.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.454+0000 7fed1db98640 1 Processor -- start 2024-02-15T23:32:58.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.454+0000 7fed1db98640 1 -- start start 2024-02-15T23:32:58.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed1db98640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed18099320 0x7fed18133210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed1db98640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1809a490 con 0x7fed18098830 2024-02-15T23:32:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed1db98640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed18072800 con 0x7fed18099320 2024-02-15T23:32:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed0ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed18099320 0x7fed18133210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed177fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fed18098830 0x7fed18098c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:59950/0 (socket says 172.21.15.131:59950) 2024-02-15T23:32:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed0ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed18099320 0x7fed18133210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53622/0 (socket says 172.21.15.131:53622) 2024-02-15T23:32:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed177fe640 1 -- 172.21.15.131:0/3015234933 learned_addr learned my addr 172.21.15.131:0/3015234933 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:32:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed0ffff640 1 -- 172.21.15.131:0/3015234933 >> v1:172.21.15.131:6789/0 conn(0x7fed18098830 legacy=0x7fed18098c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:58.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed0ffff640 1 -- 172.21.15.131:0/3015234933 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1809d790 con 0x7fed18099320 2024-02-15T23:32:58.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed0ffff640 1 --2- 172.21.15.131:0/3015234933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18099320 0x7fed18133210 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fed00009740 tx=0x7fed0001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0419327814481e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:58.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed16ffd640 1 -- 172.21.15.131:0/3015234933 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed000ab530 con 0x7fed18099320 2024-02-15T23:32:58.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed16ffd640 1 -- 172.21.15.131:0/3015234933 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed000a7050 con 0x7fed18099320 2024-02-15T23:32:58.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.458+0000 7fed16ffd640 1 -- 172.21.15.131:0/3015234933 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed000ab7e0 con 0x7fed18099320 2024-02-15T23:32:58.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- 172.21.15.131:0/3015234933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18099320 msgr2=0x7fed18133210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:58.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 --2- 172.21.15.131:0/3015234933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18099320 0x7fed18133210 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fed00009740 tx=0x7fed0001c370 comp rx=0 tx=0).stop 2024-02-15T23:32:58.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- 172.21.15.131:0/3015234933 shutdown_connections 2024-02-15T23:32:58.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 --2- 172.21.15.131:0/3015234933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18099320 0x7fed18133210 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:58.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- 172.21.15.131:0/3015234933 >> 172.21.15.131:0/3015234933 conn(0x7fed180a0920 msgr2=0x7fed1809ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:32:58.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- 172.21.15.131:0/3015234933 shutdown_connections 2024-02-15T23:32:58.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- 172.21.15.131:0/3015234933 wait complete. 2024-02-15T23:32:58.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 Processor -- start 2024-02-15T23:32:58.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- start start 2024-02-15T23:32:58.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18098830 0x7fed181c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:58.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1812da70 con 0x7fed18098830 2024-02-15T23:32:58.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed177fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18098830 0x7fed181c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:58.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed177fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18098830 0x7fed181c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53638/0 (socket says 172.21.15.131:53638) 2024-02-15T23:32:58.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed177fe640 1 -- 172.21.15.131:0/4291406455 learned_addr learned my addr 172.21.15.131:0/4291406455 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:32:58.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed177fe640 1 -- 172.21.15.131:0/4291406455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00009420 con 0x7fed18098830 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed177fe640 1 --2- 172.21.15.131:0/4291406455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18098830 0x7fed181c5440 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fed0800c3a0 tx=0x7fed0800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed14ff9640 1 -- 172.21.15.131:0/4291406455 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed08005c20 con 0x7fed18098830 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed14ff9640 1 -- 172.21.15.131:0/4291406455 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08005d80 con 0x7fed18098830 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed18072140 con 0x7fed18098830 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed14ff9640 1 -- 172.21.15.131:0/4291406455 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed08007200 con 0x7fed18098830 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed18071270 con 0x7fed18098830 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed18071a70 con 0x7fed18098830 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed14ff9640 1 -- 172.21.15.131:0/4291406455 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fed08007360 con 0x7fed18098830 2024-02-15T23:32:58.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed14ff9640 1 --2- 172.21.15.131:0/4291406455 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fecf8035a10 0x7fecf8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:58.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed14ff9640 1 -- 172.21.15.131:0/4291406455 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fed08047d30 con 0x7fed18098830 2024-02-15T23:32:58.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.462+0000 7fed0ffff640 1 --2- 172.21.15.131:0/4291406455 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fecf8035a10 0x7fecf8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:58.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.466+0000 7fed0ffff640 1 --2- 172.21.15.131:0/4291406455 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fecf8035a10 0x7fecf8037ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed000ad000 tx=0x7fed000a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:58.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.470+0000 7fed14ff9640 1 -- 172.21.15.131:0/4291406455 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed08012400 con 0x7fed18098830 2024-02-15T23:32:58.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.622+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 --> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed18062860 con 0x7fecf8035a10 2024-02-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.666+0000 7fed14ff9640 1 -- 172.21.15.131:0/4291406455 <== mgr.4101 v2:172.21.15.133:6824/3499050160 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+674141 (secure 0 0 0) 0x7fed18062860 con 0x7fecf8035a10 2024-02-15T23:32:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-02-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.670+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fecf8035a10 msgr2=0x7fecf8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.670+0000 7fed1db98640 1 --2- 172.21.15.131:0/4291406455 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fecf8035a10 0x7fecf8037ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed000ad000 tx=0x7fed000a6000 comp rx=0 tx=0).stop 2024-02-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.670+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18098830 msgr2=0x7fed181c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.670+0000 7fed1db98640 1 --2- 172.21.15.131:0/4291406455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18098830 0x7fed181c5440 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fed0800c3a0 tx=0x7fed0800c860 comp rx=0 tx=0).stop 2024-02-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.674+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 shutdown_connections 2024-02-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.674+0000 7fed1db98640 1 --2- 172.21.15.131:0/4291406455 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7fecf8035a10 0x7fecf8037ed0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.674+0000 7fed1db98640 1 --2- 172.21.15.131:0/4291406455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed18098830 0x7fed181c5440 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.674+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 >> 172.21.15.131:0/4291406455 conn(0x7fed180a0920 msgr2=0x7fed1809b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.674+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 shutdown_connections 2024-02-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.674+0000 7fed1db98640 1 -- 172.21.15.131:0/4291406455 wait complete. 2024-02-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-02-15T23:32:57.596197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3968,"ondisk_log_size":3968,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152504,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334856,"statfs":{"total":386547056640,"available":386390892544,"internally_reserved":0,"allocated":2908160,"data_stored":1785528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006708"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.668252+0000","last_change":"2024-02-15T23:31:53.668312+0000","last_active":"2024-02-15T23:31:53.668252+0000","last_peered":"2024-02-15T23:31:53.668252+0000","last_clean":"2024-02-15T23:31:53.668252+0000","last_became_active":"2024-02-15T23:29:29.730269+0000","last_became_peered":"2024-02-15T23:29:29.730269+0000","last_unstale":"2024-02-15T23:31:53.668252+0000","last_undegraded":"2024-02-15T23:31:53.668252+0000","last_fullsized":"2024-02-15T23:31:53.668252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.668051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.668051+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.668051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:56.433332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.499037+0000","last_change":"2024-02-15T23:31:52.499037+0000","last_active":"2024-02-15T23:31:52.499037+0000","last_peered":"2024-02-15T23:31:52.499037+0000","last_clean":"2024-02-15T23:31:52.499037+0000","last_became_active":"2024-02-15T23:29:31.690967+0000","last_became_peered":"2024-02-15T23:29:31.690967+0000","last_unstale":"2024-02-15T23:31:52.499037+0000","last_undegraded":"2024-02-15T23:31:52.499037+0000","last_fullsized":"2024-02-15T23:31:52.499037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:52.498705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:52.498705+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.498705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:34.262188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.419135+0000","last_change":"2024-02-15T23:31:49.419197+0000","last_active":"2024-02-15T23:31:49.419135+0000","last_peered":"2024-02-15T23:31:49.419135+0000","last_clean":"2024-02-15T23:31:49.419135+0000","last_became_active":"2024-02-15T23:29:29.718575+0000","last_became_peered":"2024-02-15T23:29:29.718575+0000","last_unstale":"2024-02-15T23:31:49.419135+0000","last_undegraded":"2024-02-15T23:31:49.419135+0000","last_fullsized":"2024-02-15T23:31:49.419135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.418938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.418938+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.418938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:26.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.093766+0000","last_change":"2024-02-15T23:31:59.093766+0000","last_active":"2024-02-15T23:31:59.093766+0000","last_peered":"2024-02-15T23:31:59.093766+0000","last_clean":"2024-02-15T23:31:59.093766+0000","last_became_active":"2024-02-15T23:29:31.701314+0000","last_became_peered":"2024-02-15T23:29:31.701314+0000","last_unstale":"2024-02-15T23:31:59.093766+0000","last_undegraded":"2024-02-15T23:31:59.093766+0000","last_fullsized":"2024-02-15T23:31:59.093766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:59.093513+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.093513+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.093513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:08:54.559676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:20.246671+0000","last_change":"2024-02-15T23:32:20.246741+0000","last_active":"2024-02-15T23:32:20.246671+0000","last_peered":"2024-02-15T23:32:20.246671+0000","last_clean":"2024-02-15T23:32:20.246671+0000","last_became_active":"2024-02-15T23:29:29.721427+0000","last_became_peered":"2024-02-15T23:29:29.721427+0000","last_unstale":"2024-02-15T23:32:20.246671+0000","last_undegraded":"2024-02-15T23:32:20.246671+0000","last_fullsized":"2024-02-15T23:32:20.246671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:20.246435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:20.246435+0000","last_clean_scrub_stamp":"2024-02-15T23:32:20.246435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:22:49.762005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.127896+0000","last_change":"2024-02-15T23:31:58.127896+0000","last_active":"2024-02-15T23:31:58.127896+0000","last_peered":"2024-02-15T23:31:58.127896+0000","last_clean":"2024-02-15T23:31:58.127896+0000","last_became_active":"2024-02-15T23:29:31.701302+0000","last_became_peered":"2024-02-15T23:29:31.701302+0000","last_unstale":"2024-02-15T23:31:58.127896+0000","last_undegraded":"2024-02-15T23:31:58.127896+0000","last_fullsized":"2024-02-15T23:31:58.127896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:58.127630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:58.127630+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.127630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:23:10.804456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.757267+0000","last_change":"2024-02-15T23:32:00.757326+0000","last_active":"2024-02-15T23:32:00.757267+0000","last_peered":"2024-02-15T23:32:00.757267+0000","last_clean":"2024-02-15T23:32:00.757267+0000","last_became_active":"2024-02-15T23:29:29.724612+0000","last_became_peered":"2024-02-15T23:29:29.724612+0000","last_unstale":"2024-02-15T23:32:00.757267+0000","last_undegraded":"2024-02-15T23:32:00.757267+0000","last_fullsized":"2024-02-15T23:32:00.757267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:00.757064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:00.757064+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.757064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:48:08.010450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.224937+0000","last_change":"2024-02-15T23:31:53.224937+0000","last_active":"2024-02-15T23:31:53.224937+0000","last_peered":"2024-02-15T23:31:53.224937+0000","last_clean":"2024-02-15T23:31:53.224937+0000","last_became_active":"2024-02-15T23:29:31.702317+0000","last_became_peered":"2024-02-15T23:29:31.702317+0000","last_unstale":"2024-02-15T23:31:53.224937+0000","last_undegraded":"2024-02-15T23:31:53.224937+0000","last_fullsized":"2024-02-15T23:31:53.224937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.224656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.224656+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.224656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:31.631150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:32.271255+0000","last_change":"2024-02-15T23:32:32.271334+0000","last_active":"2024-02-15T23:32:32.271255+0000","last_peered":"2024-02-15T23:32:32.271255+0000","last_clean":"2024-02-15T23:32:32.271255+0000","last_became_active":"2024-02-15T23:29:29.706002+0000","last_became_peered":"2024-02-15T23:29:29.706002+0000","last_unstale":"2024-02-15T23:32:32.271255+0000","last_undegraded":"2024-02-15T23:32:32.271255+0000","last_fullsized":"2024-02-15T23:32:32.271255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:32.271047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:32.271047+0000","last_clean_scrub_stamp":"2024-02-15T23:32:32.271047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:31.187683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.477578+0000","last_change":"2024-02-15T23:31:47.477646+0000","last_active":"2024-02-15T23:31:47.477578+0000","last_peered":"2024-02-15T23:31:47.477578+0000","last_clean":"2024-02-15T23:31:47.477578+0000","last_became_active":"2024-02-15T23:29:31.688982+0000","last_became_peered":"2024-02-15T23:29:31.688982+0000","last_unstale":"2024-02-15T23:31:47.477578+0000","last_undegraded":"2024-02-15T23:31:47.477578+0000","last_fullsized":"2024-02-15T23:31:47.477578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:47.477403+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:47.477403+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.477403+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:54.301986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.733100+0000","last_change":"2024-02-15T23:32:01.733158+0000","last_active":"2024-02-15T23:32:01.733100+0000","last_peered":"2024-02-15T23:32:01.733100+0000","last_clean":"2024-02-15T23:32:01.733100+0000","last_became_active":"2024-02-15T23:29:29.729590+0000","last_became_peered":"2024-02-15T23:29:29.729590+0000","last_unstale":"2024-02-15T23:32:01.733100+0000","last_undegraded":"2024-02-15T23:32:01.733100+0000","last_fullsized":"2024-02-15T23:32:01.733100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:01.732866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:01.732866+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.732866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:39.379554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.400579+0000","last_change":"2024-02-15T23:31:37.400579+0000","last_active":"2024-02-15T23:31:37.400579+0000","last_peered":"2024-02-15T23:31:37.400579+0000","last_clean":"2024-02-15T23:31:37.400579+0000","last_became_active":"2024-02-15T23:29:31.703678+0000","last_became_peered":"2024-02-15T23:29:31.703678+0000","last_unstale":"2024-02-15T23:31:37.400579+0000","last_undegraded":"2024-02-15T23:31:37.400579+0000","last_fullsized":"2024-02-15T23:31:37.400579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.400334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.400334+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.400334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:49:40.355253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:31.263987+0000","last_change":"2024-02-15T23:32:31.264051+0000","last_active":"2024-02-15T23:32:31.263987+0000","last_peered":"2024-02-15T23:32:31.263987+0000","last_clean":"2024-02-15T23:32:31.263987+0000","last_became_active":"2024-02-15T23:29:29.705237+0000","last_became_peered":"2024-02-15T23:29:29.705237+0000","last_unstale":"2024-02-15T23:32:31.263987+0000","last_undegraded":"2024-02-15T23:32:31.263987+0000","last_fullsized":"2024-02-15T23:32:31.263987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:31.263774+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:31.263774+0000","last_clean_scrub_stamp":"2024-02-15T23:32:31.263774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:36:48.334312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.635991+0000","last_change":"2024-02-15T23:31:44.636058+0000","last_active":"2024-02-15T23:31:44.635991+0000","last_peered":"2024-02-15T23:31:44.635991+0000","last_clean":"2024-02-15T23:31:44.635991+0000","last_became_active":"2024-02-15T23:29:31.688993+0000","last_became_peered":"2024-02-15T23:29:31.688993+0000","last_unstale":"2024-02-15T23:31:44.635991+0000","last_undegraded":"2024-02-15T23:31:44.635991+0000","last_fullsized":"2024-02-15T23:31:44.635991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-15T23:31:44.635777+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-15T23:31:44.635777+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.635777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:42.603964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.506217+0000","last_change":"2024-02-15T23:31:47.506217+0000","last_active":"2024-02-15T23:31:47.506217+0000","last_peered":"2024-02-15T23:31:47.506217+0000","last_clean":"2024-02-15T23:31:47.506217+0000","last_became_active":"2024-02-15T23:29:29.719156+0000","last_became_peered":"2024-02-15T23:29:29.719156+0000","last_unstale":"2024-02-15T23:31:47.506217+0000","last_undegraded":"2024-02-15T23:31:47.506217+0000","last_fullsized":"2024-02-15T23:31:47.506217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:47.505968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:47.505968+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.505968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:54.330551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.709654+0000","last_change":"2024-02-15T23:31:37.709654+0000","last_active":"2024-02-15T23:31:37.709654+0000","last_peered":"2024-02-15T23:31:37.709654+0000","last_clean":"2024-02-15T23:31:37.709654+0000","last_became_active":"2024-02-15T23:29:31.710787+0000","last_became_peered":"2024-02-15T23:29:31.710787+0000","last_unstale":"2024-02-15T23:31:37.709654+0000","last_undegraded":"2024-02-15T23:31:37.709654+0000","last_fullsized":"2024-02-15T23:31:37.709654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:37.709401+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:37.709401+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.709401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:33.404898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.070933+0000","last_change":"2024-02-15T23:32:03.070988+0000","last_active":"2024-02-15T23:32:03.070933+0000","last_peered":"2024-02-15T23:32:03.070933+0000","last_clean":"2024-02-15T23:32:03.070933+0000","last_became_active":"2024-02-15T23:29:31.699591+0000","last_became_peered":"2024-02-15T23:29:31.699591+0000","last_unstale":"2024-02-15T23:32:03.070933+0000","last_undegraded":"2024-02-15T23:32:03.070933+0000","last_fullsized":"2024-02-15T23:32:03.070933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:03.070745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:03.070745+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.070745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:50.320974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.545582+0000","last_change":"2024-02-15T23:32:03.545657+0000","last_active":"2024-02-15T23:32:03.545582+0000","last_peered":"2024-02-15T23:32:03.545582+0000","last_clean":"2024-02-15T23:32:03.545582+0000","last_became_active":"2024-02-15T23:29:29.719433+0000","last_became_peered":"2024-02-15T23:29:29.719433+0000","last_unstale":"2024-02-15T23:32:03.545582+0000","last_undegraded":"2024-02-15T23:32:03.545582+0000","last_fullsized":"2024-02-15T23:32:03.545582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:03.545376+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:03.545376+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.545376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:03:37.413362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.524000+0000","last_change":"2024-02-15T23:31:50.524000+0000","last_active":"2024-02-15T23:31:50.524000+0000","last_peered":"2024-02-15T23:31:50.524000+0000","last_clean":"2024-02-15T23:31:50.524000+0000","last_became_active":"2024-02-15T23:29:31.690916+0000","last_became_peered":"2024-02-15T23:29:31.690916+0000","last_unstale":"2024-02-15T23:31:50.524000+0000","last_undegraded":"2024-02-15T23:31:50.524000+0000","last_fullsized":"2024-02-15T23:31:50.524000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:50.523751+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:50.523751+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.523751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:31.439499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.662952+0000","last_change":"2024-02-15T23:31:41.662952+0000","last_active":"2024-02-15T23:31:41.662952+0000","last_peered":"2024-02-15T23:31:41.662952+0000","last_clean":"2024-02-15T23:31:41.662952+0000","last_became_active":"2024-02-15T23:29:29.734178+0000","last_became_peered":"2024-02-15T23:29:29.734178+0000","last_unstale":"2024-02-15T23:31:41.662952+0000","last_undegraded":"2024-02-15T23:31:41.662952+0000","last_fullsized":"2024-02-15T23:31:41.662952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:41.662713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:41.662713+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.662713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:16.784415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.471993+0000","last_change":"2024-02-15T23:31:48.471993+0000","last_active":"2024-02-15T23:31:48.471993+0000","last_peered":"2024-02-15T23:31:48.471993+0000","last_clean":"2024-02-15T23:31:48.471993+0000","last_became_active":"2024-02-15T23:29:31.689621+0000","last_became_peered":"2024-02-15T23:29:31.689621+0000","last_unstale":"2024-02-15T23:31:48.471993+0000","last_undegraded":"2024-02-15T23:31:48.471993+0000","last_fullsized":"2024-02-15T23:31:48.471993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:48.471732+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:48.471732+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.471732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:51.993523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.506627+0000","last_change":"2024-02-15T23:31:51.506627+0000","last_active":"2024-02-15T23:31:51.506627+0000","last_peered":"2024-02-15T23:31:51.506627+0000","last_clean":"2024-02-15T23:31:51.506627+0000","last_became_active":"2024-02-15T23:29:29.738666+0000","last_became_peered":"2024-02-15T23:29:29.738666+0000","last_unstale":"2024-02-15T23:31:51.506627+0000","last_undegraded":"2024-02-15T23:31:51.506627+0000","last_fullsized":"2024-02-15T23:31:51.506627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:51.506363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:51.506363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.506363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:25.908233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.453219+0000","last_change":"2024-02-15T23:31:45.453219+0000","last_active":"2024-02-15T23:31:45.453219+0000","last_peered":"2024-02-15T23:31:45.453219+0000","last_clean":"2024-02-15T23:31:45.453219+0000","last_became_active":"2024-02-15T23:29:31.708080+0000","last_became_peered":"2024-02-15T23:29:31.708080+0000","last_unstale":"2024-02-15T23:31:45.453219+0000","last_undegraded":"2024-02-15T23:31:45.453219+0000","last_fullsized":"2024-02-15T23:31:45.453219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:45.452811+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:45.452811+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.452811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:03.503688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.529592+0000","last_change":"2024-02-15T23:32:04.529655+0000","last_active":"2024-02-15T23:32:04.529592+0000","last_peered":"2024-02-15T23:32:04.529592+0000","last_clean":"2024-02-15T23:32:04.529592+0000","last_became_active":"2024-02-15T23:29:29.718256+0000","last_became_peered":"2024-02-15T23:29:29.718256+0000","last_unstale":"2024-02-15T23:32:04.529592+0000","last_undegraded":"2024-02-15T23:32:04.529592+0000","last_fullsized":"2024-02-15T23:32:04.529592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.529406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.529406+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.529406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:12.799241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.711628+0000","last_change":"2024-02-15T23:31:46.711628+0000","last_active":"2024-02-15T23:31:46.711628+0000","last_peered":"2024-02-15T23:31:46.711628+0000","last_clean":"2024-02-15T23:31:46.711628+0000","last_became_active":"2024-02-15T23:29:31.702854+0000","last_became_peered":"2024-02-15T23:29:31.702854+0000","last_unstale":"2024-02-15T23:31:46.711628+0000","last_undegraded":"2024-02-15T23:31:46.711628+0000","last_fullsized":"2024-02-15T23:31:46.711628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-02-15T23:31:46.711368+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-02-15T23:31:46.711368+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.711368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:56.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.478507+0000","last_change":"2024-02-15T23:31:51.478507+0000","last_active":"2024-02-15T23:31:51.478507+0000","last_peered":"2024-02-15T23:31:51.478507+0000","last_clean":"2024-02-15T23:31:51.478507+0000","last_became_active":"2024-02-15T23:29:29.718328+0000","last_became_peered":"2024-02-15T23:29:29.718328+0000","last_unstale":"2024-02-15T23:31:51.478507+0000","last_undegraded":"2024-02-15T23:31:51.478507+0000","last_fullsized":"2024-02-15T23:31:51.478507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:51.478248+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:51.478248+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.478248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:25.880117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.551340+0000","last_change":"2024-02-15T23:31:44.551340+0000","last_active":"2024-02-15T23:31:44.551340+0000","last_peered":"2024-02-15T23:31:44.551340+0000","last_clean":"2024-02-15T23:31:44.551340+0000","last_became_active":"2024-02-15T23:29:31.688934+0000","last_became_peered":"2024-02-15T23:29:31.688934+0000","last_unstale":"2024-02-15T23:31:44.551340+0000","last_undegraded":"2024-02-15T23:31:44.551340+0000","last_fullsized":"2024-02-15T23:31:44.551340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-02-15T23:31:44.551091+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-02-15T23:31:44.551091+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.551091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:41:29.596164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:15.220575+0000","last_change":"2024-02-15T23:32:15.220646+0000","last_active":"2024-02-15T23:32:15.220575+0000","last_peered":"2024-02-15T23:32:15.220575+0000","last_clean":"2024-02-15T23:32:15.220575+0000","last_became_active":"2024-02-15T23:29:29.716875+0000","last_became_peered":"2024-02-15T23:29:29.716875+0000","last_unstale":"2024-02-15T23:32:15.220575+0000","last_undegraded":"2024-02-15T23:32:15.220575+0000","last_fullsized":"2024-02-15T23:32:15.220575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:15.220373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:15.220373+0000","last_clean_scrub_stamp":"2024-02-15T23:32:15.220373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:18:06.499249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'18","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.562029+0000","last_change":"2024-02-15T23:31:42.562029+0000","last_active":"2024-02-15T23:31:42.562029+0000","last_peered":"2024-02-15T23:31:42.562029+0000","last_clean":"2024-02-15T23:31:42.562029+0000","last_became_active":"2024-02-15T23:29:39.759908+0000","last_became_peered":"2024-02-15T23:29:39.759908+0000","last_unstale":"2024-02-15T23:31:42.562029+0000","last_undegraded":"2024-02-15T23:31:42.562029+0000","last_fullsized":"2024-02-15T23:31:42.562029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-02-15T23:31:42.561648+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-02-15T23:31:42.561648+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.561648+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:06.676715+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.186119+0000","last_change":"2024-02-15T23:31:54.186119+0000","last_active":"2024-02-15T23:31:54.186119+0000","last_peered":"2024-02-15T23:31:54.186119+0000","last_clean":"2024-02-15T23:31:54.186119+0000","last_became_active":"2024-02-15T23:29:31.702775+0000","last_became_peered":"2024-02-15T23:29:31.702775+0000","last_unstale":"2024-02-15T23:31:54.186119+0000","last_undegraded":"2024-02-15T23:31:54.186119+0000","last_fullsized":"2024-02-15T23:31:54.186119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:54.185856+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:54.185856+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.185856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:06:08.657140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:33.316957+0000","last_change":"2024-02-15T23:32:33.317126+0000","last_active":"2024-02-15T23:32:33.316957+0000","last_peered":"2024-02-15T23:32:33.316957+0000","last_clean":"2024-02-15T23:32:33.316957+0000","last_became_active":"2024-02-15T23:29:29.711075+0000","last_became_peered":"2024-02-15T23:29:29.711075+0000","last_unstale":"2024-02-15T23:32:33.316957+0000","last_undegraded":"2024-02-15T23:32:33.316957+0000","last_fullsized":"2024-02-15T23:32:33.316957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:33.316699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:33.316699+0000","last_clean_scrub_stamp":"2024-02-15T23:32:33.316699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:12:01.748905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.381651+0000","last_change":"2024-02-15T23:31:23.381651+0000","last_active":"2024-02-15T23:31:23.381651+0000","last_peered":"2024-02-15T23:31:23.381651+0000","last_clean":"2024-02-15T23:31:23.381651+0000","last_became_active":"2024-02-15T23:29:33.712785+0000","last_became_peered":"2024-02-15T23:29:33.712785+0000","last_unstale":"2024-02-15T23:31:23.381651+0000","last_undegraded":"2024-02-15T23:31:23.381651+0000","last_fullsized":"2024-02-15T23:31:23.381651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:23.381406+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.381406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:53.788740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.240923+0000","last_change":"2024-02-15T23:31:49.240923+0000","last_active":"2024-02-15T23:31:49.240923+0000","last_peered":"2024-02-15T23:31:49.240923+0000","last_clean":"2024-02-15T23:31:49.240923+0000","last_became_active":"2024-02-15T23:29:35.747905+0000","last_became_peered":"2024-02-15T23:29:35.747905+0000","last_unstale":"2024-02-15T23:31:49.240923+0000","last_undegraded":"2024-02-15T23:31:49.240923+0000","last_fullsized":"2024-02-15T23:31:49.240923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-15T23:31:49.240607+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-15T23:31:49.240607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.240607+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:27:40.630524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.464923+0000","last_change":"2024-02-15T23:31:26.464923+0000","last_active":"2024-02-15T23:31:26.464923+0000","last_peered":"2024-02-15T23:31:26.464923+0000","last_clean":"2024-02-15T23:31:26.464923+0000","last_became_active":"2024-02-15T23:29:37.761128+0000","last_became_peered":"2024-02-15T23:29:37.761128+0000","last_unstale":"2024-02-15T23:31:26.464923+0000","last_undegraded":"2024-02-15T23:31:26.464923+0000","last_fullsized":"2024-02-15T23:31:26.464923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.464676+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.464676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:15.850726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.491181+0000","last_change":"2024-02-15T23:32:09.491239+0000","last_active":"2024-02-15T23:32:09.491181+0000","last_peered":"2024-02-15T23:32:09.491181+0000","last_clean":"2024-02-15T23:32:09.491181+0000","last_became_active":"2024-02-15T23:29:39.772102+0000","last_became_peered":"2024-02-15T23:29:39.772102+0000","last_unstale":"2024-02-15T23:32:09.491181+0000","last_undegraded":"2024-02-15T23:32:09.491181+0000","last_fullsized":"2024-02-15T23:32:09.491181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:09.490996+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:09.490996+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.490996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:50.767715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.462983+0000","last_change":"2024-02-15T23:31:33.462983+0000","last_active":"2024-02-15T23:31:33.462983+0000","last_peered":"2024-02-15T23:31:33.462983+0000","last_clean":"2024-02-15T23:31:33.462983+0000","last_became_active":"2024-02-15T23:29:31.705788+0000","last_became_peered":"2024-02-15T23:29:31.705788+0000","last_unstale":"2024-02-15T23:31:33.462983+0000","last_undegraded":"2024-02-15T23:31:33.462983+0000","last_fullsized":"2024-02-15T23:31:33.462983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:33.462731+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.462731+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:08.999822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.713072+0000","last_change":"2024-02-15T23:31:56.713134+0000","last_active":"2024-02-15T23:31:56.713072+0000","last_peered":"2024-02-15T23:31:56.713072+0000","last_clean":"2024-02-15T23:31:56.713072+0000","last_became_active":"2024-02-15T23:29:29.721952+0000","last_became_peered":"2024-02-15T23:29:29.721952+0000","last_unstale":"2024-02-15T23:31:56.713072+0000","last_undegraded":"2024-02-15T23:31:56.713072+0000","last_fullsized":"2024-02-15T23:31:56.713072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.712850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.712850+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.712850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:06:56.264686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.492105+0000","last_change":"2024-02-15T23:31:39.492105+0000","last_active":"2024-02-15T23:31:39.492105+0000","last_peered":"2024-02-15T23:31:39.492105+0000","last_clean":"2024-02-15T23:31:39.492105+0000","last_became_active":"2024-02-15T23:29:33.706814+0000","last_became_peered":"2024-02-15T23:29:33.706814+0000","last_unstale":"2024-02-15T23:31:39.492105+0000","last_undegraded":"2024-02-15T23:31:39.492105+0000","last_fullsized":"2024-02-15T23:31:39.492105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.491862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.491862+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.491862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:46.524152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.354191+0000","last_change":"2024-02-15T23:31:20.354191+0000","last_active":"2024-02-15T23:31:20.354191+0000","last_peered":"2024-02-15T23:31:20.354191+0000","last_clean":"2024-02-15T23:31:20.354191+0000","last_became_active":"2024-02-15T23:29:35.730983+0000","last_became_peered":"2024-02-15T23:29:35.730983+0000","last_unstale":"2024-02-15T23:31:20.354191+0000","last_undegraded":"2024-02-15T23:31:20.354191+0000","last_fullsized":"2024-02-15T23:31:20.354191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-15T23:31:20.353944+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.353944+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:24.028078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.362319+0000","last_change":"2024-02-15T23:31:18.362319+0000","last_active":"2024-02-15T23:31:18.362319+0000","last_peered":"2024-02-15T23:31:18.362319+0000","last_clean":"2024-02-15T23:31:18.362319+0000","last_became_active":"2024-02-15T23:29:37.751460+0000","last_became_peered":"2024-02-15T23:29:37.751460+0000","last_unstale":"2024-02-15T23:31:18.362319+0000","last_undegraded":"2024-02-15T23:31:18.362319+0000","last_fullsized":"2024-02-15T23:31:18.362319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.362075+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.362075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.313172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.452261+0000","last_change":"2024-02-15T23:31:40.452261+0000","last_active":"2024-02-15T23:31:40.452261+0000","last_peered":"2024-02-15T23:31:40.452261+0000","last_clean":"2024-02-15T23:31:40.452261+0000","last_became_active":"2024-02-15T23:29:39.756867+0000","last_became_peered":"2024-02-15T23:29:39.756867+0000","last_unstale":"2024-02-15T23:31:40.452261+0000","last_undegraded":"2024-02-15T23:31:40.452261+0000","last_fullsized":"2024-02-15T23:31:40.452261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:40.452005+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:40.452005+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.452005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:24.188956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.236850+0000","last_change":"2024-02-15T23:31:50.236850+0000","last_active":"2024-02-15T23:31:50.236850+0000","last_peered":"2024-02-15T23:31:50.236850+0000","last_clean":"2024-02-15T23:31:50.236850+0000","last_became_active":"2024-02-15T23:29:31.704011+0000","last_became_peered":"2024-02-15T23:29:31.704011+0000","last_unstale":"2024-02-15T23:31:50.236850+0000","last_undegraded":"2024-02-15T23:31:50.236850+0000","last_fullsized":"2024-02-15T23:31:50.236850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:50.236582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:50.236582+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.236582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:37.333982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.154845+0000","last_change":"2024-02-15T23:32:07.154906+0000","last_active":"2024-02-15T23:32:07.154845+0000","last_peered":"2024-02-15T23:32:07.154845+0000","last_clean":"2024-02-15T23:32:07.154845+0000","last_became_active":"2024-02-15T23:29:29.717760+0000","last_became_peered":"2024-02-15T23:29:29.717760+0000","last_unstale":"2024-02-15T23:32:07.154845+0000","last_undegraded":"2024-02-15T23:32:07.154845+0000","last_fullsized":"2024-02-15T23:32:07.154845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.154654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.154654+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.154654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:44:01.539488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.526018+0000","last_change":"2024-02-15T23:31:33.526018+0000","last_active":"2024-02-15T23:31:33.526018+0000","last_peered":"2024-02-15T23:31:33.526018+0000","last_clean":"2024-02-15T23:31:33.526018+0000","last_became_active":"2024-02-15T23:29:33.723131+0000","last_became_peered":"2024-02-15T23:29:33.723131+0000","last_unstale":"2024-02-15T23:31:33.526018+0000","last_undegraded":"2024-02-15T23:31:33.526018+0000","last_fullsized":"2024-02-15T23:31:33.526018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.525754+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.525754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.228715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.758890+0000","last_change":"2024-02-15T23:31:21.758890+0000","last_active":"2024-02-15T23:31:21.758890+0000","last_peered":"2024-02-15T23:31:21.758890+0000","last_clean":"2024-02-15T23:31:21.758890+0000","last_became_active":"2024-02-15T23:29:35.722682+0000","last_became_peered":"2024-02-15T23:29:35.722682+0000","last_unstale":"2024-02-15T23:31:21.758890+0000","last_undegraded":"2024-02-15T23:31:21.758890+0000","last_fullsized":"2024-02-15T23:31:21.758890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:21.758604+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.758604+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:00:21.378855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.276965+0000","last_change":"2024-02-15T23:31:52.276965+0000","last_active":"2024-02-15T23:31:52.276965+0000","last_peered":"2024-02-15T23:31:52.276965+0000","last_clean":"2024-02-15T23:31:52.276965+0000","last_became_active":"2024-02-15T23:29:37.773668+0000","last_became_peered":"2024-02-15T23:29:37.773668+0000","last_unstale":"2024-02-15T23:31:52.276965+0000","last_undegraded":"2024-02-15T23:31:52.276965+0000","last_fullsized":"2024-02-15T23:31:52.276965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-15T23:31:52.276608+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-15T23:31:52.276608+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.276608+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:23:11.852737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.712221+0000","last_change":"2024-02-15T23:31:36.712221+0000","last_active":"2024-02-15T23:31:36.712221+0000","last_peered":"2024-02-15T23:31:36.712221+0000","last_clean":"2024-02-15T23:31:36.712221+0000","last_became_active":"2024-02-15T23:29:39.771948+0000","last_became_peered":"2024-02-15T23:29:39.771948+0000","last_unstale":"2024-02-15T23:31:36.712221+0000","last_undegraded":"2024-02-15T23:31:36.712221+0000","last_fullsized":"2024-02-15T23:31:36.712221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:36.711954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:36.711954+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.711954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:26.098004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.434830+0000","last_change":"2024-02-15T23:32:10.434925+0000","last_active":"2024-02-15T23:32:10.434830+0000","last_peered":"2024-02-15T23:32:10.434830+0000","last_clean":"2024-02-15T23:32:10.434830+0000","last_became_active":"2024-02-15T23:29:31.695743+0000","last_became_peered":"2024-02-15T23:29:31.695743+0000","last_unstale":"2024-02-15T23:32:10.434830+0000","last_undegraded":"2024-02-15T23:32:10.434830+0000","last_fullsized":"2024-02-15T23:32:10.434830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:10.434636+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:10.434636+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.434636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:14:57.560221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.472959+0000","last_change":"2024-02-15T23:31:57.473029+0000","last_active":"2024-02-15T23:31:57.472959+0000","last_peered":"2024-02-15T23:31:57.472959+0000","last_clean":"2024-02-15T23:31:57.472959+0000","last_became_active":"2024-02-15T23:29:29.736535+0000","last_became_peered":"2024-02-15T23:29:29.736535+0000","last_unstale":"2024-02-15T23:31:57.472959+0000","last_undegraded":"2024-02-15T23:31:57.472959+0000","last_fullsized":"2024-02-15T23:31:57.472959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:57.472748+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:57.472748+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.472748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:03.321613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.380202+0000","last_change":"2024-02-15T23:31:19.380202+0000","last_active":"2024-02-15T23:31:19.380202+0000","last_peered":"2024-02-15T23:31:19.380202+0000","last_clean":"2024-02-15T23:31:19.380202+0000","last_became_active":"2024-02-15T23:29:33.714917+0000","last_became_peered":"2024-02-15T23:29:33.714917+0000","last_unstale":"2024-02-15T23:31:19.380202+0000","last_undegraded":"2024-02-15T23:31:19.380202+0000","last_fullsized":"2024-02-15T23:31:19.380202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:19.379961+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.379961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:22.107728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.801467+0000","last_change":"2024-02-15T23:31:23.801467+0000","last_active":"2024-02-15T23:31:23.801467+0000","last_peered":"2024-02-15T23:31:23.801467+0000","last_clean":"2024-02-15T23:31:23.801467+0000","last_became_active":"2024-02-15T23:29:35.717946+0000","last_became_peered":"2024-02-15T23:29:35.717946+0000","last_unstale":"2024-02-15T23:31:23.801467+0000","last_undegraded":"2024-02-15T23:31:23.801467+0000","last_fullsized":"2024-02-15T23:31:23.801467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:23.801176+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.801176+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:10:09.278307+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":343,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.592156+0000","last_change":"2024-02-15T23:31:18.592156+0000","last_active":"2024-02-15T23:31:18.592156+0000","last_peered":"2024-02-15T23:31:18.592156+0000","last_clean":"2024-02-15T23:31:18.592156+0000","last_became_active":"2024-02-15T23:29:37.751834+0000","last_became_peered":"2024-02-15T23:29:37.751834+0000","last_unstale":"2024-02-15T23:31:18.592156+0000","last_undegraded":"2024-02-15T23:31:18.592156+0000","last_fullsized":"2024-02-15T23:31:18.592156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.591821+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.591821+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:22.542917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.166029+0000","last_change":"2024-02-15T23:31:55.166087+0000","last_active":"2024-02-15T23:31:55.166029+0000","last_peered":"2024-02-15T23:31:55.166029+0000","last_clean":"2024-02-15T23:31:55.166029+0000","last_became_active":"2024-02-15T23:29:31.701799+0000","last_became_peered":"2024-02-15T23:29:31.701799+0000","last_unstale":"2024-02-15T23:31:55.166029+0000","last_undegraded":"2024-02-15T23:31:55.166029+0000","last_fullsized":"2024-02-15T23:31:55.166029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.165845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.165845+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.165845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:42:57.047533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.686615+0000","last_change":"2024-02-15T23:31:49.686753+0000","last_active":"2024-02-15T23:31:49.686615+0000","last_peered":"2024-02-15T23:31:49.686615+0000","last_clean":"2024-02-15T23:31:49.686615+0000","last_became_active":"2024-02-15T23:29:29.731380+0000","last_became_peered":"2024-02-15T23:29:29.731380+0000","last_unstale":"2024-02-15T23:31:49.686615+0000","last_undegraded":"2024-02-15T23:31:49.686615+0000","last_fullsized":"2024-02-15T23:31:49.686615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.686352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.686352+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.686352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:56.718642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.477281+0000","last_change":"2024-02-15T23:31:29.477281+0000","last_active":"2024-02-15T23:31:29.477281+0000","last_peered":"2024-02-15T23:31:29.477281+0000","last_clean":"2024-02-15T23:31:29.477281+0000","last_became_active":"2024-02-15T23:29:33.718370+0000","last_became_peered":"2024-02-15T23:29:33.718370+0000","last_unstale":"2024-02-15T23:31:29.477281+0000","last_undegraded":"2024-02-15T23:31:29.477281+0000","last_fullsized":"2024-02-15T23:31:29.477281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.477038+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.477038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.461667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.798531+0000","last_change":"2024-02-15T23:31:22.798531+0000","last_active":"2024-02-15T23:31:22.798531+0000","last_peered":"2024-02-15T23:31:22.798531+0000","last_clean":"2024-02-15T23:31:22.798531+0000","last_became_active":"2024-02-15T23:29:35.721071+0000","last_became_peered":"2024-02-15T23:29:35.721071+0000","last_unstale":"2024-02-15T23:31:22.798531+0000","last_undegraded":"2024-02-15T23:31:22.798531+0000","last_fullsized":"2024-02-15T23:31:22.798531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-15T23:31:22.798209+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.798209+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:08:35.238195+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.541487+0000","last_change":"2024-02-15T23:31:17.541487+0000","last_active":"2024-02-15T23:31:17.541487+0000","last_peered":"2024-02-15T23:31:17.541487+0000","last_clean":"2024-02-15T23:31:17.541487+0000","last_became_active":"2024-02-15T23:29:37.752149+0000","last_became_peered":"2024-02-15T23:29:37.752149+0000","last_unstale":"2024-02-15T23:31:17.541487+0000","last_undegraded":"2024-02-15T23:31:17.541487+0000","last_fullsized":"2024-02-15T23:31:17.541487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.541232+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.541232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.369965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.759456+0000","last_change":"2024-02-15T23:32:05.759513+0000","last_active":"2024-02-15T23:32:05.759456+0000","last_peered":"2024-02-15T23:32:05.759456+0000","last_clean":"2024-02-15T23:32:05.759456+0000","last_became_active":"2024-02-15T23:29:39.779161+0000","last_became_peered":"2024-02-15T23:29:39.779161+0000","last_unstale":"2024-02-15T23:32:05.759456+0000","last_undegraded":"2024-02-15T23:32:05.759456+0000","last_fullsized":"2024-02-15T23:32:05.759456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:32:05.759232+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:32:05.759232+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.759232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:16.322465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.500820+0000","last_change":"2024-02-15T23:32:08.500905+0000","last_active":"2024-02-15T23:32:08.500820+0000","last_peered":"2024-02-15T23:32:08.500820+0000","last_clean":"2024-02-15T23:32:08.500820+0000","last_became_active":"2024-02-15T23:29:31.694523+0000","last_became_peered":"2024-02-15T23:29:31.694523+0000","last_unstale":"2024-02-15T23:32:08.500820+0000","last_undegraded":"2024-02-15T23:32:08.500820+0000","last_fullsized":"2024-02-15T23:32:08.500820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:08.500638+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:08.500638+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.500638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:29.150585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.686068+0000","last_change":"2024-02-15T23:31:57.686194+0000","last_active":"2024-02-15T23:31:57.686068+0000","last_peered":"2024-02-15T23:31:57.686068+0000","last_clean":"2024-02-15T23:31:57.686068+0000","last_became_active":"2024-02-15T23:29:29.723322+0000","last_became_peered":"2024-02-15T23:29:29.723322+0000","last_unstale":"2024-02-15T23:31:57.686068+0000","last_undegraded":"2024-02-15T23:31:57.686068+0000","last_fullsized":"2024-02-15T23:31:57.686068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:57.685774+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:57.685774+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.685774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:04:55.205797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.757464+0000","last_change":"2024-02-15T23:32:07.757464+0000","last_active":"2024-02-15T23:32:07.757464+0000","last_peered":"2024-02-15T23:32:07.757464+0000","last_clean":"2024-02-15T23:32:07.757464+0000","last_became_active":"2024-02-15T23:30:10.787733+0000","last_became_peered":"2024-02-15T23:30:10.787733+0000","last_unstale":"2024-02-15T23:32:07.757464+0000","last_undegraded":"2024-02-15T23:32:07.757464+0000","last_fullsized":"2024-02-15T23:32:07.757464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.757197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.757197+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.757197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:44.013395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.459639+0000","last_change":"2024-02-15T23:31:32.459639+0000","last_active":"2024-02-15T23:31:32.459639+0000","last_peered":"2024-02-15T23:31:32.459639+0000","last_clean":"2024-02-15T23:31:32.459639+0000","last_became_active":"2024-02-15T23:29:35.746595+0000","last_became_peered":"2024-02-15T23:29:35.746595+0000","last_unstale":"2024-02-15T23:31:32.459639+0000","last_undegraded":"2024-02-15T23:31:32.459639+0000","last_fullsized":"2024-02-15T23:31:32.459639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:32.459345+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.459345+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:19.866069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.577110+0000","last_change":"2024-02-15T23:31:16.577110+0000","last_active":"2024-02-15T23:31:16.577110+0000","last_peered":"2024-02-15T23:31:16.577110+0000","last_clean":"2024-02-15T23:31:16.577110+0000","last_became_active":"2024-02-15T23:29:37.762723+0000","last_became_peered":"2024-02-15T23:29:37.762723+0000","last_unstale":"2024-02-15T23:31:16.577110+0000","last_undegraded":"2024-02-15T23:31:16.577110+0000","last_fullsized":"2024-02-15T23:31:16.577110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.576722+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.576722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:35.480941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.438325+0000","last_change":"2024-02-15T23:32:11.438395+0000","last_active":"2024-02-15T23:32:11.438325+0000","last_peered":"2024-02-15T23:32:11.438325+0000","last_clean":"2024-02-15T23:32:11.438325+0000","last_became_active":"2024-02-15T23:29:39.780451+0000","last_became_peered":"2024-02-15T23:29:39.780451+0000","last_unstale":"2024-02-15T23:32:11.438325+0000","last_undegraded":"2024-02-15T23:32:11.438325+0000","last_fullsized":"2024-02-15T23:32:11.438325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:32:11.438129+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:32:11.438129+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.438129+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:02.828046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.730502+0000","last_change":"2024-02-15T23:32:02.730563+0000","last_active":"2024-02-15T23:32:02.730502+0000","last_peered":"2024-02-15T23:32:02.730502+0000","last_clean":"2024-02-15T23:32:02.730502+0000","last_became_active":"2024-02-15T23:29:31.710680+0000","last_became_peered":"2024-02-15T23:29:31.710680+0000","last_unstale":"2024-02-15T23:32:02.730502+0000","last_undegraded":"2024-02-15T23:32:02.730502+0000","last_fullsized":"2024-02-15T23:32:02.730502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:02.730290+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:02.730290+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.730290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:47.409268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:16.211106+0000","last_change":"2024-02-15T23:32:16.211161+0000","last_active":"2024-02-15T23:32:16.211106+0000","last_peered":"2024-02-15T23:32:16.211106+0000","last_clean":"2024-02-15T23:32:16.211106+0000","last_became_active":"2024-02-15T23:29:29.720728+0000","last_became_peered":"2024-02-15T23:29:29.720728+0000","last_unstale":"2024-02-15T23:32:16.211106+0000","last_undegraded":"2024-02-15T23:32:16.211106+0000","last_fullsized":"2024-02-15T23:32:16.211106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:16.210888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:16.210888+0000","last_clean_scrub_stamp":"2024-02-15T23:32:16.210888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:03.500809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.484374+0000","last_change":"2024-02-15T23:31:37.484374+0000","last_active":"2024-02-15T23:31:37.484374+0000","last_peered":"2024-02-15T23:31:37.484374+0000","last_clean":"2024-02-15T23:31:37.484374+0000","last_became_active":"2024-02-15T23:29:33.718820+0000","last_became_peered":"2024-02-15T23:29:33.718820+0000","last_unstale":"2024-02-15T23:31:37.484374+0000","last_undegraded":"2024-02-15T23:31:37.484374+0000","last_fullsized":"2024-02-15T23:31:37.484374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.484130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.484130+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.484130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:59.045203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.514009+0000","last_change":"2024-02-15T23:31:30.514009+0000","last_active":"2024-02-15T23:31:30.514009+0000","last_peered":"2024-02-15T23:31:30.514009+0000","last_clean":"2024-02-15T23:31:30.514009+0000","last_became_active":"2024-02-15T23:29:35.746372+0000","last_became_peered":"2024-02-15T23:29:35.746372+0000","last_unstale":"2024-02-15T23:31:30.514009+0000","last_undegraded":"2024-02-15T23:31:30.514009+0000","last_fullsized":"2024-02-15T23:31:30.514009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-15T23:31:30.513714+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.513714+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:12.277197+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.644582+0000","last_change":"2024-02-15T23:31:20.644582+0000","last_active":"2024-02-15T23:31:20.644582+0000","last_peered":"2024-02-15T23:31:20.644582+0000","last_clean":"2024-02-15T23:31:20.644582+0000","last_became_active":"2024-02-15T23:29:37.762905+0000","last_became_peered":"2024-02-15T23:29:37.762905+0000","last_unstale":"2024-02-15T23:31:20.644582+0000","last_undegraded":"2024-02-15T23:31:20.644582+0000","last_fullsized":"2024-02-15T23:31:20.644582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:20.644319+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.644319+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:29.139495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:16.427397+0000","last_change":"2024-02-15T23:32:16.427523+0000","last_active":"2024-02-15T23:32:16.427397+0000","last_peered":"2024-02-15T23:32:16.427397+0000","last_clean":"2024-02-15T23:32:16.427397+0000","last_became_active":"2024-02-15T23:29:39.783317+0000","last_became_peered":"2024-02-15T23:29:39.783317+0000","last_unstale":"2024-02-15T23:32:16.427397+0000","last_undegraded":"2024-02-15T23:32:16.427397+0000","last_fullsized":"2024-02-15T23:32:16.427397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:32:16.427165+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:32:16.427165+0000","last_clean_scrub_stamp":"2024-02-15T23:32:16.427165+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:50:11.764451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.687575+0000","last_change":"2024-02-15T23:31:39.687575+0000","last_active":"2024-02-15T23:31:39.687575+0000","last_peered":"2024-02-15T23:31:39.687575+0000","last_clean":"2024-02-15T23:31:39.687575+0000","last_became_active":"2024-02-15T23:29:31.679804+0000","last_became_peered":"2024-02-15T23:29:31.679804+0000","last_unstale":"2024-02-15T23:31:39.687575+0000","last_undegraded":"2024-02-15T23:31:39.687575+0000","last_fullsized":"2024-02-15T23:31:39.687575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.687336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:21.671965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.249440+0000","last_change":"2024-02-15T23:32:13.249521+0000","last_active":"2024-02-15T23:32:13.249440+0000","last_peered":"2024-02-15T23:32:13.249440+0000","last_clean":"2024-02-15T23:32:13.249440+0000","last_became_active":"2024-02-15T23:29:29.717107+0000","last_became_peered":"2024-02-15T23:29:29.717107+0000","last_unstale":"2024-02-15T23:32:13.249440+0000","last_undegraded":"2024-02-15T23:32:13.249440+0000","last_fullsized":"2024-02-15T23:32:13.249440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:13.249231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:13.249231+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.249231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:10:51.698632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.499881+0000","last_change":"2024-02-15T23:31:31.499881+0000","last_active":"2024-02-15T23:31:31.499881+0000","last_peered":"2024-02-15T23:31:31.499881+0000","last_clean":"2024-02-15T23:31:31.499881+0000","last_became_active":"2024-02-15T23:29:33.725648+0000","last_became_peered":"2024-02-15T23:29:33.725648+0000","last_unstale":"2024-02-15T23:31:31.499881+0000","last_undegraded":"2024-02-15T23:31:31.499881+0000","last_fullsized":"2024-02-15T23:31:31.499881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.499481+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.499481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.621183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.287683+0000","last_change":"2024-02-15T23:31:47.287683+0000","last_active":"2024-02-15T23:31:47.287683+0000","last_peered":"2024-02-15T23:31:47.287683+0000","last_clean":"2024-02-15T23:31:47.287683+0000","last_became_active":"2024-02-15T23:29:35.748393+0000","last_became_peered":"2024-02-15T23:29:35.748393+0000","last_unstale":"2024-02-15T23:31:47.287683+0000","last_undegraded":"2024-02-15T23:31:47.287683+0000","last_fullsized":"2024-02-15T23:31:47.287683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-02-15T23:31:47.287351+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-02-15T23:31:47.287351+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.287351+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:28.564071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.657045+0000","last_change":"2024-02-15T23:31:21.657045+0000","last_active":"2024-02-15T23:31:21.657045+0000","last_peered":"2024-02-15T23:31:21.657045+0000","last_clean":"2024-02-15T23:31:21.657045+0000","last_became_active":"2024-02-15T23:29:37.740094+0000","last_became_peered":"2024-02-15T23:29:37.740094+0000","last_unstale":"2024-02-15T23:31:21.657045+0000","last_undegraded":"2024-02-15T23:31:21.657045+0000","last_fullsized":"2024-02-15T23:31:21.657045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.656809+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.656809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:38.124016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.397706+0000","last_change":"2024-02-15T23:32:12.397767+0000","last_active":"2024-02-15T23:32:12.397706+0000","last_peered":"2024-02-15T23:32:12.397706+0000","last_clean":"2024-02-15T23:32:12.397706+0000","last_became_active":"2024-02-15T23:29:39.765662+0000","last_became_peered":"2024-02-15T23:29:39.765662+0000","last_unstale":"2024-02-15T23:32:12.397706+0000","last_undegraded":"2024-02-15T23:32:12.397706+0000","last_fullsized":"2024-02-15T23:32:12.397706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:12.397514+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:12.397514+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.397514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:14.468246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.760813+0000","last_change":"2024-02-15T23:32:09.760813+0000","last_active":"2024-02-15T23:32:09.760813+0000","last_peered":"2024-02-15T23:32:09.760813+0000","last_clean":"2024-02-15T23:32:09.760813+0000","last_became_active":"2024-02-15T23:30:10.801016+0000","last_became_peered":"2024-02-15T23:30:10.801016+0000","last_unstale":"2024-02-15T23:32:09.760813+0000","last_undegraded":"2024-02-15T23:32:09.760813+0000","last_fullsized":"2024-02-15T23:32:09.760813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:09.760563+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:09.760563+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.760563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:25.177173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.471453+0000","last_change":"2024-02-15T23:32:01.471535+0000","last_active":"2024-02-15T23:32:01.471453+0000","last_peered":"2024-02-15T23:32:01.471453+0000","last_clean":"2024-02-15T23:32:01.471453+0000","last_became_active":"2024-02-15T23:29:29.715532+0000","last_became_peered":"2024-02-15T23:29:29.715532+0000","last_unstale":"2024-02-15T23:32:01.471453+0000","last_undegraded":"2024-02-15T23:32:01.471453+0000","last_fullsized":"2024-02-15T23:32:01.471453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:01.471256+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:01.471256+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.471256+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:37.525983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.636155+0000","last_change":"2024-02-15T23:31:33.636155+0000","last_active":"2024-02-15T23:31:33.636155+0000","last_peered":"2024-02-15T23:31:33.636155+0000","last_clean":"2024-02-15T23:31:33.636155+0000","last_became_active":"2024-02-15T23:29:33.704266+0000","last_became_peered":"2024-02-15T23:29:33.704266+0000","last_unstale":"2024-02-15T23:31:33.636155+0000","last_undegraded":"2024-02-15T23:31:33.636155+0000","last_fullsized":"2024-02-15T23:31:33.636155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.635864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.635864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:47.730744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.407975+0000","last_change":"2024-02-15T23:31:24.407975+0000","last_active":"2024-02-15T23:31:24.407975+0000","last_peered":"2024-02-15T23:31:24.407975+0000","last_clean":"2024-02-15T23:31:24.407975+0000","last_became_active":"2024-02-15T23:29:35.727413+0000","last_became_peered":"2024-02-15T23:29:35.727413+0000","last_unstale":"2024-02-15T23:31:24.407975+0000","last_undegraded":"2024-02-15T23:31:24.407975+0000","last_fullsized":"2024-02-15T23:31:24.407975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-02-15T23:31:24.407715+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.407715+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:36.649762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.276712+0000","last_change":"2024-02-15T23:31:48.276712+0000","last_active":"2024-02-15T23:31:48.276712+0000","last_peered":"2024-02-15T23:31:48.276712+0000","last_clean":"2024-02-15T23:31:48.276712+0000","last_became_active":"2024-02-15T23:29:37.772087+0000","last_became_peered":"2024-02-15T23:29:37.772087+0000","last_unstale":"2024-02-15T23:31:48.276712+0000","last_undegraded":"2024-02-15T23:31:48.276712+0000","last_fullsized":"2024-02-15T23:31:48.276712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:48.276447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:48.276447+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.276447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:14:35.402031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:37.422566+0000","last_change":"2024-02-15T23:32:37.422620+0000","last_active":"2024-02-15T23:32:37.422566+0000","last_peered":"2024-02-15T23:32:37.422566+0000","last_clean":"2024-02-15T23:32:37.422566+0000","last_became_active":"2024-02-15T23:29:39.774545+0000","last_became_peered":"2024-02-15T23:29:39.774545+0000","last_unstale":"2024-02-15T23:32:37.422566+0000","last_undegraded":"2024-02-15T23:32:37.422566+0000","last_fullsized":"2024-02-15T23:32:37.422566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:37.422369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:37.422369+0000","last_clean_scrub_stamp":"2024-02-15T23:32:37.422369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:58:52.556858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.404343+0000","last_change":"2024-02-15T23:31:27.404343+0000","last_active":"2024-02-15T23:31:27.404343+0000","last_peered":"2024-02-15T23:31:27.404343+0000","last_clean":"2024-02-15T23:31:27.404343+0000","last_became_active":"2024-02-15T23:29:31.709323+0000","last_became_peered":"2024-02-15T23:29:31.709323+0000","last_unstale":"2024-02-15T23:31:27.404343+0000","last_undegraded":"2024-02-15T23:31:27.404343+0000","last_fullsized":"2024-02-15T23:31:27.404343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.404065+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.404065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:04.056272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:22.224025+0000","last_change":"2024-02-15T23:32:22.224094+0000","last_active":"2024-02-15T23:32:22.224025+0000","last_peered":"2024-02-15T23:32:22.224025+0000","last_clean":"2024-02-15T23:32:22.224025+0000","last_became_active":"2024-02-15T23:29:29.725146+0000","last_became_peered":"2024-02-15T23:29:29.725146+0000","last_unstale":"2024-02-15T23:32:22.224025+0000","last_undegraded":"2024-02-15T23:32:22.224025+0000","last_fullsized":"2024-02-15T23:32:22.224025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:22.223817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:22.223817+0000","last_clean_scrub_stamp":"2024-02-15T23:32:22.223817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:59.143154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.466268+0000","last_change":"2024-02-15T23:31:38.466268+0000","last_active":"2024-02-15T23:31:38.466268+0000","last_peered":"2024-02-15T23:31:38.466268+0000","last_clean":"2024-02-15T23:31:38.466268+0000","last_became_active":"2024-02-15T23:29:33.718546+0000","last_became_peered":"2024-02-15T23:29:33.718546+0000","last_unstale":"2024-02-15T23:31:38.466268+0000","last_undegraded":"2024-02-15T23:31:38.466268+0000","last_fullsized":"2024-02-15T23:31:38.466268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:38.466027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:38.466027+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.466027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:12.976124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.812184+0000","last_change":"2024-02-15T23:31:27.812184+0000","last_active":"2024-02-15T23:31:27.812184+0000","last_peered":"2024-02-15T23:31:27.812184+0000","last_clean":"2024-02-15T23:31:27.812184+0000","last_became_active":"2024-02-15T23:29:35.713583+0000","last_became_peered":"2024-02-15T23:29:35.713583+0000","last_unstale":"2024-02-15T23:31:27.812184+0000","last_undegraded":"2024-02-15T23:31:27.812184+0000","last_fullsized":"2024-02-15T23:31:27.812184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:27.812031+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.812031+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:53.640763+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":345,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.837313+0000","last_change":"2024-02-15T23:31:18.837313+0000","last_active":"2024-02-15T23:31:18.837313+0000","last_peered":"2024-02-15T23:31:18.837313+0000","last_clean":"2024-02-15T23:31:18.837313+0000","last_became_active":"2024-02-15T23:29:37.750721+0000","last_became_peered":"2024-02-15T23:29:37.750721+0000","last_unstale":"2024-02-15T23:31:18.837313+0000","last_undegraded":"2024-02-15T23:31:18.837313+0000","last_fullsized":"2024-02-15T23:31:18.837313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:18.836996+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.836996+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:26.809047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.437875+0000","last_change":"2024-02-15T23:31:44.437875+0000","last_active":"2024-02-15T23:31:44.437875+0000","last_peered":"2024-02-15T23:31:44.437875+0000","last_clean":"2024-02-15T23:31:44.437875+0000","last_became_active":"2024-02-15T23:29:39.756815+0000","last_became_peered":"2024-02-15T23:29:39.756815+0000","last_unstale":"2024-02-15T23:31:44.437875+0000","last_undegraded":"2024-02-15T23:31:44.437875+0000","last_fullsized":"2024-02-15T23:31:44.437875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:44.437626+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:44.437626+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.437626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:01.530419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.694509+0000","last_change":"2024-02-15T23:31:50.694563+0000","last_active":"2024-02-15T23:31:50.694509+0000","last_peered":"2024-02-15T23:31:50.694509+0000","last_clean":"2024-02-15T23:31:50.694509+0000","last_became_active":"2024-02-15T23:29:31.706541+0000","last_became_peered":"2024-02-15T23:29:31.706541+0000","last_unstale":"2024-02-15T23:31:50.694509+0000","last_undegraded":"2024-02-15T23:31:50.694509+0000","last_fullsized":"2024-02-15T23:31:50.694509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:50.694320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:50.694320+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.694320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:34.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.224812+0000","last_change":"2024-02-15T23:32:12.224902+0000","last_active":"2024-02-15T23:32:12.224812+0000","last_peered":"2024-02-15T23:32:12.224812+0000","last_clean":"2024-02-15T23:32:12.224812+0000","last_became_active":"2024-02-15T23:29:29.717531+0000","last_became_peered":"2024-02-15T23:29:29.717531+0000","last_unstale":"2024-02-15T23:32:12.224812+0000","last_undegraded":"2024-02-15T23:32:12.224812+0000","last_fullsized":"2024-02-15T23:32:12.224812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:12.224617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:12.224617+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.224617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:48:16.867139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.474688+0000","last_change":"2024-02-15T23:31:27.474688+0000","last_active":"2024-02-15T23:31:27.474688+0000","last_peered":"2024-02-15T23:31:27.474688+0000","last_clean":"2024-02-15T23:31:27.474688+0000","last_became_active":"2024-02-15T23:29:33.718502+0000","last_became_peered":"2024-02-15T23:29:33.718502+0000","last_unstale":"2024-02-15T23:31:27.474688+0000","last_undegraded":"2024-02-15T23:31:27.474688+0000","last_fullsized":"2024-02-15T23:31:27.474688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:27.474436+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.474436+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.169933+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.325111+0000","last_change":"2024-02-15T23:31:43.325111+0000","last_active":"2024-02-15T23:31:43.325111+0000","last_peered":"2024-02-15T23:31:43.325111+0000","last_clean":"2024-02-15T23:31:43.325111+0000","last_became_active":"2024-02-15T23:29:35.749964+0000","last_became_peered":"2024-02-15T23:29:35.749964+0000","last_unstale":"2024-02-15T23:31:43.325111+0000","last_undegraded":"2024-02-15T23:31:43.325111+0000","last_fullsized":"2024-02-15T23:31:43.325111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:43.324799+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:43.324799+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.324799+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:21.930488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.408189+0000","last_change":"2024-02-15T23:31:16.408189+0000","last_active":"2024-02-15T23:31:16.408189+0000","last_peered":"2024-02-15T23:31:16.408189+0000","last_clean":"2024-02-15T23:31:16.408189+0000","last_became_active":"2024-02-15T23:29:37.733655+0000","last_became_peered":"2024-02-15T23:29:37.733655+0000","last_unstale":"2024-02-15T23:31:16.408189+0000","last_undegraded":"2024-02-15T23:31:16.408189+0000","last_fullsized":"2024-02-15T23:31:16.408189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:16.407927+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.407927+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:42.842010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.684561+0000","last_change":"2024-02-15T23:31:32.684561+0000","last_active":"2024-02-15T23:31:32.684561+0000","last_peered":"2024-02-15T23:31:32.684561+0000","last_clean":"2024-02-15T23:31:32.684561+0000","last_became_active":"2024-02-15T23:29:39.757124+0000","last_became_peered":"2024-02-15T23:29:39.757124+0000","last_unstale":"2024-02-15T23:31:32.684561+0000","last_undegraded":"2024-02-15T23:31:32.684561+0000","last_fullsized":"2024-02-15T23:31:32.684561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:32.684302+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.684302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:13.848320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.605287+0000","last_change":"2024-02-15T23:31:39.605287+0000","last_active":"2024-02-15T23:31:39.605287+0000","last_peered":"2024-02-15T23:31:39.605287+0000","last_clean":"2024-02-15T23:31:39.605287+0000","last_became_active":"2024-02-15T23:29:31.709397+0000","last_became_peered":"2024-02-15T23:29:31.709397+0000","last_unstale":"2024-02-15T23:31:39.605287+0000","last_undegraded":"2024-02-15T23:31:39.605287+0000","last_fullsized":"2024-02-15T23:31:39.605287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:39.605037+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:39.605037+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.605037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:46.637327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:24.245225+0000","last_change":"2024-02-15T23:32:24.245282+0000","last_active":"2024-02-15T23:32:24.245225+0000","last_peered":"2024-02-15T23:32:24.245225+0000","last_clean":"2024-02-15T23:32:24.245225+0000","last_became_active":"2024-02-15T23:29:29.722068+0000","last_became_peered":"2024-02-15T23:29:29.722068+0000","last_unstale":"2024-02-15T23:32:24.245225+0000","last_undegraded":"2024-02-15T23:32:24.245225+0000","last_fullsized":"2024-02-15T23:32:24.245225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:24.245026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:24.245026+0000","last_clean_scrub_stamp":"2024-02-15T23:32:24.245026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:17:13.229008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.443979+0000","last_change":"2024-02-15T23:31:16.443979+0000","last_active":"2024-02-15T23:31:16.443979+0000","last_peered":"2024-02-15T23:31:16.443979+0000","last_clean":"2024-02-15T23:31:16.443979+0000","last_became_active":"2024-02-15T23:29:33.715791+0000","last_became_peered":"2024-02-15T23:29:33.715791+0000","last_unstale":"2024-02-15T23:31:16.443979+0000","last_undegraded":"2024-02-15T23:31:16.443979+0000","last_fullsized":"2024-02-15T23:31:16.443979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.443730+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.443730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:16:47.044908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.362479+0000","last_change":"2024-02-15T23:31:21.362479+0000","last_active":"2024-02-15T23:31:21.362479+0000","last_peered":"2024-02-15T23:31:21.362479+0000","last_clean":"2024-02-15T23:31:21.362479+0000","last_became_active":"2024-02-15T23:29:35.730495+0000","last_became_peered":"2024-02-15T23:29:35.730495+0000","last_unstale":"2024-02-15T23:31:21.362479+0000","last_undegraded":"2024-02-15T23:31:21.362479+0000","last_fullsized":"2024-02-15T23:31:21.362479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-15T23:31:21.362097+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.362097+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:21.356365+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.792994+0000","last_change":"2024-02-15T23:31:24.792994+0000","last_active":"2024-02-15T23:31:24.792994+0000","last_peered":"2024-02-15T23:31:24.792994+0000","last_clean":"2024-02-15T23:31:24.792994+0000","last_became_active":"2024-02-15T23:29:37.766645+0000","last_became_peered":"2024-02-15T23:29:37.766645+0000","last_unstale":"2024-02-15T23:31:24.792994+0000","last_undegraded":"2024-02-15T23:31:24.792994+0000","last_fullsized":"2024-02-15T23:31:24.792994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.792712+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.792712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:03:10.186879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.472926+0000","last_change":"2024-02-15T23:31:30.472926+0000","last_active":"2024-02-15T23:31:30.472926+0000","last_peered":"2024-02-15T23:31:30.472926+0000","last_clean":"2024-02-15T23:31:30.472926+0000","last_became_active":"2024-02-15T23:29:39.756064+0000","last_became_peered":"2024-02-15T23:29:39.756064+0000","last_unstale":"2024-02-15T23:31:30.472926+0000","last_undegraded":"2024-02-15T23:31:30.472926+0000","last_fullsized":"2024-02-15T23:31:30.472926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:30.472637+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.472637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.285998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.502716+0000","last_change":"2024-02-15T23:31:31.502716+0000","last_active":"2024-02-15T23:31:31.502716+0000","last_peered":"2024-02-15T23:31:31.502716+0000","last_clean":"2024-02-15T23:31:31.502716+0000","last_became_active":"2024-02-15T23:29:31.708161+0000","last_became_peered":"2024-02-15T23:29:31.708161+0000","last_unstale":"2024-02-15T23:31:31.502716+0000","last_undegraded":"2024-02-15T23:31:31.502716+0000","last_fullsized":"2024-02-15T23:31:31.502716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:31:31.502461+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.502461+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:37.162072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.499666+0000","last_change":"2024-02-15T23:32:00.499823+0000","last_active":"2024-02-15T23:32:00.499666+0000","last_peered":"2024-02-15T23:32:00.499666+0000","last_clean":"2024-02-15T23:32:00.499666+0000","last_became_active":"2024-02-15T23:29:17.388817+0000","last_became_peered":"2024-02-15T23:29:17.388817+0000","last_unstale":"2024-02-15T23:32:00.499666+0000","last_undegraded":"2024-02-15T23:32:00.499666+0000","last_fullsized":"2024-02-15T23:32:00.499666+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-15T23:32:00.499419+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-15T23:32:00.499419+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.499419+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:15.916028+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:29.304044+0000","last_change":"2024-02-15T23:32:29.304096+0000","last_active":"2024-02-15T23:32:29.304044+0000","last_peered":"2024-02-15T23:32:29.304044+0000","last_clean":"2024-02-15T23:32:29.304044+0000","last_became_active":"2024-02-15T23:29:21.625321+0000","last_became_peered":"2024-02-15T23:29:21.625321+0000","last_unstale":"2024-02-15T23:32:29.304044+0000","last_undegraded":"2024-02-15T23:32:29.304044+0000","last_fullsized":"2024-02-15T23:32:29.304044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:29.303851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:29.303851+0000","last_clean_scrub_stamp":"2024-02-15T23:32:29.303851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:11:10.227864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.209733+0000","last_change":"2024-02-15T23:32:14.209811+0000","last_active":"2024-02-15T23:32:14.209733+0000","last_peered":"2024-02-15T23:32:14.209733+0000","last_clean":"2024-02-15T23:32:14.209733+0000","last_became_active":"2024-02-15T23:29:29.714976+0000","last_became_peered":"2024-02-15T23:29:29.714976+0000","last_unstale":"2024-02-15T23:32:14.209733+0000","last_undegraded":"2024-02-15T23:32:14.209733+0000","last_fullsized":"2024-02-15T23:32:14.209733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:14.209520+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:14.209520+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.209520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:41.619949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.454296+0000","last_change":"2024-02-15T23:32:13.454356+0000","last_active":"2024-02-15T23:32:13.454296+0000","last_peered":"2024-02-15T23:32:13.454296+0000","last_clean":"2024-02-15T23:32:13.454296+0000","last_became_active":"2024-02-15T23:30:10.798397+0000","last_became_peered":"2024-02-15T23:30:10.798397+0000","last_unstale":"2024-02-15T23:32:13.454296+0000","last_undegraded":"2024-02-15T23:32:13.454296+0000","last_fullsized":"2024-02-15T23:32:13.454296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:13.454116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:13.454116+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.454116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:39.790818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.412677+0000","last_change":"2024-02-15T23:31:24.412677+0000","last_active":"2024-02-15T23:31:24.412677+0000","last_peered":"2024-02-15T23:31:24.412677+0000","last_clean":"2024-02-15T23:31:24.412677+0000","last_became_active":"2024-02-15T23:29:35.745269+0000","last_became_peered":"2024-02-15T23:29:35.745269+0000","last_unstale":"2024-02-15T23:31:24.412677+0000","last_undegraded":"2024-02-15T23:31:24.412677+0000","last_fullsized":"2024-02-15T23:31:24.412677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-02-15T23:31:24.412389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.412389+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:34.534030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.511629+0000","last_change":"2024-02-15T23:31:28.511629+0000","last_active":"2024-02-15T23:31:28.511629+0000","last_peered":"2024-02-15T23:31:28.511629+0000","last_clean":"2024-02-15T23:31:28.511629+0000","last_became_active":"2024-02-15T23:29:37.762812+0000","last_became_peered":"2024-02-15T23:29:37.762812+0000","last_unstale":"2024-02-15T23:31:28.511629+0000","last_undegraded":"2024-02-15T23:31:28.511629+0000","last_fullsized":"2024-02-15T23:31:28.511629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:28.511388+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.511388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:40.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'49","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.745962+0000","last_change":"2024-02-15T23:32:03.746023+0000","last_active":"2024-02-15T23:32:03.745962+0000","last_peered":"2024-02-15T23:32:03.745962+0000","last_clean":"2024-02-15T23:32:03.745962+0000","last_became_active":"2024-02-15T23:29:39.776684+0000","last_became_peered":"2024-02-15T23:29:39.776684+0000","last_unstale":"2024-02-15T23:32:03.745962+0000","last_undegraded":"2024-02-15T23:32:03.745962+0000","last_fullsized":"2024-02-15T23:32:03.745962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-15T23:32:03.745738+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-15T23:32:03.745738+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.745738+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:51.152463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'14","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.249776+0000","last_change":"2024-02-15T23:31:51.249938+0000","last_active":"2024-02-15T23:31:51.249776+0000","last_peered":"2024-02-15T23:31:51.249776+0000","last_clean":"2024-02-15T23:31:51.249776+0000","last_became_active":"2024-02-15T23:29:31.703737+0000","last_became_peered":"2024-02-15T23:29:31.703737+0000","last_unstale":"2024-02-15T23:31:51.249776+0000","last_undegraded":"2024-02-15T23:31:51.249776+0000","last_fullsized":"2024-02-15T23:31:51.249776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:31:51.249530+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:31:51.249530+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.249530+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:17.586232+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:28.279211+0000","last_change":"2024-02-15T23:32:28.279264+0000","last_active":"2024-02-15T23:32:28.279211+0000","last_peered":"2024-02-15T23:32:28.279211+0000","last_clean":"2024-02-15T23:32:28.279211+0000","last_became_active":"2024-02-15T23:29:21.623587+0000","last_became_peered":"2024-02-15T23:29:21.623587+0000","last_unstale":"2024-02-15T23:32:28.279211+0000","last_undegraded":"2024-02-15T23:32:28.279211+0000","last_fullsized":"2024-02-15T23:32:28.279211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:28.279012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:28.279012+0000","last_clean_scrub_stamp":"2024-02-15T23:32:28.279012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:25:23.279644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.421539+0000","last_change":"2024-02-15T23:32:06.421606+0000","last_active":"2024-02-15T23:32:06.421539+0000","last_peered":"2024-02-15T23:32:06.421539+0000","last_clean":"2024-02-15T23:32:06.421539+0000","last_became_active":"2024-02-15T23:29:29.707101+0000","last_became_peered":"2024-02-15T23:29:29.707101+0000","last_unstale":"2024-02-15T23:32:06.421539+0000","last_undegraded":"2024-02-15T23:32:06.421539+0000","last_fullsized":"2024-02-15T23:32:06.421539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:06.421317+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:06.421317+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.421317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:50.686637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.399165+0000","last_change":"2024-02-15T23:31:20.399165+0000","last_active":"2024-02-15T23:31:20.399165+0000","last_peered":"2024-02-15T23:31:20.399165+0000","last_clean":"2024-02-15T23:31:20.399165+0000","last_became_active":"2024-02-15T23:29:33.716214+0000","last_became_peered":"2024-02-15T23:29:33.716214+0000","last_unstale":"2024-02-15T23:31:20.399165+0000","last_undegraded":"2024-02-15T23:31:20.399165+0000","last_fullsized":"2024-02-15T23:31:20.399165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.398920+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.398920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:13.693335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.428280+0000","last_change":"2024-02-15T23:31:25.428280+0000","last_active":"2024-02-15T23:31:25.428280+0000","last_peered":"2024-02-15T23:31:25.428280+0000","last_clean":"2024-02-15T23:31:25.428280+0000","last_became_active":"2024-02-15T23:29:35.723542+0000","last_became_peered":"2024-02-15T23:29:35.723542+0000","last_unstale":"2024-02-15T23:31:25.428280+0000","last_undegraded":"2024-02-15T23:31:25.428280+0000","last_fullsized":"2024-02-15T23:31:25.428280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-15T23:31:25.427985+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.427985+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:29.336924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.323076+0000","last_change":"2024-02-15T23:31:40.323076+0000","last_active":"2024-02-15T23:31:40.323076+0000","last_peered":"2024-02-15T23:31:40.323076+0000","last_clean":"2024-02-15T23:31:40.323076+0000","last_became_active":"2024-02-15T23:29:37.769351+0000","last_became_peered":"2024-02-15T23:29:37.769351+0000","last_unstale":"2024-02-15T23:31:40.323076+0000","last_undegraded":"2024-02-15T23:31:40.323076+0000","last_fullsized":"2024-02-15T23:31:40.323076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:40.322696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:40.322696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.322696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:29.911537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.473822+0000","last_change":"2024-02-15T23:32:10.473888+0000","last_active":"2024-02-15T23:32:10.473822+0000","last_peered":"2024-02-15T23:32:10.473822+0000","last_clean":"2024-02-15T23:32:10.473822+0000","last_became_active":"2024-02-15T23:29:39.778940+0000","last_became_peered":"2024-02-15T23:29:39.778940+0000","last_unstale":"2024-02-15T23:32:10.473822+0000","last_undegraded":"2024-02-15T23:32:10.473822+0000","last_fullsized":"2024-02-15T23:32:10.473822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-15T23:32:10.473639+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-15T23:32:10.473639+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.473639+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:20:01.304342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.339402+0000","last_change":"2024-02-15T23:31:54.339463+0000","last_active":"2024-02-15T23:31:54.339402+0000","last_peered":"2024-02-15T23:31:54.339402+0000","last_clean":"2024-02-15T23:31:54.339402+0000","last_became_active":"2024-02-15T23:29:31.693670+0000","last_became_peered":"2024-02-15T23:29:31.693670+0000","last_unstale":"2024-02-15T23:31:54.339402+0000","last_undegraded":"2024-02-15T23:31:54.339402+0000","last_fullsized":"2024-02-15T23:31:54.339402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:54.339211+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:54.339211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.339211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:41.745936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.686149+0000","last_change":"2024-02-15T23:31:54.686208+0000","last_active":"2024-02-15T23:31:54.686149+0000","last_peered":"2024-02-15T23:31:54.686149+0000","last_clean":"2024-02-15T23:31:54.686149+0000","last_became_active":"2024-02-15T23:29:21.621747+0000","last_became_peered":"2024-02-15T23:29:21.621747+0000","last_unstale":"2024-02-15T23:31:54.686149+0000","last_undegraded":"2024-02-15T23:31:54.686149+0000","last_fullsized":"2024-02-15T23:31:54.686149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:54.685949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:54.685949+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.685949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:41:39.731022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.352158+0000","last_change":"2024-02-15T23:31:55.352273+0000","last_active":"2024-02-15T23:31:55.352158+0000","last_peered":"2024-02-15T23:31:55.352158+0000","last_clean":"2024-02-15T23:31:55.352158+0000","last_became_active":"2024-02-15T23:29:29.717755+0000","last_became_peered":"2024-02-15T23:29:29.717755+0000","last_unstale":"2024-02-15T23:31:55.352158+0000","last_undegraded":"2024-02-15T23:31:55.352158+0000","last_fullsized":"2024-02-15T23:31:55.352158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.351912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.351912+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.351912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:30.889003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.696551+0000","last_change":"2024-02-15T23:31:35.696551+0000","last_active":"2024-02-15T23:31:35.696551+0000","last_peered":"2024-02-15T23:31:35.696551+0000","last_clean":"2024-02-15T23:31:35.696551+0000","last_became_active":"2024-02-15T23:29:33.702843+0000","last_became_peered":"2024-02-15T23:29:33.702843+0000","last_unstale":"2024-02-15T23:31:35.696551+0000","last_undegraded":"2024-02-15T23:31:35.696551+0000","last_fullsized":"2024-02-15T23:31:35.696551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:35.696295+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:35.696295+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.696295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:39.605234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.811746+0000","last_change":"2024-02-15T23:31:19.811746+0000","last_active":"2024-02-15T23:31:19.811746+0000","last_peered":"2024-02-15T23:31:19.811746+0000","last_clean":"2024-02-15T23:31:19.811746+0000","last_became_active":"2024-02-15T23:29:35.732024+0000","last_became_peered":"2024-02-15T23:29:35.732024+0000","last_unstale":"2024-02-15T23:31:19.811746+0000","last_undegraded":"2024-02-15T23:31:19.811746+0000","last_fullsized":"2024-02-15T23:31:19.811746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-15T23:31:19.811464+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.811464+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:28:44.508275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.546516+0000","last_change":"2024-02-15T23:31:32.546516+0000","last_active":"2024-02-15T23:31:32.546516+0000","last_peered":"2024-02-15T23:31:32.546516+0000","last_clean":"2024-02-15T23:31:32.546516+0000","last_became_active":"2024-02-15T23:29:37.763130+0000","last_became_peered":"2024-02-15T23:29:37.763130+0000","last_unstale":"2024-02-15T23:31:32.546516+0000","last_undegraded":"2024-02-15T23:31:32.546516+0000","last_fullsized":"2024-02-15T23:31:32.546516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:32.546263+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.546263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.575111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.114732+0000","last_change":"2024-02-15T23:32:04.114794+0000","last_active":"2024-02-15T23:32:04.114732+0000","last_peered":"2024-02-15T23:32:04.114732+0000","last_clean":"2024-02-15T23:32:04.114732+0000","last_became_active":"2024-02-15T23:29:39.768796+0000","last_became_peered":"2024-02-15T23:29:39.768796+0000","last_unstale":"2024-02-15T23:32:04.114732+0000","last_undegraded":"2024-02-15T23:32:04.114732+0000","last_fullsized":"2024-02-15T23:32:04.114732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.114516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.114516+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.114516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:17.701427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'14","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.467094+0000","last_change":"2024-02-15T23:31:48.467222+0000","last_active":"2024-02-15T23:31:48.467094+0000","last_peered":"2024-02-15T23:31:48.467094+0000","last_clean":"2024-02-15T23:31:48.467094+0000","last_became_active":"2024-02-15T23:29:31.690405+0000","last_became_peered":"2024-02-15T23:29:31.690405+0000","last_unstale":"2024-02-15T23:31:48.467094+0000","last_undegraded":"2024-02-15T23:31:48.467094+0000","last_fullsized":"2024-02-15T23:31:48.467094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:31:48.466864+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:31:48.466864+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.466864+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:04:45.986887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:26.290704+0000","last_change":"2024-02-15T23:32:26.290758+0000","last_active":"2024-02-15T23:32:26.290704+0000","last_peered":"2024-02-15T23:32:26.290704+0000","last_clean":"2024-02-15T23:32:26.290704+0000","last_became_active":"2024-02-15T23:29:21.622133+0000","last_became_peered":"2024-02-15T23:29:21.622133+0000","last_unstale":"2024-02-15T23:32:26.290704+0000","last_undegraded":"2024-02-15T23:32:26.290704+0000","last_fullsized":"2024-02-15T23:32:26.290704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:26.290502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:26.290502+0000","last_clean_scrub_stamp":"2024-02-15T23:32:26.290502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:33:19.527437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.726468+0000","last_change":"2024-02-15T23:31:55.726530+0000","last_active":"2024-02-15T23:31:55.726468+0000","last_peered":"2024-02-15T23:31:55.726468+0000","last_clean":"2024-02-15T23:31:55.726468+0000","last_became_active":"2024-02-15T23:29:29.720963+0000","last_became_peered":"2024-02-15T23:29:29.720963+0000","last_unstale":"2024-02-15T23:31:55.726468+0000","last_undegraded":"2024-02-15T23:31:55.726468+0000","last_fullsized":"2024-02-15T23:31:55.726468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.726248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.726248+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.726248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:22:05.847889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.558062+0000","last_change":"2024-02-15T23:31:35.558062+0000","last_active":"2024-02-15T23:31:35.558062+0000","last_peered":"2024-02-15T23:31:35.558062+0000","last_clean":"2024-02-15T23:31:35.558062+0000","last_became_active":"2024-02-15T23:29:33.719973+0000","last_became_peered":"2024-02-15T23:29:33.719973+0000","last_unstale":"2024-02-15T23:31:35.558062+0000","last_undegraded":"2024-02-15T23:31:35.558062+0000","last_fullsized":"2024-02-15T23:31:35.558062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:35.557819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:35.557819+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.557819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:02.418349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.310142+0000","last_change":"2024-02-15T23:31:45.310142+0000","last_active":"2024-02-15T23:31:45.310142+0000","last_peered":"2024-02-15T23:31:45.310142+0000","last_clean":"2024-02-15T23:31:45.310142+0000","last_became_active":"2024-02-15T23:29:35.749044+0000","last_became_peered":"2024-02-15T23:29:35.749044+0000","last_unstale":"2024-02-15T23:31:45.310142+0000","last_undegraded":"2024-02-15T23:31:45.310142+0000","last_fullsized":"2024-02-15T23:31:45.310142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-02-15T23:31:45.309885+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-02-15T23:31:45.309885+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.309885+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:11.973068+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.153845+0000","last_change":"2024-02-15T23:31:56.153902+0000","last_active":"2024-02-15T23:31:56.153845+0000","last_peered":"2024-02-15T23:31:56.153845+0000","last_clean":"2024-02-15T23:31:56.153845+0000","last_became_active":"2024-02-15T23:29:37.773597+0000","last_became_peered":"2024-02-15T23:29:37.773597+0000","last_unstale":"2024-02-15T23:31:56.153845+0000","last_undegraded":"2024-02-15T23:31:56.153845+0000","last_fullsized":"2024-02-15T23:31:56.153845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.153647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.153647+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.153647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:46.068434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.560635+0000","last_change":"2024-02-15T23:31:38.560635+0000","last_active":"2024-02-15T23:31:38.560635+0000","last_peered":"2024-02-15T23:31:38.560635+0000","last_clean":"2024-02-15T23:31:38.560635+0000","last_became_active":"2024-02-15T23:29:39.765448+0000","last_became_peered":"2024-02-15T23:29:39.765448+0000","last_unstale":"2024-02-15T23:31:38.560635+0000","last_undegraded":"2024-02-15T23:31:38.560635+0000","last_fullsized":"2024-02-15T23:31:38.560635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:38.560266+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:38.560266+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.560266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:13.070363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'12","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:15.446148+0000","last_change":"2024-02-15T23:32:15.446212+0000","last_active":"2024-02-15T23:32:15.446148+0000","last_peered":"2024-02-15T23:32:15.446148+0000","last_clean":"2024-02-15T23:32:15.446148+0000","last_became_active":"2024-02-15T23:30:10.797119+0000","last_became_peered":"2024-02-15T23:30:10.797119+0000","last_unstale":"2024-02-15T23:32:15.446148+0000","last_undegraded":"2024-02-15T23:32:15.446148+0000","last_fullsized":"2024-02-15T23:32:15.446148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:32:15.445965+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:32:15.445965+0000","last_clean_scrub_stamp":"2024-02-15T23:32:15.445965+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:30.896607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.640528+0000","last_change":"2024-02-15T23:31:43.640596+0000","last_active":"2024-02-15T23:31:43.640528+0000","last_peered":"2024-02-15T23:31:43.640528+0000","last_clean":"2024-02-15T23:31:43.640528+0000","last_became_active":"2024-02-15T23:29:29.733293+0000","last_became_peered":"2024-02-15T23:29:29.733293+0000","last_unstale":"2024-02-15T23:31:43.640528+0000","last_undegraded":"2024-02-15T23:31:43.640528+0000","last_fullsized":"2024-02-15T23:31:43.640528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:43.640321+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:43.640321+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.640321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:40.343283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.505031+0000","last_change":"2024-02-15T23:32:02.505191+0000","last_active":"2024-02-15T23:32:02.505031+0000","last_peered":"2024-02-15T23:32:02.505031+0000","last_clean":"2024-02-15T23:32:02.505031+0000","last_became_active":"2024-02-15T23:29:21.627442+0000","last_became_peered":"2024-02-15T23:29:21.627442+0000","last_unstale":"2024-02-15T23:32:02.505031+0000","last_undegraded":"2024-02-15T23:32:02.505031+0000","last_fullsized":"2024-02-15T23:32:02.505031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.504792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.504792+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.504792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:23.531981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.770494+0000","last_change":"2024-02-15T23:32:08.770494+0000","last_active":"2024-02-15T23:32:08.770494+0000","last_peered":"2024-02-15T23:32:08.770494+0000","last_clean":"2024-02-15T23:32:08.770494+0000","last_became_active":"2024-02-15T23:30:10.800905+0000","last_became_peered":"2024-02-15T23:30:10.800905+0000","last_unstale":"2024-02-15T23:32:08.770494+0000","last_undegraded":"2024-02-15T23:32:08.770494+0000","last_fullsized":"2024-02-15T23:32:08.770494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.770258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.770258+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.770258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:19.451073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"33'68","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.630125+0000","last_change":"2024-02-15T23:31:23.630125+0000","last_active":"2024-02-15T23:31:23.630125+0000","last_peered":"2024-02-15T23:31:23.630125+0000","last_clean":"2024-02-15T23:31:23.630125+0000","last_became_active":"2024-02-15T23:29:35.740293+0000","last_became_peered":"2024-02-15T23:29:35.740293+0000","last_unstale":"2024-02-15T23:31:23.630125+0000","last_undegraded":"2024-02-15T23:31:23.630125+0000","last_fullsized":"2024-02-15T23:31:23.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-02-15T23:31:23.629845+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.629845+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:22:36.251662+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.871614+0000","last_change":"2024-02-15T23:31:17.871614+0000","last_active":"2024-02-15T23:31:17.871614+0000","last_peered":"2024-02-15T23:31:17.871614+0000","last_clean":"2024-02-15T23:31:17.871614+0000","last_became_active":"2024-02-15T23:29:37.750835+0000","last_became_peered":"2024-02-15T23:29:37.750835+0000","last_unstale":"2024-02-15T23:31:17.871614+0000","last_undegraded":"2024-02-15T23:31:17.871614+0000","last_fullsized":"2024-02-15T23:31:17.871614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.871335+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.871335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:42.844132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:13.447006+0000","last_change":"2024-02-15T23:32:13.447073+0000","last_active":"2024-02-15T23:32:13.447006+0000","last_peered":"2024-02-15T23:32:13.447006+0000","last_clean":"2024-02-15T23:32:13.447006+0000","last_became_active":"2024-02-15T23:29:39.767150+0000","last_became_peered":"2024-02-15T23:29:39.767150+0000","last_unstale":"2024-02-15T23:32:13.447006+0000","last_undegraded":"2024-02-15T23:32:13.447006+0000","last_fullsized":"2024-02-15T23:32:13.447006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-15T23:32:13.446773+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-15T23:32:13.446773+0000","last_clean_scrub_stamp":"2024-02-15T23:32:13.446773+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:15.960783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.407689+0000","last_change":"2024-02-15T23:32:14.407742+0000","last_active":"2024-02-15T23:32:14.407689+0000","last_peered":"2024-02-15T23:32:14.407689+0000","last_clean":"2024-02-15T23:32:14.407689+0000","last_became_active":"2024-02-15T23:30:10.803475+0000","last_became_peered":"2024-02-15T23:30:10.803475+0000","last_unstale":"2024-02-15T23:32:14.407689+0000","last_undegraded":"2024-02-15T23:32:14.407689+0000","last_fullsized":"2024-02-15T23:32:14.407689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:14.407508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:14.407508+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.407508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:23:33.983637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.412837+0000","last_change":"2024-02-15T23:31:59.412907+0000","last_active":"2024-02-15T23:31:59.412837+0000","last_peered":"2024-02-15T23:31:59.412837+0000","last_clean":"2024-02-15T23:31:59.412837+0000","last_became_active":"2024-02-15T23:29:29.715614+0000","last_became_peered":"2024-02-15T23:29:29.715614+0000","last_unstale":"2024-02-15T23:31:59.412837+0000","last_undegraded":"2024-02-15T23:31:59.412837+0000","last_fullsized":"2024-02-15T23:31:59.412837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:59.412638+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.412638+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.412638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.093453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:27.326718+0000","last_change":"2024-02-15T23:32:27.326774+0000","last_active":"2024-02-15T23:32:27.326718+0000","last_peered":"2024-02-15T23:32:27.326718+0000","last_clean":"2024-02-15T23:32:27.326718+0000","last_became_active":"2024-02-15T23:29:21.622335+0000","last_became_peered":"2024-02-15T23:29:21.622335+0000","last_unstale":"2024-02-15T23:32:27.326718+0000","last_undegraded":"2024-02-15T23:32:27.326718+0000","last_fullsized":"2024-02-15T23:32:27.326718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:27.326521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:27.326521+0000","last_clean_scrub_stamp":"2024-02-15T23:32:27.326521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:17:47.973866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.396757+0000","last_change":"2024-02-15T23:31:17.396757+0000","last_active":"2024-02-15T23:31:17.396757+0000","last_peered":"2024-02-15T23:31:17.396757+0000","last_clean":"2024-02-15T23:31:17.396757+0000","last_became_active":"2024-02-15T23:29:33.714895+0000","last_became_peered":"2024-02-15T23:29:33.714895+0000","last_unstale":"2024-02-15T23:31:17.396757+0000","last_undegraded":"2024-02-15T23:31:17.396757+0000","last_fullsized":"2024-02-15T23:31:17.396757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.396500+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.396500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:51.906597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.394229+0000","last_change":"2024-02-15T23:31:19.394229+0000","last_active":"2024-02-15T23:31:19.394229+0000","last_peered":"2024-02-15T23:31:19.394229+0000","last_clean":"2024-02-15T23:31:19.394229+0000","last_became_active":"2024-02-15T23:29:35.732637+0000","last_became_peered":"2024-02-15T23:29:35.732637+0000","last_unstale":"2024-02-15T23:31:19.394229+0000","last_undegraded":"2024-02-15T23:31:19.394229+0000","last_fullsized":"2024-02-15T23:31:19.394229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-15T23:31:19.393966+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.393966+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:40.563671+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.413611+0000","last_change":"2024-02-15T23:31:15.413611+0000","last_active":"2024-02-15T23:31:15.413611+0000","last_peered":"2024-02-15T23:31:15.413611+0000","last_clean":"2024-02-15T23:31:15.413611+0000","last_became_active":"2024-02-15T23:29:37.734447+0000","last_became_peered":"2024-02-15T23:29:37.734447+0000","last_unstale":"2024-02-15T23:31:15.413611+0000","last_undegraded":"2024-02-15T23:31:15.413611+0000","last_fullsized":"2024-02-15T23:31:15.413611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:15.413363+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.413363+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:05.337748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:35.366239+0000","last_change":"2024-02-15T23:32:35.366301+0000","last_active":"2024-02-15T23:32:35.366239+0000","last_peered":"2024-02-15T23:32:35.366239+0000","last_clean":"2024-02-15T23:32:35.366239+0000","last_became_active":"2024-02-15T23:29:39.770913+0000","last_became_peered":"2024-02-15T23:29:39.770913+0000","last_unstale":"2024-02-15T23:32:35.366239+0000","last_undegraded":"2024-02-15T23:32:35.366239+0000","last_fullsized":"2024-02-15T23:32:35.366239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:35.366046+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:35.366046+0000","last_clean_scrub_stamp":"2024-02-15T23:32:35.366046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:52:20.712060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.069553+0000","last_change":"2024-02-15T23:32:01.069605+0000","last_active":"2024-02-15T23:32:01.069553+0000","last_peered":"2024-02-15T23:32:01.069553+0000","last_clean":"2024-02-15T23:32:01.069553+0000","last_became_active":"2024-02-15T23:29:31.701181+0000","last_became_peered":"2024-02-15T23:29:31.701181+0000","last_unstale":"2024-02-15T23:32:01.069553+0000","last_undegraded":"2024-02-15T23:32:01.069553+0000","last_fullsized":"2024-02-15T23:32:01.069553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:01.069355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:01.069355+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.069355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:53:55.098770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:23.261617+0000","last_change":"2024-02-15T23:32:23.261747+0000","last_active":"2024-02-15T23:32:23.261617+0000","last_peered":"2024-02-15T23:32:23.261617+0000","last_clean":"2024-02-15T23:32:23.261617+0000","last_became_active":"2024-02-15T23:29:29.711449+0000","last_became_peered":"2024-02-15T23:29:29.711449+0000","last_unstale":"2024-02-15T23:32:23.261617+0000","last_undegraded":"2024-02-15T23:32:23.261617+0000","last_fullsized":"2024-02-15T23:32:23.261617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:23.261330+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:23.261330+0000","last_clean_scrub_stamp":"2024-02-15T23:32:23.261330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:21:55.099505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:03.466820+0000","last_change":"2024-02-15T23:32:03.466873+0000","last_active":"2024-02-15T23:32:03.466820+0000","last_peered":"2024-02-15T23:32:03.466820+0000","last_clean":"2024-02-15T23:32:03.466820+0000","last_became_active":"2024-02-15T23:29:21.629488+0000","last_became_peered":"2024-02-15T23:29:21.629488+0000","last_unstale":"2024-02-15T23:32:03.466820+0000","last_undegraded":"2024-02-15T23:32:03.466820+0000","last_fullsized":"2024-02-15T23:32:03.466820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:03.466625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:03.466625+0000","last_clean_scrub_stamp":"2024-02-15T23:32:03.466625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:03:37.334611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:21.405756+0000","last_change":"2024-02-15T23:31:21.405756+0000","last_active":"2024-02-15T23:31:21.405756+0000","last_peered":"2024-02-15T23:31:21.405756+0000","last_clean":"2024-02-15T23:31:21.405756+0000","last_became_active":"2024-02-15T23:29:33.713347+0000","last_became_peered":"2024-02-15T23:29:33.713347+0000","last_unstale":"2024-02-15T23:31:21.405756+0000","last_undegraded":"2024-02-15T23:31:21.405756+0000","last_fullsized":"2024-02-15T23:31:21.405756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:21.405364+0000","last_clean_scrub_stamp":"2024-02-15T23:31:21.405364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:58.637097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.322259+0000","last_change":"2024-02-15T23:31:46.322334+0000","last_active":"2024-02-15T23:31:46.322259+0000","last_peered":"2024-02-15T23:31:46.322259+0000","last_clean":"2024-02-15T23:31:46.322259+0000","last_became_active":"2024-02-15T23:29:35.748636+0000","last_became_peered":"2024-02-15T23:29:35.748636+0000","last_unstale":"2024-02-15T23:31:46.322259+0000","last_undegraded":"2024-02-15T23:31:46.322259+0000","last_fullsized":"2024-02-15T23:31:46.322259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:46.322070+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:46.322070+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.322070+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:06.972017+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:19.594968+0000","last_change":"2024-02-15T23:31:19.594968+0000","last_active":"2024-02-15T23:31:19.594968+0000","last_peered":"2024-02-15T23:31:19.594968+0000","last_clean":"2024-02-15T23:31:19.594968+0000","last_became_active":"2024-02-15T23:29:37.751638+0000","last_became_peered":"2024-02-15T23:29:37.751638+0000","last_unstale":"2024-02-15T23:31:19.594968+0000","last_undegraded":"2024-02-15T23:31:19.594968+0000","last_fullsized":"2024-02-15T23:31:19.594968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:19.594660+0000","last_clean_scrub_stamp":"2024-02-15T23:31:19.594660+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:58.295976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'15","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.544082+0000","last_change":"2024-02-15T23:31:34.544082+0000","last_active":"2024-02-15T23:31:34.544082+0000","last_peered":"2024-02-15T23:31:34.544082+0000","last_clean":"2024-02-15T23:31:34.544082+0000","last_became_active":"2024-02-15T23:29:39.759581+0000","last_became_peered":"2024-02-15T23:29:39.759581+0000","last_unstale":"2024-02-15T23:31:34.544082+0000","last_undegraded":"2024-02-15T23:31:34.544082+0000","last_fullsized":"2024-02-15T23:31:34.544082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:34.543832+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.543832+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.512019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.664125+0000","last_change":"2024-02-15T23:31:52.664201+0000","last_active":"2024-02-15T23:31:52.664125+0000","last_peered":"2024-02-15T23:31:52.664125+0000","last_clean":"2024-02-15T23:31:52.664125+0000","last_became_active":"2024-02-15T23:29:31.709581+0000","last_became_peered":"2024-02-15T23:29:31.709581+0000","last_unstale":"2024-02-15T23:31:52.664125+0000","last_undegraded":"2024-02-15T23:31:52.664125+0000","last_fullsized":"2024-02-15T23:31:52.664125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-15T23:31:52.663884+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-15T23:31:52.663884+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.663884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:16.778950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.543481+0000","last_change":"2024-02-15T23:32:05.543539+0000","last_active":"2024-02-15T23:32:05.543481+0000","last_peered":"2024-02-15T23:32:05.543481+0000","last_clean":"2024-02-15T23:32:05.543481+0000","last_became_active":"2024-02-15T23:29:29.719613+0000","last_became_peered":"2024-02-15T23:29:29.719613+0000","last_unstale":"2024-02-15T23:32:05.543481+0000","last_undegraded":"2024-02-15T23:32:05.543481+0000","last_fullsized":"2024-02-15T23:32:05.543481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:05.543285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:05.543285+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.543285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:44.148974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:30.298174+0000","last_change":"2024-02-15T23:32:30.298227+0000","last_active":"2024-02-15T23:32:30.298174+0000","last_peered":"2024-02-15T23:32:30.298174+0000","last_clean":"2024-02-15T23:32:30.298174+0000","last_became_active":"2024-02-15T23:29:21.796643+0000","last_became_peered":"2024-02-15T23:29:21.796643+0000","last_unstale":"2024-02-15T23:32:30.298174+0000","last_undegraded":"2024-02-15T23:32:30.298174+0000","last_fullsized":"2024-02-15T23:32:30.298174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:30.297974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:30.297974+0000","last_clean_scrub_stamp":"2024-02-15T23:32:30.297974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:53:20.753279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.386313+0000","last_change":"2024-02-15T23:31:26.386313+0000","last_active":"2024-02-15T23:31:26.386313+0000","last_peered":"2024-02-15T23:31:26.386313+0000","last_clean":"2024-02-15T23:31:26.386313+0000","last_became_active":"2024-02-15T23:29:33.709512+0000","last_became_peered":"2024-02-15T23:29:33.709512+0000","last_unstale":"2024-02-15T23:31:26.386313+0000","last_undegraded":"2024-02-15T23:31:26.386313+0000","last_fullsized":"2024-02-15T23:31:26.386313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:26.386074+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.386074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:29.907866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.809672+0000","last_change":"2024-02-15T23:31:25.809672+0000","last_active":"2024-02-15T23:31:25.809672+0000","last_peered":"2024-02-15T23:31:25.809672+0000","last_clean":"2024-02-15T23:31:25.809672+0000","last_became_active":"2024-02-15T23:29:35.717208+0000","last_became_peered":"2024-02-15T23:29:35.717208+0000","last_unstale":"2024-02-15T23:31:25.809672+0000","last_undegraded":"2024-02-15T23:31:25.809672+0000","last_fullsized":"2024-02-15T23:31:25.809672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-15T23:31:25.809268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.809268+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:00:15.733653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.613362+0000","last_change":"2024-02-15T23:31:22.613362+0000","last_active":"2024-02-15T23:31:22.613362+0000","last_peered":"2024-02-15T23:31:22.613362+0000","last_clean":"2024-02-15T23:31:22.613362+0000","last_became_active":"2024-02-15T23:29:37.739137+0000","last_became_peered":"2024-02-15T23:29:37.739137+0000","last_unstale":"2024-02-15T23:31:22.613362+0000","last_undegraded":"2024-02-15T23:31:22.613362+0000","last_fullsized":"2024-02-15T23:31:22.613362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.613116+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.613116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:43.072580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.746979+0000","last_change":"2024-02-15T23:32:06.747036+0000","last_active":"2024-02-15T23:32:06.746979+0000","last_peered":"2024-02-15T23:32:06.746979+0000","last_clean":"2024-02-15T23:32:06.746979+0000","last_became_active":"2024-02-15T23:29:39.779892+0000","last_became_peered":"2024-02-15T23:29:39.779892+0000","last_unstale":"2024-02-15T23:32:06.746979+0000","last_undegraded":"2024-02-15T23:32:06.746979+0000","last_fullsized":"2024-02-15T23:32:06.746979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.746779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.746779+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.746779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:12.595644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.745722+0000","last_change":"2024-02-15T23:32:04.745780+0000","last_active":"2024-02-15T23:32:04.745722+0000","last_peered":"2024-02-15T23:32:04.745722+0000","last_clean":"2024-02-15T23:32:04.745722+0000","last_became_active":"2024-02-15T23:29:39.777494+0000","last_became_peered":"2024-02-15T23:29:39.777494+0000","last_unstale":"2024-02-15T23:32:04.745722+0000","last_undegraded":"2024-02-15T23:32:04.745722+0000","last_fullsized":"2024-02-15T23:32:04.745722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.745496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.745496+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.745496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:40.282587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:48.692986+0000","last_change":"2024-02-15T23:31:48.692986+0000","last_active":"2024-02-15T23:31:48.692986+0000","last_peered":"2024-02-15T23:31:48.692986+0000","last_clean":"2024-02-15T23:31:48.692986+0000","last_became_active":"2024-02-15T23:29:31.704402+0000","last_became_peered":"2024-02-15T23:29:31.704402+0000","last_unstale":"2024-02-15T23:31:48.692986+0000","last_undegraded":"2024-02-15T23:31:48.692986+0000","last_fullsized":"2024-02-15T23:31:48.692986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:48.692708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:48.692708+0000","last_clean_scrub_stamp":"2024-02-15T23:31:48.692708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:42:23.202805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.113539+0000","last_change":"2024-02-15T23:32:06.113674+0000","last_active":"2024-02-15T23:32:06.113539+0000","last_peered":"2024-02-15T23:32:06.113539+0000","last_clean":"2024-02-15T23:32:06.113539+0000","last_became_active":"2024-02-15T23:29:29.717571+0000","last_became_peered":"2024-02-15T23:29:29.717571+0000","last_unstale":"2024-02-15T23:32:06.113539+0000","last_undegraded":"2024-02-15T23:32:06.113539+0000","last_fullsized":"2024-02-15T23:32:06.113539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.113292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.113292+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.113292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:49.153473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"33'3","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.544544+0000","last_change":"2024-02-15T23:31:35.544544+0000","last_active":"2024-02-15T23:31:35.544544+0000","last_peered":"2024-02-15T23:31:35.544544+0000","last_clean":"2024-02-15T23:31:35.544544+0000","last_became_active":"2024-02-15T23:29:33.706919+0000","last_became_peered":"2024-02-15T23:29:33.706919+0000","last_unstale":"2024-02-15T23:31:35.544544+0000","last_undegraded":"2024-02-15T23:31:35.544544+0000","last_fullsized":"2024-02-15T23:31:35.544544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:35.544287+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:35.544287+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.544287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:02.404817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.391356+0000","last_change":"2024-02-15T23:31:22.391356+0000","last_active":"2024-02-15T23:31:22.391356+0000","last_peered":"2024-02-15T23:31:22.391356+0000","last_clean":"2024-02-15T23:31:22.391356+0000","last_became_active":"2024-02-15T23:29:35.745137+0000","last_became_peered":"2024-02-15T23:29:35.745137+0000","last_unstale":"2024-02-15T23:31:22.391356+0000","last_undegraded":"2024-02-15T23:31:22.391356+0000","last_fullsized":"2024-02-15T23:31:22.391356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:22.391105+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.391105+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:50:17.676736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.367893+0000","last_change":"2024-02-15T23:31:38.367893+0000","last_active":"2024-02-15T23:31:38.367893+0000","last_peered":"2024-02-15T23:31:38.367893+0000","last_clean":"2024-02-15T23:31:38.367893+0000","last_became_active":"2024-02-15T23:29:37.765420+0000","last_became_peered":"2024-02-15T23:29:37.765420+0000","last_unstale":"2024-02-15T23:31:38.367893+0000","last_undegraded":"2024-02-15T23:31:38.367893+0000","last_fullsized":"2024-02-15T23:31:38.367893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:38.367646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:38.367646+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.367646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:55.873044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.402060+0000","last_change":"2024-02-15T23:32:11.402116+0000","last_active":"2024-02-15T23:32:11.402060+0000","last_peered":"2024-02-15T23:32:11.402060+0000","last_clean":"2024-02-15T23:32:11.402060+0000","last_became_active":"2024-02-15T23:29:39.765319+0000","last_became_peered":"2024-02-15T23:29:39.765319+0000","last_unstale":"2024-02-15T23:32:11.402060+0000","last_undegraded":"2024-02-15T23:32:11.402060+0000","last_fullsized":"2024-02-15T23:32:11.402060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:11.401862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:11.401862+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.401862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:34.783625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.583056+0000","last_change":"2024-02-15T23:31:36.583056+0000","last_active":"2024-02-15T23:31:36.583056+0000","last_peered":"2024-02-15T23:31:36.583056+0000","last_clean":"2024-02-15T23:31:36.583056+0000","last_became_active":"2024-02-15T23:29:31.711381+0000","last_became_peered":"2024-02-15T23:29:31.711381+0000","last_unstale":"2024-02-15T23:31:36.583056+0000","last_undegraded":"2024-02-15T23:31:36.583056+0000","last_fullsized":"2024-02-15T23:31:36.583056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:36.582666+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:36.582666+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.582666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:45.901692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.734055+0000","last_change":"2024-02-15T23:31:59.734172+0000","last_active":"2024-02-15T23:31:59.734055+0000","last_peered":"2024-02-15T23:31:59.734055+0000","last_clean":"2024-02-15T23:31:59.734055+0000","last_became_active":"2024-02-15T23:29:29.723396+0000","last_became_peered":"2024-02-15T23:29:29.723396+0000","last_unstale":"2024-02-15T23:31:59.734055+0000","last_undegraded":"2024-02-15T23:31:59.734055+0000","last_fullsized":"2024-02-15T23:31:59.734055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:59.733761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:59.733761+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.733761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:12.574558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.359814+0000","last_change":"2024-02-15T23:31:25.359814+0000","last_active":"2024-02-15T23:31:25.359814+0000","last_peered":"2024-02-15T23:31:25.359814+0000","last_clean":"2024-02-15T23:31:25.359814+0000","last_became_active":"2024-02-15T23:29:33.710523+0000","last_became_peered":"2024-02-15T23:29:33.710523+0000","last_unstale":"2024-02-15T23:31:25.359814+0000","last_undegraded":"2024-02-15T23:31:25.359814+0000","last_fullsized":"2024-02-15T23:31:25.359814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:25.359571+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.359571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:30:32.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:27.537676+0000","last_change":"2024-02-15T23:31:27.537676+0000","last_active":"2024-02-15T23:31:27.537676+0000","last_peered":"2024-02-15T23:31:27.537676+0000","last_clean":"2024-02-15T23:31:27.537676+0000","last_became_active":"2024-02-15T23:29:35.721315+0000","last_became_peered":"2024-02-15T23:29:35.721315+0000","last_unstale":"2024-02-15T23:31:27.537676+0000","last_undegraded":"2024-02-15T23:31:27.537676+0000","last_fullsized":"2024-02-15T23:31:27.537676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:27.537385+0000","last_clean_scrub_stamp":"2024-02-15T23:31:27.537385+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:23.232882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:20.781906+0000","last_change":"2024-02-15T23:31:20.781906+0000","last_active":"2024-02-15T23:31:20.781906+0000","last_peered":"2024-02-15T23:31:20.781906+0000","last_clean":"2024-02-15T23:31:20.781906+0000","last_became_active":"2024-02-15T23:29:37.765951+0000","last_became_peered":"2024-02-15T23:29:37.765951+0000","last_unstale":"2024-02-15T23:31:20.781906+0000","last_undegraded":"2024-02-15T23:31:20.781906+0000","last_fullsized":"2024-02-15T23:31:20.781906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:20.781647+0000","last_clean_scrub_stamp":"2024-02-15T23:31:20.781647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:41:14.417063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:15.418186+0000","last_change":"2024-02-15T23:32:15.418237+0000","last_active":"2024-02-15T23:32:15.418186+0000","last_peered":"2024-02-15T23:32:15.418186+0000","last_clean":"2024-02-15T23:32:15.418186+0000","last_became_active":"2024-02-15T23:29:39.783136+0000","last_became_peered":"2024-02-15T23:29:39.783136+0000","last_unstale":"2024-02-15T23:32:15.418186+0000","last_undegraded":"2024-02-15T23:32:15.418186+0000","last_fullsized":"2024-02-15T23:32:15.418186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:15.417994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:15.417994+0000","last_clean_scrub_stamp":"2024-02-15T23:32:15.417994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:53.824487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.473112+0000","last_change":"2024-02-15T23:31:42.473112+0000","last_active":"2024-02-15T23:31:42.473112+0000","last_peered":"2024-02-15T23:31:42.473112+0000","last_clean":"2024-02-15T23:31:42.473112+0000","last_became_active":"2024-02-15T23:29:31.708734+0000","last_became_peered":"2024-02-15T23:29:31.708734+0000","last_unstale":"2024-02-15T23:31:42.473112+0000","last_undegraded":"2024-02-15T23:31:42.473112+0000","last_fullsized":"2024-02-15T23:31:42.473112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-15T23:31:42.472867+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-15T23:31:42.472867+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.472867+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:06.587933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.732380+0000","last_change":"2024-02-15T23:31:58.732520+0000","last_active":"2024-02-15T23:31:58.732380+0000","last_peered":"2024-02-15T23:31:58.732380+0000","last_clean":"2024-02-15T23:31:58.732380+0000","last_became_active":"2024-02-15T23:29:29.723521+0000","last_became_peered":"2024-02-15T23:29:29.723521+0000","last_unstale":"2024-02-15T23:31:58.732380+0000","last_undegraded":"2024-02-15T23:31:58.732380+0000","last_fullsized":"2024-02-15T23:31:58.732380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:58.732121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:58.732121+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.732121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:42:58.692459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.710546+0000","last_change":"2024-02-15T23:31:29.710546+0000","last_active":"2024-02-15T23:31:29.710546+0000","last_peered":"2024-02-15T23:31:29.710546+0000","last_clean":"2024-02-15T23:31:29.710546+0000","last_became_active":"2024-02-15T23:29:33.712431+0000","last_became_peered":"2024-02-15T23:29:33.712431+0000","last_unstale":"2024-02-15T23:31:29.710546+0000","last_undegraded":"2024-02-15T23:31:29.710546+0000","last_fullsized":"2024-02-15T23:31:29.710546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:29.710190+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.710190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:11:50.879896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'43","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.526124+0000","last_change":"2024-02-15T23:31:26.526124+0000","last_active":"2024-02-15T23:31:26.526124+0000","last_peered":"2024-02-15T23:31:26.526124+0000","last_clean":"2024-02-15T23:31:26.526124+0000","last_became_active":"2024-02-15T23:29:35.726233+0000","last_became_peered":"2024-02-15T23:29:35.726233+0000","last_unstale":"2024-02-15T23:31:26.526124+0000","last_undegraded":"2024-02-15T23:31:26.526124+0000","last_fullsized":"2024-02-15T23:31:26.526124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:26.525844+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.525844+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:36.827174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:17.360759+0000","last_change":"2024-02-15T23:31:17.360759+0000","last_active":"2024-02-15T23:31:17.360759+0000","last_peered":"2024-02-15T23:31:17.360759+0000","last_clean":"2024-02-15T23:31:17.360759+0000","last_became_active":"2024-02-15T23:29:37.730142+0000","last_became_peered":"2024-02-15T23:29:37.730142+0000","last_unstale":"2024-02-15T23:31:17.360759+0000","last_undegraded":"2024-02-15T23:31:17.360759+0000","last_fullsized":"2024-02-15T23:31:17.360759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:17.360411+0000","last_clean_scrub_stamp":"2024-02-15T23:31:17.360411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:43.189143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:39.436108+0000","last_change":"2024-02-15T23:32:39.436162+0000","last_active":"2024-02-15T23:32:39.436108+0000","last_peered":"2024-02-15T23:32:39.436108+0000","last_clean":"2024-02-15T23:32:39.436108+0000","last_became_active":"2024-02-15T23:29:39.783838+0000","last_became_peered":"2024-02-15T23:29:39.783838+0000","last_unstale":"2024-02-15T23:32:39.436108+0000","last_undegraded":"2024-02-15T23:32:39.436108+0000","last_fullsized":"2024-02-15T23:32:39.436108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:39.435922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:39.435922+0000","last_clean_scrub_stamp":"2024-02-15T23:32:39.435922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:22.555188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'10","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.176987+0000","last_change":"2024-02-15T23:31:57.177054+0000","last_active":"2024-02-15T23:31:57.176987+0000","last_peered":"2024-02-15T23:31:57.176987+0000","last_clean":"2024-02-15T23:31:57.176987+0000","last_became_active":"2024-02-15T23:29:31.701628+0000","last_became_peered":"2024-02-15T23:29:31.701628+0000","last_unstale":"2024-02-15T23:31:57.176987+0000","last_undegraded":"2024-02-15T23:31:57.176987+0000","last_fullsized":"2024-02-15T23:31:57.176987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-15T23:31:57.176757+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-15T23:31:57.176757+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.176757+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:24.740746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:59.496349+0000","last_change":"2024-02-15T23:31:59.496531+0000","last_active":"2024-02-15T23:31:59.496349+0000","last_peered":"2024-02-15T23:31:59.496349+0000","last_clean":"2024-02-15T23:31:59.496349+0000","last_became_active":"2024-02-15T23:29:29.736167+0000","last_became_peered":"2024-02-15T23:29:29.736167+0000","last_unstale":"2024-02-15T23:31:59.496349+0000","last_undegraded":"2024-02-15T23:31:59.496349+0000","last_fullsized":"2024-02-15T23:31:59.496349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:59.496102+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:59.496102+0000","last_clean_scrub_stamp":"2024-02-15T23:31:59.496102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.176917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:18.372027+0000","last_change":"2024-02-15T23:31:18.372027+0000","last_active":"2024-02-15T23:31:18.372027+0000","last_peered":"2024-02-15T23:31:18.372027+0000","last_clean":"2024-02-15T23:31:18.372027+0000","last_became_active":"2024-02-15T23:29:33.714398+0000","last_became_peered":"2024-02-15T23:29:33.714398+0000","last_unstale":"2024-02-15T23:31:18.372027+0000","last_undegraded":"2024-02-15T23:31:18.372027+0000","last_fullsized":"2024-02-15T23:31:18.372027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:18.371701+0000","last_clean_scrub_stamp":"2024-02-15T23:31:18.371701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:25.403990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:26.817387+0000","last_change":"2024-02-15T23:31:26.817387+0000","last_active":"2024-02-15T23:31:26.817387+0000","last_peered":"2024-02-15T23:31:26.817387+0000","last_clean":"2024-02-15T23:31:26.817387+0000","last_became_active":"2024-02-15T23:29:35.713489+0000","last_became_peered":"2024-02-15T23:29:35.713489+0000","last_unstale":"2024-02-15T23:31:26.817387+0000","last_undegraded":"2024-02-15T23:31:26.817387+0000","last_fullsized":"2024-02-15T23:31:26.817387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-15T23:31:26.817124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:26.817124+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:02:53.251206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.927965+0000","last_change":"2024-02-15T23:31:15.927965+0000","last_active":"2024-02-15T23:31:15.927965+0000","last_peered":"2024-02-15T23:31:15.927965+0000","last_clean":"2024-02-15T23:31:15.927965+0000","last_became_active":"2024-02-15T23:29:37.762530+0000","last_became_peered":"2024-02-15T23:29:37.762530+0000","last_unstale":"2024-02-15T23:31:15.927965+0000","last_undegraded":"2024-02-15T23:31:15.927965+0000","last_fullsized":"2024-02-15T23:31:15.927965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.927696+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.927696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:57:32.034698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:35.455640+0000","last_change":"2024-02-15T23:31:35.455640+0000","last_active":"2024-02-15T23:31:35.455640+0000","last_peered":"2024-02-15T23:31:35.455640+0000","last_clean":"2024-02-15T23:31:35.455640+0000","last_became_active":"2024-02-15T23:29:31.705229+0000","last_became_peered":"2024-02-15T23:29:31.705229+0000","last_unstale":"2024-02-15T23:31:35.455640+0000","last_undegraded":"2024-02-15T23:31:35.455640+0000","last_fullsized":"2024-02-15T23:31:35.455640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:35.455367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:35.455367+0000","last_clean_scrub_stamp":"2024-02-15T23:31:35.455367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:32:41.304232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:18.179682+0000","last_change":"2024-02-15T23:32:18.179746+0000","last_active":"2024-02-15T23:32:18.179682+0000","last_peered":"2024-02-15T23:32:18.179682+0000","last_clean":"2024-02-15T23:32:18.179682+0000","last_became_active":"2024-02-15T23:29:29.720519+0000","last_became_peered":"2024-02-15T23:29:29.720519+0000","last_unstale":"2024-02-15T23:32:18.179682+0000","last_undegraded":"2024-02-15T23:32:18.179682+0000","last_fullsized":"2024-02-15T23:32:18.179682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:18.179460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:18.179460+0000","last_clean_scrub_stamp":"2024-02-15T23:32:18.179460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:46:10.295456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.533581+0000","last_change":"2024-02-15T23:31:34.533581+0000","last_active":"2024-02-15T23:31:34.533581+0000","last_peered":"2024-02-15T23:31:34.533581+0000","last_clean":"2024-02-15T23:31:34.533581+0000","last_became_active":"2024-02-15T23:29:33.720271+0000","last_became_peered":"2024-02-15T23:29:33.720271+0000","last_unstale":"2024-02-15T23:31:34.533581+0000","last_undegraded":"2024-02-15T23:31:34.533581+0000","last_fullsized":"2024-02-15T23:31:34.533581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.533297+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.533297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:32.501484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.507799+0000","last_change":"2024-02-15T23:31:29.507799+0000","last_active":"2024-02-15T23:31:29.507799+0000","last_peered":"2024-02-15T23:31:29.507799+0000","last_clean":"2024-02-15T23:31:29.507799+0000","last_became_active":"2024-02-15T23:29:35.721126+0000","last_became_peered":"2024-02-15T23:29:35.721126+0000","last_unstale":"2024-02-15T23:31:29.507799+0000","last_undegraded":"2024-02-15T23:31:29.507799+0000","last_fullsized":"2024-02-15T23:31:29.507799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-15T23:31:29.507529+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.507529+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:11.492158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:16.901594+0000","last_change":"2024-02-15T23:31:16.901594+0000","last_active":"2024-02-15T23:31:16.901594+0000","last_peered":"2024-02-15T23:31:16.901594+0000","last_clean":"2024-02-15T23:31:16.901594+0000","last_became_active":"2024-02-15T23:29:37.762629+0000","last_became_peered":"2024-02-15T23:29:37.762629+0000","last_unstale":"2024-02-15T23:31:16.901594+0000","last_undegraded":"2024-02-15T23:31:16.901594+0000","last_fullsized":"2024-02-15T23:31:16.901594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:16.901336+0000","last_clean_scrub_stamp":"2024-02-15T23:31:16.901336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:01:50.745987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:14.397828+0000","last_change":"2024-02-15T23:32:14.397984+0000","last_active":"2024-02-15T23:32:14.397828+0000","last_peered":"2024-02-15T23:32:14.397828+0000","last_clean":"2024-02-15T23:32:14.397828+0000","last_became_active":"2024-02-15T23:29:39.778155+0000","last_became_peered":"2024-02-15T23:29:39.778155+0000","last_unstale":"2024-02-15T23:32:14.397828+0000","last_undegraded":"2024-02-15T23:32:14.397828+0000","last_fullsized":"2024-02-15T23:32:14.397828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-15T23:32:14.397617+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-15T23:32:14.397617+0000","last_clean_scrub_stamp":"2024-02-15T23:32:14.397617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:07:29.848259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.369161+0000","last_change":"2024-02-15T23:31:58.369287+0000","last_active":"2024-02-15T23:31:58.369161+0000","last_peered":"2024-02-15T23:31:58.369161+0000","last_clean":"2024-02-15T23:31:58.369161+0000","last_became_active":"2024-02-15T23:29:31.694544+0000","last_became_peered":"2024-02-15T23:29:31.694544+0000","last_unstale":"2024-02-15T23:31:58.369161+0000","last_undegraded":"2024-02-15T23:31:58.369161+0000","last_fullsized":"2024-02-15T23:31:58.369161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:58.368897+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:58.368897+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.368897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:34.625095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:55.461296+0000","last_change":"2024-02-15T23:31:55.461454+0000","last_active":"2024-02-15T23:31:55.461296+0000","last_peered":"2024-02-15T23:31:55.461296+0000","last_clean":"2024-02-15T23:31:55.461296+0000","last_became_active":"2024-02-15T23:29:29.736836+0000","last_became_peered":"2024-02-15T23:29:29.736836+0000","last_unstale":"2024-02-15T23:31:55.461296+0000","last_undegraded":"2024-02-15T23:31:55.461296+0000","last_fullsized":"2024-02-15T23:31:55.461296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:55.461068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:55.461068+0000","last_clean_scrub_stamp":"2024-02-15T23:31:55.461068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:30.998159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.651082+0000","last_change":"2024-02-15T23:31:34.651082+0000","last_active":"2024-02-15T23:31:34.651082+0000","last_peered":"2024-02-15T23:31:34.651082+0000","last_clean":"2024-02-15T23:31:34.651082+0000","last_became_active":"2024-02-15T23:29:33.703792+0000","last_became_peered":"2024-02-15T23:29:33.703792+0000","last_unstale":"2024-02-15T23:31:34.651082+0000","last_undegraded":"2024-02-15T23:31:34.651082+0000","last_fullsized":"2024-02-15T23:31:34.651082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:34.650808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:34.650808+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.650808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:51:46.892855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.445025+0000","last_change":"2024-02-15T23:31:28.445025+0000","last_active":"2024-02-15T23:31:28.445025+0000","last_peered":"2024-02-15T23:31:28.445025+0000","last_clean":"2024-02-15T23:31:28.445025+0000","last_became_active":"2024-02-15T23:29:35.745193+0000","last_became_peered":"2024-02-15T23:29:35.745193+0000","last_unstale":"2024-02-15T23:31:28.445025+0000","last_undegraded":"2024-02-15T23:31:28.445025+0000","last_fullsized":"2024-02-15T23:31:28.445025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:28.444726+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.444726+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:09.360474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:22.369935+0000","last_change":"2024-02-15T23:31:22.369935+0000","last_active":"2024-02-15T23:31:22.369935+0000","last_peered":"2024-02-15T23:31:22.369935+0000","last_clean":"2024-02-15T23:31:22.369935+0000","last_became_active":"2024-02-15T23:29:37.759793+0000","last_became_peered":"2024-02-15T23:29:37.759793+0000","last_unstale":"2024-02-15T23:31:22.369935+0000","last_undegraded":"2024-02-15T23:31:22.369935+0000","last_fullsized":"2024-02-15T23:31:22.369935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:22.369655+0000","last_clean_scrub_stamp":"2024-02-15T23:31:22.369655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:03.533673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.198053+0000","last_change":"2024-02-15T23:32:08.198105+0000","last_active":"2024-02-15T23:32:08.198053+0000","last_peered":"2024-02-15T23:32:08.198053+0000","last_clean":"2024-02-15T23:32:08.198053+0000","last_became_active":"2024-02-15T23:29:39.769231+0000","last_became_peered":"2024-02-15T23:29:39.769231+0000","last_unstale":"2024-02-15T23:32:08.198053+0000","last_undegraded":"2024-02-15T23:32:08.198053+0000","last_fullsized":"2024-02-15T23:32:08.198053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.197854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.197854+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.197854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:10.338610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:29.454965+0000","last_change":"2024-02-15T23:31:29.454965+0000","last_active":"2024-02-15T23:31:29.454965+0000","last_peered":"2024-02-15T23:31:29.454965+0000","last_clean":"2024-02-15T23:31:29.454965+0000","last_became_active":"2024-02-15T23:29:31.708778+0000","last_became_peered":"2024-02-15T23:29:31.708778+0000","last_unstale":"2024-02-15T23:31:29.454965+0000","last_undegraded":"2024-02-15T23:31:29.454965+0000","last_fullsized":"2024-02-15T23:31:29.454965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:29.454568+0000","last_clean_scrub_stamp":"2024-02-15T23:31:29.454568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:03.856437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:01.509155+0000","last_change":"2024-02-15T23:32:01.509226+0000","last_active":"2024-02-15T23:32:01.509155+0000","last_peered":"2024-02-15T23:32:01.509155+0000","last_clean":"2024-02-15T23:32:01.509155+0000","last_became_active":"2024-02-15T23:29:29.706014+0000","last_became_peered":"2024-02-15T23:29:29.706014+0000","last_unstale":"2024-02-15T23:32:01.509155+0000","last_undegraded":"2024-02-15T23:32:01.509155+0000","last_fullsized":"2024-02-15T23:32:01.509155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:01.508935+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:01.508935+0000","last_clean_scrub_stamp":"2024-02-15T23:32:01.508935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:37.563662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.714462+0000","last_change":"2024-02-15T23:31:31.714462+0000","last_active":"2024-02-15T23:31:31.714462+0000","last_peered":"2024-02-15T23:31:31.714462+0000","last_clean":"2024-02-15T23:31:31.714462+0000","last_became_active":"2024-02-15T23:29:33.706599+0000","last_became_peered":"2024-02-15T23:29:33.706599+0000","last_unstale":"2024-02-15T23:31:31.714462+0000","last_undegraded":"2024-02-15T23:31:31.714462+0000","last_fullsized":"2024-02-15T23:31:31.714462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.714124+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.714124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:37:31.708391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:25.561879+0000","last_change":"2024-02-15T23:31:25.561879+0000","last_active":"2024-02-15T23:31:25.561879+0000","last_peered":"2024-02-15T23:31:25.561879+0000","last_clean":"2024-02-15T23:31:25.561879+0000","last_became_active":"2024-02-15T23:29:35.740251+0000","last_became_peered":"2024-02-15T23:29:35.740251+0000","last_unstale":"2024-02-15T23:31:25.561879+0000","last_undegraded":"2024-02-15T23:31:25.561879+0000","last_fullsized":"2024-02-15T23:31:25.561879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:25.561617+0000","last_clean_scrub_stamp":"2024-02-15T23:31:25.561617+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:41.337167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.529167+0000","last_change":"2024-02-15T23:31:36.529167+0000","last_active":"2024-02-15T23:31:36.529167+0000","last_peered":"2024-02-15T23:31:36.529167+0000","last_clean":"2024-02-15T23:31:36.529167+0000","last_became_active":"2024-02-15T23:29:37.764987+0000","last_became_peered":"2024-02-15T23:29:37.764987+0000","last_unstale":"2024-02-15T23:31:36.529167+0000","last_undegraded":"2024-02-15T23:31:36.529167+0000","last_fullsized":"2024-02-15T23:31:36.529167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:36.528916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:36.528916+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.528916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:45.847942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.066468+0000","last_change":"2024-02-15T23:32:00.066519+0000","last_active":"2024-02-15T23:32:00.066468+0000","last_peered":"2024-02-15T23:32:00.066468+0000","last_clean":"2024-02-15T23:32:00.066468+0000","last_became_active":"2024-02-15T23:29:39.768758+0000","last_became_peered":"2024-02-15T23:29:39.768758+0000","last_unstale":"2024-02-15T23:32:00.066468+0000","last_undegraded":"2024-02-15T23:32:00.066468+0000","last_fullsized":"2024-02-15T23:32:00.066468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:00.066277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:00.066277+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.066277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:06:03.264969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:50.440425+0000","last_change":"2024-02-15T23:31:50.440425+0000","last_active":"2024-02-15T23:31:50.440425+0000","last_peered":"2024-02-15T23:31:50.440425+0000","last_clean":"2024-02-15T23:31:50.440425+0000","last_became_active":"2024-02-15T23:29:31.690874+0000","last_became_peered":"2024-02-15T23:29:31.690874+0000","last_unstale":"2024-02-15T23:31:50.440425+0000","last_undegraded":"2024-02-15T23:31:50.440425+0000","last_fullsized":"2024-02-15T23:31:50.440425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:50.440173+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:50.440173+0000","last_clean_scrub_stamp":"2024-02-15T23:31:50.440173+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:31.355921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:11.213365+0000","last_change":"2024-02-15T23:32:11.213514+0000","last_active":"2024-02-15T23:32:11.213365+0000","last_peered":"2024-02-15T23:32:11.213365+0000","last_clean":"2024-02-15T23:32:11.213365+0000","last_became_active":"2024-02-15T23:29:29.717591+0000","last_became_peered":"2024-02-15T23:29:29.717591+0000","last_unstale":"2024-02-15T23:32:11.213365+0000","last_undegraded":"2024-02-15T23:32:11.213365+0000","last_fullsized":"2024-02-15T23:32:11.213365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:11.213126+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:11.213126+0000","last_clean_scrub_stamp":"2024-02-15T23:32:11.213126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:06.414510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:33.554311+0000","last_change":"2024-02-15T23:31:33.554311+0000","last_active":"2024-02-15T23:31:33.554311+0000","last_peered":"2024-02-15T23:31:33.554311+0000","last_clean":"2024-02-15T23:31:33.554311+0000","last_became_active":"2024-02-15T23:29:33.706406+0000","last_became_peered":"2024-02-15T23:29:33.706406+0000","last_unstale":"2024-02-15T23:31:33.554311+0000","last_undegraded":"2024-02-15T23:31:33.554311+0000","last_fullsized":"2024-02-15T23:31:33.554311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:33.554047+0000","last_clean_scrub_stamp":"2024-02-15T23:31:33.554047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:30.257009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.356251+0000","last_change":"2024-02-15T23:31:42.356344+0000","last_active":"2024-02-15T23:31:42.356251+0000","last_peered":"2024-02-15T23:31:42.356251+0000","last_clean":"2024-02-15T23:31:42.356251+0000","last_became_active":"2024-02-15T23:29:35.749910+0000","last_became_peered":"2024-02-15T23:29:35.749910+0000","last_unstale":"2024-02-15T23:31:42.356251+0000","last_undegraded":"2024-02-15T23:31:42.356251+0000","last_fullsized":"2024-02-15T23:31:42.356251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-15T23:31:42.356050+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-15T23:31:42.356050+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.356050+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:50.625885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.756163+0000","last_change":"2024-02-15T23:31:28.756163+0000","last_active":"2024-02-15T23:31:28.756163+0000","last_peered":"2024-02-15T23:31:28.756163+0000","last_clean":"2024-02-15T23:31:28.756163+0000","last_became_active":"2024-02-15T23:29:37.767002+0000","last_became_peered":"2024-02-15T23:29:37.767002+0000","last_unstale":"2024-02-15T23:31:28.756163+0000","last_undegraded":"2024-02-15T23:31:28.756163+0000","last_fullsized":"2024-02-15T23:31:28.756163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-15T23:31:28.755882+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.755882+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:32.706979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:36.412827+0000","last_change":"2024-02-15T23:32:36.412945+0000","last_active":"2024-02-15T23:32:36.412827+0000","last_peered":"2024-02-15T23:32:36.412827+0000","last_clean":"2024-02-15T23:32:36.412827+0000","last_became_active":"2024-02-15T23:29:39.774324+0000","last_became_peered":"2024-02-15T23:29:39.774324+0000","last_unstale":"2024-02-15T23:32:36.412827+0000","last_undegraded":"2024-02-15T23:32:36.412827+0000","last_fullsized":"2024-02-15T23:32:36.412827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:36.412613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:36.412613+0000","last_clean_scrub_stamp":"2024-02-15T23:32:36.412613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:45:33.039263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:38.673550+0000","last_change":"2024-02-15T23:31:38.673550+0000","last_active":"2024-02-15T23:31:38.673550+0000","last_peered":"2024-02-15T23:31:38.673550+0000","last_clean":"2024-02-15T23:31:38.673550+0000","last_became_active":"2024-02-15T23:29:31.683271+0000","last_became_peered":"2024-02-15T23:29:31.683271+0000","last_unstale":"2024-02-15T23:31:38.673550+0000","last_undegraded":"2024-02-15T23:31:38.673550+0000","last_fullsized":"2024-02-15T23:31:38.673550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:38.673299+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:38.673299+0000","last_clean_scrub_stamp":"2024-02-15T23:31:38.673299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:50.183471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.513677+0000","last_change":"2024-02-15T23:32:07.513754+0000","last_active":"2024-02-15T23:32:07.513677+0000","last_peered":"2024-02-15T23:32:07.513677+0000","last_clean":"2024-02-15T23:32:07.513677+0000","last_became_active":"2024-02-15T23:29:29.721894+0000","last_became_peered":"2024-02-15T23:29:29.721894+0000","last_unstale":"2024-02-15T23:32:07.513677+0000","last_undegraded":"2024-02-15T23:32:07.513677+0000","last_fullsized":"2024-02-15T23:32:07.513677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:07.513457+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:07.513457+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.513457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:34.176641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:31.518612+0000","last_change":"2024-02-15T23:31:31.518612+0000","last_active":"2024-02-15T23:31:31.518612+0000","last_peered":"2024-02-15T23:31:31.518612+0000","last_clean":"2024-02-15T23:31:31.518612+0000","last_became_active":"2024-02-15T23:29:33.717468+0000","last_became_peered":"2024-02-15T23:29:33.717468+0000","last_unstale":"2024-02-15T23:31:31.518612+0000","last_undegraded":"2024-02-15T23:31:31.518612+0000","last_fullsized":"2024-02-15T23:31:31.518612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:31.518312+0000","last_clean_scrub_stamp":"2024-02-15T23:31:31.518312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:31:06.640014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:23.423852+0000","last_change":"2024-02-15T23:31:23.423852+0000","last_active":"2024-02-15T23:31:23.423852+0000","last_peered":"2024-02-15T23:31:23.423852+0000","last_clean":"2024-02-15T23:31:23.423852+0000","last_became_active":"2024-02-15T23:29:35.727586+0000","last_became_peered":"2024-02-15T23:29:35.727586+0000","last_unstale":"2024-02-15T23:31:23.423852+0000","last_undegraded":"2024-02-15T23:31:23.423852+0000","last_fullsized":"2024-02-15T23:31:23.423852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-15T23:31:23.423607+0000","last_clean_scrub_stamp":"2024-02-15T23:31:23.423607+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:37.518487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:15.569048+0000","last_change":"2024-02-15T23:31:15.569048+0000","last_active":"2024-02-15T23:31:15.569048+0000","last_peered":"2024-02-15T23:31:15.569048+0000","last_clean":"2024-02-15T23:31:15.569048+0000","last_became_active":"2024-02-15T23:29:37.762494+0000","last_became_peered":"2024-02-15T23:29:37.762494+0000","last_unstale":"2024-02-15T23:31:15.569048+0000","last_undegraded":"2024-02-15T23:31:15.569048+0000","last_fullsized":"2024-02-15T23:31:15.569048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:15.568926+0000","last_clean_scrub_stamp":"2024-02-15T23:31:15.568926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:10.440118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:12.430515+0000","last_change":"2024-02-15T23:32:12.430573+0000","last_active":"2024-02-15T23:32:12.430515+0000","last_peered":"2024-02-15T23:32:12.430515+0000","last_clean":"2024-02-15T23:32:12.430515+0000","last_became_active":"2024-02-15T23:29:39.780690+0000","last_became_peered":"2024-02-15T23:29:39.780690+0000","last_unstale":"2024-02-15T23:32:12.430515+0000","last_undegraded":"2024-02-15T23:32:12.430515+0000","last_fullsized":"2024-02-15T23:32:12.430515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:12.430261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:12.430261+0000","last_clean_scrub_stamp":"2024-02-15T23:32:12.430261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:59.527661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:42.635470+0000","last_change":"2024-02-15T23:31:42.635470+0000","last_active":"2024-02-15T23:31:42.635470+0000","last_peered":"2024-02-15T23:31:42.635470+0000","last_clean":"2024-02-15T23:31:42.635470+0000","last_became_active":"2024-02-15T23:29:31.683877+0000","last_became_peered":"2024-02-15T23:29:31.683877+0000","last_unstale":"2024-02-15T23:31:42.635470+0000","last_undegraded":"2024-02-15T23:31:42.635470+0000","last_fullsized":"2024-02-15T23:31:42.635470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:42.635214+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:42.635214+0000","last_clean_scrub_stamp":"2024-02-15T23:31:42.635214+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:35.664062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.163523+0000","last_change":"2024-02-15T23:32:09.163607+0000","last_active":"2024-02-15T23:32:09.163523+0000","last_peered":"2024-02-15T23:32:09.163523+0000","last_clean":"2024-02-15T23:32:09.163523+0000","last_became_active":"2024-02-15T23:29:29.722117+0000","last_became_peered":"2024-02-15T23:29:29.722117+0000","last_unstale":"2024-02-15T23:32:09.163523+0000","last_undegraded":"2024-02-15T23:32:09.163523+0000","last_fullsized":"2024-02-15T23:32:09.163523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:09.163292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:09.163292+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.163292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:34.045146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.758567+0000","last_change":"2024-02-15T23:31:30.758567+0000","last_active":"2024-02-15T23:31:30.758567+0000","last_peered":"2024-02-15T23:31:30.758567+0000","last_clean":"2024-02-15T23:31:30.758567+0000","last_became_active":"2024-02-15T23:29:33.706827+0000","last_became_peered":"2024-02-15T23:29:33.706827+0000","last_unstale":"2024-02-15T23:31:30.758567+0000","last_undegraded":"2024-02-15T23:31:30.758567+0000","last_fullsized":"2024-02-15T23:31:30.758567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:30.758324+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.758324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:34.432457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:30.549776+0000","last_change":"2024-02-15T23:31:30.549776+0000","last_active":"2024-02-15T23:31:30.549776+0000","last_peered":"2024-02-15T23:31:30.549776+0000","last_clean":"2024-02-15T23:31:30.549776+0000","last_became_active":"2024-02-15T23:29:35.719108+0000","last_became_peered":"2024-02-15T23:29:35.719108+0000","last_unstale":"2024-02-15T23:31:30.549776+0000","last_undegraded":"2024-02-15T23:31:30.549776+0000","last_fullsized":"2024-02-15T23:31:30.549776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-15T23:31:30.549503+0000","last_clean_scrub_stamp":"2024-02-15T23:31:30.549503+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:38.362864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:39.350413+0000","last_change":"2024-02-15T23:31:39.350413+0000","last_active":"2024-02-15T23:31:39.350413+0000","last_peered":"2024-02-15T23:31:39.350413+0000","last_clean":"2024-02-15T23:31:39.350413+0000","last_became_active":"2024-02-15T23:29:37.765351+0000","last_became_peered":"2024-02-15T23:29:37.765351+0000","last_unstale":"2024-02-15T23:31:39.350413+0000","last_undegraded":"2024-02-15T23:31:39.350413+0000","last_fullsized":"2024-02-15T23:31:39.350413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:39.350163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:39.350163+0000","last_clean_scrub_stamp":"2024-02-15T23:31:39.350163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:00.377352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:38.421561+0000","last_change":"2024-02-15T23:32:38.421687+0000","last_active":"2024-02-15T23:32:38.421561+0000","last_peered":"2024-02-15T23:32:38.421561+0000","last_clean":"2024-02-15T23:32:38.421561+0000","last_became_active":"2024-02-15T23:29:39.783517+0000","last_became_peered":"2024-02-15T23:29:39.783517+0000","last_unstale":"2024-02-15T23:32:38.421561+0000","last_undegraded":"2024-02-15T23:32:38.421561+0000","last_fullsized":"2024-02-15T23:32:38.421561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:38.421316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:38.421316+0000","last_clean_scrub_stamp":"2024-02-15T23:32:38.421316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:56.125193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.116498+0000","last_change":"2024-02-15T23:32:02.116549+0000","last_active":"2024-02-15T23:32:02.116498+0000","last_peered":"2024-02-15T23:32:02.116498+0000","last_clean":"2024-02-15T23:32:02.116498+0000","last_became_active":"2024-02-15T23:29:31.699306+0000","last_became_peered":"2024-02-15T23:29:31.699306+0000","last_unstale":"2024-02-15T23:32:02.116498+0000","last_undegraded":"2024-02-15T23:32:02.116498+0000","last_fullsized":"2024-02-15T23:32:02.116498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.116301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.116301+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.116301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:40.094471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:57.391810+0000","last_change":"2024-02-15T23:31:57.391944+0000","last_active":"2024-02-15T23:31:57.391810+0000","last_peered":"2024-02-15T23:31:57.391810+0000","last_clean":"2024-02-15T23:31:57.391810+0000","last_became_active":"2024-02-15T23:29:29.716365+0000","last_became_peered":"2024-02-15T23:29:29.716365+0000","last_unstale":"2024-02-15T23:31:57.391810+0000","last_undegraded":"2024-02-15T23:31:57.391810+0000","last_fullsized":"2024-02-15T23:31:57.391810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:57.391581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:57.391581+0000","last_clean_scrub_stamp":"2024-02-15T23:31:57.391581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:33:03.240446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:28.436490+0000","last_change":"2024-02-15T23:31:28.436490+0000","last_active":"2024-02-15T23:31:28.436490+0000","last_peered":"2024-02-15T23:31:28.436490+0000","last_clean":"2024-02-15T23:31:28.436490+0000","last_became_active":"2024-02-15T23:29:33.717945+0000","last_became_peered":"2024-02-15T23:29:33.717945+0000","last_unstale":"2024-02-15T23:31:28.436490+0000","last_undegraded":"2024-02-15T23:31:28.436490+0000","last_fullsized":"2024-02-15T23:31:28.436490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-15T23:31:28.436171+0000","last_clean_scrub_stamp":"2024-02-15T23:31:28.436171+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:39.946344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'28","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.362393+0000","last_change":"2024-02-15T23:31:41.362393+0000","last_active":"2024-02-15T23:31:41.362393+0000","last_peered":"2024-02-15T23:31:41.362393+0000","last_clean":"2024-02-15T23:31:41.362393+0000","last_became_active":"2024-02-15T23:29:35.749984+0000","last_became_peered":"2024-02-15T23:29:35.749984+0000","last_unstale":"2024-02-15T23:31:41.362393+0000","last_undegraded":"2024-02-15T23:31:41.362393+0000","last_fullsized":"2024-02-15T23:31:41.362393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-02-15T23:31:41.362130+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-02-15T23:31:41.362130+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.362130+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:58.292943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:44.335984+0000","last_change":"2024-02-15T23:31:44.335984+0000","last_active":"2024-02-15T23:31:44.335984+0000","last_peered":"2024-02-15T23:31:44.335984+0000","last_clean":"2024-02-15T23:31:44.335984+0000","last_became_active":"2024-02-15T23:29:37.770163+0000","last_became_peered":"2024-02-15T23:29:37.770163+0000","last_unstale":"2024-02-15T23:31:44.335984+0000","last_undegraded":"2024-02-15T23:31:44.335984+0000","last_fullsized":"2024-02-15T23:31:44.335984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:44.335687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:44.335687+0000","last_clean_scrub_stamp":"2024-02-15T23:31:44.335687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:23.592145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:41.420073+0000","last_change":"2024-02-15T23:32:41.420140+0000","last_active":"2024-02-15T23:32:41.420073+0000","last_peered":"2024-02-15T23:32:41.420073+0000","last_clean":"2024-02-15T23:32:41.420073+0000","last_became_active":"2024-02-15T23:29:39.783891+0000","last_became_peered":"2024-02-15T23:29:39.783891+0000","last_unstale":"2024-02-15T23:32:41.420073+0000","last_undegraded":"2024-02-15T23:32:41.420073+0000","last_fullsized":"2024-02-15T23:32:41.420073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:41.419870+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:41.419870+0000","last_clean_scrub_stamp":"2024-02-15T23:32:41.419870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:52:11.444107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.649753+0000","last_change":"2024-02-15T23:31:40.649753+0000","last_active":"2024-02-15T23:31:40.649753+0000","last_peered":"2024-02-15T23:31:40.649753+0000","last_clean":"2024-02-15T23:31:40.649753+0000","last_became_active":"2024-02-15T23:29:31.683970+0000","last_became_peered":"2024-02-15T23:29:31.683970+0000","last_unstale":"2024-02-15T23:31:40.649753+0000","last_undegraded":"2024-02-15T23:31:40.649753+0000","last_fullsized":"2024-02-15T23:31:40.649753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:40.649389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:40.649389+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.649389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:48.462750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:02.522382+0000","last_change":"2024-02-15T23:32:02.522513+0000","last_active":"2024-02-15T23:32:02.522382+0000","last_peered":"2024-02-15T23:32:02.522382+0000","last_clean":"2024-02-15T23:32:02.522382+0000","last_became_active":"2024-02-15T23:29:29.718393+0000","last_became_peered":"2024-02-15T23:29:29.718393+0000","last_unstale":"2024-02-15T23:32:02.522382+0000","last_undegraded":"2024-02-15T23:32:02.522382+0000","last_fullsized":"2024-02-15T23:32:02.522382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:02.522145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:02.522145+0000","last_clean_scrub_stamp":"2024-02-15T23:32:02.522145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:23.549334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:32.519469+0000","last_change":"2024-02-15T23:31:32.519469+0000","last_active":"2024-02-15T23:31:32.519469+0000","last_peered":"2024-02-15T23:31:32.519469+0000","last_clean":"2024-02-15T23:31:32.519469+0000","last_became_active":"2024-02-15T23:29:33.717545+0000","last_became_peered":"2024-02-15T23:29:33.717545+0000","last_unstale":"2024-02-15T23:31:32.519469+0000","last_undegraded":"2024-02-15T23:31:32.519469+0000","last_fullsized":"2024-02-15T23:31:32.519469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-15T23:31:32.519211+0000","last_clean_scrub_stamp":"2024-02-15T23:31:32.519211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:58:25.548059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:36.414372+0000","last_change":"2024-02-15T23:31:36.414372+0000","last_active":"2024-02-15T23:31:36.414372+0000","last_peered":"2024-02-15T23:31:36.414372+0000","last_clean":"2024-02-15T23:31:36.414372+0000","last_became_active":"2024-02-15T23:29:35.747420+0000","last_became_peered":"2024-02-15T23:29:35.747420+0000","last_unstale":"2024-02-15T23:31:36.414372+0000","last_undegraded":"2024-02-15T23:31:36.414372+0000","last_fullsized":"2024-02-15T23:31:36.414372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-02-15T23:31:36.414095+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-02-15T23:31:36.414095+0000","last_clean_scrub_stamp":"2024-02-15T23:31:36.414095+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:12.670293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:24.576932+0000","last_change":"2024-02-15T23:31:24.576932+0000","last_active":"2024-02-15T23:31:24.576932+0000","last_peered":"2024-02-15T23:31:24.576932+0000","last_clean":"2024-02-15T23:31:24.576932+0000","last_became_active":"2024-02-15T23:29:37.762608+0000","last_became_peered":"2024-02-15T23:29:37.762608+0000","last_unstale":"2024-02-15T23:31:24.576932+0000","last_undegraded":"2024-02-15T23:31:24.576932+0000","last_fullsized":"2024-02-15T23:31:24.576932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:24.576683+0000","last_clean_scrub_stamp":"2024-02-15T23:31:24.576683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:19:16.045656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:40.468008+0000","last_change":"2024-02-15T23:32:40.468071+0000","last_active":"2024-02-15T23:32:40.468008+0000","last_peered":"2024-02-15T23:32:40.468008+0000","last_clean":"2024-02-15T23:32:40.468008+0000","last_became_active":"2024-02-15T23:29:39.783915+0000","last_became_peered":"2024-02-15T23:29:39.783915+0000","last_unstale":"2024-02-15T23:32:40.468008+0000","last_undegraded":"2024-02-15T23:32:40.468008+0000","last_fullsized":"2024-02-15T23:32:40.468008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:40.467788+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:40.467788+0000","last_clean_scrub_stamp":"2024-02-15T23:32:40.467788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:48:16.717077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:37.577577+0000","last_change":"2024-02-15T23:31:37.577577+0000","last_active":"2024-02-15T23:31:37.577577+0000","last_peered":"2024-02-15T23:31:37.577577+0000","last_clean":"2024-02-15T23:31:37.577577+0000","last_became_active":"2024-02-15T23:29:31.709832+0000","last_became_peered":"2024-02-15T23:29:31.709832+0000","last_unstale":"2024-02-15T23:31:37.577577+0000","last_undegraded":"2024-02-15T23:31:37.577577+0000","last_fullsized":"2024-02-15T23:31:37.577577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:37.577323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:37.577323+0000","last_clean_scrub_stamp":"2024-02-15T23:31:37.577323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:59.138396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.666415+0000","last_change":"2024-02-15T23:31:45.666475+0000","last_active":"2024-02-15T23:31:45.666415+0000","last_peered":"2024-02-15T23:31:45.666415+0000","last_clean":"2024-02-15T23:31:45.666415+0000","last_became_active":"2024-02-15T23:29:29.733153+0000","last_became_peered":"2024-02-15T23:29:29.733153+0000","last_unstale":"2024-02-15T23:31:45.666415+0000","last_undegraded":"2024-02-15T23:31:45.666415+0000","last_fullsized":"2024-02-15T23:31:45.666415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:45.666217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:45.666217+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.666217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:02:12.526747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'8","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.471185+0000","last_change":"2024-02-15T23:31:46.471250+0000","last_active":"2024-02-15T23:31:46.471185+0000","last_peered":"2024-02-15T23:31:46.471185+0000","last_clean":"2024-02-15T23:31:46.471185+0000","last_became_active":"2024-02-15T23:29:31.688455+0000","last_became_peered":"2024-02-15T23:29:31.688455+0000","last_unstale":"2024-02-15T23:31:46.471185+0000","last_undegraded":"2024-02-15T23:31:46.471185+0000","last_fullsized":"2024-02-15T23:31:46.471185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:46.471000+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:46.471000+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.471000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:30:13.169741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.402015+0000","last_change":"2024-02-15T23:32:05.402093+0000","last_active":"2024-02-15T23:32:05.402015+0000","last_peered":"2024-02-15T23:32:05.402015+0000","last_clean":"2024-02-15T23:32:05.402015+0000","last_became_active":"2024-02-15T23:29:29.706943+0000","last_became_peered":"2024-02-15T23:29:29.706943+0000","last_unstale":"2024-02-15T23:32:05.402015+0000","last_undegraded":"2024-02-15T23:32:05.402015+0000","last_fullsized":"2024-02-15T23:32:05.402015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:05.401804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:05.401804+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.401804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:49:10.224674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:34.465414+0000","last_change":"2024-02-15T23:31:34.465414+0000","last_active":"2024-02-15T23:31:34.465414+0000","last_peered":"2024-02-15T23:31:34.465414+0000","last_clean":"2024-02-15T23:31:34.465414+0000","last_became_active":"2024-02-15T23:29:31.703930+0000","last_became_peered":"2024-02-15T23:29:31.703930+0000","last_unstale":"2024-02-15T23:31:34.465414+0000","last_undegraded":"2024-02-15T23:31:34.465414+0000","last_fullsized":"2024-02-15T23:31:34.465414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:34.465154+0000","last_clean_scrub_stamp":"2024-02-15T23:31:34.465154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:45.028387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:34.366233+0000","last_change":"2024-02-15T23:32:34.366323+0000","last_active":"2024-02-15T23:32:34.366233+0000","last_peered":"2024-02-15T23:32:34.366233+0000","last_clean":"2024-02-15T23:32:34.366233+0000","last_became_active":"2024-02-15T23:29:29.725467+0000","last_became_peered":"2024-02-15T23:29:29.725467+0000","last_unstale":"2024-02-15T23:32:34.366233+0000","last_undegraded":"2024-02-15T23:32:34.366233+0000","last_fullsized":"2024-02-15T23:32:34.366233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:34.366003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:34.366003+0000","last_clean_scrub_stamp":"2024-02-15T23:32:34.366003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:05.213171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:52.429461+0000","last_change":"2024-02-15T23:31:52.429522+0000","last_active":"2024-02-15T23:31:52.429461+0000","last_peered":"2024-02-15T23:31:52.429461+0000","last_clean":"2024-02-15T23:31:52.429461+0000","last_became_active":"2024-02-15T23:29:31.693201+0000","last_became_peered":"2024-02-15T23:29:31.693201+0000","last_unstale":"2024-02-15T23:31:52.429461+0000","last_undegraded":"2024-02-15T23:31:52.429461+0000","last_fullsized":"2024-02-15T23:31:52.429461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:52.429268+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:52.429268+0000","last_clean_scrub_stamp":"2024-02-15T23:31:52.429268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:34.192751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:04.442518+0000","last_change":"2024-02-15T23:32:04.442579+0000","last_active":"2024-02-15T23:32:04.442518+0000","last_peered":"2024-02-15T23:32:04.442518+0000","last_clean":"2024-02-15T23:32:04.442518+0000","last_became_active":"2024-02-15T23:29:29.706338+0000","last_became_peered":"2024-02-15T23:29:29.706338+0000","last_unstale":"2024-02-15T23:32:04.442518+0000","last_undegraded":"2024-02-15T23:32:04.442518+0000","last_fullsized":"2024-02-15T23:32:04.442518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:04.442322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:04.442322+0000","last_clean_scrub_stamp":"2024-02-15T23:32:04.442322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:12.712157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.431824+0000","last_change":"2024-02-15T23:31:43.431966+0000","last_active":"2024-02-15T23:31:43.431824+0000","last_peered":"2024-02-15T23:31:43.431824+0000","last_clean":"2024-02-15T23:31:43.431824+0000","last_became_active":"2024-02-15T23:29:31.708515+0000","last_became_peered":"2024-02-15T23:29:31.708515+0000","last_unstale":"2024-02-15T23:31:43.431824+0000","last_undegraded":"2024-02-15T23:31:43.431824+0000","last_fullsized":"2024-02-15T23:31:43.431824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:43.431598+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:43.431598+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.431598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:46.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:08.423709+0000","last_change":"2024-02-15T23:32:08.423847+0000","last_active":"2024-02-15T23:32:08.423709+0000","last_peered":"2024-02-15T23:32:08.423709+0000","last_clean":"2024-02-15T23:32:08.423709+0000","last_became_active":"2024-02-15T23:29:29.714837+0000","last_became_peered":"2024-02-15T23:29:29.714837+0000","last_unstale":"2024-02-15T23:32:08.423709+0000","last_undegraded":"2024-02-15T23:32:08.423709+0000","last_fullsized":"2024-02-15T23:32:08.423709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:08.423428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:08.423428+0000","last_clean_scrub_stamp":"2024-02-15T23:32:08.423428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:15.787731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.569475+0000","last_change":"2024-02-15T23:31:41.569613+0000","last_active":"2024-02-15T23:31:41.569475+0000","last_peered":"2024-02-15T23:31:41.569475+0000","last_clean":"2024-02-15T23:31:41.569475+0000","last_became_active":"2024-02-15T23:29:31.703986+0000","last_became_peered":"2024-02-15T23:29:31.703986+0000","last_unstale":"2024-02-15T23:31:41.569475+0000","last_undegraded":"2024-02-15T23:31:41.569475+0000","last_fullsized":"2024-02-15T23:31:41.569475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:41.569264+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:41.569264+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.569264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:36.816368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.460098+0000","last_change":"2024-02-15T23:31:53.460237+0000","last_active":"2024-02-15T23:31:53.460098+0000","last_peered":"2024-02-15T23:31:53.460098+0000","last_clean":"2024-02-15T23:31:53.460098+0000","last_became_active":"2024-02-15T23:29:29.736412+0000","last_became_peered":"2024-02-15T23:29:29.736412+0000","last_unstale":"2024-02-15T23:31:53.460098+0000","last_undegraded":"2024-02-15T23:31:53.460098+0000","last_fullsized":"2024-02-15T23:31:53.460098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:53.459858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:53.459858+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.459858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:12:59.119468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.381192+0000","last_change":"2024-02-15T23:31:56.381291+0000","last_active":"2024-02-15T23:31:56.381192+0000","last_peered":"2024-02-15T23:31:56.381192+0000","last_clean":"2024-02-15T23:31:56.381192+0000","last_became_active":"2024-02-15T23:29:31.694686+0000","last_became_peered":"2024-02-15T23:29:31.694686+0000","last_unstale":"2024-02-15T23:31:56.381192+0000","last_undegraded":"2024-02-15T23:31:56.381192+0000","last_fullsized":"2024-02-15T23:31:56.381192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:56.380971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:56.380971+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.380971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:06.944204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:47.669309+0000","last_change":"2024-02-15T23:31:47.669477+0000","last_active":"2024-02-15T23:31:47.669309+0000","last_peered":"2024-02-15T23:31:47.669309+0000","last_clean":"2024-02-15T23:31:47.669309+0000","last_became_active":"2024-02-15T23:29:29.731551+0000","last_became_peered":"2024-02-15T23:29:29.731551+0000","last_unstale":"2024-02-15T23:31:47.669309+0000","last_undegraded":"2024-02-15T23:31:47.669309+0000","last_fullsized":"2024-02-15T23:31:47.669309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:47.669042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:47.669042+0000","last_clean_scrub_stamp":"2024-02-15T23:31:47.669042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:58:09.230115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:54.507539+0000","last_change":"2024-02-15T23:31:54.507596+0000","last_active":"2024-02-15T23:31:54.507539+0000","last_peered":"2024-02-15T23:31:54.507539+0000","last_clean":"2024-02-15T23:31:54.507539+0000","last_became_active":"2024-02-15T23:29:31.691822+0000","last_became_peered":"2024-02-15T23:29:31.691822+0000","last_unstale":"2024-02-15T23:31:54.507539+0000","last_undegraded":"2024-02-15T23:31:54.507539+0000","last_fullsized":"2024-02-15T23:31:54.507539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:54.507342+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:54.507342+0000","last_clean_scrub_stamp":"2024-02-15T23:31:54.507342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:34:41.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:07.450623+0000","last_change":"2024-02-15T23:32:07.450688+0000","last_active":"2024-02-15T23:32:07.450623+0000","last_peered":"2024-02-15T23:32:07.450623+0000","last_clean":"2024-02-15T23:32:07.450623+0000","last_became_active":"2024-02-15T23:29:29.709822+0000","last_became_peered":"2024-02-15T23:29:29.709822+0000","last_unstale":"2024-02-15T23:32:07.450623+0000","last_undegraded":"2024-02-15T23:32:07.450623+0000","last_fullsized":"2024-02-15T23:32:07.450623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:07.450435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:07.450435+0000","last_clean_scrub_stamp":"2024-02-15T23:32:07.450435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:28:34.113619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:45.530211+0000","last_change":"2024-02-15T23:31:45.530211+0000","last_active":"2024-02-15T23:31:45.530211+0000","last_peered":"2024-02-15T23:31:45.530211+0000","last_clean":"2024-02-15T23:31:45.530211+0000","last_became_active":"2024-02-15T23:29:31.689095+0000","last_became_peered":"2024-02-15T23:29:31.689095+0000","last_unstale":"2024-02-15T23:31:45.530211+0000","last_undegraded":"2024-02-15T23:31:45.530211+0000","last_fullsized":"2024-02-15T23:31:45.530211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:45.529928+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:45.529928+0000","last_clean_scrub_stamp":"2024-02-15T23:31:45.529928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:50:15.937262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:17.227637+0000","last_change":"2024-02-15T23:32:17.227705+0000","last_active":"2024-02-15T23:32:17.227637+0000","last_peered":"2024-02-15T23:32:17.227637+0000","last_clean":"2024-02-15T23:32:17.227637+0000","last_became_active":"2024-02-15T23:29:29.714190+0000","last_became_peered":"2024-02-15T23:29:29.714190+0000","last_unstale":"2024-02-15T23:32:17.227637+0000","last_undegraded":"2024-02-15T23:32:17.227637+0000","last_fullsized":"2024-02-15T23:32:17.227637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:17.227431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:17.227431+0000","last_clean_scrub_stamp":"2024-02-15T23:32:17.227431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:05.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'14","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:17.401101+0000","last_change":"2024-02-15T23:32:17.401101+0000","last_active":"2024-02-15T23:32:17.401101+0000","last_peered":"2024-02-15T23:32:17.401101+0000","last_clean":"2024-02-15T23:32:17.401101+0000","last_became_active":"2024-02-15T23:30:10.793052+0000","last_became_peered":"2024-02-15T23:30:10.793052+0000","last_unstale":"2024-02-15T23:32:17.401101+0000","last_undegraded":"2024-02-15T23:32:17.401101+0000","last_fullsized":"2024-02-15T23:32:17.401101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-15T23:32:17.400686+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-15T23:32:17.400686+0000","last_clean_scrub_stamp":"2024-02-15T23:32:17.400686+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:24:40.141805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:53.388509+0000","last_change":"2024-02-15T23:31:53.388574+0000","last_active":"2024-02-15T23:31:53.388509+0000","last_peered":"2024-02-15T23:31:53.388509+0000","last_clean":"2024-02-15T23:31:53.388509+0000","last_became_active":"2024-02-15T23:29:29.717825+0000","last_became_peered":"2024-02-15T23:29:29.717825+0000","last_unstale":"2024-02-15T23:31:53.388509+0000","last_undegraded":"2024-02-15T23:31:53.388509+0000","last_fullsized":"2024-02-15T23:31:53.388509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:31:53.388287+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:31:53.388287+0000","last_clean_scrub_stamp":"2024-02-15T23:31:53.388287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:38.067265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'22","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:41.424844+0000","last_change":"2024-02-15T23:31:41.424844+0000","last_active":"2024-02-15T23:31:41.424844+0000","last_peered":"2024-02-15T23:31:41.424844+0000","last_clean":"2024-02-15T23:31:41.424844+0000","last_became_active":"2024-02-15T23:29:31.712807+0000","last_became_peered":"2024-02-15T23:29:31.712807+0000","last_unstale":"2024-02-15T23:31:41.424844+0000","last_undegraded":"2024-02-15T23:31:41.424844+0000","last_fullsized":"2024-02-15T23:31:41.424844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-02-15T23:31:41.424484+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-02-15T23:31:41.424484+0000","last_clean_scrub_stamp":"2024-02-15T23:31:41.424484+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:46:22.213060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":69,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:49.485141+0000","last_change":"2024-02-15T23:31:49.485212+0000","last_active":"2024-02-15T23:31:49.485141+0000","last_peered":"2024-02-15T23:31:49.485141+0000","last_clean":"2024-02-15T23:31:49.485141+0000","last_became_active":"2024-02-15T23:29:29.741033+0000","last_became_peered":"2024-02-15T23:29:29.741033+0000","last_unstale":"2024-02-15T23:31:49.485141+0000","last_undegraded":"2024-02-15T23:31:49.485141+0000","last_fullsized":"2024-02-15T23:31:49.485141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:49.484951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:49.484951+0000","last_clean_scrub_stamp":"2024-02-15T23:31:49.484951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:26.137159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:56.421836+0000","last_change":"2024-02-15T23:31:56.421894+0000","last_active":"2024-02-15T23:31:56.421836+0000","last_peered":"2024-02-15T23:31:56.421836+0000","last_clean":"2024-02-15T23:31:56.421836+0000","last_became_active":"2024-02-15T23:29:31.694115+0000","last_became_peered":"2024-02-15T23:29:31.694115+0000","last_unstale":"2024-02-15T23:31:56.421836+0000","last_undegraded":"2024-02-15T23:31:56.421836+0000","last_fullsized":"2024-02-15T23:31:56.421836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-02-15T23:31:56.421634+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-02-15T23:31:56.421634+0000","last_clean_scrub_stamp":"2024-02-15T23:31:56.421634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:14:06.984867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:06.517512+0000","last_change":"2024-02-15T23:32:06.517569+0000","last_active":"2024-02-15T23:32:06.517512+0000","last_peered":"2024-02-15T23:32:06.517512+0000","last_clean":"2024-02-15T23:32:06.517512+0000","last_became_active":"2024-02-15T23:29:29.718823+0000","last_became_peered":"2024-02-15T23:29:29.718823+0000","last_unstale":"2024-02-15T23:32:06.517512+0000","last_undegraded":"2024-02-15T23:32:06.517512+0000","last_fullsized":"2024-02-15T23:32:06.517512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:06.517319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:06.517319+0000","last_clean_scrub_stamp":"2024-02-15T23:32:06.517319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:50.782638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:43.514883+0000","last_change":"2024-02-15T23:31:43.514883+0000","last_active":"2024-02-15T23:31:43.514883+0000","last_peered":"2024-02-15T23:31:43.514883+0000","last_clean":"2024-02-15T23:31:43.514883+0000","last_became_active":"2024-02-15T23:29:31.703724+0000","last_became_peered":"2024-02-15T23:29:31.703724+0000","last_unstale":"2024-02-15T23:31:43.514883+0000","last_undegraded":"2024-02-15T23:31:43.514883+0000","last_fullsized":"2024-02-15T23:31:43.514883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:43.514514+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:43.514514+0000","last_clean_scrub_stamp":"2024-02-15T23:31:43.514514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:09:46.279795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:21.228565+0000","last_change":"2024-02-15T23:32:21.228641+0000","last_active":"2024-02-15T23:32:21.228565+0000","last_peered":"2024-02-15T23:32:21.228565+0000","last_clean":"2024-02-15T23:32:21.228565+0000","last_became_active":"2024-02-15T23:29:29.711324+0000","last_became_peered":"2024-02-15T23:29:29.711324+0000","last_unstale":"2024-02-15T23:32:21.228565+0000","last_undegraded":"2024-02-15T23:32:21.228565+0000","last_fullsized":"2024-02-15T23:32:21.228565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:32:21.228366+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:32:21.228366+0000","last_clean_scrub_stamp":"2024-02-15T23:32:21.228366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:08.186351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:46.498328+0000","last_change":"2024-02-15T23:31:46.498328+0000","last_active":"2024-02-15T23:31:46.498328+0000","last_peered":"2024-02-15T23:31:46.498328+0000","last_clean":"2024-02-15T23:31:46.498328+0000","last_became_active":"2024-02-15T23:29:31.688894+0000","last_became_peered":"2024-02-15T23:29:31.688894+0000","last_unstale":"2024-02-15T23:31:46.498328+0000","last_undegraded":"2024-02-15T23:31:46.498328+0000","last_fullsized":"2024-02-15T23:31:46.498328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-15T23:31:46.497968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-15T23:31:46.497968+0000","last_clean_scrub_stamp":"2024-02-15T23:31:46.497968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:21:56.619609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:10.165564+0000","last_change":"2024-02-15T23:32:10.165630+0000","last_active":"2024-02-15T23:32:10.165564+0000","last_peered":"2024-02-15T23:32:10.165564+0000","last_clean":"2024-02-15T23:32:10.165564+0000","last_became_active":"2024-02-15T23:29:29.717425+0000","last_became_peered":"2024-02-15T23:29:29.717425+0000","last_unstale":"2024-02-15T23:32:10.165564+0000","last_undegraded":"2024-02-15T23:32:10.165564+0000","last_fullsized":"2024-02-15T23:32:10.165564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:10.165366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:10.165366+0000","last_clean_scrub_stamp":"2024-02-15T23:32:10.165366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:14:02.611190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:05.165422+0000","last_change":"2024-02-15T23:32:05.165483+0000","last_active":"2024-02-15T23:32:05.165422+0000","last_peered":"2024-02-15T23:32:05.165422+0000","last_clean":"2024-02-15T23:32:05.165422+0000","last_became_active":"2024-02-15T23:29:31.699087+0000","last_became_peered":"2024-02-15T23:29:31.699087+0000","last_unstale":"2024-02-15T23:32:05.165422+0000","last_undegraded":"2024-02-15T23:32:05.165422+0000","last_fullsized":"2024-02-15T23:32:05.165422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:05.165244+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:05.165244+0000","last_clean_scrub_stamp":"2024-02-15T23:32:05.165244+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:35:12.231397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:51.663850+0000","last_change":"2024-02-15T23:31:51.663905+0000","last_active":"2024-02-15T23:31:51.663850+0000","last_peered":"2024-02-15T23:31:51.663850+0000","last_clean":"2024-02-15T23:31:51.663850+0000","last_became_active":"2024-02-15T23:29:29.730372+0000","last_became_peered":"2024-02-15T23:29:29.730372+0000","last_unstale":"2024-02-15T23:31:51.663850+0000","last_undegraded":"2024-02-15T23:31:51.663850+0000","last_fullsized":"2024-02-15T23:31:51.663850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:31:51.663652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:31:51.663652+0000","last_clean_scrub_stamp":"2024-02-15T23:31:51.663652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:46:32.452228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:58.523615+0000","last_change":"2024-02-15T23:31:58.523763+0000","last_active":"2024-02-15T23:31:58.523615+0000","last_peered":"2024-02-15T23:31:58.523615+0000","last_clean":"2024-02-15T23:31:58.523615+0000","last_became_active":"2024-02-15T23:29:31.694614+0000","last_became_peered":"2024-02-15T23:29:31.694614+0000","last_unstale":"2024-02-15T23:31:58.523615+0000","last_undegraded":"2024-02-15T23:31:58.523615+0000","last_fullsized":"2024-02-15T23:31:58.523615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:31:58.523409+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:31:58.523409+0000","last_clean_scrub_stamp":"2024-02-15T23:31:58.523409+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:34.779607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:25.294587+0000","last_change":"2024-02-15T23:32:25.294742+0000","last_active":"2024-02-15T23:32:25.294587+0000","last_peered":"2024-02-15T23:32:25.294587+0000","last_clean":"2024-02-15T23:32:25.294587+0000","last_became_active":"2024-02-15T23:29:29.710983+0000","last_became_peered":"2024-02-15T23:29:29.710983+0000","last_unstale":"2024-02-15T23:32:25.294587+0000","last_undegraded":"2024-02-15T23:32:25.294587+0000","last_fullsized":"2024-02-15T23:32:25.294587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-15T23:32:25.294275+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-15T23:32:25.294275+0000","last_clean_scrub_stamp":"2024-02-15T23:32:25.294275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:50:19.400906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:19.218583+0000","last_change":"2024-02-15T23:32:19.218733+0000","last_active":"2024-02-15T23:32:19.218583+0000","last_peered":"2024-02-15T23:32:19.218583+0000","last_clean":"2024-02-15T23:32:19.218583+0000","last_became_active":"2024-02-15T23:29:29.707182+0000","last_became_peered":"2024-02-15T23:29:29.707182+0000","last_unstale":"2024-02-15T23:32:19.218583+0000","last_undegraded":"2024-02-15T23:32:19.218583+0000","last_fullsized":"2024-02-15T23:32:19.218583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:19.218351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:19.218351+0000","last_clean_scrub_stamp":"2024-02-15T23:32:19.218351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:29:27.312666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:00.421684+0000","last_change":"2024-02-15T23:32:00.421747+0000","last_active":"2024-02-15T23:32:00.421684+0000","last_peered":"2024-02-15T23:32:00.421684+0000","last_clean":"2024-02-15T23:32:00.421684+0000","last_became_active":"2024-02-15T23:29:31.695552+0000","last_became_peered":"2024-02-15T23:29:31.695552+0000","last_unstale":"2024-02-15T23:32:00.421684+0000","last_undegraded":"2024-02-15T23:32:00.421684+0000","last_fullsized":"2024-02-15T23:32:00.421684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-15T23:32:00.421498+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-15T23:32:00.421498+0000","last_clean_scrub_stamp":"2024-02-15T23:32:00.421498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:15.838107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:32:09.405622+0000","last_change":"2024-02-15T23:32:09.405767+0000","last_active":"2024-02-15T23:32:09.405622+0000","last_peered":"2024-02-15T23:32:09.405622+0000","last_clean":"2024-02-15T23:32:09.405622+0000","last_became_active":"2024-02-15T23:29:29.715110+0000","last_became_peered":"2024-02-15T23:29:29.715110+0000","last_unstale":"2024-02-15T23:32:09.405622+0000","last_undegraded":"2024-02-15T23:32:09.405622+0000","last_fullsized":"2024-02-15T23:32:09.405622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T23:32:09.405404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T23:32:09.405404+0000","last_clean_scrub_stamp":"2024-02-15T23:32:09.405404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:42.824154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-15T23:31:40.574309+0000","last_change":"2024-02-15T23:31:40.574309+0000","last_active":"2024-02-15T23:31:40.574309+0000","last_peered":"2024-02-15T23:31:40.574309+0000","last_clean":"2024-02-15T23:31:40.574309+0000","last_became_active":"2024-02-15T23:29:31.709039+0000","last_became_peered":"2024-02-15T23:29:31.709039+0000","last_unstale":"2024-02-15T23:31:40.574309+0000","last_undegraded":"2024-02-15T23:31:40.574309+0000","last_fullsized":"2024-02-15T23:31:40.574309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-15T23:31:40.574041+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-15T23:31:40.574041+0000","last_clean_scrub_stamp":"2024-02-15T23:31:40.574041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:24.310993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705713,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39940,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331900,"statfs":{"total":96636764160,"available":96595865600,"internally_reserved":0,"allocated":454656,"data_stored":152016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.53700000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77300000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.48399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.83099999999999996,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Feb 15 23:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.76900000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.223,"15min":0.223},"max":{"1min":0.78600000000000003,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Feb 15 23:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.48099999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.90200000000000002,"5min":1.103,"15min":1.103},"last":0.623},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.47299999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.83599999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.81299999999999994}]}]},{"osd":2,"up_from":9,"seq":38654705711,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.55700000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81599999999999995,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.53400000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81699999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56100000000000005,"15min":0.54000000000000004},"min":{"1min":0.48599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.73499999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.46899999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.68700000000000006,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Feb 15 23:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.48599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.80900000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":2.452,"15min":2.452},"last":0.54600000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 23:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.499,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81000000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.625},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.54300000000000004,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77700000000000002,"5min":1.036,"15min":1.036},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Feb 15 23:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.48299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.73799999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.47399999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.89900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Feb 15 23:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.48799999999999999,"5min":0.247,"15min":0.247},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.57299999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":150886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 23:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.56399999999999995,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.89700000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.59899999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.91700000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.97599999999999998}]},{"osd":2,"last update":"Thu Feb 15 23:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.54300000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":1.24,"15min":1.24},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.872,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Feb 15 23:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.57599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.63300000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T23:32:58.707 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-15T23:32:58.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48e6f4f640 1 Processor -- start 2024-02-15T23:32:58.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48e6f4f640 1 -- start start 2024-02-15T23:32:58.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48e6f4f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f48e0135410 0x7f48e0137800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:58.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48e6f4f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e009c180 con 0x7f48e012ee60 2024-02-15T23:32:58.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48e6f4f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e0094fb0 con 0x7f48e0135410 2024-02-15T23:32:58.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48dffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f48e0135410 0x7f48e0137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:58.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48e4ceb640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f48e012ee60 0x7f48e012f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:59962/0 (socket says 172.21.15.131:59962) 2024-02-15T23:32:58.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48e4ceb640 1 -- 172.21.15.131:0/1845149143 learned_addr learned my addr 172.21.15.131:0/1845149143 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-02-15T23:32:58.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48dffff640 1 -- 172.21.15.131:0/1845149143 >> v1:172.21.15.131:6789/0 conn(0x7f48e012ee60 legacy=0x7f48e012f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:58.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48dffff640 1 -- 172.21.15.131:0/1845149143 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0095ec0 con 0x7f48e0135410 2024-02-15T23:32:58.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.862+0000 7f48df7fe640 1 -- 172.21.15.131:0/1845149143 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128818938 0 0) 0x7f48e009c180 con 0x7f48e012ee60 2024-02-15T23:32:58.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48dffff640 1 --2- 172.21.15.131:0/1845149143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e0135410 0x7f48e0137800 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009740 tx=0x7f48d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e5e15938c455d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:58.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48df7fe640 1 -- 172.21.15.131:0/1845149143 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48d40ab530 con 0x7f48e0135410 2024-02-15T23:32:58.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48df7fe640 1 -- 172.21.15.131:0/1845149143 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40a7050 con 0x7f48e0135410 2024-02-15T23:32:58.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48df7fe640 1 -- 172.21.15.131:0/1845149143 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48d40ab7e0 con 0x7f48e0135410 2024-02-15T23:32:58.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- 172.21.15.131:0/1845149143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e0135410 msgr2=0x7f48e0137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:58.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 --2- 172.21.15.131:0/1845149143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e0135410 0x7f48e0137800 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009740 tx=0x7f48d401c370 comp rx=0 tx=0).stop 2024-02-15T23:32:58.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- 172.21.15.131:0/1845149143 shutdown_connections 2024-02-15T23:32:58.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 --2- 172.21.15.131:0/1845149143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e0135410 0x7f48e0137800 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:58.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- 172.21.15.131:0/1845149143 >> 172.21.15.131:0/1845149143 conn(0x7f48e009a050 msgr2=0x7f48e009a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:32:58.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- 172.21.15.131:0/1845149143 shutdown_connections 2024-02-15T23:32:58.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- 172.21.15.131:0/1845149143 wait complete. 2024-02-15T23:32:58.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 Processor -- start 2024-02-15T23:32:58.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- start start 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e012ee60 0x7f48e01c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0137a80 con 0x7f48e012ee60 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e4ceb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e012ee60 0x7f48e01c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e4ceb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e012ee60 0x7f48e01c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53648/0 (socket says 172.21.15.131:53648) 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e4ceb640 1 -- 172.21.15.131:0/3065722908 learned_addr learned my addr 172.21.15.131:0/3065722908 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e4ceb640 1 -- 172.21.15.131:0/3065722908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4009420 con 0x7f48e012ee60 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e4ceb640 1 --2- 172.21.15.131:0/3065722908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e012ee60 0x7f48e01c99f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f48d000c420 tx=0x7f48d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48dd7fa640 1 -- 172.21.15.131:0/3065722908 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48d00074d0 con 0x7f48e012ee60 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48dd7fa640 1 -- 172.21.15.131:0/3065722908 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0007630 con 0x7f48e012ee60 2024-02-15T23:32:58.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e006d6c0 con 0x7f48e012ee60 2024-02-15T23:32:58.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48dd7fa640 1 -- 172.21.15.131:0/3065722908 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48d0004960 con 0x7f48e012ee60 2024-02-15T23:32:58.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e006c5e0 con 0x7f48e012ee60 2024-02-15T23:32:58.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e006cb70 con 0x7f48e012ee60 2024-02-15T23:32:58.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.866+0000 7f48dd7fa640 1 -- 172.21.15.131:0/3065722908 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f48d0004ae0 con 0x7f48e012ee60 2024-02-15T23:32:58.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.870+0000 7f48dd7fa640 1 --2- 172.21.15.131:0/3065722908 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48cc035a10 0x7f48cc037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:32:58.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.870+0000 7f48dd7fa640 1 -- 172.21.15.131:0/3065722908 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f48d0047d90 con 0x7f48e012ee60 2024-02-15T23:32:58.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.870+0000 7f48dffff640 1 --2- 172.21.15.131:0/3065722908 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48cc035a10 0x7f48cc037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:32:58.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.870+0000 7f48dffff640 1 --2- 172.21.15.131:0/3065722908 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48cc035a10 0x7f48cc037ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f48d40ad000 tx=0x7f48d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:32:58.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:58.874+0000 7f48dd7fa640 1 -- 172.21.15.131:0/3065722908 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f48d001abe0 con 0x7f48e012ee60 2024-02-15T23:32:59.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.034+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f48e0062860 con 0x7f48e012ee60 2024-02-15T23:32:59.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.034+0000 7f48dd7fa640 1 -- 172.21.15.131:0/3065722908 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f48d0018030 con 0x7f48e012ee60 2024-02-15T23:32:59.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.034+0000 7f48dd7fa640 1 -- 172.21.15.131:0/3065722908 <== mon.0 v2:172.21.15.131:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f48d001abe0 con 0x7f48e012ee60 2024-02-15T23:32:59.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48cc035a10 msgr2=0x7f48cc037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:59.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 --2- 172.21.15.131:0/3065722908 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48cc035a10 0x7f48cc037ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f48d40ad000 tx=0x7f48d4008040 comp rx=0 tx=0).stop 2024-02-15T23:32:59.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e012ee60 msgr2=0x7f48e01c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:32:59.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 --2- 172.21.15.131:0/3065722908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e012ee60 0x7f48e01c99f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f48d000c420 tx=0x7f48d000c8e0 comp rx=0 tx=0).stop 2024-02-15T23:32:59.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 shutdown_connections 2024-02-15T23:32:59.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 --2- 172.21.15.131:0/3065722908 >> [v2:172.21.15.133:6824/3499050160,v1:172.21.15.133:6825/3499050160] conn(0x7f48cc035a10 0x7f48cc037ed0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:59.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 --2- 172.21.15.131:0/3065722908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48e012ee60 0x7f48e01c99f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:32:59.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 >> 172.21.15.131:0/3065722908 conn(0x7f48e009a050 msgr2=0x7f48e0096880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:32:59.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 shutdown_connections 2024-02-15T23:32:59.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T23:32:59.038+0000 7f48e6f4f640 1 -- 172.21.15.131:0/3065722908 wait complete. 2024-02-15T23:32:59.058 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-15T23:32:59.058 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-15T23:32:59.058 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-15T23:32:59.059 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T23:32:59.126 INFO:tasks.ceph.osd.0:Stopped 2024-02-15T23:32:59.127 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-15T23:32:59.127 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T23:32:59.204 INFO:tasks.ceph.osd.1:Stopped 2024-02-15T23:32:59.204 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-15T23:32:59.204 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T23:32:59.295 INFO:tasks.ceph.osd.2:Stopped 2024-02-15T23:32:59.295 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-15T23:32:59.295 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T23:33:02.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-02-15T23:33:05.397 INFO:tasks.ceph.osd.3:Stopped 2024-02-15T23:33:05.398 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-15T23:33:05.398 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-15T23:33:05.398 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T23:33:05.428 INFO:tasks.ceph.mgr.x:Stopped 2024-02-15T23:33:05.428 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-15T23:33:05.428 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-15T23:33:05.428 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T23:33:05.453 INFO:tasks.ceph.mon.a:Stopped 2024-02-15T23:33:05.453 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-15T23:33:05.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-02-15T23:33:05.513 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T23:33:05.514 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-15T23:33:05.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:33:05.783 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-15T23:33:05.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:33:05.926 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-15T23:33:06.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:33:06.116 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-15T23:33:06.278 INFO:tasks.ceph:Archiving mon data... 2024-02-15T23:33:06.279 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725/data/mon.a.tgz 2024-02-15T23:33:06.280 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-02-15T23:33:06.286 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.vdfMWwyI57 2024-02-15T23:33:06.286 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vdfMWwyI57 2024-02-15T23:33:06.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.vdfMWwyI57 2024-02-15T23:33:06.461 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.vdfMWwyI57 is 249KB 2024-02-15T23:33:06.527 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.vdfMWwyI57 2024-02-15T23:33:06.534 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-15T23:33:06.534 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-15T23:33:06.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-15T23:33:06.638 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-15T23:33:06.643 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-15T23:33:06.644 INFO:tasks.ceph:Archiving crash dumps... 2024-02-15T23:33:06.645 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725/remote/smithi131/crash 2024-02-15T23:33:06.646 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-15T23:33:06.694 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725/remote/smithi133/crash 2024-02-15T23:33:06.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-15T23:33:06.709 INFO:tasks.ceph:Compressing logs... 2024-02-15T23:33:06.709 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T23:33:06.738 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T23:33:06.760 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23348.log 2024-02-15T23:33:06.763 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23686.log 2024-02-15T23:33:06.763 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23239.log 2024-02-15T23:33:06.763 INFO:teuthology.orchestra.run.smithi131.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.23348.log.gz 2024-02-15T23:33:06.763 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23660.log 2024-02-15T23:33:06.763 INFO:teuthology.orchestra.run.smithi131.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23686.log.gz 2024-02-15T23:33:06.764 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23239.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-15T23:33:06.764 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23154.log 2024-02-15T23:33:06.764 INFO:teuthology.orchestra.run.smithi131.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23239.log.gz 2024-02-15T23:33:06.764 INFO:teuthology.orchestra.run.smithi131.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23660.log.gz 2024-02-15T23:33:06.764 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23243.log 2024-02-15T23:33:06.769 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23816.log 2024-02-15T23:33:06.770 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23243.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23154.log.gz 2024-02-15T23:33:06.770 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23946.log 2024-02-15T23:33:06.770 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23243.log.gz 2024-02-15T23:33:06.770 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23920.log 2024-02-15T23:33:06.770 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23816.log.gz 2024-02-15T23:33:06.770 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23999.log 2024-02-15T23:33:06.770 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23920.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23946.log.gz 2024-02-15T23:33:06.770 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23596.log 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23920.log.gz 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23037.log 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23999.log.gz 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23128.log 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23037.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23596.log.gz 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23128.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23037.log.gz 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23447.log 2024-02-15T23:33:06.771 INFO:teuthology.orchestra.run.smithi131.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23128.log.gz 2024-02-15T23:33:06.772 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23712.log 2024-02-15T23:33:06.772 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23544.log 2024-02-15T23:33:06.772 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23447.log: /var/log/ceph/ceph-client.admin.23712.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23447.log.gz 2024-02-15T23:33:06.772 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20182.log 2024-02-15T23:33:06.772 INFO:teuthology.orchestra.run.smithi131.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23712.log.gz 2024-02-15T23:33:06.772 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24025.log 2024-02-15T23:33:06.772 INFO:teuthology.orchestra.run.smithi131.stderr:gzip 85.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.23544.log.gz -- 2024-02-15T23:33:06.773 INFO:teuthology.orchestra.run.smithi131.stderr: /var/log/ceph/ceph-client.admin.23634.log 2024-02-15T23:33:06.773 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.tmp-client.admin.20182.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20182.log.gz 2024-02-15T23:33:06.773 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.24025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23102.log 2024-02-15T23:33:06.773 INFO:teuthology.orchestra.run.smithi131.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24025.log.gz 2024-02-15T23:33:06.782 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21436.log 2024-02-15T23:33:06.782 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23206.log 2024-02-15T23:33:06.783 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23102.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23634.log.gz 2024-02-15T23:33:06.783 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.21436.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-15T23:33:06.783 INFO:teuthology.orchestra.run.smithi131.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23102.log.gz 2024-02-15T23:33:06.783 INFO:teuthology.orchestra.run.smithi131.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.21436.log.gz 2024-02-15T23:33:06.783 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21507.log 2024-02-15T23:33:06.783 INFO:teuthology.orchestra.run.smithi131.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23206.log.gz 2024-02-15T23:33:06.783 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23842.log 2024-02-15T23:33:06.784 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.21507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23973.log 2024-02-15T23:33:06.784 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.21507.log.gz 2024-02-15T23:33:06.784 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23344.log 2024-02-15T23:33:06.784 INFO:teuthology.orchestra.run.smithi131.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23842.log.gz 2024-02-15T23:33:06.784 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23973.log: gzip 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23973.log.gz -5 2024-02-15T23:33:06.784 INFO:teuthology.orchestra.run.smithi131.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23440.log 2024-02-15T23:33:06.784 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23344.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-15T23:33:06.784 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23440.log: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23344.log.gz 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23894.log 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23440.log.gz 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23738.log 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.23894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23336.log 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23894.log.gz 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23077.log 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-15T23:33:06.785 INFO:teuthology.orchestra.run.smithi131.stderr: 87.1%/var/log/ceph/ceph-client.admin.23336.log: -- replaced with /var/log/ceph/ceph-client.admin.23738.log.gz 2024-02-15T23:33:06.786 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23790.log 2024-02-15T23:33:06.786 INFO:teuthology.orchestra.run.smithi131.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23336.log.gz 2024-02-15T23:33:06.786 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23240.log 2024-02-15T23:33:06.786 INFO:teuthology.orchestra.run.smithi131.stderr:gzip 87.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.23077.log.gz -- 2024-02-15T23:33:06.786 INFO:teuthology.orchestra.run.smithi131.stderr: /var/log/ceph/ceph-client.admin.23570.log 2024-02-15T23:33:06.786 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23790.log: /var/log/ceph/ceph-client.admin.23240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23244.log 2024-02-15T23:33:06.786 INFO:teuthology.orchestra.run.smithi131.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23790.log.gz 2024-02-15T23:33:06.786 INFO:teuthology.orchestra.run.smithi131.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.23240.log.gz 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23180.log 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23570.log.gz 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23868.log 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23244.log: /var/log/ceph/ceph-client.admin.23180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24051.log 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23244.log.gz 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23180.log.gz 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23448.log 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23868.log.gz 2024-02-15T23:33:06.787 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.24051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21549.log 2024-02-15T23:33:06.788 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23448.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24051.log.gz 2024-02-15T23:33:06.788 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23452.log 2024-02-15T23:33:06.788 INFO:teuthology.orchestra.run.smithi131.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23448.log.gz 2024-02-15T23:33:06.788 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.21549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24101.log 2024-02-15T23:33:06.788 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23452.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.21549.log.gz 2024-02-15T23:33:06.788 INFO:teuthology.orchestra.run.smithi131.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.23452.log.gz 2024-02-15T23:33:06.788 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24077.log 2024-02-15T23:33:06.788 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23764.log 2024-02-15T23:33:06.789 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.24101.log: /var/log/ceph/ceph-client.admin.24077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23347.log 2024-02-15T23:33:06.789 INFO:teuthology.orchestra.run.smithi131.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24101.log.gz 2024-02-15T23:33:06.789 INFO:teuthology.orchestra.run.smithi131.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24077.log.gz 2024-02-15T23:33:06.789 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.23764.log: /var/log/ceph/ceph-client.admin.23347.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23764.log.gz 2024-02-15T23:33:06.791 INFO:teuthology.orchestra.run.smithi131.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23347.log.gz 2024-02-15T23:33:06.799 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28349.log 2024-02-15T23:33:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41423.log 2024-02-15T23:33:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.28349.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-02-15T23:33:06.800 INFO:teuthology.orchestra.run.smithi133.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28349.log.gz 2024-02-15T23:33:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.41423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51453.log 2024-02-15T23:33:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72693.log 2024-02-15T23:33:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.51453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34933.log 2024-02-15T23:33:06.800 INFO:teuthology.orchestra.run.smithi133.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.41423.log.gz 2024-02-15T23:33:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.72693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33753.log 2024-02-15T23:33:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.34933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71513.log 2024-02-15T23:33:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.33753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46143.log 2024-02-15T23:33:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.71513.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.34933.log.gz 2024-02-15T23:33:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44373.log 2024-02-15T23:33:06.801 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51453.log.gz 2024-02-15T23:33:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72103.log 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.46143.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.72693.log.gz 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.44373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65613.log 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.72103.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71513.log.gz 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64433.log 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.33753.log.gz 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:gzip/var/log/ceph/ceph-client.0.65613.log: -5 91.3% -- replaced with /var/log/ceph/ceph-client.0.44373.log.gz 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.0.75053.log 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.64433.log: 91.5%gzip -- replaced with /var/log/ceph/ceph-client.0.46143.log.gz -5 2024-02-15T23:33:06.802 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.0.77401.log 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.75053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33163.log 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5%/var/log/ceph/ceph-client.0.77401.log: -- replaced with /var/log/ceph/ceph-client.0.72103.log.gz 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54403.log 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64433.log.gz 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.33163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23746.log 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.65613.log.gz 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.77401.log.gz 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.54403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28325.log 2024-02-15T23:33:06.803 INFO:teuthology.orchestra.run.smithi133.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.75053.log.gz 2024-02-15T23:33:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.23746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44963.log 2024-02-15T23:33:06.804 INFO:teuthology.orchestra.run.smithi133.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.23746.log.gz 2024-02-15T23:33:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.28325.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.33163.log.gz 2024-02-15T23:33:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78569.log 2024-02-15T23:33:06.804 INFO:teuthology.orchestra.run.smithi133.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28325.log.gz 2024-02-15T23:33:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.44963.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54403.log.gz 2024-02-15T23:33:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76817.log 2024-02-15T23:33:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.78569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23794.log 2024-02-15T23:33:06.805 INFO:teuthology.orchestra.run.smithi133.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.78569.log.gz 2024-02-15T23:33:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.76817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59123.log 2024-02-15T23:33:06.805 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.44963.log.gz 2024-02-15T23:33:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53223.log 2024-02-15T23:33:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.23794.log: /var/log/ceph/ceph-client.0.59123.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-15T23:33:06.805 INFO:teuthology.orchestra.run.smithi133.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.23794.log.gz 2024-02-15T23:33:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.53223.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.76817.log.gz 2024-02-15T23:33:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49683.log 2024-02-15T23:33:06.806 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31989.log 2024-02-15T23:33:06.806 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.2.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59123.log.gz 2024-02-15T23:33:06.806 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.49683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40243.log 2024-02-15T23:33:06.819 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60303.log 2024-02-15T23:33:06.819 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.31989.log: /var/log/ceph/ceph-client.0.40243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45553.log 2024-02-15T23:33:06.819 INFO:teuthology.orchestra.run.smithi133.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.31989.log.gz/var/log/ceph/ceph-client.0.60303.log: 2024-02-15T23:33:06.820 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74463.log 2024-02-15T23:33:06.820 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53223.log.gz 2024-02-15T23:33:06.820 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49683.log.gz 2024-02-15T23:33:06.820 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.45553.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.40243.log.gz 2024-02-15T23:33:06.820 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.45553.log.gz 2024-02-15T23:33:06.820 INFO:teuthology.orchestra.run.smithi133.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.60303.log.gz 2024-02-15T23:33:06.820 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47323.log 2024-02-15T23:33:06.820 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.74463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43193.log 2024-02-15T23:33:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.47323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47913.log 2024-02-15T23:33:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53813.log 2024-02-15T23:33:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.43193.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.74463.log.gz 2024-02-15T23:33:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.47913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50273.log 2024-02-15T23:33:06.821 INFO:teuthology.orchestra.run.smithi133.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47323.log.gz 2024-02-15T23:33:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.53813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52633.log 2024-02-15T23:33:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37293.log 2024-02-15T23:33:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.50273.log: /var/log/ceph/ceph-client.0.52633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79737.log 2024-02-15T23:33:06.822 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% 91.6% -- replaced with /var/log/ceph/ceph-client.0.47913.log.gz 2024-02-15T23:33:06.822 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.0.43193.log.gz 2024-02-15T23:33:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.37293.log: 91.5% 91.4% -- replaced with /var/log/ceph/ceph-client.0.50273.log.gz 2024-02-15T23:33:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37883.log 2024-02-15T23:33:06.822 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.0.53813.log.gz 2024-02-15T23:33:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.79737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28373.log 2024-02-15T23:33:06.822 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52633.log.gz 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.37883.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.37293.log.gz 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61483.log 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54993.log 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.28373.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.79737.log.gz 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.61483.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28373.log.gz 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58533.log 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.54993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28277.log 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37883.log.gz 2024-02-15T23:33:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.58533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50863.log 2024-02-15T23:33:06.824 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.28277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79153.log 2024-02-15T23:33:06.824 INFO:teuthology.orchestra.run.smithi133.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28277.log.gz 2024-02-15T23:33:06.824 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.50863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32573.log 2024-02-15T23:33:06.824 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54993.log.gz 2024-02-15T23:33:06.824 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-15T23:33:06.824 INFO:teuthology.orchestra.run.smithi133.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.61483.log.gz 2024-02-15T23:33:06.824 INFO:teuthology.orchestra.run.smithi133.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.58533.log.gz 2024-02-15T23:33:06.824 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.79153.log: /var/log/ceph/ceph-client.0.32573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29039.log 2024-02-15T23:33:06.825 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.50863.log.gz 2024-02-15T23:33:06.825 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.3.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.79153.log.gz 2024-02-15T23:33:06.825 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39063.log 2024-02-15T23:33:06.825 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.29039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68563.log 2024-02-15T23:33:06.825 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.39063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46733.log 2024-02-15T23:33:06.825 INFO:teuthology.orchestra.run.smithi133.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.32573.log.gz/var/log/ceph/ceph-client.0.68563.log: 2024-02-15T23:33:06.825 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48503.log 2024-02-15T23:33:06.825 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23770.log 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.46733.log: 92.2% -- replaced with /var/log/ceph/ceph-client.0.29039.log.gz 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39063.log.gz 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.48503.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68563.log.gz 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.46733.log.gz 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.23770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70923.log 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.48503.log.gz 2024-02-15T23:33:06.826 INFO:teuthology.orchestra.run.smithi133.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.23770.log.gz 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73873.log 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.70923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35523.log 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.73873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40833.log 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.35523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69153.log 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.40833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70333.log 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.70923.log.gz 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.73873.log.gz/var/log/ceph/ceph-client.0.69153.log: 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52043.log 2024-02-15T23:33:06.827 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35523.log.gz 2024-02-15T23:33:06.828 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.70333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67383.log 91.7% 2024-02-15T23:33:06.828 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.0.40833.log.gz 2024-02-15T23:33:06.828 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.52043.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-15T23:33:06.828 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69153.log.gz/var/log/ceph/ceph-client.0.67383.log: 2024-02-15T23:33:06.828 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62073.log 2024-02-15T23:33:06.838 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.70333.log.gz 2024-02-15T23:33:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69743.log 2024-02-15T23:33:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.62073.log: gzip -5 --verbose 91.6% -- /var/log/ceph/ceph-client.0.80326.log -- replaced with /var/log/ceph/ceph-client.0.52043.log.gz 2024-02-15T23:33:06.839 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-02-15T23:33:06.839 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.67383.log.gz 2024-02-15T23:33:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56173.log 2024-02-15T23:33:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.69743.log: /var/log/ceph/ceph-client.0.80326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55583.log 2024-02-15T23:33:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.56173.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.62073.log.gz 2024-02-15T23:33:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39653.log 2024-02-15T23:33:06.839 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69743.log.gz/var/log/ceph/ceph-client.0.55583.log: 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56173.log.gz 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42013.log 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.39653.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.55583.log.gz 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.0.80326.log.gz 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66203.log 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.42013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43783.log 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39653.log.gz 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.66203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75643.log 2024-02-15T23:33:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.43783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38473.log 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.75643.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.42013.log.gz 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.66203.log.gz 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.38473.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43783.log.gz 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.75643.log.gz 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63253.log 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38473.log.gz 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67973.log 2024-02-15T23:33:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.63253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57943.log 2024-02-15T23:33:06.842 INFO:teuthology.orchestra.run.smithi133.stderr: 90.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-02-15T23:33:06.842 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.67973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56763.log 2024-02-15T23:33:06.842 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.57943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30219.log 2024-02-15T23:33:06.842 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.56763.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63253.log.gz 2024-02-15T23:33:06.842 INFO:teuthology.orchestra.run.smithi133.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.67973.log.gz 2024-02-15T23:33:06.842 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30809.log 2024-02-15T23:33:06.842 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.30219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65023.log 2024-02-15T23:33:06.842 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.57943.log.gz 2024-02-15T23:33:06.843 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.30809.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56763.log.gz 2024-02-15T23:33:06.843 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73283.log 2024-02-15T23:33:06.843 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.65023.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30219.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.29629.log 2024-02-15T23:33:06.843 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-02-15T23:33:06.843 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.73283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62663.log 2024-02-15T23:33:06.843 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30809.log.gz 2024-02-15T23:33:06.843 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.29629.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65023.log.gz 2024-02-15T23:33:06.843 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23722.log 2024-02-15T23:33:06.844 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.62663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42603.log 2024-02-15T23:33:06.844 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.23722.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.29629.log.gz 2024-02-15T23:33:06.844 INFO:teuthology.orchestra.run.smithi133.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.23722.log.gz 2024-02-15T23:33:06.844 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76233.log 2024-02-15T23:33:06.844 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.73283.log.gz 2024-02-15T23:33:06.844 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62663.log.gz 2024-02-15T23:33:06.844 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.42603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63843.log 2024-02-15T23:33:06.844 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.76233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66793.log 2024-02-15T23:33:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.63843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60893.log 2024-02-15T23:33:06.845 INFO:teuthology.orchestra.run.smithi133.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.76233.log.gz 2024-02-15T23:33:06.845 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.42603.log.gz 2024-02-15T23:33:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.66793.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.66793.log.gz 2024-02-15T23:33:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36113.log 2024-02-15T23:33:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.60893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36703.log 2024-02-15T23:33:06.849 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8%/var/log/ceph/ceph-client.0.36113.log: -- replaced with /var/log/ceph/ceph-client.0.63843.log.gz 2024-02-15T23:33:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77985.log 2024-02-15T23:33:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.36703.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.36113.log.gz 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28301.log 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3%/var/log/ceph/ceph-client.0.77985.log: -- replaced with /var/log/ceph/ceph-client.0.36703.log.gz 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34343.log 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.28301.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.77985.log.gz 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.0.60893.log.gz 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28301.log.gz 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57353.log 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.34343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31399.log 2024-02-15T23:33:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.57353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49093.log 2024-02-15T23:33:06.851 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.31399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59713.log 2024-02-15T23:33:06.851 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.49093.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34343.log.gz 2024-02-15T23:33:06.851 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.59713.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57353.log.gz 2024-02-15T23:33:06.851 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.31399.log.gz 2024-02-15T23:33:06.851 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.49093.log.gz 2024-02-15T23:33:06.851 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59713.log.gz 2024-02-15T23:33:06.873 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi131.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-15T23:33:07.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-02-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi133.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-15T23:33:07.586 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-15T23:33:07.588 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-02-15T23:33:07.588 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m0.847s 2024-02-15T23:33:07.588 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m1.016s 2024-02-15T23:33:07.588 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m0.049s 2024-02-15T23:33:07.638 INFO:teuthology.orchestra.run.smithi133.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-15T23:33:07.691 INFO:teuthology.orchestra.run.smithi133.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-15T23:33:07.692 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-02-15T23:33:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m0.937s 2024-02-15T23:33:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m2.608s 2024-02-15T23:33:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m0.148s 2024-02-15T23:33:07.694 INFO:tasks.ceph:Archiving logs... 2024-02-15T23:33:07.694 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725/remote/smithi131/log 2024-02-15T23:33:07.695 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T23:33:07.866 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725/remote/smithi133/log 2024-02-15T23:33:07.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T23:33:08.266 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-15T23:33:08.281 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-15T23:33:08.281 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T23:33:08.284 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T23:33:08.345 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-15T23:33:08.356 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-15T23:33:08.356 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T23:33:08.359 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T23:33:08.367 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-02-15T23:33:08.367 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-02-15T23:33:08.368 INFO:teuthology.orchestra.run.smithi131.stdout:*hv01.front.sepi 44.4.53.2 2 u 47 64 77 0.084 -0.180 1.189 2024-02-15T23:33:08.368 INFO:teuthology.orchestra.run.smithi131.stdout:+hv02.front.sepi 63.231.80.2 3 u 44 64 77 0.075 +0.198 1.501 2024-02-15T23:33:08.368 INFO:teuthology.orchestra.run.smithi131.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 64 77 0.069 -2.746 1.852 2024-02-15T23:33:08.368 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:33:08.370 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2024-02-15T23:33:08.370 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2024-02-15T23:33:08.370 INFO:teuthology.orchestra.run.smithi133.stdout:*hv01.front.sepi 44.4.53.2 2 u 49 64 77 0.091 -0.046 1.740 2024-02-15T23:33:08.370 INFO:teuthology.orchestra.run.smithi133.stdout:+hv02.front.sepi 63.231.80.2 3 u 44 64 77 0.146 +1.776 1.816 2024-02-15T23:33:08.370 INFO:teuthology.orchestra.run.smithi133.stdout:+hv03.front.sepi 74.6.168.72 3 u 49 64 77 0.083 -3.648 1.875 2024-02-15T23:33:08.370 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-15T23:33:08.371 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-15T23:33:08.382 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-15T23:33:08.383 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-15T23:33:08.396 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-15T23:33:08.411 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-15T23:33:08.425 INFO:teuthology.task.internal:Duration was 794.283181 seconds 2024-02-15T23:33:08.425 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-15T23:33:08.440 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-15T23:33:08.441 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T23:33:08.445 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T23:33:08.482 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-15T23:33:08.482 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T23:33:08.483 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T23:33:08.531 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T23:33:08.531 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T23:33:08.541 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-15T23:33:08.541 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T23:33:08.574 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T23:33:08.613 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-15T23:33:08.613 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T23:33:08.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T23:33:08.716 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-15T23:33:08.727 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-15T23:33:08.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T23:33:08.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T23:33:08.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-15T23:33:08.766 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T23:33:08.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T23:33:08.796 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-02-15T23:33:08.806 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-02-15T23:33:08.831 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T23:33:08.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:33:08.877 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T23:33:08.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:33:08.882 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-15T23:33:08.894 INFO:teuthology.task.internal:Transferring archived files... 2024-02-15T23:33:08.895 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725/remote/smithi131 2024-02-15T23:33:08.895 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T23:33:08.941 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725/remote/smithi133 2024-02-15T23:33:08.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T23:33:08.961 INFO:teuthology.task.internal:Removing archive directory... 2024-02-15T23:33:08.961 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T23:33:08.978 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T23:33:09.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-15T23:33:09.022 INFO:teuthology.task.internal:Not uploading archives. 2024-02-15T23:33:09.022 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-15T23:33:09.037 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-15T23:33:09.037 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T23:33:09.040 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T23:33:09.044 INFO:teuthology.orchestra.run.smithi131.stdout: 658644 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 23:33 /home/ubuntu/cephtest 2024-02-15T23:33:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 23:33 /home/ubuntu/cephtest 2024-02-15T23:33:09.058 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-15T23:33:09.069 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-15T23:33:09.102 INFO:teuthology.nuke:Checking targets against current locks 2024-02-15T23:33:09.129 DEBUG:teuthology.nuke:shortname: smithi131 2024-02-15T23:33:09.129 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T23:33:09.153 DEBUG:teuthology.nuke:shortname: smithi133 2024-02-15T23:33:09.154 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T23:33:09.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 23:11:15.381552', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0OS+JU08rJh+dWZW9jO+UeEZ3UuIuC7YzxMkgGN8sHlAUKbwDCvatR6Ngn/BRKfgmyTA5jyT8rsi89Cm9DdDs='} 2024-02-15T23:33:09.179 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561725', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 23:11:15.379485', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmIJEoP1VBMP1oBqsydMSpwbHi4m+lWuDRVyqDjzPv0NI1IuDmzKprt1Y/mp9q14V+8jwDY8ylCPUCVJFUxOmo='} 2024-02-15T23:33:09.207 INFO:teuthology.orchestra.console.smithi131:Power off 2024-02-15T23:33:09.208 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T23:33:09.236 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2024-02-15T23:33:09.236 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:33:09.253 INFO:teuthology.orchestra.console.smithi133:Power off 2024-02-15T23:33:09.254 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T23:33:09.264 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-02-15T23:33:09.279 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-02-15T23:33:09.279 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:33:09.302 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-15T23:33:13.266 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:33:13.303 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:33:13.378 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-02-15T23:33:13.415 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-15T23:33:17.379 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:33:17.416 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:33:17.491 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-02-15T23:33:17.529 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-15T23:33:17.630 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-02-15T23:33:21.496 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:33:21.608 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-02-15T23:33:21.709 INFO:teuthology.orchestra.console.smithi131:Power off completed 2024-02-15T23:33:21.814 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 794.2831807136536 failure_reason: 'S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000001c85fa56cdd5410e-0065ce9eb9-4227-default4227-default-default' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9baf7a73df894a76a25258bbc451c2eb status: fail success: false 2024-02-15T23:33:21.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T23:33:21.889 INFO:teuthology.run:FAIL